"My decision to ask, you specifically, for a letter of recommendation...."
If what you are trying to say is,
"My decision to ask for a letter of recommendation from you specifically ...
then yes, it's fine. If that's not your meaning then what Shyanne Rae said May well be the ticket. More context would be helpful.