First things first. You're sure he's not married, right?
I kinda like the idea of You, me, Coffee?
Maybe put in a $5 Starbucks card. You know, just a little sweet gesture.
Starbucks is the kind of place you can get a coffee with someone and sit 10 minutes, or an hour or 2, and no one bugs you.
Hey, you know, it's just coffee.
(which btw, doesn't mean you have to drink coffee. You can have tea, water, a muffin, whatever)