If you wanna meet up with him, go for it. Even if it goes nowhere but a nice time, what is there to lose? A good meal in it at least, as you said.
So there are all these great stories of people having long marriages from one-nighters. That hasn't been my experience at all. The few times I've done something like this - we spend some time together for a while and then parted ways.
And that's not bad in itself! Not everything has to 'go somewhere' either, so long as you are ok with that.
He might be an interesting guy out of the bedroom. Ya never know.