This putting you into a gender game, I apologise for on behalf of those that just did that. That's like saying you understand my nationality and the way I was bought up because I am Australian and you've met one
He said "good idea" and he said " like-wise". That is a great start and you had a good time. It seems that you being wary of your fear of rejection and being more assertive went well. Good for you, well done.
Do stop over thinking though you have it in your mind "worse scenario a great new friend". Remember the positives and just be you.