Trophy, well yeah, I'm proud of ya! That's really good.
You stood firm and went about your business.
That's huge.
You deserve a victory dance.
Keep it up. Soz is right, but I think you'll get there so long as you persist in not biting on any of his openings.
He keeps laying the bait, but you're not biting anymore.
You are still considering the taste of it though. Can guarantee it is poison.
No, I don't think it is weird at all that he said "Yeah, you should have come here earlier."
The way you describe him, it's no surprise he wants your interest...so that he can play with it and you.
And he sounds egotistical, very much about himself. He wants you to stroke his ego and it bruises it to have you reject his advances and to not have you come running after him just because he is around.
Pretty soon his baiting will be an annoyance that you simply can not be bothered with.
It could be so cleansing and good for you, man it would be a delight if I were in your shoes!! , to tell him to bugger off, what he is selling you aren't interested in. Slam the door, as Soz said.
keep keeping on