@Regarde,
It's not that simple at all.
I just checked... I have the number of an ex-girlfriend from 3 years ago because I never bothered to delete it. She hasn't called me in 3 years. I haven't called her. No big deal.
The way you can be sure that he doesn't want to talk to you is that he didn't respond when you sent him a message. That's it. Whether or not he takes the time to delete your number is his business, not yours.