ADVICE PLEASE?

Sorry for the long post – but I really do need some advice. I met a guy almost three months ago in school. We’re both the same age (21) but I had just gotten out of a long-term relationship (about 3 years). He introduced himself to me and after seeing each other a couple times, he asked for my number. From day one though, he was never the type to be constantly texting or anything like that. In fact, although he might send a text here and there, I actually initiated some conversation. He has never had a serious relationship before nor has he been in love and has had seemingly platonic physical relationships with about 10 females. I think he doesn’t know what emotion is. He has never taken a girl out to lunch (yet he’s taken me), he’s never brought a girl home (yet I’ve been to his house and met his parents) and he’s never went out alone with a girl to a club or anything like that (he’s taken me out to a club, just the 2 of us). He said that the girls he’s been with, he’s been normal with all of them, met them through mutual friends and they became physical – the girls were either okay with that or wanted something more and he’s just been normal the entire time. I know this because he’s told me when I asked and in conversations we’ve had. We’ve been hanging out and in person we are great and we have become physical. When we hang out we laugh and he is flirty like he will hold my hand, give me kisses, play with my hair and legs etc., although I still think at times I feel as though he’s holding back, especially in public he won’t be this affectionate. Most times, he will ask me out and I will say yes. The thing is, I feel as though something is wrong. Although he says he really likes me and I am the only girl that he is interested in, he never makes much contact with me. For example, he might go for the entire day without talking to me. Or we might both be online and he won’t message me once. Of course when he does this I get confused and hurt because I think that he’s not that interested. Sometimes though, he will call or message me randomly and surprise me and we will talk for a bit, or he might call on Skype and we will talk for a while. About a month back, I couldn’t take it and I asked him what was going on with the both of us and sort of stupidly asked if he only wanted to get in my pants. He said no and that he thought that something could come out of this. I also told him that I didn’t think we spoke often and he was confused, he said he thought we did! I just don’t understand how he can say that he likes me so much in one breath yet will go for a full day without talking to me – it just doesn’t make any sense. However, I kind of let it slide for a bit because I figured he wasn’t used to anything that was serious so things were different for him. But I’m at a point where I’m really burning to ask him about it but don’t want to for fear of pushing him away. I find myself waiting for his call or text. Could you please give me an idea as to what exactly he may be thinking?