have i been raped?

So I was telling my friend about this guy I used to have a thing with. She told me that I was raped, I didn't think it was at first, but now I think it might be. So I was at school and the guy, lets call him Tom. Tom texts me and says "hey come over after work". I kept telling him I can't and he says "we can have sex" ad I told him I don't want to have sex and I can't come over. He says "oh we can just cuddle then". So I agreed to come over, when I did I was half asleep cuddling with him. Then he starts fingering me and I just lay there with my eyes close, I open my eyes and he's starting to have sex with me and I just close my eyes and try to go back to bed. Even though I didn't stop him is it still rape? I just want closure because now I'm feeling uncomfy about the situation and don't even know if it was rape. I was too scared to tell him to stop and I told him beforehand I wasn't interest in having sex. Not only this but Tom has done other things that are similar like this to me. Like once after work I went to his house because he wanted to apologize to me about ignoring me or something. He gave me a very insincere apology then asks me if I accept his apology, after this he tries to get me to stay the night. I keep telling him that I can't, we smoke a blunt, then I try to leave and he brings me up to his room and I kept telling him I have to leave. So he walks me to my car and starts making out with me ad starts fingering me. I tell him sternly I have to go and he stops. I also work with him so it's a really messy situation. Also, this made me think about how many other guys have done this. They'll just have sex with me while I'm half asleep. It makes me really uncomfortable and scared. I'm lucky that now I understand this isn't okay and that my current boyfriend doesn't do anything like this to me. My current boyfriend always makes sure I'm comfortable with everything and that I'm okay. Even if I say I'm comfortable and I'm acting timid, he'll make sure I'm okay. I'm lucky now but I'm just wondering if what's happened in the past considered rape?