A lot of people get overwhelmed when it comes to sexual intimacy.
Like ehBeth said, it's likely best for the two of you to not be alone together. He'll feel teased, and you'll feel pressured.
I wish I could say that everyone, easily, can just kiss and hug and be done with it. But that's not the case with everyone or even with a lot of people.
If you want to maintain your virginity, and also don't want to engage in heavier petting (e. g. touching each other's genitals, etc.), then you are going to have to avoid being alone together and raising the possibility of something happening.
If you do not trust him to respect your wishes in this area, then you might want to reevaluate this relationship.