@Agirlhasnoname,
Take a deep breath.
Relax.
If you are not sure about going on the trip with him, tell him now.
Be honest with him. Tell him you feel rushed and that you need to be sure about things.
It does not matter what other people think or want to have happen. Do not be concerned about his friends or family.
Be sure about what you want to have happen.
If you're not feeling the happy giddies when you are with him, step back. You are in the very early stages of a possible relationship - it should feel exciting, not like a task or project to get through.
__
You don't sound excited about being with this guy. Maybe he's meant to stay as a friend.
Slow things down and decide what you want to have happen next.
__
Did he talk to you about booking the trip beforehand ?