@ThedoctorNT,
If you are attracted to him, feel safe, and make clear that you are not as emotionally invested as he is, then I don't understand why it's not okay. As long as you're both on the same page and want the same things, it should be fine. Instead of diving head first, why don't you take it slowly? If you decide you don't want to, then you can quit; vice versa, if you enjoy it, you can take it one step further each time.
Remember that when it comes to acts like this, it is also about what is right for YOU, not just what someone you care for wants. No matter how much he may want to, if he genuinely cares for you, he will be okay with whatever you want to give -- even if that may be nothing. Talk to him about what you want and what you are afraid of. I'm sure the two of you can come to an understanding.