I know kissing leads to sex. (not necessarily, but a boy is a boy)
some people are interested in sex earlier than their (potential) partners. in my experience it's not a gender thing.
If you're not ready to have sex with this guy (or someone else) AND not comfortable talking to him about it, don't go to his home. You'll be more relaxed in public for now - and maybe it will prompt you to have the conversation about where the relationship might/might not be going.
Are you ok with kissing him in public? go with that if you are. get used to being with him, being comfortable with sexual feelings with this guy. if you eventually want more / are ready for more, let him know.
If even kissing in public makes you uneasy, I'm not sure what to suggest.
I don't mean you have to stand in front of a crowd and kiss - but maybe sitting in a park, talking, relaxing, leaning in and kissing.
He does sound like a nice guy who hasn't put a lot of / any pressure on you about this so try to relax, try to talk to him - especially if you would like sex to be on the plan with this guy.