I feel things are moving too fast with him but don't want to be rude?

Had been talking to him for a few weeks/a month before meeting. We went out for dinner together a few days ago and all went well. Kissed at the end. Texted me when we got home. Said he's glad he's met a woman who likes similar things. Said he found me even more attractive in person. Wanted to see me a few days later to do something together, I agreed but then I had too much going on with work so he suggested we maybe save it for the weekend. He also asked if I would be free this weekend as his friends have an event on. I don't see anything inherently wrong with this, however, previously dated someone and I met his friends quite early on, it didn't last and he was also seeing other people unknown to me.

Before we met, he would talk about what we should be doing for our second date, like going to the beach etc. I'm not sure if this is an issue but we hadn't even met, who is to say we would get along? Wondering if he's doing this to get in the sack quickly as I didn't sleep with him on the first date/as we did have some sexual messages exchanged prior. Things over text got a bit heated when we got home too and even sent me a photo of some toys he would like us to get. In one of the other message, that was slightly sexual he said he wants his 'partner' to be satisfied.

He did mention jokingly before our date that dinner should be quick and straight to dessert, however, the night before I did sort of get a bit sexual. Did text me after saying it was good to get to know me.

Advice? Is this concerning or?