Am I going too fast into a new relationship after breaking up recently?

I broke up with my prior bf a few weeks ago but I was over the relationship for months. During one of our prior breakups I met someone else but stopped seeing him when I reconciled with my bf. Since my breakup, I have been in touch with the new guy and we are really hitting it off. We are both older and if we enjoy each other's company that's all that is important. I don't mind being alone but also know that timing is everything sometimes. The new guy and I are compatible so far but is there anything wrong in just dating him for now? I have no desire to date more than 1 man. The only thing is the new guy is smitten with me so I'm trying to slow him down. We live about 100 miles apart so we would only see each other on weekends.