He just told you that it was fine and he accepted your apology.
So, why do you think he's not being truthful about that?
Chances are really good that he actually means that. Take it at face value, as you have no reason, as of right now, to assume that he's not being fully honest with you.
Good for you, actually, for sticking up for yourself, and telling him when he'd gone too far.
Bad for you, for acting like a petulant child about it.
From here, it looks like he wants to continue. So continue! And assume he's telling the God's honest truth unless he gives you a damned good reason not to think that. You know, the old innocent until proven guilty? Well, he's honest (and so should be everyone you meet on the planet, I might add) until he's proven to be a liar, a smooth talker, or an exaggerator.
Also, and next time? If he goes too far, tell him it bothers you and then don't just sit there on the phone. It's bratty and disrespectful. If you don't want the date to continue, then say so, and go home or have him bring you home, or get a cab. But sitting there at a meal, on your phone, when you're out on a date, is pretty damned rude.
Your hands are not clean in this matter.