@Chb10c,
" ...in the end he chose me...." This sounds like you're a consolation price to him. This is so wrong on so many levels, if it were me, I had given him the boot with the first infidelity.
I am not sure what you're asking here? He's been cheating on you for quite some time and it looks like he wants out of the marriage, he just hasn't found a woman who'll take him. I think any woman in her right mind won't take him, so he'll stay put with you.
If you can, please go to counseling, you seem to have low self esteem. You don't have to take being second fiddle to this man who will have unprotected sex with other women and is jeopardizing your health along the way.
Toss his sorry ass out the door and get yourself a good therapist!
Good luck!