@Jeaniebelle13,
He needs parenting classes, and those should be non-negotiable. This is a brand new situation for him and he does not seem to realize how his words and actions are really affecting everything.
If he refuses, then suggesting counseling for him. I'm serious. He's acting like a child (don't say that, specifically, to him) and should explore that with a counselor. This is not necessarily couples counseling, and you do not necessarily go. But it might help him to unburden himself to an impartial professional. In particular, if he complains about teens being difficult, a competent counselor will 'be the bad guy' and tell him that every teenager since the beginning of time has been difficult in some fashion or another.
His third option is to go to his primary care physician in order to rule out anything organic going on with him. Perhaps he is under significant stress and has blood pressure issues, etc.
If he refuses to do any of these things and insists there is nothing wrong, then consider whether you want to continue. But I am suggesting a few options in order to give it the old college try, at least in the name of your children's stability if nothing else.
One quick q: how did he interact with your children before you two wed? I would have thought some sort of a warning sign would have cropped up if they spent enough time together, particularly alone time without you being there as a buffer or a referee.