@Kyleah,
Emotional abuse, real anger issues, have to be careful.
Do you realise that you are therefore, putting this man in extreme danger as well? Have you thought about that?
Also, does your husband abuse you and the children? Based on what you have stated it does suggest that they would hear and see things, isn't that worth getting them out of and putting them first?
I understand you feel that you've been emotionally abused for some time and need someone to be there for you to forget about it and feel that equates to "love", but blood is thicker than water and I can't help but feel that your priorities are in the wrong place at present.