@Olive303,
It sounds like he is aware of the issue as he does apologize afterwards, what he may not be aware of is how it impacts you. He may not realize that it is putting a barrier in your relationship. It might be hard, but you do need to talk with him about it.
It would be a sad thing if this is a deal breaker without you even addressing with him first. I could understand if you talked with him about it and he denied it or refused to work on it that you would consider it a deal breaker.
The one thing though when you choose to talk with him - do it when he is not angry. Let him know how it impacts you and that you want to work with him so that your relationship is even stronger - in other words focus a lot on the positives as well.
I wouldn't even put some counseling might be helpful - not sure how open he is to that - but the very first step is to let him know how much this anger episodes impact you and your relationship together.