Do you really want to hang around? And then what'll happen? Will it escalate, again? It has, so that's a possibility. Or will you or he walk on eggshells forever? Or will either of you take this out on your children?
Run, don't walk, away from this train wreck. Put this crap behind you, far, far behind you. And get some counseling, to learn why you could not let something like that go. Learn why you became verbally abusive, and how to not become that way when next angered/threatened/defensive in your life. And maybe also learn to recognize the signs of abuse and potential abuse here - in him and in yourself.
PS His taking you shopping, whatnot afterwards is pretty classic abuser behavior, where the abuse happens and then the apologies and 'making up for it all' are very victim-centric - "We'll do whatever you want
," etc. etc., as if new shoes could buy your silence or make you stay.