Feeling unwanted in marriage

I don't know what to do or think anymore. Lately I have felt that my husband isn't happy with us, and that I'm unwanted. He has a temper from time to time. I feel like I'm walking on egg shells a lot. I'm far from perfect, I make my own mistakes, but I feel no matter what i do I'm in the wrong with him. He doesn't work, so our recent argument was that he's up till 2-3am and I have to be awake at 5am for work. But he keeps me up at night with the TV. I've expressed that I need my sleep, and he gets aggrivated with me. I feel like I just don't matter at times. I took the day off today and knowing he wouldn't be able to sleep tonight he slept all morning till around noon. It seems like small issues that can be addressed easily are blown out of proportion with him. He gets mad easily over small things and then eventually threatens or relationship saying.... Do you just want me to leave?, do you love me?, Or says... Maybe I'll just leave and not come back.... Things along those lines. I generally let him cool off and he always apologizes eventually for his words cause he knows they hurt me. No matter how upset I get I never threaten or marriage or relationship. Tonight after the brief argument over sleep and him being mad that his football team lost.... He threatened to sleep in the car or to leave and not come back. I'm not honestly sure if he's home or left right now. I have always chased after him to talk things out, but I'm tired of chasing. Instead I just stayed in bed. I'll add that he's hard to talk to. I try to bring topics up, or ask how he's doing/feeling deep down but I always get a surface response. I don't know what to do. I feel like we clash. I love him, but my heart hurts in how I'm talked to sometimes. His actions at times makes me feel unwanted and I've tried talking, but he won't listen to my feelings instead he gets defensive and things gets turned on to me as if I'm always in the wrong 100%. I don't know what do, any thoughts????