I don't know, as you may have something going on medically, re which I've no idea.
The usual thing is that some people with working brains like space and not to be yammered at. Closing out noise can be a reaction. But I don't take that as your problem.
I do think it may be a medical problem, and that you shouldn't dance around that.
I would be worried and get it checked out.