@chinarican,
I think I misunderstood the question. They key gives access to the door, and not the interior of the house is what I now understand. Sounds necessary to his job, and doesn't interfere with your own privacy or security. I think you are going to have to comply, if you don't want to see your husband violated.