I think you are both making very broad generalizations here.
I have not found that my sex drive is diminished by being tired. After all, you can usually do both; sex first followed by sleep seems to work pretty well in my personal experience.
I don't know whether there are gender differences here. It seems likely that this varies from person to person.