You say someone is coming over when they're coming to your house for a reason, dinner, coffee, political meeting whatever. It's used as a phrase, and trying to reduce the phrase to its constituent parts isn't going to help.
Do you remember the 1967 movie entitled "Guess Who's Coming to Dinner" starring Spencer Tracy and Katharine Hepburn? Was it an exception to the "rule"?