USUALLY... fleas will only crawl on humans when it's a last resort. This usually happens when you've given your animal a flea preventative. They don't like the animal, so they will try crawling on you then realize that's not what they want, and make it out the house.
do you live in an apt? If so, they could be coming from the house next door.
Be sure to wash all your sheets, cat beds, etc. I really don't see a reason they should stay in the house, so give it a few more days, and they should hopefully go away.
I'm sure your cats would rather stay in the house to sleep with their favorite people in the world