@JudyJ,
Do you plan to have a future with this guy? or is it a fuckbuddy type of thing?
If there's a future with him, it will include his daughter. He's already let you know that. If you're not good with that, it's time for you to find a new boyfriend.
His child should come before you.