@john nib ,
You should stop seeing her..and find someone who is available she us in a committed relationship.
I would not speak with her boyfriend ...that is up to her. If you feel bad then that is your conscience telling you this is wrong. Simple answer until she is available you should not see her.
Put it to you this way...how would you feel if she was your girlfriend and sleeping with another guy?
Find someone more stable and available.