@FOUND SOUL,
I've seen a number of people that love their partners that engage in affairs. Studies suggest 60% of people have an afffair once in their life, but I think it would be closer to 80%. Despite this, it is still taboo to have one openly (which is fair enough).
There's plenty of men & women who just love the opposite sex.
In fact, attration to the opposite sex is genetically sound (stating the obvious?). What is unsound is people who think it should switch off just because you choose a partner...
...BUT...in answer to your question - the answer is something that is unique to your makeup. Only you can answer it, but the first 10's of answers you come up with, will not likely be honest.