I can relate. You didn't really ask a question and I don't really have any answers.
But I'm in a kinda similar boat....but I'm married too.
He has a wife and kids.
I have a husband, no kids.
We both love what we have together; a really strong and loving relationship, but are we both ready to throw away our whole life for each other?? We both have no clue!
He might not leave his wife for you, but it doesn't mean he doesn't love you or care for you deeply, it just a really messed up position to be in and not easy to walk away from a life you built. Give it time and see what happens.
It's been 2 years for us and we're still having an affair, but talk about how great it would be waking up beside each other every day. Who know what will happen and when.
Your question need to be, can YOU handle being the other woman?
Pretending you're single when you're kinda not really?