Affairs of the heart, advice required. Could write a book.

So unfortunately I'm not proud of myself for writing this however I would like some honest advice.
Over the last two years I fell madly in love with a friends husband. The feelings are completely mutual. As a result I chose to isolate myself from that friendship group and rebuild other friends. My lovers partner has suspected from day one that we were or are having an affair. It has caused a great rift in their marriage he has now been kicked out of their house. Both of us have children that we adore. I have been in a longstanding soulless marriage, he is a kind man but he is so disconnected it left me completely lonely and I guess I fell into the arms of another man.
I am very aware of how immoral the whole thing has been, and when people think of affairs ours has been quiet the opposite. Reality has been at the forefront, no magical weekends away, no hotel rooms..... But this man touches me and I have electricity running through my body, we connect on every level and laugh. I feel complete when I'm with him.

So the negatives, I get anxiety and I feel like I am on hold an awful lot waiting to hear from him. He is incredibly busy with work and works 6-8pm, he is seriously time poor and lives for his children.

Two weeks ago when we spoke he said yep we are both in, let's do this. Today he watched some show re affairs and it made him feel so guilty he has become confused. He is being honest with me, he is worried about his girls. He said he doesn't want to go back to his wife and there is only a very small part of him that would for the sake of his kids but that would mean living a very sad life. He is so overwhelmed and can't look at things in stages. He says my girls will never forgive me when they see I'm living with you and your girls etc...

He is struggling with what his friends will think of him, I have proposed that we leave the area and we don't come out for a year after the dust has settled. He can pretend to see other people. And slowly I am introduced.

He is petrified he is being followed, and if she finds out he will lose his kids forever. This is his major issue. I have been strong and supportive but I don't want to coax him into something he is confused about. He is living out of a back pack and has no stability at the moment. He is shattered and can't afford to give me much time. It can't be locally and this really affects me, I want to see him, feel nurtured.

I just want some advice, I don't want to hear what a bad person I am, I've had to deal with guilt for a long time. Do I walk away until he finalises everything which could take 8 months? Or let him go and potentially he may grovel back to his wife.

He says things like I have never ever loved anyone like you, you are my soul mate, I think about you all of the time. You are the love of my life.

My thoughts are if you both love eachother this much and it's real and been very full on (good the bad the ugly) isn't this worth seeing through, riding out the bad for a year to get to what could be a lifetime of amazing?

I have t spoken about my children because I have already started prepping them for things and I don't want to bring them into this conversation.