Affair blew up

I'm not sure if this a question or just a story that I have to tell. I just had a 5 month affair blow up recently. I am married for 20 years in my late forties with no children. I love my wife but she has made live very hard for us. She has been through rehab 3 times for pain meds and has no real interest in sex. My affair partner is a wonderful woman also in her late forties, but with 5 kids and a mentally abusive husband. We have been really good friends for four years and have always been very flirty. About 6 months ago we realized that we were much more then friends and slowly started changing our relationship to a romantic one. We both knew that this would be difficult but we were determined to make a go of it.
I would always see her at her place of business and we would make believe that we were only friends. The both of us were truly in love with one another to the point of being silly and stupid. Because of out limited time alone we only had sex a handful of times. The chemistry that we had was like nothing else I have ever experienced before. We really had talked about leaving our spouses to be together...that was until she got caught in a lie when she was with me.
Her husband knew she was lying and then he checked the cell phone records. I know how stupid we were, thousands of calls and texts of the course of 5 months. She finally gave me up 3 weeks ago and things have gone off a cliff.
My wife knows something is going on but does really not want to know. My affair partner and I tried to keep in contact covertly after things blew up until last week.
She was at a restaurant by herself and I walked in and had a great conversation until her husband saw her car in the parking lot and walked in. He confronted me and took a swing at me before some other gentlemen intervened. It has gone from bad to almost worst case scenario. The husband wants my partner to take out a retraining order against me in order for them to stay married. After she told me that, I asked her not to contact me again and blocked her from all my social media and cell phone. She had asked me to leave my wife and rescue her but I could not pull the trigger. I truly regret that decision.
Very long story kinda short, both of us are completely heartbroken at this abrupt ending and don't know what to do. I have not spoken to her in a week and do not anticipate talking anytime soon. She does not want to lose her children.
Other then the obvious that we were complete idiots, any ideas on how to get through this heartbreak? I cannot bear the thought of never being able to be her friend again.