Having an affair...what to do next?

I been married for about 10 years now. I love my husband, but he does not provide all that I want and need. Anyhow, I started an affair, with a friend from high school, two years ago. He is also married. He recently lost his job and I found out that I am responsible. Back in April, we had sex in his office, we thought no one was around and I was loud. However, we were mistaken, people did hear us and someone saw me leave. His co-workers thought that I was one of his clients and several co-workers reported him. He lost his job about a month ago, even though the "client" disputed the claims, and there was not proof of him engaging with his clients inappropriately...its all hearsay. He does not and has not told anyone that it was me and not the clients, he doesn't want to complicate things for me. I did not realize that I was mistaken as the "client" and how I feel responsible for him losing his job. I feel horrible and I don't know how to proceed. I feel like I owe him something. I've considered approaching his employers but I think that would make things worse for the both of us.