Stuck

I'm 24 and have had an affair. I wasn't happy with my husband and sought the void elsewhere. Now I'm stuck wondering if I should leave my husband as everything is coming to a head. We have a daughter and I don't want to be selfish yet don't want to live in a loveless marriage my whole life. I never felt he was my partner. I married him becauae I was pregnant. This is the toughest decision of my life. He has a drinking issue that seemed to really get in the way and I don't think he ever took it seriously. Im in love with someone else and now my husband wants to try again. I don't want to get rid of the other guy in case husband and I don't work. The other guy and I have an amazing connection as my husband and I do not.