Wait a second! Capitalism does no such thing. It does not force
you to act against your moral values. It allows other
people to act against your
moral values. It doesn't force you to do anything. It frees other people from your moral values (which you may not like, but I think is a good thing).
I am very happy to pay interest. Interest is the reason I am able to have my own house right now. Interest has saved me money in the long run since if I weren't paying a bank interest on my mortgage I would be paying a landlord rent. In my experience interest is good for me as a borrower (and good for the bank).
For you to tell me that I can't pay interest to a bank in order to buy a house would be a great imposition. You are basically taking away my freedom to do something that is beneficial to me financial and beneficial for my quality of life.
If you think interest is immoral, then fine. No one is forcing you to participate. There are people, particularly people of the Muslim faith, who avoid interest for moral reasons. You have the right to not charge interest and you have the right to not make loans that cause you to pay interest. I have no problem with this as long as you don't try to push your moral values on the rest of us.
But for those of us who benefit from the ability to borrow money at interest, I don't believe you should have the right to impose your moral values on us.