@icybae,
To be honest I would think you were leaving him too because of money - why - because it seems you state the difference between the two by their wealth not their character.
Do you think there is something hidden underneath that might even be subconscious if that you are using wealth to describe the two?
If you are clear that isn't the case then why do you care what the guy you dropped thinks?
Do you know which one you want to be with? If you can't decide it is only fair to tell each of them at this point you cannot commit to either. One or the other or both may drop you - but it really isn't fair to them if you are not 100% committed to ask them to be committed.