You're the twelfth person that's told me that...
Ironically, I only like two songs in carousel (You'll never walk again, um, alone, and what's the use of wond'rin). Just goes to show you how much variation there can be in one show.
I do quite like If I Loved You, but personally I don't think it's that good in the context of the show (it always remains me of 'don't like you' from the boys in the photograph. A few songs later and they're married. A bit superfluos really). However, I have only seen two productions of Carousel, so it might be the actor and actress involved and not the song.