Of course that doesn't make you a bad or sad person. It makes you someone who doesn't much care for animals.
I have no particular interest in babies, beyond once in a while thinking a picture is cute or funny. Doesn't tug at my heartstrings or make me feel like I want to be more involved.
Thing is, I know there are a lot more people than let on who feel that way, because it's seen as a negative in, well, all societies I suppose.
I'm sure there are a lot more people who don't care for animals than you might think.