@sunshineroom03,
Go to whatever store you please. Whatever he thinks about that is unimportant.
But even if it was, are you buying stuff, or just hanging out? If you're not just making eyes or chatting him up, then you are a customer, just like everyone else who walks in the door.
Don't change your habits or your preferences for the sake of, well, anyone, assuming you're not harming anyone, and you aren't.
PS it's his job to be friendly to the customers. Don't read anything into that.