is it wrong

It's called shyness.

You're putting a lot of weight on these interactions. The best thing to do is practice interactions.

So talk to people. Old people. Young people. Male people. Female people. Nice people. And, not so nice people. Greet the mailman when you see him (or her). Smile at people out pushing strollers and say, "Cute baby!" Ask the cashier in the checkout line whether he or she thinks it'll rain.

This will not magically, overnight, get you over your shyness. But you will find that interacting with people is easier if you work at it, and get some practice in under your belt.