Of course not and neither do you, but it's pretty common for shy people to be considered aloof.
It's such a common perception that you are not going to change the way people generally think.
Despite all the blather we see and hear about empathy, people tend to think of things in terms of themselves. If someone won't talk to them their first impression is not that that person is shy but that he or she is aloof.
If you truly are aloof then why care what anyone thinks?
If you are not and you don't want people to think you are then work to change the way you interract with them.
They are not going to change, you must.
Get past your fears and engage. Some people will prove to be jerks but not all.
It's yur life and you, better than anyone else, will control how it plays out.