@Aedes,
If the origin of the word is unknown to either party - the one using the word, and the one the word is directed towards - then there seems little room for the origin (of which both are ignorant) to be of much influence.
However, if I call someone X, where I understand the common usage of X and the etymology of X while the other person is only aware of the common usage, the origin of X may not harm the other person, but it will harm me.