You've hit on a strange anomoly, which has been mentioned here before (by me, actually!)
"Quite" has two opposite meanings: completely, and not completely. Strange, but true.
You will have to rely on the context to indicate the meaning you want.
It doesn't cause any problems in practice.
I'm quite sure about that.