@Monas,
My guess is that it really was a test - but only after he got caught.
In other words, the man is a thief, and there is no limit on what else he will do, especially if he doesn't get caught. I think you would be better off without him, even if it means being alone.