@Chile,
You're fine and he's' playing games.
His game is called,
Guess Why I'm Pissed Off and I'll Give You No Hints.
This is a bit of manipulative behavior and you're right; it's unfair to you. Him distancing himself during exams is 100% logical behavior so you were right to believe that was the cause, and to give him a chance to study and take his tests.
Because I can bet you dollars to doughnuts that, if you had contacted him and asked him what was wrong, he would have bitched that you were bugging him during exams.
This is a no-win situation for you, and it's compounded by him distancing himself even more right now.
You may want to seriously consider if this is the sort of behavior you're willing to put up with, as it's not likely to get any better.