What should I do? red flag, need Major advice

I am really bothered with my boyfriend, cause I really don’t know if I can take his word or not anymore, he told me that I can stay over the weekend in his apartment in the city, in fact, he has said it many times, the times I have traveled to see him which is just a few, I go for a day and then he brings me back the same day, cause he studies here in the town that I live so when he comes here we see each other, so I did not feel the need to go and see him on the weekends (since he already comes here from Monday to Friday)So yesterday I said to myself ‘i’m going to take his word and text him to stay that I want to stay over this weekend’.

So I texted him yesterday at 5:46 pm and told him: ‘Hey hun, I want to go over tomorrow and stay over this weekend, Are you doing something? and he replied super late at 8:35 just saying ” I'm coming next week’. Honestly, I got so mad I did not reply back anything, So I don’t understand why wouldn't he tell me the reason why I could not go? it’s the weekend, plus I have not gone to his place for a super long time, I get he is a super messy and his house looks like a hoarders dream literally, but to me, this is a very red flag!! I have to think he has another woman over there or something, so I don't know if I Should just break up with him over text and get it over with, or talk to him when he comes this week straight and clear?