please help did I do the right thing by breaking up?

I met a guy 4 months ago, we immediately clicked I have a really hard time connecting with people but with him it really just clicked emotionally and intellectually.
from the beginning it was clear he was very busy and seemed like he put school, work, family and friends before me, i knew he still really cared for me but as time past he seemed to write me less and meet up with me less. on one hand I really loved hanging out with him and having him in my life, but on the other hand I was always waiting for him, to call to send a cute message, to meet up and it seemed that most of the time we were together I was sad because I felt alone, I didn't bring it up until we were at a house party he and some friends were organizing, he barely paid any attention to me. the next day I called him and told him how I felt, he went on and on about how important his work is to him, and that he will never change. he said he wanted things to stay the way they are but he would understand if I wanted to break up, the next day I wrote him that I really care for him, love the fact he works hard for his dreams and that I wanted to stay, he wrote me back "ok" and I didn't hear from him for a week. by the beginning of the next week i found myself anxious and sad again, so I told him I wanted to break up, he didn't argue and I haven't heard from him since, its been a week and I'm having second guess, did i do the right thing?