I have too much strong will and self-worth to ask him
Self worth? If you had self worth I would think you would have no difficulty being straight with him. I find it the opposite - if you had self worth you would ask him - having lack of confidence or possibly fear of being turned down is stopping you.
What is the worst thing that would happen if you asked straight out? He would turn you down. So then you know to not keep up with him any more.
I do agree with Max that you are sending mixed messages and it seems he is almost doing the same as you - holding back out of fear that you don't want to pursue him - hurting his ego.
Someone needs to step up and be honest if there is to even be a possibility of a relationship else you two will keep dancing around it.
And for future reference be wary of what you text - keep texts for informational purposes - it is so easy to misread texts there is no tone and no facial expressions to read so quite often texts are mis-interpreted. At least on the phone you can hear your voice tones.
And for that mis- call - my opinion - I would have said something along the lines sorry I did call you by accident but I am glad I did - it is nice to hear your voice. Otherwise it sounds like he said either you did mean it and want it seem you do not; or you really don't care.
Just be upfront and honest about your feelings - at the least then you will know.