@Grant2016,
I am not quite sure what you are asking. Are you asking if it is "dickish" for him to not have sex with you? Or are you saying that it would be "dickish" for you to leave? I don't see that he has any obligation to have sex with you, nor do you have any obligation to stay in the relationship if you aren't happy.
There is nothing you describe in your post that I think is "dickish" on either your part or his. If it isn't working then it isn't working... assigning blame doesn't help anyone.
If I am in a relationship that isn't making me happy and I don't see a way to fix it then I leave. The other option you have is to accept things the way they are. You don't get to force your partner to change, that isn't how relationships work.
It's your choice.