@BryBry88,
I have to ask, is he in he closet when it comes to his sexual prefs? Do other people in his "bubble" know about your friendship with him? I hope that you are not a 'dirty little secret' in any fashion, but I would do a few things to test the waters before I gave up on him.
Ask him out on a date, movie and a dinner, something that a couple would do and see what response you get.
If he refuses a date, then it would be obvious that all you are to him is sex. If that's the case, as hard as it would be, you need to move on. Why keep breaking your own heart in hopes of him suddenly wanting a relationship with you instead of a friends-with-benefits situation?
In any case, I wish you nothing but the best, and I commend you for not falling into that stereotype that all gay men want nothing but sex as it is clear you want a relationship. If he isn't willing to go down that path with you, remember there are other fish in the sea that are looking for the same thing you desire. Yes, it may be heartbreaking to let go of the possibilities with your friend, but in the long run, it may be a good decision for you to let it go and find what you seek in someone else that seeks the same.
Good luck, and remember, take care of yourself first.