@imsak,
My offhand opinion/questions/comments:
1.Do you know how hard/difficult this job is
to me? For me, not "to me.: What's implied is that the job is hard for me (to perform)
2.I knew exactly how serious that problem was to you? This would depend on the context and what you really intend to say. Here again, I suspect you mean "for you" not "to you" It might "seem" to you, but, otherwise it is a problem you have to deal with--it is a problem for you (to solve).
.I can imagine how sad/painful/happy it had been to you? Just doesn't sound right to me. usually it's "made" happy (so, in this case "it made you") "Sad" is a mood--here again, things "make you sad" "painful is a state of discomfort, so "painful for you (not really "to you" although I guess you could get by with this). It's not uncommon to say that something is painful "to me" (or "to you"), but not in that sentence.
4.I can sense how much love/hateful she had been to him during that time? hateful would be OK. But not "love." loving, maybe. But in either case, leave out the word "much."