Please paraphrase the paragraph:
It is sometimes easy to overlook the actual wrongdoing of the victim of your curse, when one considers how "unhappy" a person he really is.
If you realized what an unhappy person he actually was, sometimes you could easily overlook the guilt of the victim of the curse.