To be off the mark is to be inaccurate or wrong, and in this context the person's insult is not accurate.
Context: If that's supposed to be an insult, you're not right.
Hypothesis: If that's supposed to be an insult, you're off the mark.

Given this context, is the hypothesis true (Yes/No/I don't know)?