To be off the hook means to be pardoned or released from blame or responsibility, and in this context Rory is not going to let him off the hook or pardon him.
Consider the statement "It looked like Rory wasn't going to pardon him, ". Is the statement "It appeared rory wasn't letting him off the hook." false? Yes/no/unknown