To throw in the towel means to give up, which is what the speaker thought would happen.
Consider the staetement "I never thought you'd give up there.". Based on this statement, is "I never thought you'd throw in the towel there." a true statement? Yes/no/unknown