To be out of this world means to be extraordinary, and in this sentence his good looks and body are extraordinary.
Consider the statement "I can't like him, but my god, he's so handsome, and his body is supernatural.". Based on this "I can't like him, but my god, he's so damn good-looking, and his body is out of this world." a true statement? Yes, no, or I don't know?