They couldn't wipe out the human race with thunderbolts and kill them all off, as they had the giants, because that would wipe out the worship they receive, along with the sacrifices we humans give them.