After he releases them, the Avengers become suspicious of him after hearing they are wanted and they cannot remember what happened at the castle and go there, however nearly all of them are paralyzed by Nefaria's gas.
The Avengers become suspicious of him after hearing they are wanted. They cannot remember what happened at the castle. They cannot go there. Nearly all of them are paralyzed by Nefaria's gas. He releases them.