And I think we do have to worry about a danger called goal misspecification, where people give it a goal but don't really specify very well how to accomplish that goal, and then the system gets a funny idea, like I was giving an example before about telling it to make you a lot of money quickly but not telling it how, and maybe it goes out and commits a crime on your behalf.