Unintended Consequences




Or, with gene editing, what if we are successful at eradicating illness and preserving life forever?  What new challenges will that present?  How will we eat?  How will we not consume all of earth’s natural resources?  Or perhaps the life-saving potential will ultimately be canceled out by the life-harming potential — it’s clearly just as possible to use gene editing to weaponize mosquitos as it is to sterilize them.

Or, with the democratization of media — on the one hand radically increasing freedom of expression, but also laying the foundation for the “fake news” problem.  I don’t think anyone who believed in the power of social networks to enable free speech and political organizing online really saw that coming, and it’s a real, hard problem.

Or, with artificial intelligence — how do we avoid being blinded by the shiny newness of helpful automation while ignoring potential existential threats? Bill Gates on that subject:


All of these consequences are made more serious by the fact that in a connected world, change can take place very very quickly, and it can be hard, or impossible to manage or roll back. A single person in a single place now has more power to impact the world (the whole world!) than ever before.  As Kevin Esvelt, the geneticist who is the subject of the New Yorker article linked above said: “as a single scientist, I can alter an organism in a laboratory that will have more of an effect on all your lives than anything the legislature across the river can do.” [#]

So what to do?  These kinds of changes are coming (seemingly) faster than ever.  I like Esvelt’s suggestion that, in the case of gene editing, we should be building “undo” functionality into anything we deploy:

“With CRISPR and gene-drive technology, it might be possible for just one engineered mosquito, or fly, or any other animal or seed, to eventually change the fundamental genetics of an entire species. As Esvelt puts it, “A release anywhere could be a release everywhere.” Recognizing the possibility of an irreversible error, however, he and Church, in their earliest experiments, began to build drives capable of restoring any DNA that had been removed. Both say that if an edit cannot be corrected it should not be attempted. They also suggest retaining, in its original form, some part of any population that has been edited—a kind of molecular Noah’s Ark.” [#]

That’s one approach that seems reasonably and will hopefully be effective, at least in some cases.  But for most of what we’re doing there is no natural “undo” function, so we must think about other ways to manage, or at the very least, quantify and understand, the consequences of what we’re making.