"Teminator Genisys" (Paramount Pictures)

Meet your "Doom": Carnegie Mellon researchers deliberately violate Asimov's First Law of robotics, teach robots to kill

The scientists used "Doom" deathmatch to create A.I. with the potential to become Terminators


Scott Eric Kaufman
September 22, 2016 10:19PM (UTC)

Guillaume Lample and Devendra Singh Chaplot, two researchers at Carnegie Mellon, recently announced that they had created an artificial intelligence in "Doom" deathmatch capable of killing human players in deathmatch scenarios — a situation of the very sort Isaac Asimov's Laws of Robotics was intended to prevent.

The First Law is that "a robot may not injure a human being, or through inaction, allow a human being to come to harm" — a law that Lample and Chaplot's research clearly violates. According to their paper, their model is "is trained to simultaneously learn these features along with minimizing a Q-learning objective, which is shown to dramatically improve the training speed and performance of our agent. Our architecture is also modularized to allow different models to be independently trained for different phases of the game. We show that the proposed architecture substantially outperforms built-in AI agents of the game as well as humans in deathmatch scenarios."

At the moment, the AI can only kill humans on the version of Mars within "Doom," but as Dave Gershgorn noted on Twitter:

The danger here isn't that an AI will kill random characters in 23-year-old first-person shooter games, but because it is designed to navigate the world as humans do, it can easily be ported. Given that it was trained via deep reinforcement learning which rewarded it for killing more people, the fear is that if ported into the real world, it wouldn't be satisfied with a single kill, and that its appetite for death would only increase as time went on.


Scott Eric Kaufman

Scott Eric Kaufman is an assistant editor at Salon. He taught at a university, but then thought better of it. Follow him at @scottekaufman or email him at skaufman@salon.com.

MORE FROM Scott Eric KaufmanFOLLOW scottekaufmanLIKE Scott Eric Kaufman

BROWSE SALON.COM
COMPLETELY AD FREE,
FOR THE NEXT HOUR

Read Now, Pay Later - no upfront
registration for 1-Hour Access

Click Here
7-Day Access and Monthly
Subscriptions also available
No tracking or personal data collection
beyond name and email address

•••


Fearless journalism
in your inbox every day

Sign up for our free newsletter

• • •