Frigid temperatures this weekend prompt cold weather advisories

MPR News helps you turn down the noise and build shared understanding. Turn up your support for this public resource and keep trusted journalism accessible to all. 

Turn Up Your Support

In his lab at George Mason University in Virginia, Sean Luke has all kinds of robots: big ones with wheels; medium ones that look like humans. And then he has a couple of dozen that look like small, metal boxes.

 are training those little ones to work together without the help of a human.


In the future, Luke and his team hope those little robots can work like ants — in teams of hundreds, for example, to build houses, or help search for survivors after a disaster.

"These things are changing very rapidly and they're changing much faster than we sort of expected them to be changing recently," Luke says.


New algorithms and huge new databases are allowing robots to navigate complex spaces, and artificial intelligence just achieved a victory few thought would ever happen: A computer made by Google 

beat a professional human in a match of Go

It doesn't take much imagination to conjure a future in which a swarm of those robots are used on a battlefield. And if that sounds like science fiction, it's not.

Earlier this month representatives from more than 82 countries gathered in Geneva to consider the repercussions of that kind of development. In the end, they emerged with a recommendation: The key U.N. body that sets norms for weapons of war should put killer robots on its agenda.


Human Rights Watch and Harvard Law School's International Human Rights Clinic added to the urgency of the meeting by 

 calling for a complete ban on autonomous killer robots.



, who teaches at Harvard Law School and was the lead author of the report, says the technology must be stopped before humanity crosses what she calls a "moral threshold."


"[Lethal autonomous robots] have been called the third revolution of warfare after gunpowder and nuclear weapons," she says. "They would completely alter the way wars are fought in ways we probably can't even imagine."

Docherty says killer robots could start an arms race and also obscure who is held responsible for war crimes. But above all, she says, there is the issue of basic human rights.

"It would undermine human dignity to be killed by a machine that can't understand the value of human life," she says.

, who runs a program on ethical autonomy at the Center for a New American Security and was also in Geneva for the talks, says that it's pretty clear that nobody wants "Cylons and Terminators."



In truth, he says, the issue of killer robots is more complicated in reality than it is in science fiction.

 Lockheed Martin is developing for the U.S. military. The LRASM can lose contact with its human minders yet still scour the sea with its sensors, pick a target and slam into it.


"It sounds simple to say things like: 'Machines should not make life-or-death decisions.' But what does it mean to make a decision?" Scharre asks. "Is my Roomba making a decision when it bounces off the couch and wanders around? Is a land mine making a decision? Does a torpedo make a decision?"

Scharre helped write U.S. policy on killer robots and he likes where things ended up.

Department of Defense Directive 3000.09 requires

 a high-ranking Defense official to approve unusual uses of autonomous technology and also calls for those systems to always keep "appropriate levels of human judgment over the use of force."


Proponents of a ban say that policy leaves too much wiggle room. They advocate that all military weapons maintain "meaningful human control."

, who is one of the country's leading roboethicists, says hashing out that distinction is important but the potential benefits of killer robots should not be overlooked.


"They can assume far more risk on behalf of a noncombatant than any human being in their right mind would," he says. "They can potentially have better sensors to cut through the fog of war. They can be designed without emotion — such as anger, fear, frustration — which causes human beings, unfortunately, to err."

Arkin says robots could become a new kind of precision-guided weapon. They could be sent into an urban environment, for example, to take out snipers. He says that's probably far into the future, but what he knows right now is that too many innocent people are still being killed in war.

"We need to do something about that," he says. "And technology affords one way to do that and we should not let science fiction cloud our judgment in terms of moving forward."

Arkin says one day killer robots could be so precise that it might become inhumane not to use them.


The next meeting in Geneva is set for December, when a U.N. group will decide whether to formally start developing new international law governing killer robots. Since the last meeting, 14 countries have joined in calling for a total ban.  Copyright 2019 NPR. To see more, visit https://www.npr.org.

Science

New algorithms and huge new databases are allowing robots to navigate complex spaces. It doesn't take much imagination to conjure a future in which a swarm of those robots are used on a battlefield.

Autonomous killer robots in battle: The good and the bad

Go Deeper.

Like this?