Robohub.org
 

Losing Humanity: The case against killer robots

by
20 November 2012



share this:

Released yesterday by the Human Rights Watch (HRW) organization, the report Losing Humanity: The Case against Killer Robots (herein: the report) and associated press release and video (below), warn of the increasing governmental interest in autonomous, “killer” robots, and the dangers that such technology would pose if ever allowed onto the battlefield.

As mentioned on Robohub before (Rise of the robots: The robotization of today’s military), today’s military is becoming increasingly robotic. In its current iteration, all military strikes carried out by robots are authorized by a human operator, meaning that military decisions – decisions to end human lives – are supported by and traceable through a human chain of accountability.

However as documented by the HRW, governments are showing increasing interest in automating this decision process, thus removing the accountable human from the chain. This line of thought raises the question: who is liable if an autonomous robot kills someone? The HRW argues that autonomous robots “would inherently lack human qualities that provide legal and non-legal checks on the killing of civilians”. We’ve discussed some of these ethical issues with Noel Sharkey (also featured in the above video) and Ronald Arkin before in our two part series on robot ethics (part 1, part 2).

Precursor technologies (discussed in detail on page 4 of the report) are already being developed and in some cases, deployed on the battlefield. These technologies have the ability to identify and target a threat, but will wait upon human permission before engaging. These technologies include South Korea’s sentry turrets (with a similar installation being carried out by Israel); the US Military’s missile defense systems; and various autonomous aircraft currently in development.

The US Government has confirmed its interest in autonomous military robots, through the release of military development roadmaps. The Unmanned Systems Integrated Roadmap FY2011-2036 released by the US Department of Defense states that the department “envisions unmanned systems seamlessly operating with manned systems while gradually reducing the degree of human control and decision making required for the unmanned portion of the force structure”.

Similar visions are expressed by the US Army, who state a “current goal of supervised autonomy, but with an ultimate goal of full autonomy”; the US Navy, who state that “while admittedly futuristic in vision, one can conceive of scenarios where UUVs sense, track, identify, target, and destroy an enemy – all autonomously”; and the US Airforce, who foresee that:

Increasingly humans will no longer be “in the loop” but rather “on the loop” – monitoring the execution of certain decisions. Simultaneously, advances in AI will enable systems to make combat decisions and act within legal and policy constraints without necessarily requiring human input.

These excerpts, all taken directly from unclassified military development roadmaps, show a clear governmental interest in reducing the dependence on humans, with a final goal of autonomous decision making and execution. Thankfully, these roadmaps do question the legal, ethical and political ramifications of fully autonomous “lethal systems”, which have “not yet been fully addressed and resolved”.

The report addresses these legal and ethical questions and calls for the following two resolutions to be made:

To All States:

  • Prohibit the development, production, and use of fully autonomous weapons through an international legally binding instrument.
  • Adopt national laws and policies to prohibit the development, production, and use of fully autonomous weapons.
  • Commence reviews of technologies and components that could lead to fully autonomous weapons. These reviews should take place at the very beginning of the development process and continue throughout the development and testing phases.

To Roboticists and Others Involved in the Development of Robotic Weapons:

  • Establish a professional code of conduct governing the research and development of autonomous robotic weapons, especially those capable of becoming fully autonomous, in order to ensure that legal and ethical concerns about their use in armed conflict are adequately considered at all stages of technological development.

In closing, I would like to leave you with an extract from page 8 the report:

In training their troops to kill enemy forces, armed forces often attempt “to produce something close to a ‘robot psychology,’ in which what would otherwise seem horrifying acts can be carried out coldly.” This desensitizing process may be necessary to help soldiers carry out combat operations and cope with the horrors of war, yet it illustrates that robots are held up as the ultimate killing machines.

I personally believe we are at the beginning of the era of robotics, during which robots will become increasingly present in our everyday lives. I only hope that this era and that the robots we develop, will be remembered for more than simply being the ultimate killing machines.

 



tags: , , , , , ,


Mike Hamer





Related posts :



Sense Think Act Pocast: Erik Schluntz

In this episode, Audrow Nash interviews Erik Schluntz, co-founder and CTO of Cobalt Robotics, which makes a security guard robot. Erik speaks about how their robot handles elevators, how they have hum...
19 October 2021, by and

A robot that finds lost items

Researchers at MIT have created RFusion, a robotic arm with a camera and radio frequency (RF) antenna attached to its gripper, that fuses signals from the antenna with visual input from the camera to locate and retrieve an item, even if the item is buried under a pile and completely out of view.
18 October 2021, by

Robohub gets a fresh look

If you visited Robohub this week, you may have spotted a big change: how this blog looks now! On Tuesday (coinciding with Ada Lovelace Day and our ‘50 women in robotics that you need to know about‘ by chance), Robohub got a massive modernisation on its look by our technical director Ioannis K. Erripis and his team.
17 October 2021, by
ep.

339

podcast

High Capacity Ride Sharing, with Alex Wallar

In this episode, our interviewer Lilly speaks to Alex Wallar, co-founder and CTO of The Routing Company. Wallar shares his background in multi-robot path-planning and optimization, and his research on scheduling and routing algorithms for high-capacity ride-sharing. They discuss how The Routing Company helps cities meet the needs of their people, the technical ins and outs of their dispatcher and assignment system, and the importance of public transit to cities and their economics.
12 October 2021, by

50 women in robotics you need to know about 2021

It’s Ada Lovelace Day and once again we’re delighted to introduce you to “50 women in robotics you need to know about”! From the Afghanistan Girls Robotics Team to K.G.Engelhardt who in 1989 ...
12 October 2021, by and

Join the Women in Robotics Photo Challenge

How can women feel as if they belong in robotics if we can't see any pictures of women building or programming robots? The Civil Rights Activist Marian Wright Edelson aptly said, "You can't be what yo...
12 October 2021, by





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association