Prof Noel Sharkey on Autonomous Robots: “we don’t want to sleepwalk into further technological disasters” #NIHRF

Prof Noel SharkeyNorthern Ireland-born Prof Noel Sharkey from University of Sheffield’s Centre for Robotics addressed a crowd of forty who had managed to battle through the disrupted Belfast traffic to St Mary’s University College this evening. (Older readers may remember him from BBC Two’s Robot Wars!)

As part of the NI Human Rights Festival, he delivered a talk on

From War to Surveillance: Human Rights and Autonomous Weapons

Sharkey began by explaining the scale and scope of military drones which he described as “more surgically precise than flying over with a B52 bomber” but still not precision weapons.

He believes that the CIA have around 80 drones in their air force, and hints at a UK role in the transit of signals from drone operators in the US to the countries in which drones are operating.

But Sharkey believes that even worse than human-guided drones is the removal of humans from the loop: programming aerial vehicles to fly themselves, identify targets and fire weapons.

While a advocate for the good that robots can do, Sharkey is very uncomfortable with “killer robots”. What computer can distinguish between someone holding a firearm and a child holding a toy gun. He argues that human rights are at risk when computer systems cannot be proportionate and lack situational awareness and deliberative reasoning.

Autonomous robots aren’t just up in the air. A robotic submarine to sink other submarines is being developed along with all-terrain armed vehicles that have already competed in DARPA challenges.

campaign to stop killer robots logoTogether with other activists, the Campaign to Stop Killer Robots (@stoptherobotwar) was formed and has succeeded in getting expert meetings staged through the Convention on Conventional Weapons (CCW, or more formally the Convention on Prohibitions or Restrictions on the Use of Certain Conventional Weapons) at the UN to look into the total prohibition of lethal autonomous robots. Since human-controlled drones are already deployed, some countries are unwilling to even debate restrictions on their use. So the campaign focuses on future weaponry, autonomous robots.

CCWThough Sharkey notes that even if a restriction on the use of these lethal weapons in war was agreed, it would not extend to use by police in day-to-day society.

Sharkey is struck by what at first seem innocuous uses of drones that lead to civilian loss of privacy during surveillance operations. He talked about freedom of information requests discovering that drones were being used to police mundane crimes such as fly posting rather than serious criminal activity.

Back in March 2013, the then PSNI Chief Constable Matt Baggott explained to me in an interview why the local police force was buying drones.

Matt Baggott drones blog post snippetFairly inoffensive, peaceful robots can be quickly repurposed for military and lethal means. Sharkey says “the internet took us by surprise”. The original academic network held no clues to today’s commercial use of the internet: spying on people, supporting the selling pornography and allowing paedophilic images to be swapped.

We don’t want to sleepwalk into further technological disasters.

Sharkey talked about the lack of rigour in existing methods of targeting “combatants” in war zones, which could only get worse without human oversight.

Professionally well informed about robotics through his years of academic research, Prof Sharkey is very suspicious of the perils of autonomous weapons. At times he comes across as alarmist, and his exaggerated and imprecise language weaken his message.

But behind the superlatives, Sharkey is picking out abuses that can be predicted today and highlighting the need for further analysis and debate. Though he admits that he may not still be living if and when the UN ever manage to ban “killer robots” under the CCW.

In the Q&A after Sharkey’s illustrated talk, one member of the audience asked if we – society at large – weren’t complicit in accelerating the development of drones technology and its onward application to autonomous robotic vehicles through increased consumer purchase and use.

In my opinion, the reality is that there are good uses and evil abuses of all technology. Civilian and commercial applications have military use, and vice versa. Holding governments to account and upholding ethical standards is the difficult problem …

Look out for an article on Prof Noel Sharkey in the Irish News this week.