A US military demonstration of autonomous technology
US Army Photo/Alamy
The US, China and Russia are expected to undermine attempts to enact a global ban on autonomous weapons at a conference this week. Such weapons are becoming an increasingly common feature of modern conflict, but are criticised as presenting an unacceptable risk to civilians and muddying the waters of accountability in war.
The Convention on Certain Conventional Weapons (CCW) is a United Nations treaty binding together 128 states to regulate excessively harmful or indiscriminate weapons. The treaty’s five existing protocols ban incendiary weapons, bombs that create shrapnel that can’t be detected by X-rays and lasers designed to blind soldiers – weapons that the global community has decided are beyond the pale.
For more than 10 years, states have debated adding autonomous weapons to the list. Members meet every five years to discuss what changes may be needed to the treaty, and this week the seventh such Review Conference is being held in Geneva. But there have been few signs of progress and efforts to bind parties to promises of action look set to fail.
The use of AI is common in militaries around the world, helping to pick targets among overwhelming piles of intelligence data and automating certain functions of weapons, including steering missiles and drones.
Humans are usually in the loop at some point, but on at least one occasion to date, fully autonomous drones have been used without human oversight to kill enemy soldiers. A senior figure in the Ukrainian defence industry told New Scientist earlier this year that a test took place two years ago that lead to two deaths.
It is that sort of weapon, where human input is minimal or non-existent, that most worries campaigners like Elizabeth Minor at pressure group Stop Killer Robots. “Machines shouldn’t make life and death decisions. Tasking weapons systems or algorithms to identify targets and kill people is just a moral red line we shouldn’t be crossing,” she says.
Over the past three years, work has gone on behind the scenes in the CCW to lay out the groundwork for a ban. Peru, as chair of the conference, has proposed that negotiations should start on a protocol and that work to create that ban should finish within two years.
Minor says 130 countries support a ban or restrictions on autonomous weapons, and more than 70 are ready to begin negotiations. But she warns that the US, Russia and China, as well as other nations including the UK, Japan and South Korea, are likely to block such efforts. “What we’ll obviously see as the week goes on, unfortunately, is the weakening of this text [from Peru] at the behest of larger militarised states who want to continue to see these weapons unregulated,” she says.
Discussions are likely to run late into the night on 20 November and deliberations aren’t open to the public, with an announcement expected on 21 November. The CCW operates on unanimity, meaning that just one state can stymie action.
The US has already proposed at the meeting that further work should be carried out to investigate how existing international law applies to autonomous weapons, arguing that an update to the CCW is unnecessary, and essentially kicking the can down the road on a potential ban until the next meeting in 2031.
Aurel Sari at the University of Exeter, UK, says autonomous weapons already fall under existing law around armed conflict, meaning those who use them must avoid attacks that would cause excessive collateral damage and take all feasible precautions to spare civilians. An autonomous weapon that can’t be used in line with these rules is already unlawful. But none of these existing laws ban their use, and Sari sees hurdles in the way of greater regulation.
“Supporters of a ban want to stop weapons that select and attack targets in ways their operators cannot predict or control. Meanwhile, states that operate defensive systems that react faster than any human can, such as systems protecting warships against incoming missiles automatically, do not want to see these prohibited,” says Sari. “A ban wide enough to meet the first concern risks also capturing these defensive systems, while a ban narrow enough to win the support of the major military powers might prohibit little that anyone intends to field.”
Because of this, the leading states that are developing these systems, among them the US, Russia and China, have different strategic priorities from others, says Sari.
“None of the major powers wants an agreement that would hand its rivals an advantage on the battlefield. A wide-ranging ban would appeal to them only if all their rivals observed it as well. That would require states to agree on exactly what the ban covers, to close the loopholes and to establish a reliable way of checking compliance,” says Sari. “None of these seems achievable at present.”
Countries are already using these weapons, but there is still time to act, says Minor. “I wouldn’t say that we’re too late to make rules. You can do this at any point. And there is still time to have a meaningful response to this that can prevent things going down an even worse path, but that depends on the international community really acting now.”
That could mean side-stepping the CCW entirely and taking the issue to the UN General Assembly, where you only need a majority to start negotiations on a treaty. “But they need to do it now otherwise we’ll just keep seeing this dynamic of a race to the bottom for these capabilities,” says Minor.
Source: New Scientist · Matthew Sparkes
At a glance
- Topic
- Technology
- Country
- 🇬🇧 GB
- Publisher language
- EN
- Added to Allnira