There is a lot of talk in the blogosphere about Western use of robots in war, but not much on how someone would fight said robots. The latest story (via MindHacks) is a post on DARPA wanting to have robots with human-like decision making.
How would a group of humans fight nascent artificial intelligence (AI) and automated killing machines?
I was thinking about this the other day after dwelling on whether robots could have morality. I’d imagine this is a common line of thought in households where a roomba bangs into your foot while cleaning. So … come and join me for some off-the-wall thinking and frankstein scaremongering (and I’m definitely not the first).
Firstly, let us imagine a robot reactionary organisation similar to the Birchers, but instead of John Birch imagine the organisation is called the Robert Williams Society (though in reality, robots have been killing humans for much longer. Williams’ death was perhaps the first unintentional robot death). The Robert Williams Society dedicates itself to fighting AI and robots. Pretty far fetched it seems. But then again maybe not, maybe it already began with a lone yo-yo.
Are contemporary robots a threat as our wacky murderous friend Ted thought? Probably not to us at this stage, but human-controlled robots are definitely threats to individuals in warzones. It wouldn’t surprise me if there are nascent anti-war robot groups similar to my imaginary aforementioned Robert Williams Society (perhaps of an Islamic or anti-Western flavour?). The wikipedia page for death by industrial robot contains two people, yet the page for deaths by robot in total was deleted a few months back.
Ah, those wikipedia deletionists, obviously they see a future trend of too many entries, and therefore the category becomes meaningless.
It’d be immensely interesting to see the statistics on death by robots in war over the last few years. I’d wager the deaths would look like an exponential graph. Check out this page on the Predator UAV operations. This missile-firing mechanical duck of the skies is straight out of a violent Warner Brothers cartoon, but in this case the Elmer Fudds wear keffiyehs.
One could argue that contemporary military robotics are merely an extension from the tools long ago when we first picked up a rock and smashed open a fellow caveman’s head. But that sort of thinking leads us into what’s know as ‘heap arguments’ or the Sorites paradox, e.g. when do we draw the line between saying there is no longer a tool, and there is an autonomous device separate from humans entirely? When do AI and robots get their own branch on the phylogenetic tree? One dividing line is the notion of decision making. They’ll be considered separate from the us when they can decide on their own when, and when not, to kill.
This is where the connection between morality and AI coalesces and where we can start to think about how a Robert Williams Society would fight robots (though see here for a short argument as to why AI may not have intelligence as we define it). Part of AI decision making is reasoning ability. Let’s assume from now on that the AI researchers solve the problem of combinatorial explosion. The decision by the machines is a moral one, insofar as they are partaking in a specific type of reasoning: moral reasoning (what they should do). The sentient machine has to make a split second decision as to whether that group of people is a wedding party or a group of terrorists, then decide whether to attack. Anyone who has taken a basic ethics course can see the problem here. There is a fact-value distinction. How does the machine derive what it should do based on sensory data of what is? Typically this problem has been solved by philosophers in three ways:
(1) Values are derived from emotional responses to facts.
(2) Values are found within facts by a process of intuition, e.g. We maximize pleasure through helping an old lady across the road (a fact). Therefore it is a good thing (value).
(3) Within our decision making process we include a prescriptive statement (P1) and a descriptive statement (P2) as premises, followed by a prescriptive conclusion (C1). Thus the argument from P1 & P2 to C1 is logically valid.
There are of course problems with all these solutions, as discussed by many philosophers. But that is too much to write about here. My focus is on how to fight robots. Let’s assume our future AI doesn’t have a thinking system based on emotions (hard to believe considering reason is inherently tied to our emotions, but I digress). Solution number three looks the most likely way that near-future robots will make decisions.
The robots will probably have some form of Kantian imperative (deontological ethics). That is to say, they’ll be programmed with some form of act to kill or not kill when certain facts are met. This would seem to fit into current robotic paradigms. So we’ve come to a conclusion how autonomous robots make a decision. How do we exploit that thinking process? As per Sun Tzu, the highest form of strategy is attacking the opponent’s plan, or their thinking and decision making process. Here’s one way to attack it:
If a robot contains Kantian imperatives to do things based on certain facts, then the robot will contain a number of distinct prescriptive values. For instance a robot may be programmed to not kill children. The same robot may also be programmed to kill an armed human that is pointing a weapon at the robot. What if the armed person is a child? What decision does it then make? In moral reasoning these are value conflicts. The stanford encyclopedia of philosophy has a good standard form of these sorts of arguments. They are outlined as follows:
(1) The robot ought to do A.
(2) The robot ought to do B.
(3) The robot cannot do both A and B.
(4) (1) does not overrided (2) and (2) does not override (1).
There are of course some fixes to these arguments that are explained in the above link, nonetheless I think that such use of paradox is key to fighting AI when combined with other strategies. Other lingering questions also remain though. Could the robot be aware enough to reprogram their Kantian imperative? How do you find the prescriptive values?What if the AI was using a logic system that was successful in dealing with paradoxical information? Perhaps a discussion for another time.
So, our first main strategy against robots is the use of paradox to confuse robot reasoning. I consider this a weak strategy compared to my second strategy. This is because of Moravec’s paradox. In essence, AI systems reason faster than their sensory and motor systems. Sensory computation demands much more on a system than reasoning processes.
The ability to tie up computation processes will become essential, as sensors are the primary means of gathering information. Near-future wars against robots will become perception wars. For example, let’s take the same child example from above. This time around the child is not armed with a gun, but they are armed with deceptively hidden suicide bomb. However, pattern recognising machine vision might eventually notice this, so the blur between what is real and what isn’t will become essential to the human deceivers. Machine learning, the process of how computers learn, is made up of a few areas, but the main two are statistics and epistemology. The ability to thwart these two areas will be the thrust of such a strategy. It’ll be about spamming the vast number of sensors and data mining capabilities with chaff, contradictory information, and bad data. Not that much different to what happens in war now. The Clausewitzian Colin Gray would agree; war with robots will probably be just like war now.
A third strategy will be attacking the gap between the military and their new toys (I’m assuming that the robots don’t rise up against them, and that like my statement above about the perennial nature of warfare that these autonomous killing machines will be killing the same third-world guerrillas). Striking this air gap is going to be essential. Take this hilarious entry on wikipedia about robotic sentries on the border of Korea:
In 2006, Samsung Techwire, a subsidiary of Samsung Group, announced a $200,000, all weather, 5.56 mm robotic machine gun to guard the Korean DMZ. It is capable of tracking multiple moving targets using IR and visible light cameras, and is under the control of a human operator. The Intelligent Surveillance and Guard Robot can “identify and shoot a target automatically from over two miles away.” … It is also equipped with communication equipment (a microphone and speakers), “so that passwords can be exchanged with human troops.” If the person gives the wrong password, the robot can “sound an alarm or fire at the target using rubber bullets or a swivel-mounted K-3 machine gun.” South Korea’s 3,500 soldiers in Iraq are “currently using robot sentries to guard home bases.”
The amount of deception opportunities abound, e.g. North Koren special forces and sappers –with a history of being most excellent at deception — sneak up, tape the password, if caught after this they can use the password. Then they could go about re-programming the sentries to fire on their own side by cutting off comms with the human operator and re-installing their own command and control. A lot of effort, but I think it could be done.
So, summing up we have three strategies:
(1) Make use of paradox to confuse robotic reasoning.
(2) Make use of deception to thwart sensors.
(3) Attack the gap between Human-computer interaction.
I could think of many problems with these arguments. One striking example is the trend of singular robots to become swarms. This is also known as physicomimetics. From wiki:
In response to growing concerns that single, monolithic robotic vehicles are expensive, brittle, and vulnerable, there has been a trend toward the development of distributed networks of small, inexpensive vehicles. The capability of these networks to dynamically monitor and sense environmental conditions, while maintaining cost-effectiveness, robustness, and flexibility, is considered to be among their greatest assets.
Vast swarms of robots, a quantitative shift from the qualititative AI, is something I haven’t considered here. One possible solution could be scalable swarm-robotics. Backyard counter-robotics networks, similar to tinkering networks.
Posted in Random Thoughts
Tags: military robotics, robotics, warfare