Well, yeah. As anyone who has watched the “Terminator” movies and TV program know, we run the risk of giving over too much control to the robots. Never take your hand from their off switch 🙂

Increasingly autonomous, gun-totting robots developed for warfare could easily fall into the hands of terrorists and may one day unleash a robot arms race, a top expert on artificial intelligence told AFP.

“They pose a threat to humanity,” said University of Sheffield professor Noel Sharkey ahead of a keynote address Wednesday before Britain’s Royal United Services Institute.
Intelligent machines deployed on battlefields around the world — from mobile grenade launchers to rocket-firing drones — can already identify and lock onto targets without human help.
There are more than 4,000 US military robots on the ground in Iraq, as well as unmanned aircraft that have clocked hundreds of thousands of flight hours.
The first three armed combat robots fitted with large-caliber machine guns deployed to Iraq last summer, manufactured by US arms maker Foster-Miller, proved so successful that 80 more are on order, said Sharkey.
But up to now, a human hand has always been required to push the button or pull the trigger.
It we are not careful, he said, that could change.
[…]
“I have worked in artificial intelligence for decades, and the idea of a robot making decisions about human termination terrifies me,” Sharkey said.

BTW, the expert does make a valid point about using robots in a theater like Iraq where it might be hard to tell civilian from combatant.

Teaching a computer-driven machine — even an intelligent one — how to distinguish between civilians and combatants, or how to gauge a proportional response as mandated by the Geneva Conventions, is simply beyond the reach of artificial intelligence today.

I don’t think machines will ever get to the point that they will be able to tell the difference, we can’t do it, how can they?