Robots gain lateral thinking - algorithms for smarter household help

SHARE:
February 26, 2013

Robots outside the box - teaching robots how to think laterally. MIT News Office story, Feb. 25. 2-13.

 

 

 

 

 

 

 

 

 

 

At this year’s IEEE International Conference on Robotics and Automation, students in the Learning and Intelligent Systems Group at MIT’s Computer Science and Artificial Intelligence Laboratory will present a pair of papers showing how household robots could use a little lateral thinking to compensate for their physical shortcomings. EECS senior and MIT EECS - Angle Undergraduate Research and Innovation Scholar Annie Holladay has designed an algorithm that allows a robot to use both hands to avoid the bad, error-prone track so that it can successfully place an object in what might be up to a 16-dimensional space. 

Read more in the Feb. 25, 2013 MIT News Office article by Larry Hardesty titled "Teaching robots lateral thinking. New algorithms could help household robots work around their physical shortcomings," also posted below in its entirety.


Many commercial robotic arms perform what roboticists call “pick and place” tasks: The arm picks up an object in one location and places it in another. Usually, the objects — say, automobile components along an assembly line — are positioned so that the arm can easily grasp them; the appendage that does the grasping may even be tailored to the objects’ shape.

General-purpose household robots, however, would have to be able to manipulate objects of any shape, left in any location. And today, commercially available robots don’t have anything like the dexterity of the human hand.

At this year’s IEEE International Conference on Robotics and Automation, students in the Learning and Intelligent Systems Group at MIT’s Computer Science and Artificial Intelligence Laboratory will present a pair of papers showing how household robots could use a little lateral thinking to compensate for their physical shortcomings.

One of the papers concentrates on picking, the other on placing. Jennifer Barry, an EECS PhD student in the group, describes an algorithm that enables a robot to push an object across a table so that part of it hangs off the edge, where it can be grasped. Annie Holladay, an MIT senior majoring in electrical engineering and computer science, shows how a two-armed robot can use one of its graspers to steady an object set in place by the other.

Colliding approaches

Most experimental general-purpose robots use a motion-planning algorithm called the rapidly exploring random tree, which maps out a limited number of collision-free trajectories through the robot’s environment — rather like a subway map overlaid on the map of a city. A sophisticated-enough robot might have arms with seven different joints; if the robot is also mounted on a mobile base — as was the Willow Garage PR2 that the MIT researchers used — then checking for collisions could mean searching a 10-dimensional space.

EECS PhD student Jennifer Barry and MIT EECS – Angle Undergraduate Research and Innovation Scholar Annie Holladay (right) pose with the robot for which they have developed algorithms to allow for more than just put and place functionality by the robot.Add in a three-dimensional object with three different axes of orientation, which the robot has to push across a table, and the size of the search space swells to 16 dimensions, which is too large to search efficiently. Barry’s first step was to find a concise way to represent the physical properties of the object to be pushed — how it would respond to different forces applied from different directions. Armed with that description, she could characterize a much smaller space of motions that would propel the object in useful directions. “This allows us to focus the search on interesting parts of the space rather than simply flailing around in 16 dimensions,” she says. Finally, after her modification of the motion-planning algorithm, she had to “make sure that the theoretical guarantees of the planner still hold,” she says.

By contrast, Holladay’s algorithm in some sense inverts the ordinary motion-planning task. Rather than identifying paths that avoid collisions and adhering to them, it identifies paths that introduce collisions and seals them off. If the robot is using one hand to set down an object that’s prone to tipping over, for instance, “I might look for a place for the other hand that will block bad paths and kind of funnel the object into the path that I want,” Holladay says. [Image, above left: EECS PhD student Jennifer Barry (left) and MIT EECS - Angle Undergraduate Research and Innovation Scholar Annie Holladay (right) with the Willow Garage PR2 robot for which Annie Holladay has designed new functionality to allow for more than just put and place capability. Photo courtesy MIT News Office/Allegra Boverman.] 

Like Barry, Holladay had to find a simple method of representing the physical properties of the object the robot is manipulating. In addition to the placement of tall, tippy objects, her algorithm can also handle cases in which the robot is setting an object on a table, but the object sticks to the rubber sheath of the robot’s gripper. With Holladay’s algorithm, the robot can use its free gripper to prevent the object from sliding as it withdraws the other gripper.

Independent learning

Both Barry and Holladay allow modification of their algorithms, through application programming interfaces that would allow other researchers to plug in parameters describing the physical behavior of new types of objects. But the ultimate goal is for the robot itself to infer the relevant properties of objects by lifting, shoving, or otherwise manipulating them.

Nor are the researchers concerned that hardware improvements will render their algorithmic research obsolete. “The thought is that we’re unlikely to get hands that are as flexible and dexterous as human hands, and even if we did, it would be hard to figure out the AI and planning for those,” Barry says. “So we’ll always have to think about interesting ways to grasp things.”

“You see a lot of demos where a robot might do something like slide plates, but it’s usually hard-coded for the demo: The robot knows that at this point, it needs to do this action for this particular thing,” says Kaijen Hsiao, a research scientist and manager at Willow Garage, the company that manufactures the PR2. Barry and Holladay’s research, by contrast, is “a framework for incorporating behaviors like that as a more general motion-planning problem,” she says. “Which is a very difficult thing, because it’s very high-dimensional. I think it’s really important research, and it’s very novel.”