It's a mug's game: Watch AI robot grab a cuppa it hasn't seen before | 9/11/2018 | Staff
gbabii05 (Posted by) Level 3
Click For Photo:

Video A trio of researchers have trained a robot that can pick up new objects it hasn’t seen before.

It’s a trivial task for humans yet an incredibly complex one for machines. When people reach out to grab a mug, it’s common sense to hold it by its handle - it doesn’t matter if the mug is upright, upside down, or tipped on its side. But for robots it’s much more difficult, they can get confused by the different orientations, or distracted by things like the background or lighting conditions.

Researchers - Massachusetts - Institute - Technology - MIT

Researchers at Massachusetts Institute of Technology (MIT) have built a system where you can direct the robot to grasp the object at a specific point. In the experiments, the researchers play with three objects: shoes, hats, and mugs. They train the robot to grab the shoe by its tongue, the hat by its brim, and the mug by its handle.

"Many approaches to manipulation can’t identify specific parts of an object across the many orientations that object may encounter,” said Lucas Manuelli, co-author of the research paper out on arXiv and a PhD student at MIT.


You can watch it in action here.

After the robot is trained, it learns to pick up all shoes by their tongues even if it hasn’t seen that exact shoe before. At the robot’s heart is a computer vision system made up of convolutional neural networks known as Dense Object Nets (DON).

Camera - Robot - Arm - Swivels - Hovers

First, a camera attached to the robot arm swivels around and hovers over the shoe to scan it in different orientations. This creates a video from which image stills can be analyzed. The goal is to create what the researchers call a “dense visual...
(Excerpt) Read more at:
Wake Up To Breaking News!
Been there, done that, twice...
Sign In or Register to comment.

Welcome to Long Room!

Where The World Finds Its News!