Robohub.org
 

Amazon Picking Challenge


by
05 November 2014



share this:
amazon_pick_banner_robot

In September 2014 Amazon announced the Amazon Picking Challenge, a new robot manipulation contest as part of the ICRA robot challenges. The idea was to take a difficult problem from the warehouse order-fulfillment industry and see how far contestants can get applying innovative robotics research. The challenge is centered around a problem the robotics community has been chipping away at for decades: picking various, distinct items off of a shelf under uncertain conditions. The location of the item is only known within a few dozen centimeters, and only vague high-level information is known about the item itself. The challenge description has obvious roots in warehouse fulfillment, but this is clearly a generic task robots need to get better at to be useful in a variety of everyday contexts.

When inventory comes into an Amazon warehouse it is singulated (pulled apart into individual items a customer might purchase) and stocked into shelves, and the location of the item is tagged in a warehouse management system. Later, when the item is ordered, a person is directed to the shelf that contains this item and picks it off. Shelves are often stocked as densely as possible to maximize the value of the warehouse. In a system that handles millions of different products, it is economical to store a variety of items in the same space. The resulting mixed and cluttered bin is relatively easy for a human to work with, but poses a challenge for traditional automation systems.

We might have an idea of what the item ordinarily looks like beforehand, but perhaps this time the packaging has changed color, the manufacturer has added an extra plastic bag to protect it, or it is folded in half inside the bin. Products in an Amazon warehouse have a wide range of visual and physical properties. A real product is rarely just a simple brown cardboard box. It could be a large stuffed animal, a floppy bag of rice, a package of cookies (cookies are more appetizing in their un-crushed state), a necklace, or a small USB stick. The goal in creating this challenge was to clearly define a simplified but applicable version of the real world problem.

The ICRA challenge lists 27 different items that will be randomly stocked inside of a pre-defined shelf structure. The challenge carefully avoids putting constraints on the solution space. The goal of this first challenge year is not to drive toward any one specific software or hardware architecture, but to provide the robotics community with a difficult, real-world problem. The human arm has 7 degrees-of-freedom, but is this really the best configuration to complete such a task? Robot end-effector designs are undergoing a renaissance (as evidenced by the variety of new gripper companies appearing each year), but which design fits well in tight spaces? Perhaps calling this the ‘Picking’ challenge was misleading. Pick and place is a convenient categorization for robotics, but observation of human strategies in these tasks has shown that human manipulation is far more nuanced than the simple approach-grasp-retreat paradigm we traditionally see in a robot. Humans take advantage of many different environmental constraints to perform the task effectively.

meta_items2

The response from the community so far has been fantastic. Over 150 people have signed up for the contest email list, and three robot distributors have agreed to bring base platforms if necessary for teams that can’t bring their own bot (Rethink Robotics with the Baxter Research Robot, Clearpath Robotics with the PR2 Robot, and Olympus Controls with the UR5). We hope this is the beginning of a fun and fruitful event that helps bring together subdomains of robot manipulation to accomplish some very cool tasks. We look forward to seeing everyone at ICRA in 2015!

The first deadline for the challenge is to submit a video this year to receive free challenge supplies in the mail (items and a shelf). Learn more at: http://amazonpickingchallenge.org.



tags: , , ,


Joe Romano Joe is a Research Scientist developing next-generation robotic platforms at Kiva Systems in North Reading, Massachusetts. Prior to Kiva, Joe was part of the engineering team that brought Rethink Robotics Baxter Robot to life.
Joe Romano Joe is a Research Scientist developing next-generation robotic platforms at Kiva Systems in North Reading, Massachusetts. Prior to Kiva, Joe was part of the engineering team that brought Rethink Robotics Baxter Robot to life.





Related posts :



Social media round-up from #IROS2025

  27 Oct 2025
Take a look at what participants got up to at the IEEE/RSJ International Conference on Intelligent Robots and Systems.

Using generative AI to diversify virtual training grounds for robots

  24 Oct 2025
New tool from MIT CSAIL creates realistic virtual kitchens and living rooms where simulated robots can interact with models of real-world objects, scaling up training data for robot foundation models.

Robot Talk Episode 130 – Robots learning from humans, with Chad Jenkins

  24 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Chad Jenkins from University of Michigan about how robots can learn from people and assist us in our daily lives.

Robot Talk at the Smart City Robotics Competition

  22 Oct 2025
In a special bonus episode of the podcast, Claire chatted to competitors, exhibitors, and attendees at the Smart City Robotics Competition in Milton Keynes.

Robot Talk Episode 129 – Automating museum experiments, with Yuen Ting Chan

  17 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Yuen Ting Chan from Natural History Museum about using robots to automate molecular biology experiments.

What’s coming up at #IROS2025?

  15 Oct 2025
Find out what the International Conference on Intelligent Robots and Systems has in store.

From sea to space, this robot is on a roll

  13 Oct 2025
Graduate students in the aptly named "RAD Lab" are working to improve RoboBall, the robot in an airbag.

Robot Talk Episode 128 – Making microrobots move, with Ali K. Hoshiar

  10 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Ali K. Hoshiar from University of Essex about how microrobots move and work together.



 

Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


 












©2025.05 - Association for the Understanding of Artificial Intelligence