news    views    podcast    learn    |    about    contribute     republish    

DARPA Virtual Robotics Challenge results


The first competition of the DARPA Robotics Challenge (DRC) was a software simulation of humanoid rescue work. The 6 best teams were to be allocated ATLAS robots for the next stage of the challenge, but there’s been an interesting change. Gill Pratt, the DRC program manager, and Nate Koenig, the CTO of OSRF, will be on reddit from 1:00 – 2:00 PM ET today (June 27) to discuss the results of the Virtual Robotics Challenge (VRC) and the future of the DARPA Simulator with the community.

In the Virtual Robotics Challenge (VRC), teams competed in a simulated suburban obstacle course. Twenty-six teams from eight countries qualified for the VRC, which ran from June 17-21, 2013. Competing teams applied software of their own design to a simulated robot in an attempt to complete a series of tasks that are prerequisites for the next stages of the grand challenge.

Gill Pratt: “Typically in a disaster there is no time for training, no time to acquire specialized tools; you have to use what you have on hand and if you want the robot to respond immediately, the important thing is for that interface between the person and the robot to be intuitive so the people in the disaster response team who have the most expertise about what needs to be done can utilize the robot [and not depend on the people who built it].”
Q: What will the operators be seeing when they run the simulation? Is it a graphical user interface with a monitor and a camera?Gill Pratt: “Here’s what’s so neat: DARPA and OSRF get to see an overhead view of everything from any viewpoint that we want. Contestants are only fed data from sensors on the robot, and it is completely up to them to decide what kind of user interface and operator  control interface they choose to give themselves. We are expecting them to innovate the solution for what that interface is to look like. We’re just giving them the data from the sensors on the virtual robot itself. “

Gill Pratt: “The reason we wanted to have this virtual challenge is that we wanted to open the contest to teams that were strong not just in both building hardware for robots and programming them with software, but to include a wide variety of teams including those that had experience with just software. So for those teams whose strength is primarily software, we are having this contest in simulation. They will essentially be programming and interacting with a robot that we will provide for the people who will do the best in the contest, which is a robot called Atlas that was designed by Boston Dynamics. The government, at its expense, will give up to six teams who do the best in the VRC this robot to use in the [final] event itself.”

While DARPA had only allocated resources for the top six teams to move through, a combination of good sportsmanship and generosity will see members of the top nine teams move forward:

  1. Team IHMC, Institute for Human and Machine Cognition, Pensacola, Fla. (52 points)
  2. WPI Robotics Engineering C Squad (WRECS), Worcester Polytechnic Institute, Worcester, Mass. (39 points)
  3. MIT, Massachusetts Institute of Technology, Cambridge, Mass. (34 points)
  4. Team TRACLabs, TRACLabs, Inc., Webster, Texas (30 points)
  5. JPL / UCSB / Caltech, Jet Propulsion Laboratory, Pasadena, Calif. (29 points)
  6. TORC, TORC / TU Darmstadt / Virginia Tech, Blacksburg, Va. (27 points)
  7. Team K, Japan (25 points)
  8. TROOPER, Lockheed Martin, Cherry Hill, N.J. (24 points)
  9. Case Western University, Cleveland, Ohio (23 points)

In all a total of 7 teams will receive funding and an ATLAS robot to compete in the DRC Trials in December 2013. DARPA is also funding several other “Track A” teams, like CMU, Raytheon and JPL, to construct their own robot and compete in the Trials.

In a demonstration of good sportsmanship, Jet Propulsion Laboratory, which also has a DARPA-funded Track A effort with its own robot, decided to merge its two efforts and offer the bulk of the resources it earned in the VRC to other teams. DARPA split the freed resources between the 7th and 8th ranked teams. The robot associated with the JPL win and some funding now goes to TROOPER (Lockheed Martin).

As well, additional funds are being allocated to a newly formed team of Team K and Case Western. That team, now known as HKU, will use an ATLAS robot generously donated to it by Hong Kong University to participate in the DRC Trials in December. In total, 7 teams, combining members of the top 9 teams, will move on, with ATLAS robots and DARPA support, to the December round of the DRC, where they will compete with other teams with their own robots.

From the DARPA press release:

VRC teams were evaluated based on task completion and effective operator control of the robots in five simulated runs for each of three tasks (15 total timed runs) that addressed robot perception, manipulation and locomotion. The tasks included: entering, driving and exiting a utility vehicle; walking across muddy, uneven and rubble-strewn terrain; and attaching a hose connector to a spigot, then turning a nearby valve. To simulate communications limitations in a disaster zone, the VRC imposed a round trip latency of 500 milliseconds on data transmission, and varied the total number of communications bits available in each run, from a high of 900 megabits down to 60 megabits.

To conduct the VRC, DARPA funded the Open Source Robotics Foundation to develop a cloud-based simulator that calculates and displays the physical and sensory behaviors of robots in a three- dimensional virtual space, in real time. The simulator allowed teams to send commands and receive data over the Internet to and from a simulated ATLAS robot—information very similar to what would be sent between a physical robot and its operator in the real world.

“The VRC and the DARPA Simulator allowed us to open the field for the DARPA Robotics Challenge beyond hardware to include experts in robotic software. Integrating both skill sets is vital to the long- term feasibility of robots for disaster response,” said Gill Pratt, DRC program manager. “The Virtual Robotics Challenge itself was also a great technical accomplishment, as we have now tested and provided an open-source simulation platform that has the potential to catalyze the robotics and electro- mechanical systems industries by lowering costs to create low-volume, highly complex systems.”

Additional video and images of the simulation and teams’ runs are available at: and on

Andra Keay robot startup strategist.. read more

comments powered by Disqus

Presented work at IROS 2018 (Part 1 of 3)
November 12, 2018

Are you planning to crowdfund your robot startup?

Need help spreading the word?

Join the Robohub crowdfunding page and increase the visibility of your campaign