Robohub.org
 

Repeatable robotics: Standards and benchmarks from frontier science to applied technology

by
23 July 2015



share this:

factory_Making_robotsIn a recent article in Frontiers in Robotics and AI, Gianluca Antonelli suggests that the Grand Challenge of robotics is to systematize the way its research is conducted. At Robohub we believe this is an important topic that needs to trace the arc between academia, R&D and even commercial territory. Robotics is so fundamentally multidisciplinary that traditional scientific methods can be hard to apply, and lab experiments difficult to validate, reproduce, or even adequately catalogue within the confines of traditional journal publications.

Is robotics a science, or is it a technology, and how do we demonstrate/benchmark either? Scientific method exists to test science; standards and regulations exist to benchmark technologies. Researchers face the issue of repeatability at the experimental level. Product developers face the issue at the prototype level, and producers of consumer product face the issue at a commercial level. Robotics is an emerging technology – caught between the research lab and the real world – and frequently falls into the abyss between.

Publishing and peer review alone cannot keep pace with the full spectrum robotics developments, and not everything can be contained in a paper. Indeed, robotic systems entwine both the physical and the non-physical in ways that are difficult to catalogue entirely in journal format. For example, code can not be adequately cited or valued academically, yet is fundamental to robotics and AI research. At the same time, standards and regulatory frameworks push robotics in certain directions that might not be optimal. As open source code increasingly becomes the foundation for commercial products, the need to ensure repeatability, robustness and validation becomes essential, not just for commercially scaled producers, but for regulators as well.

At the same time, academic development requires flexibility, creativity, and unboundedness. How else could you mix chemistry and robotics, as in the recent paper on designing soft jumping robots published in Science? Breakthroughs require state-of-the-art knowhow that is sometimes difficult to reproduce outside the original lab setting, but shows potential for developments further down the line.

We know the robotics community understands this need, hence the call for research benchmarks, competitions, current ROS efforts, and new standards for collaborative robotics. But approaches are fragmented and neither widely established nor confirmed. We believe it is time to review these issues, and to examine the various solutions proposed to date. Over the next several months Robohub will be delving more deeply into how these issues are being played out between the research lab and the real world.

Interested in participating in the discussion? Leave your comments below, or send a draft proposal to info[at]robohub.org.

Relevant links:

http://clawar.org/towards-standarised-experiments-in-human-robot-interactions/

http://www.robot-standards.eu/

http://rockinrobotchallenge.eu/

http://www.ros.org/



tags: , , ,


Robohub Editors





Related posts :



Breaking through the mucus barrier

A capsule that tunnels through mucus in the GI tract could be used to orally administer large protein drugs such as insulin.
02 October 2022, by

Women in Tech leadership resources from IMTS 2022

There’ve been quite a few events recently focusing on Women in Robotics, Women in Manufacturing, Women in 3D Printing, in Engineering, and in Tech Leadership. One of the largest tradeshows in the US is IMTS 2022. Here I bring you some resources shared in the curated technical content and leadership sessions.
29 September 2022, by and

MIT engineers build a battery-free, wireless underwater camera

The device could help scientists explore unknown regions of the ocean, track pollution, or monitor the effects of climate change.
27 September 2022, by

How do we control robots on the moon?

In the future, we imagine that teams of robots will explore and develop the surface of nearby planets, moons and asteroids - taking samples, building structures, deploying instruments.
25 September 2022, by , and

Have a say on these robotics solutions before they enter the market!

We have gathered robots which are being developed right now or have just entered the market. We have set these up in a survey style consultation.
24 September 2022, by

Shelf-stocking robots with independent movement

A robot that helps store employees by moving independently through the supermarket and shelving products. According to cognitive robotics researcher Carlos Hernández Corbato, this may be possible in the future. If we engineer the unexpected.
23 September 2022, by





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association