Vision, force and touch for manipulation

22 July 2010

share this:

Manipulating objects is still a major challenge for robots in human-centered environments. To overcome this hurdle, Prats et al. propose to combine vision, force and tactile sensing to achieve robust and reliable manipulation with a robot arm fitted with a 3-finger hand (see video below).

Using three sensing modalities increases the robustness of the system, especially since each sensor taken alone has its shortcomings. For example, vision can be used to track a manipulated object and can therefor be used to control manipulation. However, vision is sometimes badly calibrated or occluded. Furthermore, forces applied to the robot arm can be measured to make sure the efforts are focussed in the right direction. However, if the robot does not have a good grip on the object it is manipulating, this might cause it to slip. Adding tactile sensing instead is useful to feel the object manipulated and readjust the position of the manipulator when errors occur.

To prove their point, Prats et al. test different combinations of all three sensor modalities on a tricky task for robots, opening a sliding door. In the end, it seems that a combination of vision, force and tactile sensing saves the day.

Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory
Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory

Related posts :

Women in Tech leadership resources from IMTS 2022

There’ve been quite a few events recently focusing on Women in Robotics, Women in Manufacturing, Women in 3D Printing, in Engineering, and in Tech Leadership. One of the largest tradeshows in the US is IMTS 2022. Here I bring you some resources shared in the curated technical content and leadership sessions.
29 September 2022, by and

MIT engineers build a battery-free, wireless underwater camera

The device could help scientists explore unknown regions of the ocean, track pollution, or monitor the effects of climate change.
27 September 2022, by

How do we control robots on the moon?

In the future, we imagine that teams of robots will explore and develop the surface of nearby planets, moons and asteroids - taking samples, building structures, deploying instruments.
25 September 2022, by , and

Have a say on these robotics solutions before they enter the market!

We have gathered robots which are being developed right now or have just entered the market. We have set these up in a survey style consultation.
24 September 2022, by

Shelf-stocking robots with independent movement

A robot that helps store employees by moving independently through the supermarket and shelving products. According to cognitive robotics researcher Carlos Hernández Corbato, this may be possible in the future. If we engineer the unexpected.
23 September 2022, by

RoboCup humanoid league: Interview with Jasper Güldenstein

We talked to Jasper Güldenstein about how teams transferred developments from the virtual humanoid league to the real-world league.
20 September 2022, by and

©2021 - ROBOTS Association


©2021 - ROBOTS Association