Robohub.org
 

Place recognition and localization with omnidirectional vision

by
09 May 2011



share this:

Let’s say you just purchased a new service robot and you want it to be able to know its way in your apartment. The obvious thing to do would be to show it around, going from room to room saying “this is the living room” and “this is the kitchen”. The robot, equipped with an omnidirectional camera, could then take pictures along the way while recording its location. This will build-up its visual memory of the apartment. The challenge for the robot next time around is to figure out in what room it is (place recognition) and where it is in this room (localization) based on its current view of the world.

This requires finding a good way to compare new images to the robot’s visual memory. The comparison needs to be robust to robot motion, objects changing place and transformations required to use omnidirectional images. As a solution, Labbani-Igbida et al. propose to compute signatures for each omnidirectional image based on invariant Haar integrals. Signatures are numbers that capture distinctive features in the image (color, shape, texture, interest points…). By comparing signatures between images (similarity), the robot is able to determine in what room it is and at what location much faster than having to process the raw images.

Experiments were conducted using a Koala robot equipped with a paracatadioptric omnidirectional sensor. The robot was first placed in different rooms of an office environment where it took images to build a visual memory. The robot was then set loose to explore the office including places in the environment that had not been previously visited during the memory building phase.

Results show that the robot is able to do space recognition and localization in ways that outperform or perform similarly to state-of-the-art algorithms while being very time and memory efficient. In the future, authors would like to limit the number of images needed for the robot to build its visual memory.




Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory
Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory





Related posts :



Robot Talk Episode 42 – Thom Kirwan-Evans

In this week's episode of the Robot Talk podcast, host Claire Asher chatted to Thom Kirwan-Evans from Origami Labs all about computer vision, machine learning, and robots in industry.
25 March 2023, by

Resilient bug-sized robots keep flying even after wing damage

New repair techniques enable microscale robots to recover flight performance after suffering severe damage to the artificial muscles that power their wings.
23 March 2023, by

How drones for organ transportation are changing the healthcare industry

The healthcare drone industry has witnessed a dramatic surge in the last couple of years. In 2020, the market grew 30% and is expected to grow from $254 million in 2021 to $1,5 billion in 2028.
21 March 2023, by

Robotic bees and roots offer hope of healthier environment and sufficient food

Miniature robots that mimic living organisms are being developed to explore and support real-life ecosystems.
18 March 2023, by

Robot Talk Episode 41 – Alessandra Rossi

In this week's episode of the Robot Talk podcast, host Claire Asher chatted to Alessandra Rossi from the University of Naples all about social robotics, theory of mind, and robots playing football.
17 March 2023, by





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association