Robohub.org
 

Place recognition and localization with omnidirectional vision

by
09 May 2011



share this:

Let’s say you just purchased a new service robot and you want it to be able to know its way in your apartment. The obvious thing to do would be to show it around, going from room to room saying “this is the living room” and “this is the kitchen”. The robot, equipped with an omnidirectional camera, could then take pictures along the way while recording its location. This will build-up its visual memory of the apartment. The challenge for the robot next time around is to figure out in what room it is (place recognition) and where it is in this room (localization) based on its current view of the world.

This requires finding a good way to compare new images to the robot’s visual memory. The comparison needs to be robust to robot motion, objects changing place and transformations required to use omnidirectional images. As a solution, Labbani-Igbida et al. propose to compute signatures for each omnidirectional image based on invariant Haar integrals. Signatures are numbers that capture distinctive features in the image (color, shape, texture, interest points…). By comparing signatures between images (similarity), the robot is able to determine in what room it is and at what location much faster than having to process the raw images.

Experiments were conducted using a Koala robot equipped with a paracatadioptric omnidirectional sensor. The robot was first placed in different rooms of an office environment where it took images to build a visual memory. The robot was then set loose to explore the office including places in the environment that had not been previously visited during the memory building phase.

Results show that the robot is able to do space recognition and localization in ways that outperform or perform similarly to state-of-the-art algorithms while being very time and memory efficient. In the future, authors would like to limit the number of images needed for the robot to build its visual memory.




Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory
Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory





Related posts :



Robot Talk Episode 64 – Rav Chunilal

In the latest episode of the Robot Talk podcast, Claire chatted to Rav Chunilal from Sellafield all about robotics and AI for nuclear decommissioning.
31 December 2023, by

AI holidays 2023

Thanks to those that sent and suggested AI and robotics-themed holiday videos, images, and stories. Here’s a sample to get you into the spirit this season....
31 December 2023, by and

Faced with dwindling bee colonies, scientists are arming queens with robots and smart hives

By Farshad Arvin, Martin Stefanec, and Tomas Krajnik Be it the news or the dwindling number of creatures hitting your windscreens, it will not have evaded you that the insect world in bad shape. ...
31 December 2023, by

Robot Talk Episode 63 – Ayse Kucukyilmaz

In the latest episode of the Robot Talk podcast, Claire chatted to Ayse Kucukyilmaz from the University of Nottingham about collaboration, conflict and failure in human-robot interactions.
31 December 2023, by

Interview with Dautzenberg Roman: #IROS2023 Best Paper Award on Mobile Manipulation sponsored by OMRON Sinic X Corp.

The award-winning author describe their work on an aerial robot which can exert large forces onto walls.
19 November 2023, by

Robot Talk Episode 62 – Jorvon Moss

In the latest episode of the Robot Talk podcast, Claire chatted to Jorvon (Odd-Jayy) Moss from Digikey about making robots at home, and robot design and aesthetics.
17 November 2023, by





©2024 - Association for the Understanding of Artificial Intelligence


 












©2021 - ROBOTS Association