Robohub.org
 

Driving, flying, and climbing in a sand and gravel pit


by
18 July 2016



share this:
NCFRN Field Trials 2016. Photo: Tim Barfoot

NCFRN Field Trials 2016. Grizzly in challenging lighting. Photo: Tim Barfoot

In June, the University of Toronto (as part of the NSERC Canadian Field Robotics Network) carried out a set of field trials at an old sand and gravel pit in Sudbury, Ontario, Canada. This involved three main experiments:

  1. A new version of our Visual Teach and Repeat (VT&R) approach to vision-only route following,
  2. Aerial surveys of the site using fixed-wing unmanned aerial vehicles, and
  3. A tethered robot design for mapping steep surfaces such as cliffs.

In the VT&R experiments, we taught our robot a 5 km network of interconnected paths, then carried out 120 km of autonomous repeats on these paths using only stereo vision for feedback. The below video shows some sections being repeated. Our new technique, dubbed VT&R 2.0, is a significant advance over our earlier work in that (i) it uses a Multi­-Experience Localization (MEL) technique to match live images to several previous experience of a path (making it more robust to appearance change), and (ii) is able to do place-­dependent terrain assessment to safeguard the robot and people around it, even in rough terrain with vegetation.

The team also captured some great images of the various experiments.  All images copyright Tim Barfoot or Francois Pomerleau.

grizzly2 grizzly3 grizzly4 grizzly5

All photos can be viewed here.


This video is associated with the following papers:

Paton M, MacTavish K A, Warren M, and Barfoot T D. “Bridging the Appearance Gap: Multi-Experience Localization for Long-Term Visual Teach and Repeat”. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 9-14 October 2016

Berczi L P and Barfoot T D. “It’s Like Déjà Vu All Over Again: Learning Place-Dependent Terrain Assessment for Visual Teach and Repeat”. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 9-14 October 2016



tags:


Tim Barfoot Dr. Timothy Barfoot (Professor, University of Toronto Institute for Aerospace Studies -- UTIAS) holds the Canada Research Chair (Tier II) in Autonomous Space Robotics and works in the area of guidance, navigation, and control of mobile robots for space and terrestrial applications.
Tim Barfoot Dr. Timothy Barfoot (Professor, University of Toronto Institute for Aerospace Studies -- UTIAS) holds the Canada Research Chair (Tier II) in Autonomous Space Robotics and works in the area of guidance, navigation, and control of mobile robots for space and terrestrial applications.





Related posts :



Social media round-up from #IROS2025

  27 Oct 2025
Take a look at what participants got up to at the IEEE/RSJ International Conference on Intelligent Robots and Systems.

Using generative AI to diversify virtual training grounds for robots

  24 Oct 2025
New tool from MIT CSAIL creates realistic virtual kitchens and living rooms where simulated robots can interact with models of real-world objects, scaling up training data for robot foundation models.

Robot Talk Episode 130 – Robots learning from humans, with Chad Jenkins

  24 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Chad Jenkins from University of Michigan about how robots can learn from people and assist us in our daily lives.

Robot Talk at the Smart City Robotics Competition

  22 Oct 2025
In a special bonus episode of the podcast, Claire chatted to competitors, exhibitors, and attendees at the Smart City Robotics Competition in Milton Keynes.

Robot Talk Episode 129 – Automating museum experiments, with Yuen Ting Chan

  17 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Yuen Ting Chan from Natural History Museum about using robots to automate molecular biology experiments.

What’s coming up at #IROS2025?

  15 Oct 2025
Find out what the International Conference on Intelligent Robots and Systems has in store.

From sea to space, this robot is on a roll

  13 Oct 2025
Graduate students in the aptly named "RAD Lab" are working to improve RoboBall, the robot in an airbag.

Robot Talk Episode 128 – Making microrobots move, with Ali K. Hoshiar

  10 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Ali K. Hoshiar from University of Essex about how microrobots move and work together.



 

Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


 












©2025.05 - Association for the Understanding of Artificial Intelligence