Robohub.org
 

Drones can almost see in the dark

by
26 September 2017



share this:

We want to share with you our recent breakthrough teaching drones to fly using an eye-inspired camera, which opens the door to them performing fast, agile maneuvers and flying in low-light environments, where all commercial drones fail. Possible applications include supporting rescue teams with search missions at dusk or dawn. We submitted this work to the IEEE Robotics and Automation Letters.

How it works
Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They do not suffer from motion blur and have a very high dynamic range, which enables them to provide reliable visual information during high speed motions or in scenes characterized by high dynamic range. However, event cameras output only little information when the amount of motion is limited, such as in the case of almost still motion. Conversely, standard cameras provide instant and rich information about the environment most of the time (in low-speed and good lighting scenarios), but they fail severely in case of fast motions or difficult lighting such as high dynamic range or low light scenes. In this work, we present the first state estimation pipeline that leverages the complementary advantages of these two sensors by fusing in a tightly-coupled manner events, standard frames, and inertial measurements. We show that our hybrid pipeline leads to an accuracy improvement of 130% over event-only pipelines, and 85% over standard-frames only visual-inertial systems, while still being computationally tractable. Furthermore, we use our pipeline to demonstrate—to the best of our knowledge—the first autonomous quadrotor flight using an event camera for state estimation, unlocking flight scenarios that were not reachable with traditional visual inertial odometry, such as low-light environments and high dynamic range scenes: we demonstrate how we can even fly in low light (such as after switching completely off the light in a room) or scenes characterized by a very high dynamic range (one side of the room highly illuminated and another side of the room dark).

Paper:
T. Rosinol Vidal, H.Rebecq, T. Horstschaefer, D. Scaramuzza
Hybrid, Frame and Event based Visual Inertial Odometry for Robust, Autonomous Navigation of Quadrotors, submitted to IEEE Robotics and Automation Letters PDF



tags:


Davide Scaramuzza is Assistant Professor of Robotics at the University of Zurich.
Davide Scaramuzza is Assistant Professor of Robotics at the University of Zurich.





Related posts :



Robot Talk Episode 42 – Thom Kirwan-Evans

In this week's episode of the Robot Talk podcast, host Claire Asher chatted to Thom Kirwan-Evans from Origami Labs all about computer vision, machine learning, and robots in industry.
25 March 2023, by

Resilient bug-sized robots keep flying even after wing damage

New repair techniques enable microscale robots to recover flight performance after suffering severe damage to the artificial muscles that power their wings.
23 March 2023, by

How drones for organ transportation are changing the healthcare industry

The healthcare drone industry has witnessed a dramatic surge in the last couple of years. In 2020, the market grew 30% and is expected to grow from $254 million in 2021 to $1,5 billion in 2028.
21 March 2023, by

Robotic bees and roots offer hope of healthier environment and sufficient food

Miniature robots that mimic living organisms are being developed to explore and support real-life ecosystems.
18 March 2023, by

Robot Talk Episode 41 – Alessandra Rossi

In this week's episode of the Robot Talk podcast, host Claire Asher chatted to Alessandra Rossi from the University of Naples all about social robotics, theory of mind, and robots playing football.
17 March 2023, by

Mix-and-match kit could enable astronauts to build a menagerie of lunar exploration bots

Robotic parts could be assembled into nimble spider bots for exploring lava tubes or heavy-duty elephant bots for transporting solar panels.
14 March 2023, by





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association