Shaojie Shen: Minimalist Visual Perception and Navigation for Consumer Drones | CMU RI Seminar

26 January 2019

share this:

Link to video on YouTube

Abstract: “Consumer drone developers often face the challenge of achieving safe autonomous navigation under very tight size, weight, power, and cost constraints. In this talk, I will present our recent results towards a minimalist, but complete perception and navigation solution utilizing only a low-cost monocular visual-inertial sensor suite. I will start with an introduction of VINS-Mono, a robust state estimation solution packed with multiple features for easy deployment, such as online spatial and temporal inter-sensor calibration, loop closure, and map reuse. I will then describe efficient monocular dense mapping solutions utilizing efficient map representation, parallel computing, and deep learning techniques for real-time reconstruction of the environment. The perception system is completed by a geometric-based method for estimating full 6-DoF poses of arbitrary rigid dynamic objects using only one camera. With this real-time perception capability, trajectory planning and replanning methods with optimal time allocation are proposed to close the perception-action loop. The performance of the overall system is demonstrated via autonomous navigation in unknown complex environments, as well as aggressive drone racing in a teach-and-repeat setting.”

John Payne

Related posts :

Looking beyond “technology for technology’s sake”

Whether building robots or helping to lead the National Society of Black Engineers, senior Austen Roberson is thinking about the social implications of his field.
08 December 2022, by

Estimating manipulation intentions to ease teleoperation

Introducing an intention estimation model that relies on both gaze and motion features.
06 December 2022, by and

Countering Luddite politicians with life (and cost) saving machines

Beyond aerial tricks, drones are now being deployed in novel ways to fill the labor gap of menial jobs that have not returned since the pandemic.
04 December 2022, by

Call for robot holiday videos 2022

That’s right! You better not run, you better not hide, you better watch out for brand new robot holiday videos on Robohub!
02 December 2022, by

The Utah Bionic Leg: A motorized prosthetic for lower-limb amputees

Lenzi’s Utah Bionic Leg uses motors, processors, and advanced artificial intelligence that all work together to give amputees more power to walk, stand-up, sit-down, and ascend and descend stairs and ramps.

Touch sensing: An important tool for mobile robot navigation

Proximal sensing often is a blind spot for most long range sensors such as cameras and lidars for which touch sensors could serve as a complementary modality.
29 November 2022, by

©2021 - ROBOTS Association


©2021 - ROBOTS Association