Robohub.org
 

Learning behavioral models

by
21 December 2010



share this:

It is often difficult to predict the high-level behavior of a robot given low-level models about sensors, actuators and controllers. You might know your robot will turn in response to obstacles but not how it will behave in a room full of people.

Modeling the global behavior of a robot is useful in order to predict how the robot behaves in different environments. Furthermore, once a good model is inferred, it can be used to improve the robot’s controller parameters online.

To model robot behaviors, Infantes et al. use a probabilistic representation called Dynamic Bayesian Networks. The approach is tested using the Rackham RWI B21R museum guide robot shown below that needs to navigate in an open environment with people. The network captures information concerning the robot’s parameters, environment variables, robot state variables and mission variables. The model is then used to optimize the robot behavior for a given environment. During the learning process, robots are rewarded for good behaviors that avoid failures, go fast and are “human-friendly”. Using this approach, the robot fails less, is faster and has better human acceptance than a robot with hand-tuned parameters.

In the future, Infantes et al. plan to use this approach to learn other robotic tasks such as grasping or interacting with humans.




Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory
Sabine Hauert is President of Robohub and Associate Professor at the Bristol Robotics Laboratory





Related posts :



Women in Tech leadership resources from IMTS 2022

There’ve been quite a few events recently focusing on Women in Robotics, Women in Manufacturing, Women in 3D Printing, in Engineering, and in Tech Leadership. One of the largest tradeshows in the US is IMTS 2022. Here I bring you some resources shared in the curated technical content and leadership sessions.
29 September 2022, by and

MIT engineers build a battery-free, wireless underwater camera

The device could help scientists explore unknown regions of the ocean, track pollution, or monitor the effects of climate change.
27 September 2022, by

How do we control robots on the moon?

In the future, we imagine that teams of robots will explore and develop the surface of nearby planets, moons and asteroids - taking samples, building structures, deploying instruments.
25 September 2022, by , and

Have a say on these robotics solutions before they enter the market!

We have gathered robots which are being developed right now or have just entered the market. We have set these up in a survey style consultation.
24 September 2022, by

Shelf-stocking robots with independent movement

A robot that helps store employees by moving independently through the supermarket and shelving products. According to cognitive robotics researcher Carlos Hernández Corbato, this may be possible in the future. If we engineer the unexpected.
23 September 2022, by

RoboCup humanoid league: Interview with Jasper Güldenstein

We talked to Jasper Güldenstein about how teams transferred developments from the virtual humanoid league to the real-world league.
20 September 2022, by and





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association