Robohub.org
 

TERESA project adds a vital component to human-robot interaction: social intelligence

by
02 February 2017



share this:
Source: TERESA project

TERESA project. Photo credit: Claire Cocano

TERESA is a 3-year research project funded by the European Union and carried out by six institutions from four European countries. Its goal is to develop a new socially intelligent semi-autonomous telepresence system.

A telepresence system consists of an internet-connected mobile robot equipped with a video screen, speakers, and microphones.  A remotely located pilot sitting at a computer can control the robot and use it to interact with people at the robot’s location.

Telepresence systems offer a number of advantages over traditional teleconferencing solutions such as Skype. The robot acts as an avatar for the pilot, allowing the pilot to appear much more present to people around the robot. In addition, because a telepresence robot is mobile, it enables spontaneous interaction, such as mingling at a cocktail party, that would not be possible with Skype.

Source: TERESA project

TERESA project. Photo credit: Claire Cocano

However, existing telepresence systems suffer from a key limitation. They require the pilot to manually execute many behaviours that would happen automatically and effortlessly if the pilot was physically present.  These include navigating through groups of people in a socially appropriate way, maintaining a socially appropriate distance and orientation to others, and maintaining socially appropriate eye contact.

The need to manually execute these low-level behaviours at the same time as selecting high-level behaviours, such as whom to talk to and what to say, can afflict the pilot with cognitive overload, which in turns leads to poor quality social interaction.

In the TERESA project, we have created a new semi-autonomous telepresence system that automates low-level decision making, thereby freeing the pilot to focus on the social interaction itself. TERESA can autonomously navigate through groups of people in a socially intelligent way and approach a specific person selected by the pilot. During conversation, TERESA can also maintain a socially appropriate distance from those around the robot and set the height, orientation, and tilt of its video screen so as to facilitate that conversation.

TERESA is not just intelligent but socially intelligent, thanks to advances in multi-modal perception, machine learning, and robotics developed in the project by an interdisciplinary team of computer scientists, engineers, sociologists, and experts in human-robot interaction.

Working with an elderly day centre in France, we have repeatedly validated TERESA with dozens of elderly subjects. Our results show that semi-autonomous telepresence systems can play a key role in improving the quality of remote interaction. Although TERESA is just a proof of concept, it illustrates the potential of social intelligence to transform telepresence systems and other robots as well.


If you enjoyed this article, you may want to read more about telepresence robotics:

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.



tags: , , , , , ,


Shimon Whiteson research focuses on artificial intelligence.
Shimon Whiteson research focuses on artificial intelligence.





Related posts :



Open Robotics Launches the Open Source Robotics Alliance

The Open Source Robotics Foundation (OSRF) is pleased to announce the creation of the Open Source Robotics Alliance (OSRA), a new initiative to strengthen the governance of our open-source robotics so...

Robot Talk Episode 77 – Patricia Shaw

In the latest episode of the Robot Talk podcast, Claire chatted to Patricia Shaw from Aberystwyth University all about home assistance robots, and robot learning and development.
18 March 2024, by

Robot Talk Episode 64 – Rav Chunilal

In the latest episode of the Robot Talk podcast, Claire chatted to Rav Chunilal from Sellafield all about robotics and AI for nuclear decommissioning.
31 December 2023, by

AI holidays 2023

Thanks to those that sent and suggested AI and robotics-themed holiday videos, images, and stories. Here’s a sample to get you into the spirit this season....
31 December 2023, by and

Faced with dwindling bee colonies, scientists are arming queens with robots and smart hives

By Farshad Arvin, Martin Stefanec, and Tomas Krajnik Be it the news or the dwindling number of creatures hitting your windscreens, it will not have evaded you that the insect world in bad shape. ...
31 December 2023, by

Robot Talk Episode 63 – Ayse Kucukyilmaz

In the latest episode of the Robot Talk podcast, Claire chatted to Ayse Kucukyilmaz from the University of Nottingham about collaboration, conflict and failure in human-robot interactions.
31 December 2023, by





Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


©2024 - Association for the Understanding of Artificial Intelligence


 












©2021 - ROBOTS Association