Robohub.org
 

TERESA project adds a vital component to human-robot interaction: social intelligence


by
02 February 2017



share this:
Source: TERESA project

TERESA project. Photo credit: Claire Cocano

TERESA is a 3-year research project funded by the European Union and carried out by six institutions from four European countries. Its goal is to develop a new socially intelligent semi-autonomous telepresence system.

A telepresence system consists of an internet-connected mobile robot equipped with a video screen, speakers, and microphones.  A remotely located pilot sitting at a computer can control the robot and use it to interact with people at the robot’s location.

Telepresence systems offer a number of advantages over traditional teleconferencing solutions such as Skype. The robot acts as an avatar for the pilot, allowing the pilot to appear much more present to people around the robot. In addition, because a telepresence robot is mobile, it enables spontaneous interaction, such as mingling at a cocktail party, that would not be possible with Skype.

Source: TERESA project

TERESA project. Photo credit: Claire Cocano

However, existing telepresence systems suffer from a key limitation. They require the pilot to manually execute many behaviours that would happen automatically and effortlessly if the pilot was physically present.  These include navigating through groups of people in a socially appropriate way, maintaining a socially appropriate distance and orientation to others, and maintaining socially appropriate eye contact.

The need to manually execute these low-level behaviours at the same time as selecting high-level behaviours, such as whom to talk to and what to say, can afflict the pilot with cognitive overload, which in turns leads to poor quality social interaction.

In the TERESA project, we have created a new semi-autonomous telepresence system that automates low-level decision making, thereby freeing the pilot to focus on the social interaction itself. TERESA can autonomously navigate through groups of people in a socially intelligent way and approach a specific person selected by the pilot. During conversation, TERESA can also maintain a socially appropriate distance from those around the robot and set the height, orientation, and tilt of its video screen so as to facilitate that conversation.

TERESA is not just intelligent but socially intelligent, thanks to advances in multi-modal perception, machine learning, and robotics developed in the project by an interdisciplinary team of computer scientists, engineers, sociologists, and experts in human-robot interaction.

Working with an elderly day centre in France, we have repeatedly validated TERESA with dozens of elderly subjects. Our results show that semi-autonomous telepresence systems can play a key role in improving the quality of remote interaction. Although TERESA is just a proof of concept, it illustrates the potential of social intelligence to transform telepresence systems and other robots as well.


If you enjoyed this article, you may want to read more about telepresence robotics:

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.



tags: , , , ,


Shimon Whiteson research focuses on artificial intelligence.
Shimon Whiteson research focuses on artificial intelligence.





Related posts :



Robot Talk Episode 129 – Automating museum experiments, with Yuen Ting Chan

  17 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Yuen Ting Chan from Natural History Museum about using robots to automate molecular biology experiments.

What’s coming up at #IROS2025?

  15 Oct 2025
Find out what the International Conference on Intelligent Robots and Systems has in store.

From sea to space, this robot is on a roll

  13 Oct 2025
Graduate students in the aptly named "RAD Lab" are working to improve RoboBall, the robot in an airbag.

Robot Talk Episode 128 – Making microrobots move, with Ali K. Hoshiar

  10 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Ali K. Hoshiar from University of Essex about how microrobots move and work together.

Interview with Zahra Ghorrati: developing frameworks for human activity recognition using wearable sensors

and   08 Oct 2025
Zahra tells us more about her research on wearable technology.

Women in robotics you need to know about 2025

  06 Oct 2025
This global list celebrates women's impact across the robotics ecosystem and globe.

Robot Talk Episode 127 – Robots exploring other planets, with Frances Zhu

  03 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Frances Zhu from the Colorado School of Mines about intelligent robotic systems for space exploration.



 

Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


 












©2025.05 - Association for the Understanding of Artificial Intelligence