Robohub.org
 

Embodied communication: Looking for systems that mean what they say

by
14 March 2014



share this:
EUCog_bochum_conference

The lay notion of how human communication works is, basically, that we exchange packages of information that are encoded and then decoded in our heads using language. But it just takes a little observation to see that this “computer metaphor” just doesn’t apply to the human way of communicating. We can’t reduce communication to a transfer of abstract information, and the same happens to be true of human-machine communication if we expect it to be of any use.

Think of turn-taking during a conversation. Speakers and listeners switch roles very quickly, often faster than typical reaction times. Silences between turns last less than 300 milliseconds, leading us to believe that a lot more is going on than simply waiting for the information to arrive in order to decide the next step. In fact, a lot of anticipatory planning is happening in both the speaker and listener. There’s a continuous monitoring of the other in search of subtle cues as to when the turn will be yielded. Such cues include changes of prosody, gestures, gaze shifts toward the listener, implicit verbal cues such as filler utterances…. Turn-taking is just one example of embodiment, a critical dimension of communication that most classical models ignore.

In fact it was the the study of human language that led the way toward the revolution of embodiment in the cognitive sciences. Cognition, in this view, unfolds in time while we perceive and act. Cognitive processes are continuously linked to sensory information and continuously coupled to motor systems that impact on the sensed world.

Communication is embodied in the obvious sense that natural communication occurs between people with physical and physiological bodies, and their cognitive abilities originate from processes in their nervous systems. But the embodiment stance to human communication is deeper than that. It extends the scientific approach to human language by adding a new emphasis on the grounding of language in the ongoing perception of the scene.

We begin to understand the emergence of language during development as a consequence of the immersion of the child in an environment shared with speakers. Development helps us explain how gesture and other non-linguistic cues are tightly coupled into language processing in the here and now of human communication. Embodied communication is also essential for researchers building artificial cognitive systems that autonomously generate language to communicate with a human and, conversely, make sense of human language and gesture by tying it to the system’s own scene perception.

Researchers exploring these different approaches to the study of embodied communication will share their ideas and insights during the Fifth EUCogIII Members Conference in Bochum 19-20 March 2014. Peter Dominey from the INSERM Stem Cell and Brain Research Institute in Lyon, France will show, for instance, how the iCub robot acquires “meaning” by establishing a link between physical action and language, and Yiannis Aloimonos from the University of Maryland in the USA will demonstrate how an “action grammar” is able to parse human action into meaningful sequences. Psychologists like Larissa Samuelson and Susan Wagner Cook from the University of Iowa will present the developmental perspective on embodied communication, focusing on how children learn words and how gesture and language co-develop. Srini Narayana will show in theoretical models how meaning and grammar are intimately tied together in the learning process.

Our aim is to advance the interdisciplinary interchanges between artificial and human cognition research fields. Both technical and natural aspects of communication will therefore be represented at the conference. To develop cognitive systems we need to understand the variety of ways that speech and gesture are coordinated, and develop technical aspects like creating automatic semantic descriptions of complex human activity from perceptual data. Knowing more about how humans really communicate and make sense of human communication is important if we want to create machines that are smart like us.

EUCog is the European Network for the Advancement of Artificial Cognitive Systems, Interaction and Robotics.



tags: , , , , ,


Gregor Schöner is the Director of the Institut für Neuroinformatik at the Ruhr-Universität Bochum in Germany.
Gregor Schöner is the Director of the Institut für Neuroinformatik at the Ruhr-Universität Bochum in Germany.





Related posts :



Sense Think Act Pocast: Erik Schluntz

In this episode, Audrow Nash interviews Erik Schluntz, co-founder and CTO of Cobalt Robotics, which makes a security guard robot. Erik speaks about how their robot handles elevators, how they have hum...
19 October 2021, by and

A robot that finds lost items

Researchers at MIT have created RFusion, a robotic arm with a camera and radio frequency (RF) antenna attached to its gripper, that fuses signals from the antenna with visual input from the camera to locate and retrieve an item, even if the item is buried under a pile and completely out of view.
18 October 2021, by

Robohub gets a fresh look

If you visited Robohub this week, you may have spotted a big change: how this blog looks now! On Tuesday (coinciding with Ada Lovelace Day and our ‘50 women in robotics that you need to know about‘ by chance), Robohub got a massive modernisation on its look by our technical director Ioannis K. Erripis and his team.
17 October 2021, by
ep.

339

podcast

High Capacity Ride Sharing, with Alex Wallar

In this episode, our interviewer Lilly speaks to Alex Wallar, co-founder and CTO of The Routing Company. Wallar shares his background in multi-robot path-planning and optimization, and his research on scheduling and routing algorithms for high-capacity ride-sharing. They discuss how The Routing Company helps cities meet the needs of their people, the technical ins and outs of their dispatcher and assignment system, and the importance of public transit to cities and their economics.
12 October 2021, by

50 women in robotics you need to know about 2021

It’s Ada Lovelace Day and once again we’re delighted to introduce you to “50 women in robotics you need to know about”! From the Afghanistan Girls Robotics Team to K.G.Engelhardt who in 1989 ...
12 October 2021, by and

Join the Women in Robotics Photo Challenge

How can women feel as if they belong in robotics if we can't see any pictures of women building or programming robots? The Civil Rights Activist Marian Wright Edelson aptly said, "You can't be what yo...
12 October 2021, by





©2021 - ROBOTS Association


 












©2021 - ROBOTS Association