Robohub.org
 

Virtual role-play and robo-tutors

Alelo's virtual role-play technology creates safe learning environments for students to practice real-life conversations. Customized feedback can be provided during and after interaction to analyze performance.

Alelo’s virtual role-play technology creates safe learning environments for students to practice real-life conversations. Customized feedback can be provided during and after interaction to analyze performance.

Cyberlearning project teaches language and cross-cultural communication with avatars and robots.

Communication skills are critical in a global economy.

Since communication often occurs across cultures, people must know more than just the vocabulary and grammar of a foreign language. They must also have cultural awareness–a recognition of the “dos and don’ts” that each culture maintains–to communicate smoothly, effortlessly and with confidence.

Virtual role-play – where learners engage in simulated encounters with artificially intelligent agents that behave and respond in a culturally accurate manner – has been shown to be effective at teaching cross-cultural communication.

“You learn by playing a role in a simulation of some real-life situation,” said W. Lewis Johnson, a former professor at the University of Southern California and co-founder of Alelo Inc., a company that makes cyberlearning tools. “You practice communication with some artificial intelligent interactive characters that will listen and respond to you, depending on what you say and do. It helps develop fluency, but it also helps to develop confidence.”

With an award from the National Science Foundation (NSF), Johnson and his team at Alelo (a Hawaiian word that means “language” or “tongue”) developed a range of products to teach cross-cultural communication using virtual worlds. Alelo’s tools have already achieved success in military training and English-as-a-second-language programs and are now being applied to a wide range of learning applications.

“We found in our military training that when soldiers use this approach, once they get into a foreign country–let’s say they’re sitting down with local leaders–they feel as if it’s a familiar situation to them, even though they’ve never experienced it in real life before,” Johnson said. “That degree of comfort is extremely powerful.”

As an example, Johnson showed a role-playing scenario that orients officers to the etiquette expected at a Chinese banquet. (The goal: Don’t get drunk!)

“How do you show proper respect for your host in participating in these toasts but not fall down drunk in the process?” Johnson asked. “That’s an effective communication problem. Role-playing teaches some of the communication skills that you could use if you find yourself in this situation.”

Importantly, Alelo’s virtual role-playing tool gives one the ability to practice conversation and etiquette until you get them right.

To develop a version to teach English as a second language (ESL) to those in the United States, the researchers interviewed immigrants to determine what cultural issues they found most problematic. The instruction they created–available in multiple languages–explains how to handle different situations that one might face as a new immigrant in the United States and provides tips on culturally appropriate behavior.

Students can practice on a range of devices, allowing them to use the program to prepare for classroom activities, as follow-up to classroom activities or as needed in the field. The ESL program even offers a virtual coach who provides help and feedback.

In 2012, Alelo partnered with the Commonwealth of Virginia to develop and test virtual role-play learning products for conversational practice in Chinese.

Tammy McGraw, the former director of digital innovations and outreach at the Virginia Department of Education, had met Johnson at a Wired conference years earlier and, although Alelo was demonstrating cyberlearning technologies for soldiers, McGraw was struck by how the virtual characters were able to impart both linguistic and cultural lessons.

Moreover, the software could address the shortage of qualified teachers able to teach Chinese, Arabic and other less popular languages, while allowing the state to increase the number of students who were able to take classes that were over-enrolled.

The RALL-E project combines Robokind's advanced social robotics and Alelo's virtual role-play technology. Using automated-speech recognition and customized acoustic models, RALL-E can understand and respond to Mandarin Chinese speakers of all levels.

The RALL-E project combines Robokind’s advanced social robotics and Alelo’s virtual role-play technology. Using automated-speech recognition and customized acoustic models, RALL-E can understand and respond to Mandarin Chinese speakers of all levels.

The first Web-based course was tested last year via Virtual Virginia, a statewide virtual school program and received overwhelmingly positive ratings from the students.

“The virtual classes enabled students to be more self-directed than teachers could normally support,” McGraw said.

Recently, McGraw and Johnson have been adapting the insights learned in virtual role-playing research for a new platform: a robo-tutor.

With support from NSF, Alelo has taken RoboKind’s lifelike social robot and equipped it with the ability to converse in Chinese. The technology gives learners abundant opportunities to practice their conversational skills and lowers the entry barrier for difficult languages such as Chinese.

“It’s non-threatening,” McGraw said. “The robot is not going to be offended if you say the wrong thing. He’s not going to laugh at you if you pronounce Chinese incorrectly. But he also has the ability to engage learners through active interaction.”

Though still in the prototype phase, they imagine RoboKind could be used in the classroom, with kids coming up to engage with it at will. It could also be used outside of formal class as a personal tutor. Teachers at Thomas Jefferson High School of Science and Technology in Alexandria, Va., signed on to try out the computer-based pilot.

By combining artificial intelligence and robotics with insights from virtual role-playing research, Alelo is pioneering new avenues of personalized education.

“The question we’re trying to answer is: what are the aspects of the technology that are most important for mastering communicative skills?” McGraw said.

With the RALL-E project, Alelo, in cooperation with the National Science Foundation and Virginia Department of Education, is investigating how to design simulation-based learning experiences for language learning that optimize learner motivation and promote conversational skills. They are doing this by developing a prototype lifelike robot that engages in conversations in foreign language and studying its use in educational settings.

“We have two different realizations of virtual role-play technology. They have different strengths, different weaknesses. What are they going to be good for? Which is good for what? Doing this research, we hope to get some answers to those questions.”

Related Websites
Alelo: http://www.alelo.com/



tags: ,


the National Science Foundation (NSF) is an independent federal US agency created to promote the progress of science.
the National Science Foundation (NSF) is an independent federal US agency created to promote the progress of science.





Related posts :



Robot Talk Episode 126 – Why are we building humanoid robots?

  20 Jun 2025
In this special live recording at Imperial College London, Claire chatted to Ben Russell, Maryam Banitalebi Dehkordi, and Petar Kormushev about humanoid robotics.

Gearing up for RoboCupJunior: Interview with Ana Patrícia Magalhães

and   18 Jun 2025
We hear from the organiser of RoboCupJunior 2025 and find out how the preparations are going for the event.

Robot Talk Episode 125 – Chatting with robots, with Gabriel Skantze

  13 Jun 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Gabriel Skantze from KTH Royal Institute of Technology about having natural face-to-face conversations with robots.

Preparing for kick-off at RoboCup2025: an interview with General Chair Marco Simões

and   12 Jun 2025
We caught up with Marco to find out what exciting events are in store at this year's RoboCup.

Interview with Amar Halilovic: Explainable AI for robotics

  10 Jun 2025
Find out about Amar's research investigating the generation of explanations for robot actions.

Robot Talk Episode 124 – Robots in the performing arts, with Amy LaViers

  06 Jun 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Amy LaViers from the Robotics, Automation, and Dance Lab about the creative relationship between humans and machines.

Robot Talk Episode 123 – Standardising robot programming, with Nick Thompson

  30 May 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Nick Thompson from BOW about software that makes robots easier to program.

Congratulations to the #AAMAS2025 best paper, best demo, and distinguished dissertation award winners

  29 May 2025
Find out who won the awards presented at the International Conference on Autonomous Agents and Multiagent Systems last week.



 

Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


©2025.05 - Association for the Understanding of Artificial Intelligence


 












©2025.05 - Association for the Understanding of Artificial Intelligence