Robohub.org
 

Virtual role-play and robo-tutors

Alelo's virtual role-play technology creates safe learning environments for students to practice real-life conversations. Customized feedback can be provided during and after interaction to analyze performance.

Alelo’s virtual role-play technology creates safe learning environments for students to practice real-life conversations. Customized feedback can be provided during and after interaction to analyze performance.

Cyberlearning project teaches language and cross-cultural communication with avatars and robots.

Communication skills are critical in a global economy.

Since communication often occurs across cultures, people must know more than just the vocabulary and grammar of a foreign language. They must also have cultural awareness–a recognition of the “dos and don’ts” that each culture maintains–to communicate smoothly, effortlessly and with confidence.

Virtual role-play – where learners engage in simulated encounters with artificially intelligent agents that behave and respond in a culturally accurate manner – has been shown to be effective at teaching cross-cultural communication.

“You learn by playing a role in a simulation of some real-life situation,” said W. Lewis Johnson, a former professor at the University of Southern California and co-founder of Alelo Inc., a company that makes cyberlearning tools. “You practice communication with some artificial intelligent interactive characters that will listen and respond to you, depending on what you say and do. It helps develop fluency, but it also helps to develop confidence.”

With an award from the National Science Foundation (NSF), Johnson and his team at Alelo (a Hawaiian word that means “language” or “tongue”) developed a range of products to teach cross-cultural communication using virtual worlds. Alelo’s tools have already achieved success in military training and English-as-a-second-language programs and are now being applied to a wide range of learning applications.

“We found in our military training that when soldiers use this approach, once they get into a foreign country–let’s say they’re sitting down with local leaders–they feel as if it’s a familiar situation to them, even though they’ve never experienced it in real life before,” Johnson said. “That degree of comfort is extremely powerful.”

As an example, Johnson showed a role-playing scenario that orients officers to the etiquette expected at a Chinese banquet. (The goal: Don’t get drunk!)

“How do you show proper respect for your host in participating in these toasts but not fall down drunk in the process?” Johnson asked. “That’s an effective communication problem. Role-playing teaches some of the communication skills that you could use if you find yourself in this situation.”

Importantly, Alelo’s virtual role-playing tool gives one the ability to practice conversation and etiquette until you get them right.

To develop a version to teach English as a second language (ESL) to those in the United States, the researchers interviewed immigrants to determine what cultural issues they found most problematic. The instruction they created–available in multiple languages–explains how to handle different situations that one might face as a new immigrant in the United States and provides tips on culturally appropriate behavior.

Students can practice on a range of devices, allowing them to use the program to prepare for classroom activities, as follow-up to classroom activities or as needed in the field. The ESL program even offers a virtual coach who provides help and feedback.

In 2012, Alelo partnered with the Commonwealth of Virginia to develop and test virtual role-play learning products for conversational practice in Chinese.

Tammy McGraw, the former director of digital innovations and outreach at the Virginia Department of Education, had met Johnson at a Wired conference years earlier and, although Alelo was demonstrating cyberlearning technologies for soldiers, McGraw was struck by how the virtual characters were able to impart both linguistic and cultural lessons.

Moreover, the software could address the shortage of qualified teachers able to teach Chinese, Arabic and other less popular languages, while allowing the state to increase the number of students who were able to take classes that were over-enrolled.

The RALL-E project combines Robokind's advanced social robotics and Alelo's virtual role-play technology. Using automated-speech recognition and customized acoustic models, RALL-E can understand and respond to Mandarin Chinese speakers of all levels.

The RALL-E project combines Robokind’s advanced social robotics and Alelo’s virtual role-play technology. Using automated-speech recognition and customized acoustic models, RALL-E can understand and respond to Mandarin Chinese speakers of all levels.

The first Web-based course was tested last year via Virtual Virginia, a statewide virtual school program and received overwhelmingly positive ratings from the students.

“The virtual classes enabled students to be more self-directed than teachers could normally support,” McGraw said.

Recently, McGraw and Johnson have been adapting the insights learned in virtual role-playing research for a new platform: a robo-tutor.

With support from NSF, Alelo has taken RoboKind’s lifelike social robot and equipped it with the ability to converse in Chinese. The technology gives learners abundant opportunities to practice their conversational skills and lowers the entry barrier for difficult languages such as Chinese.

“It’s non-threatening,” McGraw said. “The robot is not going to be offended if you say the wrong thing. He’s not going to laugh at you if you pronounce Chinese incorrectly. But he also has the ability to engage learners through active interaction.”

Though still in the prototype phase, they imagine RoboKind could be used in the classroom, with kids coming up to engage with it at will. It could also be used outside of formal class as a personal tutor. Teachers at Thomas Jefferson High School of Science and Technology in Alexandria, Va., signed on to try out the computer-based pilot.

By combining artificial intelligence and robotics with insights from virtual role-playing research, Alelo is pioneering new avenues of personalized education.

“The question we’re trying to answer is: what are the aspects of the technology that are most important for mastering communicative skills?” McGraw said.

With the RALL-E project, Alelo, in cooperation with the National Science Foundation and Virginia Department of Education, is investigating how to design simulation-based learning experiences for language learning that optimize learner motivation and promote conversational skills. They are doing this by developing a prototype lifelike robot that engages in conversations in foreign language and studying its use in educational settings.

“We have two different realizations of virtual role-play technology. They have different strengths, different weaknesses. What are they going to be good for? Which is good for what? Doing this research, we hope to get some answers to those questions.”

Related Websites
Alelo: http://www.alelo.com/



tags: ,


the National Science Foundation (NSF) is an independent federal US agency created to promote the progress of science.
the National Science Foundation (NSF) is an independent federal US agency created to promote the progress of science.





Related posts :



Robot Talk Episode 132 – Collaborating with industrial robots, with Anthony Jules

  07 Nov 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Anthony Jules from Robust.AI about their autonomous warehouse robots that work alongside humans.

Teaching robots to map large environments

  05 Nov 2025
A new approach could help a search-and-rescue robot navigate an unpredictable environment by rapidly generating an accurate map of its surroundings.

Robot Talk Episode 131 – Empowering game-changing robotics research, with Edith-Clare Hall

  31 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Edith-Clare Hall from the Advanced Research and Invention Agency about accelerating scientific and technological breakthroughs.

A flexible lens controlled by light-activated artificial muscles promises to let soft machines see

  30 Oct 2025
Researchers have designed an adaptive lens made of soft, light-responsive, tissue-like materials.

Social media round-up from #IROS2025

  27 Oct 2025
Take a look at what participants got up to at the IEEE/RSJ International Conference on Intelligent Robots and Systems.

Using generative AI to diversify virtual training grounds for robots

  24 Oct 2025
New tool from MIT CSAIL creates realistic virtual kitchens and living rooms where simulated robots can interact with models of real-world objects, scaling up training data for robot foundation models.

Robot Talk Episode 130 – Robots learning from humans, with Chad Jenkins

  24 Oct 2025
In the latest episode of the Robot Talk podcast, Claire chatted to Chad Jenkins from University of Michigan about how robots can learn from people and assist us in our daily lives.

Robot Talk at the Smart City Robotics Competition

  22 Oct 2025
In a special bonus episode of the podcast, Claire chatted to competitors, exhibitors, and attendees at the Smart City Robotics Competition in Milton Keynes.



 

Robohub is supported by:




Would you like to learn how to tell impactful stories about your robot or AI system?


scicomm
training the next generation of science communicators in robotics & AI


 












©2025.05 - Association for the Understanding of Artificial Intelligence