Robot Partner

Autistic Children Training App for Harbin Institute of Technology, Shenzhen

Robot Partner is a training mobile App aiming at improving the social and emotional skills for children with Autism Spectrum Disorder aged four to six. Early researchers have found that comparing to interacting with people in real world, autistic children are more interested in communicating with robots. Based on the above research findings, a virtual character of robot was created to guide autistic children going through training activities in three modules including Speech and Gesture, Emotion, and Social Interaction.

Download Press Kit № 108295

Download Press Kit № 108295 Autistic Children Training App for Harbin Institute of Technology, Shenzhen by Shumeng Hou to access high-res images, essential texts, translations, and exclusive interviews—all in one.

Available Now for Your Next Story

At design|newsroom, we understand the pressures and deadlines journalists face. That’s why we offer exclusive access to our curated press kits and high-resolution images, tailored for accredited journalists. These resources are designed to enrich your stories with depth and visual appeal, spotlighting the world's most innovative designs.

Please Note:

• Credit the work's creator and/or photographer.
• Mention design|newsroom as your source.
• Share your published pieces with us; we love to celebrate and promote your work on our platform and social media.

Let’s Collaborate: Your stories matter. design|newsroom is here to support you with quality, accessible content. Once you are accredited, reach out for the images and content you need. We will provide the specific images and content directly, along with recommendations on works to feature.

Get Accredited Easily: Quick access to our resources requires media accreditation. Apply for media accreditation to join our network and start exploring a wealth of design stories.

Robot Partner by Shumeng Hou

Download 1800 Pixels JPEG Image.

Autistic Children Training App by Shumeng Hou

Download 1800 Pixels JPEG Image.

Shumeng Hou Robot Partner

Download 1800 Pixels JPEG Image.

Shumeng Hou Autistic Children Training App

Download 1800 Pixels JPEG Image.

Harbin Institute of Technology ShenzhenBrand Logo

Download 1800 Pixels JPEG Image.

Robot Partner Autistic Children Training App Press Releases

Press releases tailored for Robot Partner are available in the languages: English.

Robot Partner Autistic Children Training App Media Articles

Our Robot Partner articles are prepped and available in these languages: French, Dutch, Korean, Indonesian, Japanese, Russian, Chinese (Mandarin), German, Turkish, Arabic (Standard), English, Spanish, Portuguese, Italian and Hindi, ready for your use.

Unique Properties

Robot Partner is a training mobile App aiming at improving the social and emotional skills for autistic children between 4 to- 6- year old. Previous studies have found that comparing to interacting with people in the real world, autistic children are more interested in communicating with robots (Dautenhahn and Werry, 2004). In addition, a growing number of studies have found that using a social robot to assist autistic children is a potentially useful area of research (David, Costescu, Matu, Szentagotai, and Dobrean, 2018; Wood, Zarakl, Robins, and Dautenhahn, 2019). Specifically, robot animation is effective in teaching children with autism to recognize and produce gestures in social communicating situation (So, Wong, Cabibihan, Lam, Chan, and Qian, 2016). In order to scaffold the development of autistic children with a scientific method and with an image they are interested in, a virtual character of robot was created to guide autistic children in taking part in training activities of Speech and Gesture, Emotion, and Social Communication in the present design.

Tags

Interface Design, Autism Spectrum Disorder, Speech and Gesture, Emotion, Social Interaction

Production Technology

The App was designed mainly based on a systematical intervening program of autistic children’s social and emotional skills. The intervening program is developed based on research findings of a national research project from one of the designers in our team. In the neural imaging of the above projects, autistic children showed significant difference in the activation of dorsolateral prefrontal cortex when they were watching a robot interacting with them comparing to when they were interacting with a person. Such difference was not found in typical developing children. Dorsolateral prefrontal cortex plays a key role in the modulation of affective processing (Keuper Terrighena, Chan, Joughoefer, and Lee, 2018). Such findings indicated that autistic children are more sensitive to social interactions with robots comparing to with human, and this is revealed in the activation of cortex that related to affection. Therefore, trainings provided by a robot partner may elicit greater effects in enhancing autistic children’s social skills. Accordingly, we designed a virtual robot character as a partner and a trainer to help autistic children in several tasks. Specifically, a big number of studies have shown that, the core symptoms of ASD children are lacking of social interactive skills and communicating skills (American Psychiatric Association, 2013). They feel difficult to share the same feelings and interests with other people. In this sense, Robot Xiaozhao consists three modules of Speech and Gesture (So, Wong, Cabibihan, Lam, Chan, and Qian, 2016), Emotion and Social Interaction (Schertz, baker, Hurwitz, and Benner, 2011). The three modules support the training based on common social dialogues with gestures, emotional expression, and comprehensive social communication between the robot partner Xiaozhao and autistic children. In addition, some other updated research findings regarding autistic children’s preference of color, sound and the looking of the robot were also adopted when designing the robot and the framework of the App. For example, an early study has suggested that autistic children prefer color options of blue, green, and brown (Grandgeorge and Masataka, 2016). Therefore, the above colors are selected as the main colors in the design of Robot Xiaozhao.

Design Challenge

Among the whole process of designing, there are two challenges and obstacles that we overcame. First, the target users of the product are special young children. Second, we need to guarantee the effects of the training system before it is applied into the App program. Therefore, on the one hand, the content of the training App needs to be professional and suitable to the above group of people. On the other hand, the whole intervening system which takes two months need to be implemented on at least thirty autistic children to make sure of the effectiveness. We have solved the above obstacles based on two research projects during the past three years. In our team, there is an expert in research regarding autistic children’s neural biological characteristics and the intervention. Since the year of 2017, the designer has already developed two research aiming at exploring the neural evidences on the atypical interests of autistic children in robot and on the intervening techniques of enhancing their social and emotional skills. By making use of the research findings, we are much confident that comparing to a human helper, the autistic children are more interested in the robot image we designed, and that would lead to better training outcomes.

Project Duration

The project started in February 2019 and finished in July 2020 in Shenzhen.

Operation Flow

Robot Partner consists of modules of Speech and Gesture, Emotion, and Social Interaction to support the training based on common social dialogues and gestures, emotion expression, and comprehensive social communication between the robot partner and autistic children. In the module of Speech& and Gesture, the meaning of basic speech utterances and gestures in social interpersonal context are introduced. From this module, children are expected to understand the basic communicating dialogs in the daily life. In the module of Emotion, different types of human emotions in various situations are introduced. By going through this module, autistic children are expected to understand the meaning of different types of basic emotions and the ways to express their emotions. The last module Social Interaction provides a variety of complex social scenes where autistic children are trained to react in proper speech utterances, facial expressions and gestures.

Research

The present App was designed based on two research projects from the designers. One is an intervening study supported by Humanities and Social Sciences Foundation of National Ministry of Education in China (Id: 17YJC190006), the other one is a neural imaging study supported by Shenzhen Natural Science Foundation. Specifically, in the brain imaging research project, we aimed at investigating the neural evidence regarding 45 autistic children’s atypical interests in interacting with robots comparing to interacting with people. This is the theoretical foundation of developing an image of robot in the training App. In the other intervention study, we developed a systematical computer-based training program to train autistic children’s social emotional skills in social interactive scenes. Autistic children went through three stages of training including Language and Gesture Recognition and Imitation, Emotion Recognition and Imitation, and Application Training. We also compared the social and emotional performance before and after the two months’ training. After the completion of the whole training system, the language and gestures skills of 30 autistic children were increased significantly. In addition, the score on Social Responsiveness Scale (Constantino and Gruber, 2005) increased, which reveals that the social and emotional behaviors and reactions of autistic children were improved after taking part in the intervention program. Taken together, the above two research projects and findings provide a scientific evidence indicating that a social and emotional training program with robot would be of great effectiveness on improving autistic children’s performance.

Inspiration

Autism Spectrum Disorder (autism) is a pervasive developmental disorder characterized by severe, widespread social interactive problems and impairments in communicating skills. About 1 in 54 children has been identified with autism in the United States. The lack of professional therapists, especially in developing countries, and the high costs cause great difficulties for families with autistic children in getting enough and professional interventions. Therefore, developing an App that provides professional, convenient, and user-friendly training system for enhancing autistic children’s emotional and social skills will not only benefit families with autistic children, but also reduce the social and economic pressure.

Image Credits

Images by Shumeng Hou, Huicong Hu, 2020

Project Overview

Robot Partner Autistic Children Training App has been a Iron winner in the Education, Teaching Aid and Training Content Design award category in the year 2020 organized by the prestigious A' Design Award & Competition. The Iron A' Design Award is awarded to good designs that meet the rigorous professional and industrial standards set by the A' Design Awards. This recognition is reserved for works that demonstrate a solid understanding of design principles and show creativity within their execution. Recipients of the Iron A' Design Award are acknowledged for their practical innovations and contributions to their respective fields, providing solutions that improve quality of life and foster positive change. These designs are a testament to the skill and dedication of their creators, showcasing their ability to address real-world challenges through thoughtful design.

Iron Recognition

Shumeng Hou was recognized with the coveted Iron A' Design Award in 2021, a testament to excellence of their work Robot Partner Autistic Children Training App.

Shumeng Hou Press Releases

Media members, dive into our press releases on Shumeng Hou's work, ready for you to use and enhance your journalistic content. Press members can now immediately access 1 press releases.

Robot Partner: A Revolutionary Training App for Autistic Children

Shumeng Hou Introduces Robot Partner, an Innovative App to Enhance Social and Emotional Skills for Autistic Children

Shumeng Hou Newsroom

Visit Shumeng Hou Newsroom for an inside look at exceptional design and award-winning projects.