Skip to main content
Download PDF

The impact of robotic intervention on joint attention in children with autism spectrum disorders

Molecular Autism volume 9, Article number: 46 (2018) Cite this article

Abstract

Background

A growing body of anecdotal evidence indicates that the use of robots may provide unique opportunities for assisting children with autism spectrum disorders (ASD). However, previous studies investigating the effects of interventions using robots on joint attention (JA) in children with ASD have shown insufficient results. The robots used in these studies could not turn their eyes, which was a limitation preventing the robot from resembling a human agent.

Methods

We compared the behavior of children with ASD with that of children with typical development (TD) during a JA elicitation task while the children interacted with either a human or a robotic agent. We used the robot “CommU,” which has clear eyes and can turn its eyes, for the robotic intervention. The age range of the participants was limited to 5–6 years.

Results

Sixty-eight participants participated in this study, including 30 (10 females and 20 males) children with ASD and 38 (13 females and 25 males) children with TD. The participants were randomly assigned to one of the following two groups: the robotic intervention group or the control group. JA in the children with ASD was better during the robotic intervention than during the human agent intervention. These children exhibited improved performance in the JA task with human after interacting with the robot CommU. JA was differentially facilitated by the human and robotic agents between the ASD and TD children.

Conclusions

The findings of this study significantly contribute to the literature on the impact of robots on JA and provide information regarding the suitability of specific robot types for therapeutic use.

Background

Autism spectrum disorders (ASD) are characterized by social communication deficits and a tendency to engage in repetitive behaviors [1]. A core social-communication deficit observed in children with ASD is limited joint attention (JA) behaviors. JA refers to a social exchange in which a child coordinates attention with a social partner or aspect of the environment by the acts of eye-gazing and pointing or other verbal or non-verbal indications. JA serves as a foundation for developing communicative competence and early social and cognitive skills [2,3,4,5,6,7,8,9]. Early interventions that facilitate JA are promising because these strategies increase children’s opportunities to learn from their environment and change their developmental trajectories [10, 11].

To engage in JA, children must orient toward their social partners and shift attention rapidly between social and non-social stimuli in their surroundings [12, 13]. Children with ASD require a well-suited interaction partner to develop JA skill [14]. In many cases, children with ASD do not show sustained motivation to interact with an interaction partner. For caregivers and trainers, concentrating on interactions with children with ASD is a difficult task [15, 16].

Children with ASD preferentially orient visually toward non-social objects, such as robots, rather than social objects [17,18,19]. These children prefer non-social objects because they are predictable, simple, and easy to comprehend. The use of robots may provide unique opportunities for assisting children with ASD [20,21,22,23,24,25]. For example, children with ASD exhibit improved performance in imitation tasks using a robot [22, 26]. However, previous studies [14, 27, 28] investigating the efficacy of interventions using robots on JA in children with ASD have shown insufficient results because these studies used a robot (i.e., “Nao”) that cannot turn its eyes. The robot’s inability to turn its eyes was a limitation that prevented the robot from resembling a human agent, and eye-gazing is among the primary elements of JA [28, 29].

Thus, we selected the communication robot “CommU” (Fig. 1; Vstone Co., Ltd.) [30, 31] to facilitate JA. CommU has clear eyes and can turn its eyes. Because eye contact is a basic social skill that children with ASD often lack, CommU’s clear eyes allow the children to recognize and interpret the communication signals and are expected to facilitate JA.

Fig. 1
figure 1

CommU

Full size image

We compared the behavior of children with ASD with that of children with typical development (TD) during a JA elicitation task while the children interacted with a human or a robotic agent. The primary objective of this study was to test whether the robot is more useful in facilitating JA than a human agent in children with ASD during an interactive session. Second, we tested whether children with ASD show improvement in JA during human interactions after interacting with the robot CommU. Third, we tested whether the robot is more useful in facilitating JA in children with ASD than children with TD. We hypothesized that (a) children with ASD would demonstrate better JA under the CommU condition than under the human agent condition, (b) children with ASD would show improvement in JA tasks with a human after interacting with CommU, and (c) the facilitative effect of JA due to robot intervention would be larger in children with ASD than in TD children.

The age of the participants naturally affects the outcome of experiments investigating JA. JA performance in older children with ASD (mean age 9.25 ± 1.87 years) is similar to that in TD children during interactions with a human agent [14]. However, these experiments are too difficult for younger children to complete. In fact, in a previous study [28] involving children with ASD under 5 years of age, many participants dropped out of the study. In our preliminary study (unpublished), many children younger than 4 years of age were afraid of CommU and could not participate in the study. This confounding factor should be minimized using subjects within a narrow age range over 5 years. In addition, Vailouli et al. [32] suggested that challenges with JA do not abate, even at the time the child enters elementary school. There are several studies reporting the efficacy of JA intervention in children with ASD older than 5 years of age. For example, Vailouli et al. [32] have shown that JA intervention for children with ASD between the ages of 5 and 7 years was effective in promoting social engagement. Eissa [33] showed that JA intervention for children with ASD between the ages of 5 and 7 years was effective in improving eye contact, gesturing, following instructions, initiating caressing/singing, and communication skills. Therefore, we studied participants whose age range was limited to 5–6 years.

Methods

Participants

The present study was approved by the ethics committee of Kanazawa University. All participants were recruited from the Research Center for Child Mental Development, Kanazawa University. All procedures involving human participants were conducted according to the ethical standards of the institutional and/or national research committee and the 1964 Helsinki Declaration and its subsequent amendments or comparable ethical standards. After providing a complete explanation of the study, all participants provided written informed consent. All participants and their guardians agreed to participate in the study. The inclusion criteria for the participants were as follows: (1) age 5–6 years, (2) mental processing score on the Kaufman Assessment Battery for Children (K-ABC) [34] ≥ 70, and (3) acquisition score on the K-ABC ≥ 70. The K-ABC was employed to estimate the intelligence levels of the children. The children with ASD were diagnosed using the Autism Diagnostic Observational Schedule-Generic (ADOS-G) [35], the Diagnostic Interview for Social and Communication Disorders (DISCO) [36], and the DSM-5 criteria at the time of recruitment for this study. Children with ASD were included in this study if they met the diagnosis criteria for childhood autism, atypical autism or Asperger’s syndrome with DISCO or the ADOS criteria for an autism spectrum disorder.

The parents of the children in the TD group completed the Social Communication Questionnaire (SCQ) [37] to screen for clinically significant ASD symptoms in the TD children. Furthermore, to exclude children with psychiatric diagnoses, the Mini-International Neuropsychiatric Interview for Children and Adolescents (MINI Kids) [38, 39] was administered.

Procedures

Both the children with ASD and the TD children were randomly assigned to one of two groups (see Fig. 2). The participants completed a sequence of three interaction conditions that were done consecutively within the same visit. In the robotic intervention group, the participants interacted with “human A,” “CommU,” and “human A.” In the control group, the participants interacted with “human A,” “human B,” and “human A.” The participants were informed of the interaction order after the group assignments. During each session, the participants interacted with the robot or human agent for approximately 5 min (i.e., the participants in each group had approximately 15 min of total interaction). During each interaction, a human agent or “CommU” followed a specific interview script and protocol. Across the sessions, the scripts were slightly varied to promote engagement but followed the same basic structure. Please refer to the Additional file 1 for examples of the scripts.

Fig. 2
figure 2

Participant flow

Full size image

During the “CommU” session, the robot was placed on a table in the middle of the room. To elicit the belief that the robot behaved and responded autonomously, we adopted a Wizard-of-Oz scheme similar to the systems conventionally used in robotics studies [40]. Specifically, the robot was operated by the researchers, who sat in front of a terminal computer located against a wall in the experimental room; the researchers were not visible during the trial. The participants were not informed that the robots were controlled by the researchers. The researchers operated the robots according to the prepared scripts.

To capture the relevant information, a simple joint interaction performance was prepared. A child-sized table with chairs was set up in the middle of the experimental room. The parents were invited to sit 150 cm diagonally behind their child. CommU or a human agent was seated in front of the participant at a distance of 150 cm. We placed CommU on a desk at a height similar to that of a human agent. Two images were placed on the left and right sides of the participant, which were used as the foci of attention by the system. The images were 21 cm × 29.7 cm (width × height). The images were replaced each session. The images were placed at locations 200 cm to the side of the participant. Figures 3 (robotic setting) and Fig. 4 (human agent setting) illustrate the experimental room setup.

Fig. 3
figure 3

Experimental room setting during the robotic intervention session

Full size image
Fig. 4
figure 4

Experimental room setting during the human agent session

Full size image

During each session, the participants were individually brought to the room by a research assistant and were accompanied by their parents, who remained in the room throughout the entire procedure. Each trial lasted as long as the participants were comfortable in the room and ended immediately if the children indicated that they wanted to stop the interaction or if the prepared content of the interaction had been completed.

During the latter half of each interaction session, after calling “Ne!,” which corresponds to the English “Hey!” (we used this syllable because /ne/ is a sentence-ending word in Japanese and conveys prosodic information [41]), the human agent or CommU attempted to induce JA by alternatively gazing toward the child for 1 s and then toward the image on the left side of the participant for 3 s; then, without calling, the agent again gazed toward the child for 1 s and then toward the image for 3 s. Then, the human agent or CommU gazed again toward the child for 1 s and then toward the other image on right side of the participant for 3 s using the same procedure, first after calling “Ne!,” and second without calling “Ne!” (i.e., the human agent or CommU attempted to induce JA four times during each interaction session). Three digital videos were set up to capture any participant response to the social prompts for an off-line analysis. Figure 5 provides an example of how the participants typically interacted with the robots. The person in this manuscript provided written informed consent to publish this picture. He agreed to publish the picture.

Fig. 5
figure 5

Typical interaction with the robot

Full size image

“Achievement of JA” was defined as a participant responding (i.e., turning to look at) to the correct target within the 3 s window. Regardless of the participant response, the human agent or robot returned to a neutral position (standing straight and facing the participant) after each prompt. Each “achievement of JA” was measured offline by counting the number of times the child turned his/her head and/or eyes in the direction of the target without fully turning, following the social prompt. Each JA event was rated a 1 (success) or 0 (failure). Each score in each interaction was calculated by simple addition (maximum score = 4). Two trainers who did not know the objective of this study independently rated the scores by watching the videotape. The raters attained a high degree of reliability (intraclass coefficient (ICC) = .98). If their scores differed, they watched the videotape together and determined the score.

Robotic platform

CommU (Vstone Co., Ltd.) is 304 mm tall. CommU has 14 ° of freedom (DoFs) as follows: waist (2), left shoulder (2), right shoulder (2), neck (3), eyes (3), eyelids (1), and lips (1). The careful design of the eyes and multiple DoFs dedicated to controlling its field of vision contribute to its rich gaze expressions. Its face can show a range of simplified expressions that are less complex than those of a real human face. The robot’s cute shape, which resembles a child, is expected to be easy to anthropomorphize. Furthermore, its small and cute appearance is expected to help prevent fearfulness among children. In addition, CommU makes very little noise, and its interlocutor is not distressed by its noise.

Statistical analysis

The statistical analyses were performed using SPSS version 24.0 (IBM, Armonk, NY, USA). Descriptive statistics were performed to describe the sample. The differences between the groups in terms of age, K-ABC mental processing score, and K-ABC achievement score were analyzed by performing independent samples t tests. The gender proportion was analyzed by performing a χ2 test. To test the first hypothesis that children with ASD would demonstrate better JA under the CommU condition than under the human agent condition, a two-way mixed ANOVA was performed to analyze the collected data from the children with ASD (JA) with one repeated factor (time; first and second interactive sessions) and one group factor (i.e., robot intervention group vs. control group). To test the second hypothesis that children with ASD would exhibit improved JA tasks with human after interacting with CommU, a two-way mixed ANOVA was performed to analyze the collected data from the children with ASD (JA) with one repeated factor (time; first and third interactive sessions) and one group factor (i.e., robot intervention group vs. control group). To test the third hypothesis that JA was facilitated differently by the human and robot agents between the children with ASD and TD children in the robotic intervention group, a two-way mixed ANOVA was used to analyze the collected data (JA) with one repeated factor (time: first and second interactive sessions) and one group factor (ASD vs. TD). An alpha level of 0.05 was employed for these analyses.

Results

Demographic data

Thirty children with ASD (aged 5–6 years) and 38 children with typical development (TD) (aged 5–6 years) participated in this experiment. Two children with ASD who were assigned to the control group were unable to complete the study due to distress. The ASD robotic intervention group included 16 participants (12 males), with a mean age of 70.56 ± 6.09 months. The ASD control group included 12 participants (7 males), with a mean age of 69.00 ± 4.39 months. The TD robotic intervention group included 17 participants (11 males), with a mean age of 69.88 ± 5.88 months. The TD control intervention group included 21 participants (14 males) with a mean age of 67.62 ± 6.03 months. No significant differences were observed among the groups in terms of the mean age, gender proportion, K-ABC mental processing score, or K-ABC achievement score. The SCQ total score of all participants was under 10. The participant details are presented in Table 1.

Table 1 Descriptive characteristics of the participants in the ASD robot intervention group, ASD control group, TD robot intervention group, and TD control group
Full size table

Performance of the children during the JA task

Regarding the differences in the ratings of JA between the robotic interaction and human agent groups in the children with ASD, the results of a two-way mixed ANOVA with one repeated factor (time; first and second interactive sessions) and one group factor (i.e., robot intervention group vs. control group) showed a significant interaction between the time and group effect (F (1, 26) = 11.45; p < 0.01; see Fig. 6). This result supported our first hypothesis that children with ASD would demonstrate better JA under the CommU condition than under the human agent condition. In addition, the results of a two-way mixed ANOVA with one repeated factor (time; first and third interactive sessions) and one group factor (i.e., robot intervention group vs. control group) showed a significant interaction between the time and group effect (F (1, 26) = 8.90; p < 0.01; see Fig. 6). This result supported our second hypothesis that children with ASD would exhibit improvement in JA tasks with human after interacting with CommU.

Fig. 6
figure 6

Mean rating of the joint attention in the robotic intervention and control groups (i.e., human interaction) in the children with ASD

Full size image

Regarding the differences in the ratings of the JA under the robotic condition between the ASD and TD children, the results of a two-way mixed ANOVA with one repeated factor (time; first and second interactive sessions) and one group factor (i.e., ASD vs. TD) showed a significant interaction between the time and group effect (F (1, 31) = 8.00; p < 0.01; see Fig. 7). This result supported our third hypothesis that the facilitative effect of JA due to robot intervention would be larger in children with ASD than in TD children. The details are presented in Table 2.

Fig. 7
figure 7

Mean rating of the joint attention in the robotic intervention group in the children with ASD and TD children

Full size image
Table 2 Performance of the participants in the ASD robot intervention group, ASD control group, TD robot intervention group, and TD control group during the JA task
Full size table

Among the children with ASD in the robotic interaction group, 8 of 16 participants (50.0% of total sample) had improved JA responses, and no participants had worsened JA responses under the human agent condition before vs. after interaction with CommU (i.e., first and third interactive sessions).

Discussion

In the current study, we examined the differences between children with ASD and TD children in their responses to induction of JA by either a human or robotic agent with clear eyes that can turn its eyes. The children with ASD who interacted with the robot had better outcomes in terms of JA than the children who interacted with a human agent during all sessions and exhibited improved performance in a JA task with human after interacting with the robot. In addition, the facilitative effect of JA due to robot intervention was larger in children with ASD than in TD children. While we used a simple design, our aim was to provide preliminary data regarding which agent better elicits JA from children with ASD and TD children with the goal of designing appropriate and tailored robotic intervention paradigms in the future.

The results of this study demonstrate that simple exposure to the robot CommU increased JA. Interestingly, this occurred in the absence of specific guidance and special settings (i.e., we used simple pictures on paper as the target objects.). Thus, utilizing this robot could contribute to improvements in JA.

Many interventions using non-social objects are available for children with ASD; however, humanoid robot-assisted interventions could be more interesting to the children than two-dimensional programs (i.e., virtual reality) [42] because the physical presence of a robot allows for a more engaging and enjoyable interaction than the use of virtual agents [43, 44]. In this study, many children with ASD showed sustained motivation to interact with the robot, which is an important factor in facilitating JA.

Madipakkam et al. [45] suggested that children with ASD exhibit an atypical response to eye contact due to their unconscious avoidance of eye contact. Thus, CommU’s clear eyes likely urged the children with ASD to pay attention to the existence of its eyes. In previous studies using Flobi, which has clear eyes and can turn its eyes, the children with ASD paid attention to the robot’s eyes [46]. In contrast, in previous studies using Nao, whose eyes are relatively small, although the children with ASD appeared to be absorbed by the robot, they could not pay attention to its eyes [14, 27, 28]. Notably, Nao is a strong attractor for children with ASD. Nao does not highly resemble a human; thus, children with ASD do not feel threatened. However, Nao’s body parts may not lead to the best results, as the attractive body parts can prevent the children from attending to a third object [29]. While brightly colored body parts attract attention, they must not be so bright as to over-stimulate the child in order to prompt JA. The color of the body parts of CommU is quiet and may contribute to the facilitation of JA in this study.

Pierno et al. [22] showed that during an imitation task, facilitation effects were only observed under the human agent condition in the TD children and only under the robot condition in ASD children. Our results are consistent with these findings in terms of the behaviors of the ASD children toward the robots and the behaviors of the TD children toward the human agents. One plausible theory might be that the complexity of the tasks completed by the robot and the human partner differ considerably. That is, variables in human behaviors include body pose, head pose, facial expression, head rotation during the experiment, and special unintentional gestures not present in the robotic experiment. The much larger number of potential uncontrolled variables in the experiments with the human partner makes it difficult to improve performance for children with ASD. Using a more complex robot like iCub [47] which has many other variables, it may be impossible to improve performance in children with ASD. Future studies using robots with different degrees of social complexity for children with various social abilities would help clarify an important factor in facilitating JA in children with ASD.

Although the changes observed in children with ASD in the robotic intervention group were statistically significant, we must consider whether they are also clinically significant. On average, the total JA score improved by 0.69 following interaction with CommU (i.e., first vs. third interactive sessions). This comprises an increase of 69% when compared to the pre-test score. In contrast, the total JA score was reduced by 0.25 in children with ASD in the control group following interaction with “human B” (i.e., first vs. third interactive sessions). This indicates that JA can improve in children with ASD in a quite limited number of sessions over a short period. Although the children in this sample demonstrated variable baseline JA skills under the human agent condition (i.e., first interactive session), 8 of 16 participants (50.0% of total sample) had improved JA responses, and no participants had worsened JA responses following interaction with CommU. Collectively, these findings suggest that robotic intervention successfully improved JA. Therefore, we believe that this increase is clinically relevant.

The strength of this study is its simple setting (i.e., we used simple pictures on paper as the target objects.) compared to that in previous studies [14, 28, 48]. The participants had no previous experience interacting with an unfamiliar robot. Notably, the children with ASD, who are generally weak in novel settings, demonstrated better JA during the interactions with the robot than with humans, and they exhibited improvement in JA tasks with human after interacting with the robot.

Certain limitations must be acknowledged. First, this study was a single session study and did not provide any indication of whether the children respond similarly over multiple sessions. Multiple sessions may offer a more extensive understanding of habituation to the robotic agent over time. While the current study did not test habituation effects in any way, it represents one of the first systematic investigations of JA using robots in children with ASD. Future studies should evaluate habituation effects with the robots by observing JA over an extended period. In addition, we do not have evidence supporting the generalizability of acquired JA to daily life. Therefore, we cannot comment on the social utility of our intervention program. The ultimate goal of the program is to enhance communication skills in daily life. In order to examine whether our program can attain this goal, future studies with a long-term longitudinal design are needed to confirm the generalized effect of this intervention in daily life (e.g., in kindergarten and at home). Third, the studied group had average cognitive skills. Clearly, future studies involving a broader range of functioning individuals are necessary to obtain a richer understanding of the potential use and impact of robotic interventions.

Conclusions

In conclusion, as hypothesized, the children with ASD demonstrated better JA during their interaction with the robot which has clear eyes and can turn its eyes than during their interaction with the human agents. In addition, the children with ASD exhibited improved JA tasks with human after interacting with the robot. While robotic technologies are considered potential vehicles for enhancing skills in children with ASD, few studies have shown such an impact using experimental designs relevant to core challenging areas. It is both unrealistic and unlikely that robotic technology will constitute a sufficient intervention paradigm addressing all areas of impairment for all individuals with the disorder in the immediate future. Given the current state of robotic technologies, we recommend that robots be used as adjunctive tools for short-term training in individuals with ASD. The findings of this study represent a meaningful contribution to the literature on the impact of robots on JA and provide information regarding the suitability of specific robot types for therapeutic use.

Abbreviations

ASD:

Autism spectrum disorders

DSM-5:

Diagnostic and Statistical Manual of Mental Disorders

JA:

Joint attention

K-ABC:

Kaufman Assessment Battery for Children

MINI Kids:

Mini-International Neuropsychiatric Interview for Children and Adolescents

SCQ:

Social Communication Questionnaire

TD:

Typical development

References

  1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington, VA: American Psychiatric Publishing; 2013.

    Book  Google Scholar 

  2. Charman T, Baron-Cohen S, Swettenham J, Baird G, Drew A, Cox A. Predicting language outcome in infants with autism and pervasive developmental disorder. Int J Lang Commun Disord. 2003;38:265–85.

    Article  PubMed  Google Scholar 

  3. Delinicolas EK, Young RL. Joint attention, language, social relating, and stereotypical behaviours in children with autistic disorder. Autism. 2007;11:425–36.

    Article  PubMed  Google Scholar 

  4. Mundy P, Block J, Delgado C, Pomares Y, Van Hecke AV, Parlade MV. Individual differences and the development of joint attention in infancy. Child Dev. 2007;78:938–54.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Schertz HH, Odom SL, Baggett KM, Sideris JH. Effects of joint attention mediated learning for toddlers with autism spectrum disorders: an initial randomized controlled study. Early Child Res Q. 2013;28:249–58.

    Article  Google Scholar 

  6. Schietecatte I, Roeyers H, Warreyn P. Exploring the nature of joint attention impairments in young children with autism spectrum disorder: associated social and cognitive skills. J Autism Dev Disord. 2012;42:1–12.

    Article  PubMed  Google Scholar 

  7. Mundy P, Sigman M, Kasari C. A longitudinal study of joint attention and language development in autistic children. J Autism Dev Disord. 1990;20:115–28.

    Article  CAS  PubMed  Google Scholar 

  8. Murza KA, Schwartz JB, Hahs-Vaughn DL, Nye C. Joint attention interventions for children with autism spectrum disorder: a systematic review and meta-analysis. Int J Lang Commun Disord. 2016;51:236–51.

    Article  PubMed  Google Scholar 

  9. Mundy P, Kim K, McIntyre N, Lerro L, Jarrold W. Brief report: joint attention and information processing in children with higher functioning autism spectrum disorders. J Autism Dev Disord. 2016;46:2555–60.

    Article  PubMed  Google Scholar 

  10. Kasari C, Gulsrud AC, Wong C, Kwon S, Locke J. Randomized controlled caregiver mediated joint engagement intervention for toddlers with autism. J Autism Dev Disord. 2010;40:1045–56.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Poon KK, Watson LR, Baranek GT, Poe MD. To what extent do joint attention, imitation, and object play behaviors in infancy predict later communication and intellectual functioning in ASD? J Autism Dev Disord. 2012;42:1064–74.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Dawson G, Meltzoff AN, Osterling J, Rinaldi J, Brown E. Children with autism fail to orient to naturally occurring social stimuli. J Autism Dev Disord. 1998;28:479–85.

    Article  CAS  PubMed  Google Scholar 

  13. Courchesne E, Chisum H, Townsend J. Neural activity-dependent brain changes in development: implications for psychopathology. Dev Psychopathol. 1994;6:697–722. https://doi.org/10.1017/S0954579400004740.

  14. Anzalone SM, Tilmont E, Boucenna S, Xavier J, Jouen A-L, Bodeau N, et al. How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D+time) environment during a joint attention induction task with a robot. Res Autism Spec Disord. 2014;8:814–26.

    Article  Google Scholar 

  15. Scott JG, Saint-Georges C, Mahdhaoui A, Chetouani M, Cassel RS, Laznik M-C, et al. Do parents recognize autistic deviant behavior long before diagnosis? Taking into account interaction using computational methods. PLoS One. 2011;6:e22393.

    Article  CAS  Google Scholar 

  16. White SA, Cohen D, Cassel RS, Saint-Georges C, Mahdhaoui A, Laznik M-C, et al. Do parentese prosody and fathers’ involvement in interacting facilitate social interaction in infants who later develop autism? PLoS One. 2013;8:e61402.

    Article  Google Scholar 

  17. Klin A, Lin DJ, Gorrindo P, Ramsay G, Jones W. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 2009;459:257–61.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Baron-Cohen S. The hyper-systemizing, assortative mating theory of autism. Prog Neuro-Psychopharmacol Biol Psychiatry. 2006;30:865–72.

    Article  Google Scholar 

  19. Baron-Cohen S. The extreme male brain theory of autism. Trends Cogn Sci. 2002;6:248–54.

    Article  PubMed  Google Scholar 

  20. Kumazaki H, Muramatsu T, Yoshikawa Y, Matsumoto Y, Miyao M, Ishiguro H, et al. Tele-operating an android robot to promote the understanding of facial expressions and to increase facial expressivity in individuals with autism spectrum disorder. Am J Psychiatry. 2017;174:904–5.

    Article  PubMed  Google Scholar 

  21. Cook J, Swapp D, Pan X, Bianchi-Berthouze N, Blakemore SJ. Atypical interference effect of action observation in autism spectrum conditions. Psychol Med. 2014;44:731–40.

    Article  CAS  PubMed  Google Scholar 

  22. Pierno AC, Mari M, Lusher D, Castiello U. Robotic movement elicits visuomotor priming in children with autism. Neuropsychologia. 2008;46:448–54.

    Article  PubMed  Google Scholar 

  23. Yun SS, Choi J, Park SK, Bong GY, Yoo H. Social skills training for children with autism spectrum disorder using a robotic behavioral intervention system. Autism Res. 2017;10:1306–23.

    Article  PubMed  Google Scholar 

  24. Huskens B, Palmen A, Van der Werff M, Lourens T, Barakova E. Improving collaborative play between children with autism spectrum disorders and their siblings: the effectiveness of a robot-mediated intervention based on Lego® therapy. J Autism Dev Disord. 2015;45:3746–55.

    Article  PubMed  Google Scholar 

  25. Diehl JJ, Schmitt LM, Villano M, Crowell CR. The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res Autism Spectr Disord. 2012;6:249–62.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Bird G, Leighton J, Press C, Heyes C. Intact automatic imitation of human and robot actions in autism spectrum disorders. Proc Biol Sci. 2007;274:3027–31.

    PubMed  PubMed Central  Google Scholar 

  27. Warren ZE, Zheng Z, Swanson AR, Bekele E, Zhang L, Crittendon JA, et al. Can robotic interaction improve joint attention skills? J Autism Dev Disord. 2015;45:3726–34.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Bekele E, Crittendon JA, Swanson A, Sarkar N, Warren ZE. Pilot clinical application of an adaptive robotic system for young children with autism. Autism. 2014;18:598–608.

    Article  PubMed  Google Scholar 

  29. Pennisi P, Tonacci A, Tartarisco G, Billeci L, Ruta L, Gangemi S, et al. Autism and social robotics: a systematic review. Autism Res. 2016;9:165–83.

    Article  PubMed  Google Scholar 

  30. Shimaya J, Yoshikawa Y, Matsumoto Y, Kumazaki H, Ishiguro H, Mimura M, et al. Advantages of indirect conversation via a desktop humanoid robot: case study on daily life guidance for adolescents with autism spectrum disorders. 25th IEEE Int Symp Robot Hum Interact Commun. 2016:831–6.

  31. Kumazaki H, Warren Z, Swanson A, Yoshikawa Y, Matsumoto Y, Takahashi H, et al. Can robotic systems promote self-disclosure in adolescents with autism spectrum disorder? A pilot study. Front Psychiatry. 2018;9:36.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Vaiouli P, Grimmet K, Ruich LJ. “Bill is now singing”: joint engagement and the emergence of social communication of three young children with autism. Autism. 2013;19:73–83.

    Article  PubMed  Google Scholar 

  33. Eissa MA. The effectiveness of a joint attention training program on improving communication skills of children with autism spectrum disorder. Int J Psycho-Educational Sci. 2015;4:3–12.

    Google Scholar 

  34. Kaufman A, Kaufman N. Kaufman assessment battery for children: administration and scoring manual. Circle Pines, MN: American Guidance Service; 1983.

    Google Scholar 

  35. Lord C, Risi S, Lambrecht L, Cook EH Jr, Leventhal BL, DiLavore PC, et al. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000;30:205–23.

    Article  CAS  PubMed  Google Scholar 

  36. Wing L, Leekam SR, Libby SJ, Gould J, Larcombe M. The diagnostic interview for social and communication disorders: background, inter-rater reliability and clinical use. J Child Psychol Psychiatry. 2002;43:307–25.

    Article  PubMed  Google Scholar 

  37. Rutter M, Bailey A, Lord C. The social communication questionnaire. Los Angeles, CA: Western Psychological Services; 2010.

    Google Scholar 

  38. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33. quiz 34

    PubMed  Google Scholar 

  39. Otsubo T, Tanaka K, Koda R, Shinoda J, Sano N, Tanaka S, et al. Reliability and validity of Japanese version of the Mini-International Neuropsychiatric Interview. Psychiatry Clin Neurosci. 2005;59:517–26.

    Article  PubMed  Google Scholar 

  40. Nishio S, Taura K, Sumioka H, Ishiguro H. Teleoperated android robot as emotion regulation media. Int J Soc Rob. 2013;5:563–73.

    Article  Google Scholar 

  41. Anderson V, Hiramoto M, Wong A. Prosodic analysis of the interactional particle ne in Japanese gendered speech. Japanese/Korean Linguis. 2007;15:43–54.

    Google Scholar 

  42. Pan Y, Steed A. A comparison of avatar-, video-, and robot-mediated interaction on users’ trust in expertise. Front Robot AI. 2016;3. https://doi.org/10.3389/frobt.2016.00012.

  43. Lee KM, Jung Y, Kim J, Kim SR. Are physically embodied social agents better than disembodied social agents? The effects of physical embodiment, tactile interaction, and people's loneliness in human–robot interaction. Int J Hum Comput Stud. 2006;64:962–73.

    Article  Google Scholar 

  44. Wainer J, Feil-seifer D, Shell D, Mataric M. The role of physical embodiment in human-robot interaction. 15th IEEE Int Symp Robot Hum Interactive Commun. 2006:117–22.

  45. Madipakkam AR, Rothkirch M, Dziobek I, Sterzer P. Unconscious avoidance of eye contact in autism spectrum disorder. Sci Rep. 2017;7:13378.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  46. Damm O, Malchus K, Jaecks P, Krach S, Paulus F, Naber M, et al. Different gaze behavior in human-robot interaction in Asperger’s syndrome: an eye-tracking study. IEEE RO-MAN. 2013:368–9.

  47. Metta G, Natale L, Nori F, Sandini G, Vernon D, Fadiga L, et al. The iCub humanoid robot: an open-systems platform for research in cognitive development. Neural Netw. 2010;23:1125–34.

    Article  PubMed  Google Scholar 

  48. Warren Z, Zheng Z, Das S, Young EM, Swanson A, Weitlauf A, et al. Brief report: development of a robotic intervention platform for young children with ASD. J Autism Dev Disord. 2015;45:3870–6.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We sincerely thank the participants and all the families who participated in this study. We thank M. Ozawa, Y. Morita, S. Kitagawa, and Y. Saotome for assisting with the data collection.

Funding

This study was partially supported by Grants-in-Aid for Scientific Research from the Japan Society for the Promotion of Science (17H05857), ERATO ISHIGURO Symbiotic Human-Robot Interaction Project and the Center of Innovation Program from the Japan Science and Technology Agency, JST, Japan.

Author information

Authors and Affiliations

  1. Research Center for Child Mental Development, Kanazawa University, 13-1, Takaramachi, Kanazawa, Ishikawa, 920-8640, Japan

    Hirokazu Kumazaki, Yuko Yoshimura, Takashi Ikeda, Chiaki Hasegawa, Daisuke N. Saito, Sara Tomiyama, Kyung-min An, Yoshio Minabe & Mitsuru Kikuchi

  2. Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, 1-3, Machikaneryamachou, Toyonaka, Osaka, 560-0043, Japan

    Yuichiro Yoshikawa, Jiro Shimaya & Hiroshi Ishiguro

  3. Service Robotics Research Group, Intelligent Systems Institute, National Institute of Advanced Industrial Science and Technology, Ibaraki, 305-8560, Japan

    Yoshio Matsumoto

Authors
  1. Hirokazu Kumazaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuichiro Yoshikawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuko Yoshimura
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Takashi Ikeda
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Chiaki Hasegawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Daisuke N. Saito
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sara Tomiyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Kyung-min An
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Jiro Shimaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Hiroshi Ishiguro
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Yoshio Matsumoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Yoshio Minabe
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Mitsuru Kikuchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HK designed the study, conducted the experiment, performed the statistical analyses, analyzed and interpreted the data, and drafted the manuscript. YuiY, YukY, TI, CH, DS, ST, AK, JS, HI, YMa, YMi, and MK conceived the study, participated in its design, assisted with the data collection and scoring of the behavioral measures, analyzed and interpreted the data, were involved in drafting the manuscript, and revised the manuscript critically for important intellectual content. MK was involved in the final approval of the version to be published. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Hirokazu Kumazaki.

Ethics declarations

Competing interests

Yuichiro Yoshikawa and Hiroshi Ishiguro serve as consultants for Vstone Co. Ltd. Hiroshi Ishiguro owns stock in the same company. This involvement does not alter our adherence to the Molecular Autism policies regarding sharing data and materials.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The following scripts are example of the scripts. Each session lasted approximately 5 min. (DOCX 18 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumazaki, H., Yoshikawa, Y., Yoshimura, Y. et al. The impact of robotic intervention on joint attention in children with autism spectrum disorders. Molecular Autism 9, 46 (2018). https://doi.org/10.1186/s13229-018-0230-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13229-018-0230-8

Keywords

Molecular Autism

ISSN: 2040-2392