- Open Access
Objective measurement of head movement differences in children with and without autism spectrum disorder
Molecular Autismvolume 9, Article number: 14 (2018)
Deficits in motor movement in children with autism spectrum disorder (ASD) have typically been characterized qualitatively by human observers. Although clinicians have noted the importance of atypical head positioning (e.g. social peering and repetitive head banging) when diagnosing children with ASD, a quantitative understanding of head movement in ASD is lacking. Here, we conduct a quantitative comparison of head movement dynamics in children with and without ASD using automated, person-independent computer-vision based head tracking (Zface). Because children with ASD often exhibit preferential attention to nonsocial versus social stimuli, we investigated whether children with and without ASD differed in their head movement dynamics depending on stimulus sociality.
The current study examined differences in head movement dynamics in children with (n = 21) and without ASD (n = 21). Children were video-recorded while watching a 16-min video of social and nonsocial stimuli. Three dimensions of rigid head movement—pitch (head nods), yaw (head turns), and roll (lateral head inclinations)—were tracked using Zface. The root mean square of pitch, yaw, and roll was calculated to index the magnitude of head angular displacement (quantity of head movement) and angular velocity (speed).
Compared with children without ASD, children with ASD exhibited greater yaw displacement, indicating greater head turning, and greater velocity of yaw and roll, indicating faster head turning and inclination. Follow-up analyses indicated that differences in head movement dynamics were specific to the social rather than the nonsocial stimulus condition.
Head movement dynamics (displacement and velocity) were greater in children with ASD than in children without ASD, providing a quantitative foundation for previous clinical reports. Head movement differences were evident in lateral (yaw and roll) but not vertical (pitch) movement and were specific to a social rather than nonsocial condition. When presented with social stimuli, children with ASD had higher levels of head movement and moved their heads more quickly than children without ASD. Children with ASD may use head movement to modulate their perception of social scenes.
Autism spectrum disorder (ASD) is characterized by persistent impairments in social interaction and communication, as well as repetitive and stereotyped behaviors . Previous research has identified deficits in motor development  and higher levels of motor stereotypies in children with ASD than children without ASD . Atypical movement patterns, such as abnormalities in eye contact and body posture, and motor stereotypies are used in the evaluation of ASD, but little attention has focused on characterizing these motor differences through automated, objective measurement [1, 3, 4]. The current study examined whether head movement dynamics differentiated children with and without ASD, and contrasted head movement while watching video of nonsocial and social stimuli.
While movement stereotypies are common in typically developing infants, they decrease rapidly over the first 2 years of life . Atypical head movements in young children have garnered little attention, even though this stereotypy is clinically viewed as highly suggestive of ASD [3, 5, 6]. Descriptively, clinicians have noted that children with ASD exhibit atypical head movements as they stare at their fingers or objects closely from a “strange angle” , repetitively peer at objects “from the side” , and examine objects from “odd angles or peripheral vision” . Goldman et al.  found that this stereotypy is rare, but seemingly specific to children with ASD.
Head movement stereotypy may be an adaptive strategy that facilitates perception or social communication [9, 10]. Turning away from over-stimulating stimuli often marks a child’s need to self-regulate . By engaging in head movement stereotypies or similar movements, individuals with ASD may be regulating incoming visual and social information that is perceived as over-arousing .
On the other hand, atypical head movements in children with ASD may contribute to the social impairments that characterize children with ASD. Motor movement is crucial for verbal and nonverbal communication, formation of friendships, and the maintenance of social interactions. Head nods and turns, for example, serve to influence turn-taking between social partners . In successful social interactions, motor movements must be initiated and coordinated  as typical motor control functions link the perception of other’s actions and one’s own actions . Motor delays in ASD, such as the inability to coordinate functional head and arm movements, may prevent head turning in response to one’s name and gaze following, and contribute to failures to engage in gestural nonverbal communication such as joint attention . Better quantification of these motor movements will further our understanding of their role in the development of ASD.
Motor movement in ASD has typically been assessed descriptively via parent report and trained human observers. While parents have opportunities to observe their children in multiple contexts, their reports are prone to bias [4, 15]. Coding schemes of motor movement and stereotypies conducted by trained observers are frequently study-specific and receive little or no independent validation [3, 16]. In response to the limitations of qualitative efforts, automated measurement has been used to objectively document atypical motor movement and stereotypies [3, 4, 16,17,18]. ASD is associated with atypical gait in toddlers and children [19,20,21,22], reduced postural stability in children [23,24,25,26], and increased repetitive and stereotypic behaviors in children [3, 27, 28]. A recent meta-analysis revealed that motor impairments in movement preparation, upper extremity motor function, and gait were significantly more pronounced in individuals with ASD than individuals without ASD .
Automated measurement and machine-learning algorithms have been used to examine motor movements to both enhance clinical assessment [29, 30] and to elucidate the mechanisms and heterogeneity of ASD [22, 31,32,33]. Machine learning algorithms have successfully distinguished children with severe ASD (age 2–4 years) from children without ASD during a reach-to-grasp task . Machine learning analysis of motor patterns of children playing with smart tablet computers correctly identified children with ASD from children without ASD . Children with ASD contacted the table with greater force, had different distributions of force within a gesture, and displayed faster and larger movements than children without ASD [30, 32].
An initial report on postural sway examined head movement differences between children with and without ASD. Children with ASD exhibited greater head movement and sway while standing than children without ASD, and both groups reduced their postural sway during performance of a nonsocial task . However, with the exception of postural sway tasks , investigations of motor movement have not focused on head movements in children with and without ASD. Taken together, previous research supports the importance of head movement atypicalities in ASD and suggests they warrant further exploration.
We conducted a quantitative comparison of head movement dynamics in children with and without ASD, matched on mental age, between 2.5- and 6.5-years-old, using an automated head tracking system. In lieu of subjective, manual coding, automated tracking provided objective measurement to quantify differences in head movement dynamics. We hypothesized that children with ASD would exhibit greater and more rapid head movement than children without ASD. As children with ASD typically exhibit preferential attention to nonsocial versus social stimuli [34,35,36], we conducted an a priori analysis to ascertain whether differences in head movement dynamics between children with and without ASD varied by social and nonsocial stimulus presentation.
Participants were 2.5–6.5-year-old children (mean = 4.72 years, SD = 1.14 years, range = 4.25 years) with (n = 21) and without (n = 21) ASD. Children with ASD were the older siblings of infants recruited from a longitudinal study of high-risk development. Children without ASD were typically developing children, with no reported risks or diagnoses at the time of study, and were recruited from a longitudinal study of high-risk development and from the community, through recruitment flyers. Children were excluded from the study if they had a gestational age below 37 weeks or major birth complications. Parents were reimbursed $50 for their child’s participation in the study. Recruitment and procedures were approved by the University’s Internal Review Board and written, parental consent was obtained before participation.
Measures and procedure
Clinical diagnosis of ASD or the absence of ASD was determined at study entry. The Autism Diagnostic Observation Schedule  and Autism Diagnostic Interview-Revised  were used to inform the DSM-IV-based best estimate diagnosis from a licensed psychologist, who was unfamiliar with the child’s previous diagnosis. To assess children’s mental age, children were administered with either the Wechsler Preschool and Primary Scale of Intelligence (n = 33; WPPSI-III, ) or the Mullen Scales of Early Learning (n = 6; Mullen, ). The Mullen was typically administered when children were 37 months of age or younger. Except for two 36-month-olds (1 ASD, 1 No ASD), the WPPSI was administered when childern were older than 37 months. Three children (2 ASD, 1 No ASD) did not receive a cognitive assessment. Groups were comparable on the assessments administered, χ2(2) = 1.27, p = .53.
Groups were matched a priori on mental age . Groups did not differ on chronological age, F (1,41) = 4.00, p > .05; mental age, F (1,38) = .007, p > .05 (Table 1); or gender, Fisher’s exact test p = .58 (Table 2).
Children were seated approximately 65 cm in front of a 19-in. video monitor. They were asked to watch a short video, while a camera positioned on top of the monitor recorded their face and upper body at 29.971 frames/s. The protocol consisted of a 16-min video, composed of both social and nonsocial stimuli. The monitor displayed six videos of stimuli designed to elicit joint-attention and emotion expression in children. Video 1 was a 3-min social stimulus presentation of an actual boy pointing in a virtual environment to a side television of an animated character (SpongeBob), which was designed to elicit looks from the boy to the television (joint attention). Video 2 was a 2-min presentation of a non-social, audio-visual screensaver. Video 3 was a 3-min social stimulus presentation of an animated boy pointing in a virtual environment to a side television of an animated character (SpongeBob), which was designed to elicit looks from the boy to the television (joint attention). Video 4 was a social, 6-min emotion-eliciting story of a birthday party told by a woman. Video 5 was a social, 1-min Wonder Pets cartoon clip, and video 6 was a social, 1-min Mickey Mouse cartoon clip (Fig. 1).
Based on an a priori hypothesis, video 2 served as the nonsocial stimulus and the first 2-min of video 4 served as the social stimulus (the same pattern of results was observed when analyzing the full 6-min of video 4). Other videos contained a mixture of actual and animated figures and were not appropriate for sociality contrasts.
To quantify head movement dynamics, a fully automatic, person-independent computer-vision algorithm was used to track pitch, yaw, and roll of head movement (http://zface.org/, Zface, ). For each video frame, the algorithm registered a dense 3D face shape in real-time. This was accomplished using a fast cascade regression framework trained on high-resolution 3D face-scans of posed and spontaneous face and head motion. Zface was computationally efficient but delivered high precision tracking. Experimental findings strongly support the validity of real-time, 3D registration and reconstruction from 2D video . Compared to 10 other computer-vision based approaches for head tracking, Zface achieved the lowest absolute angular error for head pitch and the second lowest angular error for yaw (2.66 and 3.93 degrees, respectively) .
For each video frame, the algorithm outputted 3° of rigid head movement—pitch (vertical movement; head nods), yaw (horizontal movement; head turns), and roll (lateral head inclinations toward the shoulder) (Fig. 2) or a failure message when a frame could not be tracked (see Table 3 for the range of pitch, yaw, and roll).
17.4% of the frames could not be tracked, which is comparable with previous work in this area . Several conditions contributed to tracking failure, including self-occlusion (hands on the face), extreme head movement, and location change (e.g., i.e., child moved out of the frame). Proportions of successfully tracked frames were examined for ASD group differences.
To ensure that missing data would not bias measurements, head movement dynamics were measured separately for each consecutively tracked segment (epoch). Epochs were defined as successfully tracked consecutive frames within a video (mean epoch length = 577.35 frames, at 29.971 frames per second). A 2 (group) by 6 (video) repeated-measures ANOVA indicated that the number of epochs per video did not differ significantly between groups, F (40) = 2.70, p = .11, Marginal MeanASD = 18.1, Marginal MeanNonASD = 8.0. A 2 (group) by 6 (video) showed that the mean duration of an epoch also did not differ significantly between groups, F (40) = 1.89, p = .18, Marginal MeanASD = 747.98 frames/epoch, Marginal MeanNonASD = 1049.04 frames/epoch (Table 4). Nevertheless, children with ASD tended to have more epochs of briefer duration than children without ASD.
Within each epoch, head movement dynamics were quantified with respect to the three principal axes of pitch, yaw, and roll. For each of these axes, angular displacement and angular velocity were calculated for each frame of video. Angular values in displacement and velocity of pitch, yaw, and roll were measured in radians and radians/frame, respectively. For pitch, yaw, and roll, angular displacement was calculated as the difference between each observed head angle value and the overall mean of head angle within each epoch. Similarly, for pitch, yaw, and roll, angular velocity was calculated as the temporal derivative of the angular displacement for each movement direction using the finite difference method (the location difference between successive video frames).
The root mean square (RMS) then was used to measure the magnitude of angular displacement and angular velocity of pitch, yaw, and roll, respectively [44,45,46,47]. The RMS value was calculated as the square root of the arithmetic mean of the squares of the original values, in our case the angular displacements and the angular velocities. To account for the varying lengths of epochs caused by untracked frames, the RMS value for each epoch was weighted by its epoch duration. These weighted values were averaged across epochs to obtain a normalized RMS value (nRMS; Eq. 1). The obtained nRMS for angular displacement and angular velocity for pitch, yaw, and roll are used in subsequent analyses and are referred to as angular displacement and angular velocity for simplicity.
where x21…x2 n are the squared differences between the value of a frame and the mean value of frames within an epoch.
A preliminary 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) compared the proportion of successfully tracked frames by ASD group to determine whether children with and without ASD differed in levels of automated tracking.
ASD group differences
A second 2 (group) × 6 (video) repeated-measures ANOVA was used to test for differences between children with and without ASD in the angular displacement and angular velocity of pitch, yaw, and roll respectively. We hypothesized that children with ASD would exhibit greater angular displacement and angular velocity of pitch, yaw, and roll than children without ASD.
ASD group by stimulus type interaction
Planned contrasts were then used to test for the interaction between stimulus type (social versus nonsocial) and group (ASD versus no ASD). A 2 (group) × 2 (NonsocialVideo2 vs. SocialVideo4) repeated-measures ANOVAs examined whether children with and without ASD differed in pitch, yaw, and roll angular displacement and angular velocity separately between nonsocial (video 2) and social stimuli (video 4). All main analyses were then repeated covarying chronological age to determine the degree to which differences between the mental-age-matched groups might be due to chronological age. (Analyses of supplementary head movement variables, which yielded results similar to those outlined below, are found in Additional file 1.)
A one-way analysis of the proportion of successfully tracked frames over the entire course of the protocol revealed no group differences, F (39) = .08, p = .77, partial η2 = .003 (Fig. 3). A repeated-measures ANOVA indicated a main effect of video, F (3.58, 38) = 3.01, p = .03 partial η2 = .07, and no interaction of video by group, F (3.58, 38) = .15, p = .95, partial η2 = .004. There were no group differences in proportion of successfully tracked frames by video, ps > .69.
ASD group differences
For angular displacement, a 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) revealed main effects of video for pitch and yaw. No significant interactions of video and group were found for the angular displacement of pitch, yaw, and roll. Children with ASD exhibited greater angular displacement of yaw than children without ASD, indicating greater head turning, F (1, 37) = 4.36, p = .04, partial ηp2 = .11 (Fig. 4, Table 5). Children with ASD did not differ from children without ASD on pitch and roll angular displacement, ps > .05.
For angular velocity, repeated-measures ANOVA revealed a main effect of video for pitch and roll. No significant interactions of video and group were found for angular velocity of yaw, pitch, and roll. Children with ASD exhibited greater angular velocity of yaw, F (1, 37) = 4.01, p = .050, partial ηp2 = .10, and roll, F (1, 37) = 7.35, p = .010, partial ηp2 = .17 than children without ASD, indicating greater head movement (Fig. 5, Table 5). Pitch angular velocity did not differ between children with and without ASD, p > .05.
ASD group by stimulus type (social versus nonsocial video) interaction
Planned contrasts revealed an interaction between video and group for yaw angular displacement, F (1,40) = 7.86, p < .01, ηp2 = 16, and a significant between-subjects effect of group, F (1) = 5.99, p = .019, ηp2 = .13 (Fig. 6). Children with ASD had greater angular displacement of yaw in the social video (video 4), than children without ASD, and did not differ in their angular displacement of yaw in the nonsocial video (video 2) than children without ASD. There were no interactions between video and group for angular displacement of pitch and roll, ps > .05.
For angular velocity of yaw, there was an interaction between video and group, F (1,40) = 8.35, p < .01, ηp2 = .17, and a significant between-subjects effect of group, F (1,40) = 4.90, p = .033, ηp2 = .11 (Fig. 6). There was also an interaction between video and group for angular velocity of roll F (1,40) = 4.27, p = .045, ηp2 = .10, with a significant between-subjects effect of group, F (1,40) = 4.69, p = .036, ηp2 = .11 (Fig. 6). Children with ASD had greater angular velocity of yaw and roll in video 4 (social video) than children without ASD and did not differ in their angular velocity of yaw and roll in video 2 (nonsocial video). There was no interaction between video and group for angular velocity of pitch, p > .05.
Controlling for age
A 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) was conducted with chronological age as a covariate. As when not considering this covariate, children with ASD exhibited greater angular displacement of yaw than children without ASD, indicating greater head turning, F (1, 36) = 5.36, p = .02, η p 2 = .13. As when not considering the age covariate, children with ASD exhibited greater angular velocity of roll, F (1, 36) = 5.45, p = .02, ηp2 = .13, than children without ASD, indicating greater head rolling motion. Unlike previous findings without age, children with ASD did not exhibit greater angular velocity of yaw, F (1, 36) = .73, p = .40, η p 2 = .02 when controlling for chronological age. All other findings were unchanged.
The planned contrast models (social versus nonsocial video) were repeated with angular velocity including chronological age as a covariate. As in previous findings without age as a covariate, there was an interaction between video and group for angular velocity of yaw, F (1,39) = 4.83, p < .03, ηp2 = .11, but there was no between subject’s effect of group, F (1,39) = 1.72, p = .20, ηp2 = .04. Children with ASD had greater angular velocity of yaw in the social video (video 4) than children without ASD, and the two groups did not differ in the angular velocity of yaw and roll in the nonsocial video (video 2). Unlike previous analyses without age as a covariate, no interaction between group and video was found for angular velocity of roll when chronological age was included in the model, F (1,39) = 2.97, p = .09, ηp2 = .07. All other findings were unchanged.
Using automated, objective measurement, we quantified differences in head movement dynamics between children with and without ASD, shedding light on head movement atypicalities previously described by clinicians. Children with ASD showed greater angular displacement of yaw and greater angular velocity of yaw and roll than children without ASD. Angular displacement is interpreted as head movement quantity, and angular velocity is interpreted as the speed of head movement. Thus, children with ASD exhibited greater head turning (yaw)—and turned their heads (yaw) and inclined their heads (roll) with greater speed—than children without ASD. Differences in head movement dynamics between children with and without ASD were specific to the presentation of a social stimulus. That is, children with ASD exhibited greater yaw angular displacement and yaw and roll angular velocity during presentation of the social stimulus than children without ASD.
Analyses were repeated including chronological age as a covariate—groups were matched a priori on mental age—to disentangle age and ASD differences [3, 48]. When controlling for chronological age, children with ASD continued to exhibit greater head turning (yaw) and inclined their heads (roll) with greater speed than children without ASD. When controlling for chronological age, differences in head movement dynamics between children with and without ASD remained specific to the presentation of a social stimulus for angular displacement of yaw and angular velocity of yaw, but not angular velocity of roll. Comparison of models, with and without statistical controls for chronological age, highlight angular displacement of yaw and angular velocity of yaw and roll as consistent signatures of ASD.
The current findings add to a small but growing body of literature utilizing automated measurement of body and head movement to objectively quantify the ASD phenotype [32, 49]. In a previous investigation, for example, 9-year-old children with ASD exhibited greater sway while standing in both the anterior-posterior (front-to-back) and medial-lateral (side-to-side) axes than did children without ASD, but sway was reduced during the search task, suggesting better movement control when pursuing a goal . By contrast, we measured 3° of rigid head movement (pitch, yaw, and roll) from video-recordings of younger, seated children. Younger children with ASD exhibited greater head displacement and velocity in the horizontal (yaw) and lateral (roll) but not vertical (pitch) axes than children without ASD. These differences in displacement and velocity were specific to social stimuli presentation. Together, these findings suggest that nonsocial engagement constrains excess head movement dynamics in children with ASD, while spontaneous activity, particularly in reaction to social stimuli, is associated with increased head movement dynamics.
Children with ASD may use head movement as a way to modulate their sensory experience . Previous primary research  and meta-analytic results of observational measures  indicate that infants and children with ASD displayed higher levels of motor impairments than infants and children without ASD. Motor impairments may constitute a core feature of ASD, a finding supported by the current studies comparisons of children with and without ASD [4, 32]. However, when head movement was compared during the presentation of social and nonsocial stimuli, head movement differences were specific to the presentation of social stimuli. Previous research using eye-tracking indicates that children with ASD look less at social stimuli than nonsocial stimuli [36, 51, 52], suggesting that children with ASD shift their gaze to regulate overstimulating social information. Viewing faces and engaging with social partners requires complex timing and attunement, which may be effortful for children with ASD . Together, these findings suggest that increased head movement in reaction to social stimuli may reflect increased sensitivity to social scenes among children with ASD.
Children with ASD may engage in more extreme and quicker head movement than children without ASD because they are unable to regulate incoming social information. Possible disruptions in motor planning and head movements early in development may have cascading effects in later social engagement [54, 55]. Given early associations between motor experience and the development of social behaviors , early disruptions in head movement may index atypical developmental trajectories [6, 57].
Limitations and future directions
Differences between children with and without ASD in head displacement and velocity were obtained in a small sample, highlighting the need for replication. The current study tested specific a priori hypotheses regarding head movement dynamic differences by nonsocial and social stimuli. Future research could build upon this research and explore whether head movement dynamics varies proportionally as a result of the degree of sociality of the stimulus. Future research with larger sample sizes and a fully counterbalanced protocol will allow researchers to examine more nuanced research questions.
While use of automated measurement marks progress in objectively quantifying head movement dynamics, there were limitations associated with this approach. The inability of the automated software to track extreme head movement and self-occlusion resulted in missing data (~ 17%). Although missing data did not vary by group, the presence of missing data necessitated using epochs of continuous data collection as a unit of analysis. Moreover, although not significant, children with ASD tended to have more epochs of briefer duration than children without ASD. It is possible that an inability to quantify head movement between epochs yielded a conservative assessment of group differences.
Angular displacement and velocity of pitch, yaw, and roll were moderately correlated in our data, and we chose to examine these dynamics separately. An alternative approach could be to model these movements together to assess differences in children with and without ASD. The addition of postural adjustments and muscle tension measurements to the model would allow for examination of coupling between head, neck, and torso in human movement, and potential differences in coupling associated with ASD.
Using automated measurement, we quantified differences in the quantity and speed of head movement between children with and without ASD, finding differences in the lateral (yaw and roll) but not vertical (pitch) domain. Children with ASD had greater yaw angular displacement and greater yaw and roll angular velocity, and these differences were most pronounced during social stimulus presentation. The results are consistent with the hypothesis that children with ASD use head movement to regulate their direct exposure to potentially arousing social situations. The study reports on a promising advance in objectively characterizing head movement dynamics. Our findings highlight the possibility of using automated measurement of head motion to supplement current diagnostic approaches for ASD. Automated measurement of head motion in varied contexts could provide an objective method of differentiating children with and without ASD. In contrast to previous approaches to head movement quantification, the computer-vision based approach we used here is non-invasive, may be applied to already collected video of children, and may be well suited for use in monitoring change over the course of the disorder and in response to interventions.
Analyses of variance
Autism spectrum disorder
- nRMS :
Normalized root mean square
Root mean square
American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Arlington: American Psychiatric Publishing; 2013.
Provost B, Lopez B, Heimerl S. A comparison of motor delays in young children: autism spectrum disorder, developmental delay, and developmental concerns. J Autism Dev Disord. 2007;37(2):321–8.
Goldman S, et al. Motor stereotypies in children with autism and other developmental disorders. Dev Med Child Neurol. 2009;51(1):30–8.
Fournier, et al. Motor coordination in autism spectrum disorders: a synthesis and meta-analysis. J Autism Dev Disord. 2010;40(10):1227–40.
Freeman BJ, et al. The behavior observation scale for autism: initial methodology, data analysis, and preliminary findings on 89 children. J Am Acad Child Psychiatry. 1978;17(4):576–88.
Zwaigenbaum L, et al. Behavioral manifestations of autism in the first year of life. Int J Dev Neurosci. 2005;23(2–3):143–52.
Kim SH, Lord C. Restricted and repetitive behaviors in toddlers and preschoolers with autism spectrum disorders based on the autism diagnostic observation schedule (ADOS). Autism Res. 2010;3(4):162–73.
Ozonoff S, et al. A prospective study of the emergence of early behavioral signs of autism. J Am Acad Child Adolesc Psychiatry. 2010;49(3):256–66. e2
Mottron, et al. Lateral glances toward moving stimuli among young children with autism: early regulation of locally oriented perception? Dev Psychopathol. 2007;19(1):23–36.
Hellendoorn A, et al. The relationship between atypical visual processing and social skills in young children with autism. Res Dev Disabil. 2014;35(2):423–8.
Mundy P, Newell L. Attention, joint attention, and social cognition. Curr Dir Psychol Sci. 2007;16(5):269–74.
Duncan S. Some signals and rules for taking speaking turns in conversations. J Pers Soc Psychol. 1972;23(2):283.
Piek JP, Dyck MJ. Sensory-motor deficits in children with developmental coordination disorder, attention deficit hyperactivity disorder and autistic disorder. Hum Mov Sci. 2004;23(3):475–88.
Wolpert DM, Doya K, Kawato M. A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences. 2003;358(1431):593–602.
Mooney E, Gray K, Tonge B. Early features of autism. Eur Child Adolesc Psychiatry. 2006;15(1):12–8.
Ozonoff S, et al. Gross motor development, movement abnormalities, and early identification of autism. J Autism Dev Disord. 2008;38(4):644–56.
Bryson SE, et al. A prospective case series of high-risk infants who developed autism. J Autism Dev Disord. 2007;37(1):12–24.
Loh A, et al. Stereotyped motor behaviors associated with autism in high-risk infants: a pilot videotape analysis of a sibling sample. J Autism Dev Disord. 2007;37(1):25–36.
Calhoun M, Longworth M, Chester VL. Gait patterns in children with autism. Clin Biomech. 2011;26(2):200–6.
Esposito G, et al. Analysis of unsupported gait in toddlers with autism. Brain Dev. 2011;33(5):367–73.
Rinehart NJ, et al. Gait function in newly diagnosed children with autism: cerebellar and basal ganglia related motor disorder. Dev Med Child Neurol. 2006;48(10):819–24.
Rinehart NJ, et al. Gait function in high-functioning autism and Asperger’s disorder. Eur Child Adolesc Psychiatry. 2006;15(5):256–64.
Chang C-H, et al. Visual tasks and postural sway in children with and without autism spectrum disorders. Res Dev Disabil. 2010;31(6):1536–42.
Chen FC, et al. Postural responses to a suprapostural visual task among children with and without developmental coordination disorder. Res Dev Disabil. 2011;32(5):1948–56.
Fournier, et al. Decreased static and dynamic postural control in children with autism spectrum disorders. Gait & Posture. 2010;32(1):6–9.
Memari AH, et al. Postural sway patterns in children with autism spectrum disorder compared with typically developing children. Res Autism Spectr Disord. 2013;7(2):325–32.
Rodgers J, et al. Anxiety and repetitive behaviours in autism spectrum disorders and Williams syndrome: a cross-syndrome comparison. J Autism Dev Disord. 2012;42:175–80.
Singer HS. Motor stereotypies. Semin Pediatr Neurol. 2009;16(2):77–81.
Crippa A, et al. Use of machine learning to identify children with autism and their motor abnormalities. J Autism Dev Disord. 2015;45(7):2146–56.
Anzulewicz A, Sobota K, Delafield-Butt JT. Toward the autism motor signature: gesture patterns during smart tablet gameplay identify children with autism. Sci Rep. 2016;6:31107
Rinehart NJ, et al. Movement preparation in high-functioning autism and Asperger disorder: a serial choice reaction time task involving motor reprogramming. J Autism Dev Disord. 2001;31(1):79–88.
Torres E, et al. Autism: the micro-movement perspective. Front Integr Neurosci. 2013;7:32.
Torres EB, et al. Toward precision psychiatry: statistical platform for the personalized characterization of natural behaviors. Front Neurol. 2016;7:8.
Pierce K, et al. Preference for geometric patterns early in life as a risk factor for autism. Arch Gen Psychiatry. 2011;68(1):101–9.
Klin A, et al. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59:809–16.
Chawarska K, Macari S, Shic F. Decreased spontaneous attention to social scenes in 6-month-old infants later diagnosed with autism Spectrum disorders. Biol Psychiatry. 2013;74(3):195–203.
Lord C, et al. The autism diagnostic observation schedule—generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000;30(3):205–23.
Lord C, Rutter M, Le Couteur A. Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994;24(5):659–85.
Wechsler D. The Wechsler Primary and Preschool Scale of Intelligence. San Antonio, TX: The Psychological Corporation; 2002.
Mullen EM. Mullen scales of early learning. MN: AGS Circle Pines; 1995.
Staples KL, Reid G. Fundamental movement skills and autism spectrum disorders. J Autism Dev Disord. 2010;40(2):209–17.
Jeni, L.A., J.F. Cohn, and T. Kanade, Dense 3D face alignment from 2D videos in real-time. 2015, FG.
Jeni LA, Cohn JF. Person-independent 3d gaze estimation using face frontalization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. Las Vegas: 2016. p. 87-95.
Hammal Z, et al. Head movement dynamics during normal and perturbed parent-infant interaction. In: Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), 2013. Geneva: 2013. p. 276-282.
Hammal Z, Cohn JF, George DT. Interpersonal coordination of headmotion in distressed couples. Affective Computing, IEEE Transactions on. 2014;5(2):155–67.
Barnes G, Asselman P. The mechanism of prediction in human smooth pursuit eye movements. J Physiol. 1991;439(1):439–61.
McLean L, et al. The effect of head position, electrode site, movement and smoothing window in the determination of a reliable maximum voluntary activation of the upper trapezius muscle. J Electromyogr Kinesiol. 2003;13(2):169–80.
Mahone EM, et al. Repetitive arm and hand movements (complex motor stereotypies) in children. J Pediatr. 2004;145(3):391–5.
Cohen I, et al. Rating scale measures are associated with Noldus EthoVision-XT video tracking of behaviors of children on the autism spectrum. Mol Autism. 2014;5(1):15.
Dunn W. The impact of sensory processing abilities on the daily lives of young children and their families: a conceptual model. Infants & Young Children. 1997;9(4):23–35.
Shic F, et al. Limited activity monitoring in toddlers with autism spectrum disorder. Brain Res. 2011;1380:246–54.
Klin A, et al. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 2009;459(7244):257–61.
Happé F, Frith U. The weak coherence account: detail-focused cognitive style in autism Spectrum disorders. J Autism Dev Disord. 2006;36(1):5–25.
Trevarthen C, Delafield-Butt JT. Autism as a developmental disorder in intentional movement and affective engagement. Front Integr Neurosci. 2013;7:49.
Cook J. From movement kinematics to social cognition: the case of autism. Phil Trans R Soc B. 2016;371(1693):20150372.
Libertus K, Needham A. Reaching experience increases face preference in 3-month-old infants. Dev Sci. 2011;14(6):1355–64.
Landa R, Garrett-Mayer E. Development in infants with autism spectrum disorders: a prospective study. J Child Psychol Psychiatry. 2006;47(6):629–38.
Autism Speaks National Institute of General Medical Sciences (1R01GM105004).
Availability of data and materials
The datasets generated and/or analyzed during the current study are not publicly available as participants were not consented for public data release, but datasets are available from the corresponding author on reasonable request and consent of participants.
JCohn leads efforts to develop methods for the automatic analysis of facial expression and automated tracking of rigid and non-rigid head motion and applied those tools to research in psychopathology. ZH is part of the JCohn’s interdisciplinary group and has applied computer vision and machine learning to improve measurement of and theoretical advances in mother-infant interaction, depression, pain, and social interaction. JCassell is the director of the Human-Computer Interaction Institute, in the school of Computer Science at Carnegie Mellon University, and focuses on applying computer vision systems to the study of human interactions. GR is a postdoctoral fellow at the Center for Computational Science and is part of the Big Data Mining and Data Analytics team, and MO is a professor in the Department of Computer Science at the University of Miami. Together, GR and MO have expertise in computational approaches to big-data. JB is an assistant professor in the Department of Psychology at the University of Miami with expertise in interdisciplinary research that utilizes advancements in technology to study the intersection of human development and clinical outcomes. AG is the assistant director for the Center for Autism and Related Disabilities (CARD) at the University of Miami. DM’s research uses objective measurement of body movement, facial expression, and vocalization to better understand communicative development in typically developing children and those affected by ASD.
Ethics approval and consent to participate
Recruitment and procedures were approved by the University of Miami’s Social and Behavioral Sciences Internal Review Board (reference number: 20070095). Written, parental consent was obtained before participation in the study.
Consent for publication
Parents consented to the following:
“VIDEOTAPES: When the researcher plays with your child and when your child watches the children’s videos, we will be videotaping your child. The videotapes of your child will be coded by experts, undergraduate students, and other parents. Additionally, the videos will be measured using computer software at the University of Miami, University of Pittsburgh, and the University of Denver. They may also be used in publications and at scientific conferences. You agree to all of these uses by taking part in this study….”
“CONFIDENTIALITY: Your child’s videotaped images will be rated by other people, analyzed by computer at the University of Pittsburgh, and presented in scientific reports. The images will not be linked to personal identifiers in any way. These videotaped images are scientifically valuable and will be stored permanently by the investigators as a record of this study. At your request, the images will be immediately destroyed. The US Department of Health and Human Services (DHHS) may request to review and obtain copies of your records. Your records may also be reviewed for audit purposes by authorized University employees or other agents who will be bound by the same provisions of confidentiality.”
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Summary of Supplementary Data Analyses. (DOCX 23 kb)