- Open Access
A constellation of eye-tracking measures reveals social attention differences in ASD and the broad autism phenotype
Molecular Autism volume 13, Article number: 18 (2022)
Social attention differences, expressed through gaze patterns, have been documented in autism spectrum disorder (ASD), with subtle differences also reported among first-degree relatives, suggesting a shared genetic link. Findings have mostly been derived from standard eye-tracking methods (total fixation count or total fixation duration). Given the dynamics of visual attention, these standard methods may obscure subtle, yet core, differences in visual attention mechanisms, particularly those presenting sub-clinically. This study applied a constellation of eye-tracking analyses to gaze data from individuals with ASD and their parents.
This study included n = 156 participants across groups, including ASD (n = 24) and control (n = 32) groups, and parents of individuals with ASD (n = 61) and control parents (n = 39). A complex scene with social/non-social elements was displayed and gaze tracked via an eye tracker. Eleven analytic methods from the following categories were analyzed: (1) standard variables, (2) temporal dynamics (e.g., gaze over time), (3) fixation patterns (e.g., perseverative or regressive fixations), (4) first fixations, and (5) distribution patterns. MANOVAs, growth curve analyses, and Chi-squared tests were applied to examine group differences. Finally, group differences were examined on component scores derived from a principal component analysis (PCA) that reduced variables to distinct dimensions.
No group differences emerged among standard, first fixation, and distribution pattern variables. Both the ASD and ASD parent groups demonstrated on average reduced social attention over time and atypical perseverative fixations. Lower social attention factor scores derived from PCA strongly differentiated the ASD and ASD parent groups from controls, with parent findings driven by the subset of parents demonstrating the broad autism phenotype.
To generalize these findings, larger sample sizes, extended viewing contexts (e.g., dynamic stimuli), and even more eye-tracking analytical methods are needed.
Fixations over time and perseverative fixations differentiated ASD and the ASD parent groups from controls, with the PCA most robustly capturing social attention differences. Findings highlight their methodological utility in studies of the (broad) autism spectrum to capture nuanced visual attention differences that may relate to clinical symptoms in ASD, and reflect genetic liability in clinically unaffected relatives. This proof-of-concept study may inform future studies using eye tracking across populations where social attention is impacted.
The study of eye movement patterns has proven to be a powerful tool for revealing meaningful information about perceptual and attentional strategies, including providing an indirect measurement of underlying cognitive, attentional, and executive skills . Early eye-tracking studies , along with many that followed [1, 3,4,5,6], have demonstrated that the location of gaze (i.e., where individuals look when visually exploring stimuli) not only reflects attentional processes [7, 8], but also maps onto underlying thoughts and cognition . In this way, eye movement may be considered as both complementary to and associated with both psychophysical (e.g., accuracy and reaction time indices) and neural measurements of cognition . For example, studies have demonstrated that saccade speed or saccade target location predicts reaction time [10, 11], and that analyses of gaze could index activity in areas of the brain associated with visual perception (e.g., visual examination of social stimuli activates the amygdala, and face perception activates the Fusiform Face Area) [12,13,14,15,16]. Eye-tracking also has the potential to reveal moment-to-moment information of underlying cognition, revealing nuanced and dynamic patterns at an individual or group level. Given the often automatic and rapid nature of eye movements, analysis of gaze may thus represent a phenomenon existing as an intermediate link between brain and behavior, with the potential of revealing cognitive differences that may stem from underlying neurobiology.
The use of eye tracking has been particularly revealing in studies of social cognition in autism spectrum disorder (ASD) [17,18,19]. Specifically, differences in visual attention have been repeatedly documented in individuals ASD relative to controls [20,21,22], with such differences relating to social communication impairments [17, 23,24,25,26] and restricted and repetitive behaviors [27, 28], core features of the disorder. Gaze and eye movement differences can be detected as early as infancy in individuals with ASD (such as lacking a preference between looking at faces versus objects, or showing atypical scanning patterns when gazing at faces) [29,30,31,32,33,34,35,36]. These visual attention differences appear to persist into adolescence and adulthood, wherein individuals with ASD have been reported to show slower latencies to orient to social features of the scene [28, 37] and exhibit different scanning patterns [21, 38]; though findings vary depending on the type of stimulus [26, 39]. For example, when there is competing information in the scene (i.e., both salient and non-salient features), individuals with ASD tend to spend more time exploring non-salient aspects of the scene, such as inanimate objects or non-eye regions of facial stimuli [21, 23, 40, 41]. These differences appear to be clinically meaningful, with several studies reporting a link between atypical gaze patterns and reduced social competency [17, 30].
Eye movement patterns appear to be heritable in the general population  and across psychiatric disorders , suggesting that eye movements and visual attention may not only reflect underlying genetics (i.e., constituting endophenotypes, which are heritable characteristics associated with the genetic underpinnings of a disorder ), but also neurobiological mechanisms contributing to the development of a disorder’s symptomatology. Studies of gaze in individuals with ASD and their relatives thus have the potential to inform the mechanistic processes related to the etiology and development of ASD symptomatology, as well as subclinical features of the broad autism phenotype (BAP), which are linked to underlying genetic liability in clinically unaffected relatives [45,46,47]. Indeed, subtle differences in gaze have been reported among first-degree relatives of individuals with ASD [23, 42, 47, 48], and particularly among those who display the BAP [48,49,50,51]. For instance, Adolphs et al. , showed that parents who displayed features of the BAP relied less on the eye region of the face when making judgments about emotions. Less fluent gaze-language coordination and subtle differences in gaze when narrating from illustrated stimuli have also been reported among parents, and linked with BAP features [23, 27].
Together, this work demonstrates the utility of studying looking patterns as potentially good candidate endophenotypes, given their known heritability and association with ASD. However, visual attention and related eye movement patterns have typically been examined using primarily global fixation measures across many different stimuli across studies, and have been understudied in first-degree relatives with only three studies to date examining visual perception/attention using eye tracking in parents [23, 27, 51]. Further study is therefore warranted to understand the nature and extent of gaze differences in relatives, how such differences may overlap with those evident in ASD, and important connections to underlying cognitive mechanistic and biological factors. Additionally, evidence suggests that study results dependent on standard fixation measures are heavily influenced by processing methods [52,53,54], and have been shown to dramatically alter findings in ASD . Finally, these standard measures provide only a global overview of looking patterns, and may miss potentially important subtleties evident in ASD and the BAP.
Ongoing studies have demonstrated the efficacy of applying other methods of analyses to examine eye-tracking data, which may reveal important aspects of cognition. For example, perseverations (repeat successive fixations towards the same area of interest) may reflect “sticky attention” or mental disengagement , whereas regressions (i.e., refixating on previously examined areas of interest) may index the loss of mental set or executive control, as the looker’s attention is captured [56,57,58,59]. Analysis of both these fixation types have been fruitfully applied in studies of ASD and the BAP using social and non-social stimuli, and were also found to relate to ASD symptomatology [27, 28]. Shic and colleagues  utilized another fixation analytic method, transition entropy analyses, in young children with ASD, finding no changes in the transitions of fixations (i.e., transitions from one AOI to another) between salient and non-salient regions of the face in individuals with ASD, unlike controls, thus demonstrating differences in patterns of attention allocation between groups. Spatial Distribution Analysis or Nearest Neighbor Index (i.e., distance-dispersion algorithm) were also examined in children with and without ASD, to explore how fixations were dispersed across the facial stimuli . Finally, growth curve analyses (GCA), proves to be a rigorous method of assessing changes over the course of time, which can be applied to understand the moment-to-moment pattern of gaze while interpreting a scene [61, 62]. In particular, GCA maps out the time-linked gaze trajectory over the course of the stimulus presentation and can elucidate changes occurring longitudinally across developmental time periods, such as those found in infants with and without ASD . As such, while traditional methods of dwell time and fixations can reveal important aspects of information processing, they may lack sensitivity for capturing more nuanced patterns of eye movement that can be revealed through more detailed and expansive methods. Examining temporal dynamics is critical to be able to capture social attentional patterns granularly, thus allowing a vivid illustration of the social attentional trajectories that unfold over time and reflecting the dynamic (versus static) process of social attention in the real world.
The present study was an attempt to address this concern, through application of a suite of eye-tracking analytic tools to gaze data in ASD and the BAP, with the goal of evaluating potentially more sensitive methods of gaze patterns than global analyses of looking time or fixations, and that might help to capture subtle top-down social visual attentional differences in non-clinical populations such as the BAP. Based on evidence previously reviewed and the social atypicalities inherent to ASD, and more subtly in the BAP, it was predicted that individuals with ASD and their parents (particularly those with features of the BAP) would show reduced social attention and increased attention to non-salient components of the scene, reflective of decreased attribution of social salience. Based on evidence demonstrating relationships between perseverative eye movement patterns and restricted and repetitive behaviors, a larger number of refixations (repeated fixations) and shorter first fixation duration was also expected, with decreased spatial distribution of fixations, and atypical fixation transition and looking patterns over the course of the task compared to controls.
Participants (Table 1)
Participants included in the present study were identical to those included in a prior study exploring language and related looking patterns . Twenty-nine individuals with ASD (ASD group) and 34 control participants (control group), as well as 74 parents of individuals with ASD (ASD parent group) and 45 control parents (control parent group) were included in the study. Inclusion criteria for individuals with ASD and controls included being 15 years of age and older and having a Full Scale IQ (FSIQ) and Verbal IQ (VIQ) ≥ 80. Participants were excluded for any severe psychiatric disorder (e.g., schizophrenia, bipolar disorder) and uncorrected vision impairments (e.g., strabismus). Participant characteristics are outlined in Table 1. All procedures were approved by the University’s Institutional Review Board and written informed consent/assent were obtained for all participants.
Individuals with ASD were included following confirmation of ASD with gold standard instruments (Autism Diagnostic Observation Schedule-General or 2nd Edition (ADOS)  and/or the Autism Diagnostic Interview-Revised (ADI-R) ). Parents of an individual with ASD were included if they had at least one child with idiopathic ASD, and control participants were required to have no personal or family history of ASD or related genetic disorders (e.g., fragile X syndrome). BAP status was assessed in the ASD parent group only, given low base rates of the BAP among individuals without a family history of ASD [49, 66, 67]. BAP status was assessed using the Modified Personality Assessment Scale-Revised (MPAS-R) , which includes a series of questions specifically designed to tap the subclinical features related to the BAP including aloof, rigid, perfectionistic, and untactful personality traits. Coding of personality features followed methods outlined in prior work, such that raters were assigned scores ranging from 0 to 2 (trait absent, possibly present, definitely present) on a 5-point Likert scale.
Eye tracking procedures
Participants were asked to narrate a story after looking at an image being presented for 8 s on a 17-inch TFT LCD (1280 × 1024 resolution) Tobii T60 series eye tracker (Tobii Technology AB, Danderyd, Sweden). All participants were seated 50–60 cm from the screen and had their gaze calibrated prior to task administration, including using a standard 5-point calibration grid, which has a visual angle accuracy of 0.5°. Participants were recalibrated following any large movements. Tracking was monitored live during task administration using Tobii Studio’s built-in live view and track window options, with additional calibration checks embedded in the task (e.g., center crosshair, corner star) to ensure tracking accuracy.
Eye tracking task
The thematic apperception test (TAT)  was developed as a psychological projective test, and has been used in numerous studies of narrative elicitation [23, 69,70,71,72]. Prior work  has demonstrated gaze differences in ASD and ASD parent groups when generating stories from TAT stimuli. The current study focused on the “Farmland Scene” (greyscale card 2; Fig. 1A) from the TAT, because of its complexity and prior findings that global indices of fixation revealed differences in attention to setting and protagonists among individuals with ASD and their parents with the BAP .
Areas of Interests (AOIs). AOIs were manually drawn in Tobii Studio. The AOIs in the Farmland Scene are depicted in Fig. 1B, and were categorized as either social (e.g., human figures) or non-social (e.g., barn in the background). “Buffer” regions were created identical to prior work, such that each AOI was proportionally expanded by up to 10% of its original size . When social and non-social AOIs overlapped, the final AOI designation was assigned as social.
Gaze processing parameters. Eye movements were recorded for both eyes with a sampling rate of 60 Hz. Parameters to account for data loss in working with populations with neurodevelopmental disorders were modeled in line with previous pipelines . These parameters were consistent with prior work  and the built-in I-VT fixation filter in Tobii Studio as follows—(1) fixations were based on the strict average across both eyes; (2) a velocity threshold of 35 degrees per second was established; (3) adjacent fixations were merged if fixations were less than 100 ms apart and angles were less than 0.5 degrees apart; (4) missing data were linearly interpolated based on a 150 ms maximum continuous gap; and (5) noise reduction was addressed by utilizing a moving average window of 3 samples. Finally, following data export, fixations were set to be a minimum duration of 100 ms (i.e., fixation durations less than 100 ms were excluded).
Quality control procedures. Track loss was based on prior work such that participants’ data were excluded if their overall fixation count on the Farmland Scene was < 5 and the total fixation duration was < 4 s (i.e., gaze data was reliably collected for at least half of the 8 s that the stimulus was presented). These criteria resulted in the exclusion of 17% ASD (n = 5), 6% control (n = 2), 18% ASD-parent (n = 13) and 13% control parent (n = 6) participants’ data. Fisher’s Exact Test (FET) and Chi-Squared Test revealed no significant group differences in the proportion of valid or invalid data in ASD versus controls (FET p = 0.233) or in ASD parents versus control parents (X2(1,119) = 0.374, p = 0.541), respectively. The final sample was as follows: n = 29 in the ASD group, n = 34 in the control group, n = 61 in the ASD parent group, and n = 39 in the control parent group. From the sample of parents of individuals with ASD, 24 were characterized as BAP(+) (i.e., meeting criteria for having BAP traits), and 37 were characterized as BAP(−) (i.e., not meeting criteria for the BAP).
Standard gaze variables: Dwell time and fixation count were included in an existing study (Lee et al., 2019), and re-reported here for the purpose of examining the efficacy of more nuanced eye-tracking variables in relation to the overall gaze variables. The below metrics are thought to reflect attentional engagement as well as processing time .
(1) Dwell time—Percentage of looking time (sec) toward an AOI was derived by summing the fixation duration of each AOI and dividing it by the total duration of looking, multiplied by 100.
(2) Fixation count—Percentage of the number of fixations was captured by summing the total number of fixations toward an AOI out of the total number of fixations across the duration of stimulus presentation, multiplied by 100.
(3) Fixations over time—Growth curve analyses (GCA) were employed to investigate change in looking patterns (percentage of fixations) over the course of the stimulus presentation towards social versus non-social AOIs, adapted from the EyetrackingR package . To account for track loss at the end of the image as well as pre-established attention-capturing stimuli (i.e., center and corner crosshairs) prior to stimulus presentation, 7 s of the 8 s image were examined (500 ms removed from the beginning and end of the stimuli), using 1 s time bins. Divergence analyses were then applied to examine at which point(s) groups differed from one another in terms of social versus non-social looking. Divergence analyses applied t-tests that are embedded within the divergence vignette from the EyetrackingR package . Time bins were set to 300 ms to match the approximate average fixation duration across participants. Taken together, these sets of analyses not only provide information on the dynamic patterns of looking via GCA, but also delineate the exact moments in which groups diverge from one another.
(4) Perseverative fixations—Percentage of perseverative fixations were derived by summing fixations that occurred in succession toward the same AOI, divided by the total number of fixations, multiplied by 100. Perseverative fixations are thought to tap into attentional “stickiness” or mental disengagement .
(5) Regressive fixations—Percentage of regressive fixations was captured as the percentage of times a participant returned their gaze to a specific AOI that had already been previously explored, by summing the number of fixations that occurred towards an AOI previously fixated (not including successive fixations/perseverative fixations), divided by the total number of fixations, multiplied by 100. Regressions are thought to reflect slower processing speed or the loss of mental set/executive control [56,57,58,59], and reflects the information that repeatedly attracted the viewer’s attention.
(6) Fixation transition analysis—Examining transitions between different AOIs provides an estimate of general exploration. For the purpose of this study, to demonstrate the utility of examining transitions, we explored the transitions between social and non-social information in four ways: (i) social to social AOI transitions, (ii) non-social to non-social AOI transitions, (iii) social to non-social AOI transitions, and (iv) non-social to social AOI transitions. Percentages based on the total number of transitions were calculated for (i)–(iv). Fixation transition has been shown to reflect shifts in attention , in addition to reasoning abilities through the process of comparison between task relevant and task irrelevant information [75,76,77].
(7) First fixation AOI—The percentage of first fixations toward social or non-social information was measured by summing the total number of first fixations that was social or non-social and dividing it by the total number of first fixations, multiplied by 100. First fixation AOI is thought to index the utilization of peripheral visual information, that is associated with global or rapid and automatic visual information processing and generally reflects visual information preference .
(8) First fixation duration—The first fixation duration was derived by measuring the time (in sec) spent examining any AOI during the first fixation (i.e., the first fixation that occurs after the stimulus appears) before making a fixation transition. The first fixation duration on an AOI reflects how much either social or non-social information initially attracted the looker’s attention.
(9) Fixation rate (exploration)—In order to obtain a general measure of fixation rate (i.e., exploration) regardless of AOI type was examined. The total number of fixations per participant was divided by the total time spent examining the scene, to produce the number of fixations that occurred per second of track time regardless of AOI. A higher number indicates a greater number of fixations occurring per second of track time, reflecting greater exploration or fixation rate.
(10) Fixation rate (exploration) AOI—To investigate how much participants explored either social or non-social AOIs, the number of fixations per track time (in sec) toward social or non-social information was further explored. Greater exploration reflects a larger number of fixations toward social or non-social information for a given second, and provides a general indication of attentional capacity and cognitive load .
(11) Fixation spatial distribution/coverage analyses (Fig. 2)—Spatial distribution/coverage analyses were conducted to obtain an estimate of how much of the screen was being explored regardless of social or non-social AOI. Given that the Tobii T60 screen was 1280 × 1024 pixels, a 5 × 4 matrix of 20 large areas (256 × 256 pixels/6.45° × 6.45°) and a 10 × 8 matrix of 80 small areas (128 × 128 pixels/3.2° × 3.2°) were generated. Based on prior work  showing that the attention maintaining and capturing abilities of an AOI increases with size but asymptotes at 3° visual angle (i.e., 120 × 120 pixels using the T60 Tobii display) for ASD and control groups, the smaller area 10 × 8 matrix would be the most appropriate for the present study while still maintaining equal sized “boxes”. Each fixation point’s location was categorized into one of these 20 or 80 “boxes”, respectively. To account for the different number of fixations per participant, the percentage of mini areas explored was computed per participant by taking the number of areas explored and dividing it by the total number of fixations for that participant, which was then multiplied by 100. This final percent coverage was included in subsequent analyses for larger (5 × 4 matrix) and smaller (10 × 8 matrix) areas. A higher percentage represents greater coverage overall (i.e., a greater proportion of fixations were covering unique areas not previously explored), while a lower percentage indexes less coverage or scatter. This measure indicates whether visual attention was “trapped” within certain general regions of a stimulus, or whether there is greater flexibility in underlying attentional mechanisms.
General analytic plan
All analyses were conducted using the following comparisons: (i) ASD group versus control group; (ii) ASD parent group versus control parent group; and (iii) BAP(+) versus BAP(−) versus control parent group, to examine the role of BAP status on overall group differences among parents. Group differences were adjusted using the Benjamini–Hochberg method  using a FDR of 0.10 to reduce false negatives and thereby potentially missing important effects . Benjamini–Hochberg adjusted p values are reported in the tables; all other p values meeting an alpha criterion of < 0.05 are reported below.
Data were examined to ensure model assumptions of primary statistical tests (i.e., multivariate analysis of variance; MANOVA) were met. Gaze variables for social and non-social looking were included in assumptions testing, and were conducted separately for proband and parent groups. All assumptions were adequate, with the exception of homogeneity of variance–covariance matrices for some variables and sphericity assumptions for others. As such, across all variables, findings using the more robust Pillai’s Trace  are reported.
Group differences, and growth curve analyses
Group differences in standard gaze variables, fixation patterns, and fixation rates were examined using a one-way MANOVA separately for proband and parent (including by BAP status) groups, with social and non-social AOIs as the dependent variables. Only significant MANOVAs were followed up with univariate ANOVAs. For BAP-level differences, additional planned post-hoc pairwise comparisons (i.e., BAP(+) versus BAP(−) versus control parent groups) were conducted when the overall MANOVA or univariate ANOVAs were significant. Given that the percent of perseverations towards social and non-social information was skewed, MANOVA results were followed up with nonparametric Mann–Whitney U tests. To examine gaze variables not involving social and non-social AOIs (i.e., fixation spatial distribution/coverage, first fixation duration), one-way ANOVAs were conducted separately for proband and parent groups.
Due to their lower sample sizes and categorical nature, first fixation AOIs were analyzed using frequency tests. Sample sizes were low for first fixations towards non-social information (n = 6 individuals with ASD/controls and n = 17 parents of individuals with ASD/control parents), relative to a greater number of participants who looked towards social information upon their first fixation (n = 50 ASD/Controls and n = 83 ASD parents/Control parents). As a result, a series of 2 × 2 contingency tables using Fisher’s exact tests were performed separately in parent and proband groups to examine group differences in the proportions of first fixations that were directed towards social and non-social AOI.
To investigate changes in looking patterns towards social versus non-social AOIs over the course of the stimulus presentation, growth curve analyses (GCA) were utilized using similar methods applied in recent work examining gaze during affective facial expressions . Specifically, orthogonal polynomial terms, each representing a different pattern of looking, were added in a stepwise fashion: (1) the linear term reflected an increase or decrease in proportion of looking over time linearly; (2) the quadratic term reflected the dynamic nature of switching from one AOI to another and back again; and (3) the cubic term reflected the timing of switches between AOIs. Only interactions that include a polynomial term were reported.
Finally, a principal component analysis (PCA) was applied to determine whether the large number of gaze variables may be captured by distinct dimensions based on empirical patterns (i.e., principal components), representing most of the information from the original variables . Variables in the PCA included: standard gaze variables (dwell time, fixation count), fixation patterns (perseverative fixations, regressive fixations, fixation transition analyses), first fixation duration, and distribution patterns (fixation rates, fixation spatial distribution/coverage analyses) (see asterisks in Table 2, and Additional file 1: Table S1 for a correlation matrix of all eye-tracking variables). All data from proband and parent groups were included to generate components. Regression factor scores were generated for each component for each individual, and analyzed using one-way ANOVAs to examine group differences among the proband and parent/BAP groups and controls.
Although verbal IQ significantly differed between the ASD and control groups, and full-scale IQ was marginally different between parent groups, IQ was not associated with any eye-tracking outcome variable by group. Additionally, IQ variability is an inherent phenotype of ASD , together providing little empirical and conceptual justification for including IQ as a covariate in eye-tracking analyses. Given the large age range of participants included in this study, and that age was significantly associated with several outcome variables for the ASD and ASD parent groups only, analyses were repeated covarying for age. Findings did not meaningfully change, and we therefore report results from models without any covariates.
Clinical-Behavioral Correlates (see Additional file 1: Table S3 for results)
Using Pearson correlations, potential clinical-behavioral correlates of gaze were examined in the ASD group using the ADOS, ADI-R, and The Reading the Mind in the Eyes Test (a measure of social cognition) . No significant associations were found, and data are reported in Additional file 1: Table S3.
Below we include statistical details for significant findings for probands and parents only (p < 0.05), with detailed significant and non-significant findings reported in Tables 3, 4, 5, 6). All BAP findings are reported in detail below.
Standard gaze variables (Fig. 3)
Findings from the standard gaze variables have been previously reported with different statistical analyses  and are reported below for the purpose of comparison to non-standard analytic methods.
(1) Dwell time:
Probands and Parents. There were no significant differences between the ASD and control group, or between parent groups in the percentage of time spent attending towards social or non-social information.
BAP. On average, the overall model for social and non-social looking times was significant across BAP(+), BAP(−), and control parents (F(4,197) = 2.71, Pillai’s Trace = 0.11, p < 0.05, partial η2 = 0.053), with significant differences emerging in both social (F(2,97) = 3.70, p < 0.05, partial η2 = 0.071) and non-social (F(2,97) = 4.44, p < 0.05, partial η2 = 0.084) looking time. Pairwise comparisons revealed that BAP(+) parents on average showed significantly reduced social looking compared to the control parent group (mean difference = − 8.77, p < 0.01) and increased non-social looking compared to both BAP(−) parents (mean difference = 5.51, p < 0.05) and control parents (mean difference = 6.84, p < 0.05).
(2) Fixation count:
Probands and Parents. No significant group differences emerged in the percentage of fixations directed towards social or non-social information.
BAP. No significant differences in BAP status emerged overall for social or non-social looking (F(4,194) = 1.42, Pillai’s Trace = 0.06, p = 0.229, partial η2 = 0.028).
Temporal dynamics (Fig. 4)
Probands. There were no significant group differences detected across linear (Estimate = 0.10, t(832) = 0.75, p = 0.453), quadratic (Estimate = 0.21, t(832) = 1.58, p = 0.12), or cubic (Estimate = 0.006, t(832) = 0.05, p = 0.962) terms in social versus non-social looking patterns over the course of the stimulus presentation. Time-bin divergence analyses revealed significant differences occurring halfway through the stimulus presentation, where individuals with ASD on average demonstrated significantly reduced social looking between 3000 and 3300 ms compared to controls. These findings indicate that individuals with ASD disengage from social information early, decreasing social fixations over time, whereas the control group showed increased social looking initially, that also decreased over the course of the task.
Parents. In contrast to findings in the ASD group, a significant group difference was detected for the cubic polynomial term (Estimate = − 0.23, t(1474) = − 2.24, p < 0.05), indicating that the ASD parent group shifted away earlier from social AOIs, and demonstrated decreased attention to social information over time, compared to the control parent group. To examine the exact moments at which time points groups differed from one another, divergence analyses demonstrated that, on average, ASD parents demonstrated reduced social looking patterns primarily during the beginning (i.e., 300–600 ms) and end (i.e., 4500–4800 ms and 6900–7200 ms) of the stimulus presentation (see Fig. 4). Interestingly, ASD parents also demonstrated increased social looking relative to the control parent group between 5100 and 5400 ms, showing a dynamic pattern of an increase followed by a decrease in social looking towards the end of the stimulus presentation, compared to the control parent group.
BAP. Significant group differences were detected for the linear, quadratic, and cubic terms, indicating that BAP(+) parents shifted away from social stimuli earlier, and demonstrated decreased social attention over the course of the task compared to the BAP(−) (linear estimate = 0.46, t(1474) = 3.38, p < 0.001; quadratic estimate = 0.48, t(1474) = 3.50, p < 0.001, cubic estimate = 0.30, t(1474) = 2.28, p < 0.05) and control parent groups (linear estimate = 0.44, t(1474) = 3.31, p < 0.001; quadratic estimate = 0.39, t(1474) = 2.91, p < 0.001, cubic estimate = 0.42, t(1474) = 3.20, p = 0.001). BAP(−) and control parent groups did not differ from one another across any linear, quadratic, or cubic terms (linear estimate = − 0.02, t(1474) = − 0.16, p = 0.876; quadratic estimate = − 0.09, t(1474) = − 0.76, p = 0.446, cubic estimate = 0.11, t(1474) = 0.10, p = 0.320). Divergence tests showed that, on average, the BAP(+) group fixated more towards social information relative to the control parent group towards the second half of the stimulus presentation (i.e., 5100–5400 ms), and showed a stark decrease towards the end of the viewing window (i.e., 6900–7200 ms). Similarly, on average, the BAP(+) group showed significantly decreased social attention towards the end of the stimulus compared to the BAP(−) parent group between 6900 and 7200 ms. In contrast, the BAP(−) group showed reduced social attention towards the second half of the stimulus presentation (i.e., 4500–4800 ms), with a later (i.e., 5100–5400) increase in social attention relative to controls.
(4) Perseverative fixations:
Probands. MANOVA results revealed significant differences between ASD and control groups in the percentage of perseverative fixations towards social and non-social information (F(2,53) = 3.27, Pillai’s Trace = 0.11, p < 0.05, partial η2 = 0.110). Follow-up univariate ANOVA tests revealed that on average the ASD group made a greater proportion of perseverations on non-social information compared to the control group (F(1,54) = 6.43, p < 0.05, partial η2 = 0.106). Follow-up nonparametric analyses confirmed these findings, ASD Mrank = 32.98; controls Mrank = 25.14; U = 276.5, p < 0.05. No significant differences emerged between groups for social perseverations (ASD Mrank = 26.13, Control Mrank = 30.28, U = 327, p = 0.324).
Parents. No significant group differences were found between ASD parent and control parent groups (F(2,97) = 1.50, Pillai’s Trace = 0.03, p = 0.228, partial η2 = 0.030). Nonparametric analyses confirmed these findings (social AOI: ASD parent Mrank = 47.01, Control parent Mrank = 55.96, U = 976.5, p = 0.122; non-social AOI: ASD parent Mrank = 50.97, Control parent Mrank = 49.77, U = 1161, p = 0.827).
BAP. MANOVA results showed no difference in social or non-social perseverative looking patterns between BAP(+), BAP(−), or control parent groups (F(4,194) = 1.59, Pillai’s Trace = 0.06, p = 0.179, partial η2 = 0.032). However, nonparametric Mann–Whitney U test revealed that the BAP(+) group (Mrank = 26.31) made, on average, significantly fewer perseverations towards social information compared to the control parent group (Mrank = 35.50) (U = 331.5, p < 0.05).
(5) Regressive fixations:
Probands and Parents. No significant group differences emerged for social and non-social regressive fixations.
BAP. No significant differences in social and non-social regressive fixations emerged by BAP status (F(4,194) = 1.87, Pillai’s Trace = 0.07, p = 0.118, partial η2 = 0.037).
(6) Fixation transition analyses:
Probands and Parents. There were no significant differences in the percentage of transitions occurring (regardless of direction of fixation transitions) between social and non-social information.
BAP. BAP status did not affect overall findings across specific transition patterns (F(6,192) = 0.72, Pillai’s Trace = 0.04, p = 0.637, partial η2 = 0.022).
(7) First fixation AOI and (8) First fixation duration:
Probands and Parents. No significant group differences emerged in the first fixations towards social and non-social information, or in the duration of their first fixations.
BAP. Similarly, no differences emerged when considering BAP status in parents in the proportion of social (BAP(+) 21%, BAP(−) 29%, control parent 29%) and non-social (BAP(+) 2%, BAP(−) 10%, Control parent 9%) first fixations.
Distribution patterns (Fig. 8)
(9) Fixation rate (exploration), (10) Fixation rate (exploration) AOI, and (11) Fixation spatial distribution/coverage:
Probands and Parents. Groups demonstrated a similar number of fixations per second of track time regardless of AOI, and in the number of fixations per second of track time that were made towards social and non-social information. There were also no significant group differences in the percentage of unique areas explored in the matrix for larger or smaller “boxes”.
BAP. There were no differences across BAP groups and controls for any variable examined (Fixation rate: F(2,97) = 0.17, p = 0.848, partial η2 = 0.003; Fixation rate AOI: F(4,194) = 1.794, Pillai’s Trace = 0.07, p = 0.132, partial η2 = 0.036; Fixation spatial distribution/coverage: large boxes—F(2,97) = 1.52, p = 0.225, partial η2 = 0.030) or small boxes—F(2,97) = 1.29, p = 0.281, partial η2 = 0.026).
Principal Component Analysis (PCA)
Examination of the scree plot (Additional file 1: Fig. S1) led to a two-component solution describing 58.6% of the variance of the data. The PCA yielded adequate loadings (≥ 0.30) on the two components (Additional file 1: Table S2). The first component consisted of all fixation variables tapping social versus non-social looking (henceforth, “social/non-social attention factor”. The second component consisted of fixation rates versus fixation spatial coverage efficiency—essentially reflecting the overall efficiency of spatial exploration in terms of fixation rates (henceforth, “efficiency of exploration”). For example, an individual scoring high on this component would have fixations that covered a relatively greater area, even if occurring less frequently; or conversely, fixations that were spatially confined even given an increased rate of fixation (Fig. 9).
Probands. There were no significant group differences between the ASD and control groups on the social/non-social attention factor (F(1,53) = 2.39, p = 0.128, partial η2 = 0.043) or on the efficiency of exploration factor (F(1,53) = 0.05, p = 0.818, partial η2 = 0.001).
Parents. The ASD parent group demonstrated significantly lower scores on average on the social/non-social attention factor (lower value indicating less social and more non-social looking) compared to the control parent group (F(1,95) = 4.40, p < 0.05, partial η2 = 0.044). No differences in efficiency of exploration factor scores emerged between groups (F(1,95) = 0.33, p = 0.568, partial η2 = 0.003).
BAP. Overall, there was a significant effect for the BAP (F(2,97) = 3.29, p < 0.05, partial η2 = 0.064), with the BAP(+) group, on average, scoring significantly lower on the social/non-social attention factor relative to the control parent group (mean difference = 0.582, p = 0.01). No significant differences were found in efficiency of exploration factor scores by BAP status (F(2,97) = 0.13, p = 0.880, partial η2 = 0.003).
This study applied a suite of eye-tracking analyses in attempt to deeply characterize potential differences in visual attention patterns to social and non-social information in ASD and the broad autism phenotype (BAP). Relatively robust differences were observed in patterns of fixations over the course of the stimulus presentation in the ASD and BAP parent groups, where both groups decreased social attention over time. Both the ASD and BAP(+) parent groups also showed differences in repeat perseverative fixations, with increased non-social and decreased social visual perseveration, respectively. Notably, although additional eye tracking analyses revealed relatively few differences in ASD and parent groups (regardless of BAP status), reducing data through principal component analysis revealed more robust group differences among parents, and these appeared largely driven by the subgroup showing the BAP. These findings underscore the utility of applying a broad array of analytic approaches to capture what may be nuanced, but still highly meaningful differences in visual attention in ASD and clinically unaffected relatives.
As noted, standard gaze variables (i.e., percentage of fixation duration and percentage of fixations) were re-produced from prior work  for comparison with the more expansive battery of variables examined here, and showed that parents with BAP traits spent more time generally fixating on non-social information compared to both parents without BAP features and control parents. Individuals with ASD in prior work showed similar trending patterns . Gaze analyses beyond these standard variables were unique to the present study, with growth curve analyses examining changes in visual attention over time emerging as a primary variable distinguishing the ASD and BAP(+) groups from controls and BAP(−) parents. For these groups, fixations towards social information changed over the course of the task, wherein ASD and BAP(+) groups showed distinct fixation patterns from controls. Parents with the BAP shifted away earlier from social information, and showed decreased social attention over time compared to parents without the BAP and control parents. While this overall pattern was not significantly different in the ASD group, examination of the data revealed qualitatively similar fixation patterns over the course of the stimulus presentation in ASD and the BAP. Importantly, divergence analyses, performed to determine the exact moments in which groups diverged from each other, demonstrated that individuals with ASD showed significantly reduced social attention towards the middle of the stimulus presentation compared to controls, while BAP(+) parents showed a later divergence from control parents, occurring towards the second half, and an even more dramatic decline in attention to social AOIs in the final seconds of the stimulus presentation, compared to both control parents and BAP(−) parents. These findings converge with prior literature examining temporal dynamics of social attention among adults with ASD relative to controls [61, 62]. Both studies found a decrease of social attention among adults with ASD relative to controls, who instead looked away from social information initially but returned their attention back to social information towards the end of the stimulus presentation. Findings therefore provide additional evidence of divergent social attention temporal dynamics in ASD. Parallel findings from parents in the present study further suggest that these patterns may stem from genetic origins. Clinically, in light of Hedger and Chakrabarti’s (2021) findings that showed strengthening relationships between ASD traits (as measured by the Autism Quotient) and social attention over time, our findings support those authors’ conclusions that individuals with ASD demonstrate disparate sustained maintenance of social attention as opposed to initial orienting differences . The lack of differences in first fixations AOIs in the present study provides further evidence for this conclusion. Moreover, because decreased social attention over time is believed to indicate a reduced interest for social stimuli , there may exist a diminished value or reward in social information among individuals with ASD and the BAP . A reduction in the reward mechanisms associated with social information may potentially underlie the decay in social attention observed among our ASD and BAP (+) groups, and the subsequent increased interest towards non-social information (as reflected by perseverative fixations findings discussed below). It therefore appears necessary to examine timing effects in studies of visual perception and attention, particularly given prior work evidencing delayed global (i.e., gestalt or integrative) processing in non-social tasks in ASD  and atypicalities in the underlying neural correlates indexing face perception in later time windows [90, 91]. It is possible that in more dynamic stimuli involving prolonged looking, findings of decreased social attention may result in information overload . Finally, results highlight how standard gaze variables may obscure shifting patterns of attentional engagement documented here, which may be meaningful to consider in understanding social-emotional processing differences in ASD. As such, an examination of fixations over the course of a stimulus presentation and divergence over specific time bins becomes an important step in further disentangling the nuanced and dynamic nature of gaze inherent to human behavior and impacted in ASD.
A prior study with this same sample, examining only standard eye-tracking variables  concluded that increased attention allocation towards non-social information in the TAT scene may reflect greater cognitive effort required to support narrative production (given the nature of the task); however, this pattern of visual attention did not improve narrative quality, suggesting that groups capitalized on different sources of information to inform their narratives. Patterns revealed by the more extensive gaze analyses performed in the current study suggest that these standard variables may not be sufficiently sensitive to capturing important shifts in attention during the narrative task. Specifically, increased attention towards non-social information over time suggests that shifting attention towards non-salient aspects of a scene may be advantageous in gleaning meaning from a scene to inform meaningful narratives. Given these findings, it is therefore possible that an examination of the second half of the scene (where individuals with ASD and ASD parents have already disengaged from social stimuli), may align more consistently with prior work that showed relationships between increased attention to non-salient information and greater clinical-behavioral impairments . For example, individuals with ASD have been observed to demonstrate reduced attention towards the eye region of the face and more attention towards the mouth  and, during natural scenes in this same study, increased fixations towards non-social information was associated with poorer social adjustment and increased ASD symptom severity , complementing findings from a later study that showed relationships between elevated fixations directed towards the background of a scene that related to increased ASD symptom severity . Future studies might benefit from a step-wise method of analysis that first includes an examination of fixations over the course of a task via GCA, followed by an application of divergence time bin analyses, and subsequent assessment of traditional and unique gaze analytical tools applied in the present study during critical time windows showing divergent patterns only. Together, that individuals with ASD and the BAP showed decreased fixations directed towards social information over time, suggests that this looking pattern may be particularly sensitive in reflecting ASD genetic vulnerability.
Other eye-tracking indices beyond standard fixation duration and proportion of fixations revealed further differences associate with ASD and the BAP. Specifically, individuals with ASD showed elevated rates of perseverative fixations towards non-social information and parents with the BAP showed reduced perseverations towards social AOIs. It may be that perseverative fixations reflect rigid tendencies, or a tendency to visually get “stuck” on certain visual information . Prior work has also documented such patterns of perseveration among individuals with ASD or the BAP during eye-tracking tasks involving social and non-social images [28, 93], complex scenes , and language processing [27, 95]. Such perseverative tendencies are manifested behaviorally and are among the defining characteristics of ASD. They may also be evident in more subtle forms in the BAP [96,97,98], revealed through rigid or inflexible personality traits and behaviors reported in every-day life through both self-report questionnaires and objective, semi-structured interviews [49, 50, 66, 99,100,101,102].
Although relationships between gaze variables and clinical-behavioral features are not entirely consistent [17, 23, 36, 40], and the lack of such relationships in the context of this study as well (see Additional file 1: Table S3), observed patterns of refixations (i.e., perseverative or regressive fixations) have been shown to relate to both lower-order motoric RRBs and social communication in ASD [27, 28] and the BAP in parents . A study examining gaze-language coordination additionally identified specific associations emerging between refixations in parents with the BAP and elevated rates of RRBs in their children . Findings of atypical perseverative visual attention documented in ASD and the BAP in the present study may suggest that perseverative fixations or “sticky” visual attention could inform patterns of inheritance of ASD-related candidate endophenotypes. It additionally highlights the utility of examining eye-tracking data using methods beyond traditional fixation and duration eye-tracking variables.
Finally, it is possible that increased perseverative fixations towards non-social information in ASD and decreased preservative fixations towards social information may stem from differences in local (i.e., detailed) and global (i.e., integrative) visual processing in ASD more broadly [89, 103]. Individuals with ASD have been shown to demonstrate heightened local perceptual abilities (i.e., the enhanced perceptual functioning theory) which may result in a reduction in global perceptual abilities (i.e., weak central coherence theory), suggesting that they have difficulty shifting attention from local to a global level [104, 105]. Enhanced local perceptual abilities also may explain the tendency for individuals with ASD to more often focus on or get distracted by insignificant, non-salient details in their environment, which has been documented in both eye-tracking studies [23, 40] and autobiographical accounts (e.g., ). As such, it is possible that the findings documented in the present study contribute to both the social deficit and weak central coherence/enhanced perceptual functioning theories of ASD, which further necessitates studies examining the links between these theories.
In contrast to these relatively robust differences noted in perseverative fixations, there were few differences in proband and parent groups when applying other eye-tracking analytical techniques. Specifically, first fixation AOI or duration did not differ between groups. This was somewhat surprising, particularly in light of social orientation differences reported repeatedly in ASD [20, 37, 107]. It is possible that the demands of the task (i.e., providing a narrative after viewing the picture) influenced visual attention patterns in ways distinct from the passive viewing tasks used in much of prior work, where participants may explore the image as they please [28, 108]. Moreover, given that prior work has shown a lack of social orientation differences in higher functioning individuals with ASD (e.g., ), the higher cognitive ability of the sample included in the present study (i.e., verbal IQ > 80) may have further contributed to the null findings. First fixation methods may thus be more appropriate during infancy when social orientation comes online, applied to individuals who may have lower IQ, task methods involving passive viewing, and/or more dynamic stimuli.
Similarly, the lack of differences in fixation rate/exploration (i.e., number of fixations per second), transition, or fixation spatial distribution/fixation coverage analyses were surprising, given that prior work has documented differences in ASD, particularly during a face processing task . As such, it may be that the concurrent narrative task demands necessitated both individuals with ASD and controls to explore the complex scene generously and comparably to deduce information to help inform their narratives; this stands in contrast to stimuli depicting motionless faces given their reduced “clutter” and visual complexity. Indeed, there is strong evidence in ASD demonstrating that patterns of fixations vary and depend highly on the context . As such, use of fixation transitions, coverage, and exploration may be applied to future work examining visual attentional differences in the BAP during a face processing task, particularly given distinct face processing emerging in parents that have also been linked to underlying neural correlates .
Despite there being no group differences on most of these individual variables outlined above, when considered together, using data reduction methods to identify variables tapping similar constructs, they were fruitful in increasing power to detect subclinical differences associated with the BAP. Specifically, robust BAP-specific differences were observed on the social/non-social factor score compared to control parents, indicating that parents of individuals with the BAP looked significantly less at social information than ASD parents without the BAP or controls. Although significant group differences in scores of social/non-social looking were not identified between the ASD and control groups, the effect size of the difference was medium (and comparable to that of the parent groups). Of note, distribution measures that did not take social/non-social differences into account did not differentiate between parent or proband groups, underscoring the specificity of social communicative differences among ASD and the BAP, and providing further evidence that social attention differences may serve as a potential ASD-related endophenotype. These findings also emphasize the utility of extracting multiple eye-tracking outcome variables and synthesizing them through data reduction methodologies, such as PCA, such that the emergent properties associated with mechanistic underpinnings of special populations can be decoded. It is important to note that the results generated from PCA required the assembly of a large number of potential candidate eye-tracking markers associated with ASD risk, and that the interpretation and understanding of the specificity of the constructs required an in depth, independent examination of each marker’s specific performance and properties.
Analyses of clinical-behavioral correlates of gaze metrics in the ASD group revealed no significant associations (see Additional file 1: Table S3). These results are perhaps not surprising, given prior findings of inconsistent relationships between gaze variables and clinical-behavioral features [17, 23, 36, 40]. It is possible that although the measures of clinical-behavioral phenotypes examined (e.g., ADOS, ADI-R) are highly effective as diagnostic classifiers, they may not be sufficiently sensitive to capture more nuanced clinical variations related to eye-tracking metrics and associated underlying cognition, particularly in older participants without intellectual disability. It is also possible that associations may be observed between clinical scores and gaze variables at different developmental stages, or perhaps evident in samples comprised of individuals with a wider range of ability levels. Together these factors may limit our ability to capture individual clinical variation relevant to gaze metrics. Future studies may therefore consider including participants across the cognitive and age spectrum.
Based on recent convergent evidence demonstrating key timing effects in the social attentional profiles of ASD [61, 62], we emphasize the importance of applying growth curve and time-bin divergent analyses (or similar temporal models) in studies of gaze patterns. We highlight here key differences at various time points along the continuum of time that were obscured by overall metrics of gaze, which may similarly be important to examine in studies of gaze in other populations as well. Moreover, given prior literature documenting differences in perseverative fixations and their association with restricted and repetitive behaviors [27, 28], inclusion of perseverative fixations is important in the context of ASD. We additionally see the value added from the principal component analysis, which provided overarching context to the various gaze metrics included in this and prior literature, in addition to insights into the two components extracted from this type of analysis. Future work should aim to incorporate such granular methods (alongside broad-based metrics) to help elucidate nuanced trajectories of visual attention. These have direct implications for clinical translation, given that visual attention is indeed a dynamic process. An understanding of when and how an individual with ASD capitalizes on certain aspects of their visual world can provide keys into their underlying cognition and avenues for intervention. This work may serve to capture subtle phenotypic variability associated with social-communication impairments in these groups, and perhaps lead to more powerful, objective tools for monitoring treatment outcomes. Taken together, findings from this study may further our understanding of eye-tracking methods, their application to special populations and associated characterization of endophenotypes, and underlying cognitive and biological mechanisms contributing to ASD and the BAP.
Although adequately powered, larger sample sizes including groups with a wider range of verbal skills will be useful in future work, particularly for the principal component analysis. Additionally, although social attention differences have been repeatedly documented in ASD, such differences are not necessarily specific to ASD (though quality can differ; e.g., greater social anxiety levels were associated with faster orienting away from the eyes whereas elevated ASD traits were related to delayed orientation towards the eyes , and future work may consider including as additional control groups, populations not associated with ASD, in which social attention is impacted. Given emerging evidence for sex-related social attention differences [108, 111, 112], substantial evidence documenting social-communicative differences between males and females with ASD  and emerging evidence of sex-related differences in the BAP [114, 115], future studies should enrich for females to permit well-powered analyses of potential sex-specific patterns of the social attentional profiles examined here. This study also applied eye-tracking analyses to only one context (i.e., a complex scene depicting both social and non-social information). Future studies are warranted to further examine how these unique eye-tracking methods may be applied to studies of the BAP across stimuli varying in context. It is also important to acknowledge that the 11 methodological tools documented here, while applicable to research in ASD and subclinical features related to ASD, represent only a subset of a large number of analytic measures that can be applied to eye-tracking studies (e.g., see ).
Taken together, this study highlights the specific utility of growth curve analyses to characterize meaningful fixation differences over the course of a task studies of visual social attention in ASD and the BAP. By providing a detailed examination of looking patterns over time, growth curve analyses may better capture the dynamic aspect of gaze that typically occurs in natural settings and which are impacted in ASD. In contrast, average dwell time and proportion of fixation variables assume a uniform or stagnant method of exploration, and tend to attenuate potential differences in looking patterns. Additionally, perseverations may be specifically tied to greater ASD risk, given differences observed in both ASD and the BAP. Despite most other variables yielding no robust differences between groups independently, when considered together using principal component analysis, this broad suite of eye-tracking variables contributed critical information to revealing relatively striking differences in social attention between the BAP and ASD from respective control groups. The eye-tracking variables examined in this study are thought to effectively reveal different aspects of underlying cognition [1, 9, 55,56,57,58,59, 79], and therefore may reveal key mechanistic insights into the roots of social functioning differences in ASD. These methods may additionally benefit studies of social skills training in individuals with ASD, as an objective means of measuring treatment outcomes. To our knowledge, this study is the most comprehensive application of different types of eye-tracking analytical methods in ASD and the BAP to date. Given the objective and measurable nature of the rigorous eye-tracking variables documented here, findings might contribute to development of a template that could be drawn upon in future eye-tracking studies examining visual attention across ASD and other populations.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Area of interest
Autism spectrum disorder
Broad autism phenotype
Multivariate analysis of variance
Thematic apperception test
Eckstein MK, Guerra-Carrillo B, Singley ATM, Bunge SA. Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? Dev Cogn Neurosci. 2017;25:69–91.
Yarbus AL. Eye movements during perception of complex objects. Eye movements and vision. New York: Plenum Press; 1967.
Theeuwes J, Belopolsky A, Olivers CN. Interactions between working memory, attention and eye movements. Acta Psychol (Amst). 2009;132(2):106–14.
Thomas LE, Lleras A. Moving eyes and moving thought: on the spatial compatibility between eye movements and cognition. Psychon Bull Rev. 2007;14(4):663–8.
Van der Stigchel S, Meeter M, Theeuwes J. Eye movement trajectories and what they tell us. Neurosci Biobehav Rev. 2006;30(5):666–79.
Just MA, Carpenter PA. Eye fixations and cognitive processes. Cogn Psychol. 1976;8:441–480.
Awh E, Armstrong KM, Moore T. Visual and oculomotor selection: links, causes and implications for spatial attention. Trends Cogn Sci. 2006;10(3):124–30.
Grosbras MH, Laird AR, Paus T. Cortical regions involved in eye movements, shifts of attention, and gaze perception. Hum Brain Mapp. 2005;25(1):140–54.
Luna B, Velanova K, Geier CF. Development of eye-movement control. Brain Cogn. 2008;68(3):293–308.
Hoppe D, Rothkopf CA. Learning rational temporal eye movement strategies. Proc Natl Acad Sci USA. 2016;113(29):8332–7.
Vullings C, Madelain L. Control of saccadic latency in a dynamic environment: allocation of saccades in time follows the matching law. J Neurophysiol. 2018;119(2):413–21.
Sabatinelli D, Fortune EE, Li Q, Siddiqui A, Krafft C, Oliver WT, et al. Emotional perception: meta-analyses of face and natural scene processing. Neuroimage. 2011;54(3):2524–33.
Yucel GH, Belger A, Bizzell J, Parlier M, Adolphs R, Piven J. Abnormal neural activation to faces in the parents of children with autism. Cereb Cortex. 2015;25(12):4653–66.
Dalton KM, Nacewicz BM, Johnstone T, Schaefer HS, Gernsbacher MA, Goldsmith HH, et al. Gaze fixation and the neural circuitry of face processing in autism. Nat Neurosci. 2005;8(4):519–26.
Adolphs R. What does the amygdala contribute to social cognition? Ann N Y Acad Sci. 2010;1191:42–61.
Kanwisher N, McDermott J, Chun MM. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci. 1997;17(11):4302–11.
Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59(9):809–16.
Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD, Piven J. Visual scanning of faces in autism. J Autism Dev Disord. 2002;32(4):249–61.
Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Defining and quantifying the social phenotype in autism. Am J Psychiatry. 2002;159(6):895–908.
Chita-Tegmark M. Social attention in ASD: a review and meta-analysis of eye-tracking studies. Res Dev Disabil. 2016;48:79–93.
Frazier TW, Strauss M, Klingemier EW, Zetzer EE, Hardan AY, Eng C, et al. A meta-analysis of gaze differences to social and nonsocial information between individuals with and without autism. J Am Acad Child Adolesc Psychiatry. 2017;56(7):546–55.
Papagiannopoulou EA, Chitty KM, Hermens DF, Hickie IB, Lagopoulos J. A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders. Soc Neurosci. 2014;9(6):610–32.
Lee M, Nayar K, Maltman N, Hamburger D, Martin GE, Gordon PC, Losh M. Understanding social communication differences in autism spectrum disorder and first-degree relatives: a study of looking and speaking. J Autism Dev Disord. 2020;50(6):2128–2141. https://doi.org/10.1007/s10803-019-03969-3.
Navab A, Gillespie-Lynch K, Johnson SP, Sigman M, Hutman T. Eye-Tracking as a measure of responsiveness to joint attention in infants at risk for autism. Infancy. 2012;17(4):416–31.
Righi G, Tenenbaum EJ, McCormick C, Blossom M, Amso D, Sheinkopf SJ. Sensitivity to audio-visual synchrony and its relation to language abilities in children with and without ASD. Autism Res. 2018;11(4):645–53.
Speer LL, Cook AE, McMahon WM, Clark E. Face processing in children with autism: effects of stimulus contents and type. Autism. 2007;11(3):265–77.
Nayar K, Gordon PC, Martin GE, Hogan AL, La Valle C, McKinney W, et al. Links between looking and speaking in autism and first-degree relatives: insights into the expression of genetic liability to autism. Mol Autism. 2018;9:51.
Sasson NJ, Turner-Brown LM, Holtzclaw TN, Lam KS, Bodfish JW. Children with autism demonstrate circumscribed attention during passive viewing of complex social and nonsocial picture arrays. Autism Res. 2008;1(1):31–42.
Chawarska K, Shic F. Looking but not seeing: atypical visual scanning and recognition of faces in 2 and 4-year-old children with autism spectrum disorder. J Autism Dev Disord. 2009;39(12):1663–72.
Falck-Ytter T, Fernell E, Gillberg C, von Hofsten C. Face scanning distinguishes social from communication impairments in autism. Dev Sci. 2010;13(6):864–75.
Jones W, Carr K, Klin A. Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Arch Gen Psychiatry. 2008;65(8):946–54.
Nakano T, Tanaka K, Endo Y, Yamane Y, Yamamoto T, Nakano Y, et al. Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour. Proc Biol Sci. 2010;277(1696):2935–43.
Chawarska K, Volkmar F, Klin A. Limited attentional bias for faces in toddlers with autism spectrum disorders. Arch Gen Psychiatry. 2010;67(2):178–85.
Klin A, Jones W. Altered face scanning and impaired recognition of biological motion in a 15-month-old infant with autism. Dev Sci. 2008;11(1):40–6.
Klin A, Lin DJ, Gorrindo P, Ramsay G, Jones W. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 2009;459(7244):257–61.
Shic F, Bradshaw J, Klin A, Scassellati B, Chawarska K. Limited activity monitoring in toddlers with autism spectrum disorder. Brain Res. 2011;1380:246–54.
Unruh KE, Sasson NJ, Shafer RL, Whitten A, Miller SJ, Turner-Brown L, et al. Social orienting and attention is influenced by the presence of competing nonsocial information in adolescents with autism. Front Neurosci. 2016;10:586.
Wang Q, Campbell DJ, Macari SL, Chawarska K, Shic F. Operationalizing atypical gaze in toddlers with autism spectrum disorders: a cohesion-based approach. Mol Autism. 2018;9:25.
Chevallier C, Parish-Morris J, McVey A, Rump KM, Sasson NJ, Herrington JD, et al. Measuring social attention and motivation in autism spectrum disorder using eye-tracking: Stimulus type matters. Autism Res. 2015;8(5):620–8.
Chawarska K, Macari S, Shic F. Context modulates attention to social scenes in toddlers with autism. J Child Psychol Psychiatry. 2012;53(8):903–13.
Shic F, Chawarska K, Bradshaw J, Scassellati B. Autism, eye-tracking, entropy. In: 2008 IEEE 7th international conference on development and learning 2008. p. 73–8.
Constantino JN, Kennon-McGill S, Weichselbaum C, Marrus N, Haider A, Glowinski AL, et al. Infant viewing of social scenes is under genetic control and is atypical in autism. Nature. 2017;547(7663):340–4.
Ettinger U, Kumari V, Crawford TJ, Corr PJ, Das M, Zachariah E, et al. Smooth pursuit and antisaccade eye movements in siblings discordant for schizophrenia. J Psychiatr Res. 2004;38(2):177–84.
Gottesman II, Gould TD. The endophenotype concept in psychiatry: etymology and strategic intentions. Am J Psychiatry. 2003;160(4):636–45.
Bradshaw J, Shic F, Holden AN, Horowitz EJ, Barrett AC, German TC, et al. The use of eye tracking as a biomarker of treatment outcome in a pilot randomized clinical trial for young children with autism. Autism Res. 2019;12(5):779–93.
Murias M, Major S, Davlantis K, Franz L, Harris A, Rardin B, et al. Validation of eye-tracking measures of social attention as a potential biomarker for autism clinical trials. Autism Res. 2018;11(1):166–74.
Pierce K, Marinero S, Hazin R, McKenna B, Barnes CC, Malige A. Eye tracking reveals abnormal visual preference for geometric images as an early biomarker of an autism spectrum disorder subtype associated with increased symptom severity. Biol Psychiatry. 2016;79(8):657–66.
Adolphs R, Spezio ML, Parlier M, Piven J. Distinct face-processing strategies in parents of autistic children. Curr Biol. 2008;18(14):1090–3.
Losh M, Childress D, Lam K, Piven J. Defining key features of the broad autism phenotype: a comparison across parents of multiple- and single-incidence autism families. Am J Med Genet B Neuropsychiatr Genet. 2008;147B(4):424–33.
Losh M, Piven J. Social-cognition and the broad autism phenotype: identifying genetically meaningful phenotypes. J Child Psychol Psychiatry. 2007;48(1):105–12.
Groen WB, Rommelse N, de Wit T, Zwiers MP, van Meerendonck D, van der Gaag RJ, et al. Visual scanning in very young children with autism and their unaffected parents. Autism Res Treat. 2012;2012:748467.
Wass SV, Forssman L, Leppänen J. Robustness and precision: How data quality may influence key dependent variables in infant eye-tracker analyses. Infancy. 2014;19(5):427–60.
Wass SV, Smith TJ, Johnson MH. Parsing eye-tracking data of variable quality to provide accurate fixation duration estimates in infants and adults. Behav Res Methods. 2013;45(1):229–50.
Shic F, Chawarska K, Scassellati B. The incomplete fixation measure. In Proceedings of the 2008 symposium on Eye tracking research & applications. 2008. p. 111-114. https://doi.org/10.1145/1344471.1344500.
Hughes C, Russell J. Autistic children’s difficulty with mental disengagement from an object: Its implications for theories of autism. Dev Psychol. 1993;29(3):498.
Booth RW, Weger UW. The function of regressions in reading: backward eye movements allow rereading. Mem Cognit. 2013;41(1):82–97.
Perea M, Carreiras M. Regressions and eye movements: where and when. Behav Brain Sci. 2003;26(4):497.
Rayner K. Eye movements in reading and information processing: 20 years of research. Psychol Bull. 1998;124(3):372–422.
Rayner K, Slattery TJ, Belanger NN. Eye movements, the perceptual span, and reading speed. Psychon Bull Rev. 2010;17(6):834–9.
Shic F, Chawarska K, Scassellati B. The amorphous fixation measure revisited: with applications to autism. In 30th Annual Meeting of the Cognitive Science Society. 2008. p. 1–6.
Del Bianco T, Mason L, Charman T, Tillman J, Loth E, Hayward H, et al. Temporal profiles of social attention are different across development in autistic and neurotypical people. Biol Psychiatry Cogn Neurosci Neuroimaging. 2021;6(8):813–24.
Hedger N, Chakrabarti B. Autistic differences in the temporal dynamics of social attention. Autism. 2021;25(6):1615–26.
Jones W, Klin A. Attention to eyes is present but in decline in 2-6-month-old infants later diagnosed with autism. Nature. 2013;504(7480):427–31.
Lord C, Rutter M, DiLavore P, Risi S, Gotham K, Bishop S. Autism diagnostic observation schedule–2nd edition (ADOS-2). Los Angeles: Western Psychological Corporation; 2012.
Lord C, Rutter M, Le Couteur A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994;24(5):659–85.
Piven J, Palmer P, Landa R, Santangelo S, Jacobi D, Childress D. Personality and language characteristics in parents from multiple-incidence autism families. Am J Med Genet. 1997;74(4):398–411.
Sasson NJ, Lam KS, Childress D, Parlier M, Daniels JL, Piven J. The broad autism phenotype questionnaire: prevalence and diagnostic classification. Autism Res. 2013;6(2):134–43.
Murray HA. Thematic apperception test. Cambridge: Harvard University Press; 1943.
Hiraishi H, Haida M, Matsumoto M, Hayakawa N, Inomata S, Matsumoto H. Differences of prefrontal cortex activity between picture-based personality tests: a near-infrared spectroscopy study. J Pers Assess. 2012;94(4):366–71.
Turk AA, Brown WS, Symington M, Paul LK. Social narratives in agenesis of the corpus callosum: linguistic analysis of the Thematic Apperception Test. Neuropsychologia. 2010;48(1):43–50.
Beaumont R, Newcombe P. Theory of mind and central coherence in adults with high-functioning autism or Asperger syndrome. Autism. 2006;10(4):365–82.
Lee M, Martin GE, Hogan A, Hano D, Gordon PC, Losh M. What’s the story? A computational analysis of narrative competence in autism. Autism. 2018;22(3):335–44.
Anderson CJ, Colombo J, Jill SD. Visual scanning and pupillary responses in young children with Autism Spectrum Disorder. J Clin Exp Neuropsychol. 2006;28(7):1238–56.
Dink JW, Ferguson B. eyetrackingR: An R Library for Eye-tracking Data Analysis. 2015 Available from: http://www.eyetrackingr.com.
Demarais AM, Cohen BH. Evidence for image-scanning eye movements during transitive inference. Biol Psychol. 1998;49(3):229–47.
Thibaut JP, French RM. Analogical reasoning, control and executive functions: a developmental investigation with eye-tracking. Cogn Dev. 2016;38:10–26.
Vigneau F, Caissie AF, Bors DA. Eye-movement analysis demonstrates strategic influences on intelligence. Intelligence. 2006;34(3):261–72.
Kimchi R. Primacy of wholistic processing and global/local paradigm: a critical review. Psychol Bull. 1992;112(1):24–38.
Zagermann J, Pfeil U, Reiterer H, editors. Studying eye movements as a basis for measuring cognitive load. In: Extended Abstracts of the 2018 CHI conference on human factors in computing systems; 2018.
Hessels RS, Kemner C, van den Boomen C, Hooge IT. The area-of-interest problem in eyetracking research: a noise-robust solution for face and sparse stimuli. Behav Res Methods. 2016;48(4):1694–712.
Benjamini Y, Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57(1):289–300.
APA. Publication manual of the American Psychological Association. 4th edn. Washington: American Psychiatric Association; 1994.
Olson CL. Comparative robustness of six tests in multivariate analysis of variance. J Am Stat Assoc. 1974;69(348):894–908.
Winston M, Nayar K, Hogan AL, Barstein J, La Valle C, Sharp K, et al. Physiological regulation and social-emotional processing in female carriers of the FMR1 premutation. Physiol Behav. 2020;214:112746.
Lever J, Krzywinski M, Altman N. Principal component analysis. Nat Methods. 2017;14:641–2.
Dennis M, Francis DJ, Cirino PT, Schachar R, Barnes MA, Fletcher JM. Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders. J Int Neuropsychol Soc. 2009;15(3):331–43. https://doi.org/10.1017/S1355617709090481
Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I. The, “Reading the Mind in the Eyes” Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry. 2001;42(2):241–51.
Shimojo S, Simion C, Shimojo E, Scheier C. Gaze bias both reflects and influences preference. Nat Neurosci. 2003;6(12):1317–22.
Van der Hallen R, Evers K, Brewaeys K, Van den Noortgate W, Wagemans J. Global processing takes time: a meta-analysis on local-global visual processing in ASD. Psychol Bull. 2015;141(3):549–73.
McPartland JC, Webb SJ, Keehn B, Dawson G. Patterns of visual attention to faces and objects in autism spectrum disorder. J Autism Dev Disord. 2011;41(2):148–57.
McPartland J, Dawson G, Webb SJ, Panagiotides H, Carver LJ. Event-related brain potentials reveal anomalies in temporal processing of faces in autism spectrum disorder. J Child Psychol Psychiatry. 2004;45(7):1235–45.
O’Connor K, Kirk I. Brief report: atypical social cognition and social behaviours in autism spectrum disorder: a different way of processing rather than an impairment. J Autism Dev Disord. 2008;38(10):1989–97.
Swanson MR, Serlin GC, Siller M. Broad autism phenotype in typically developing children predicts performance on an eye-tracking measure of joint attention. J Autism Dev Disord. 2013;43(3):707–18.
Au-Yeung SK, Benson V, Castelhano M, Rayner K. Eye movement sequences during simple versus complex information processing of scenes in autism spectrum disorder. Autism Res Treat. 2011;2011:657383.
Nayar K, Kang X, Xing J, Gordon PC, Wong PCM, Losh M. A cross-cultural study showing deficits in gaze-language coordination during rapid automatized naming among individuals with ASD. Sci Rep. 2021;11(1):13401.
Cuccaro ML, Shao Y, Grubber J, Slifer M, Wolpert CM, Donnelly SL, et al. Factor analysis of restricted and repetitive behaviors in autism using the Autism Diagnostic Interview-R. Child Psychiatry Hum Dev. 2003;34(1):3–17.
Lam KSL, Bodfish JW, Piven J. Evidence for three subtypes of repetitive behavior in autism that differ in familiality and association with other symptoms. J Child Psychol Psychiatry. 2008;49(11):1193–200.
Richler J, Bishop SL, Kleinke JR, Lord C. Restricted and repetitive behaviors in young children with autism spectrum disorders. J Autism Dev Disord. 2007;37(1):73–85.
Losh M, Adolphs R, Piven J. The broad autism phenotype. Autism spectrum disorders. Oxford: Oxford University Press; 2011.
Losh M, Klusek J, Martin GE, Sideris J, Parlier M, Piven J. Defining genetically meaningful language and personality traits in relatives of individuals with fragile X syndrome and relatives of individuals with autism. Am J Med Genet B Neuropsychiatr Genet. 2012;159B(6):660–8.
Losh M, Adolphs R, Poe MD, Couture S, Penn D, Baranek GT, et al. Neuropsychological profile of autism and the broad autism phenotype. Arch Gen Psychiatry. 2009;66(5):518–26.
Piven J, Wzorek M, Landa R, Lainhart J, Bolton P, Chase GA, et al. Personality characteristics of the parents of autistic individuals. Psychol Med. 1994;24(3):783–95.
Van Eylen L, Boets B, Steyaert J, Wagemans J, Noens I. Local and global visual processing in autism spectrum disorders: influence of task and sample characteristics and relation to symptom severity. J Autism Dev Disord. 2018;48(4):1359–81.
Plaisted K, Swettenham J, Rees L. Children with autism show local precedence in a divided attention task and global precedence in a selective attention task. J Child Psychol Psychiatry. 1999;40(5):733–42.
Rinehart NJ, Bradshaw JL, Moss SA, Brereton AV, Tonge BJ. Atypical interference of local detail on global processing in high-functioning autism and Asperger’s disorder. J Child Psychol Psychiatry. 2000;41(6):769–78.
Grandin T. Thinking in pictures and other reports from my life with autism; New York, NY: Vintage Books. 2006.
Franchini M, Glaser B, de Wilde HW, Gentaz E, Eliez S, Schaer M. Social orienting and joint attention in preschoolers with autism spectrum disorders. PLoS ONE. 2017;12(6):10.
Harrop C, Jones D, Zheng S, Nowell S, Boyd BA, Sasson N. Circumscribed interests and attention in autism: the role of biological sex. J Autism Dev Disord. 2018;48(10):3449–59.
Fischer J, Koldewyn K, Jiang YV, Kanwisher N. Unimpaired attentional disengagement and social orienting in children with autism. Clin Psychol Sci. 2014;2(2):214–23.
Kleberg JL, Hogstrom J, Nord M, Bolte S, Serlachius E, Falck-Ytter T. Autistic traits and symptoms of social anxiety are differentially related to attention to others’ eyes in social anxiety disorder. J Autism Dev Disord. 2017;47(12):3814–21.
Harrop C, Jones D, Zheng S, Nowell SW, Boyd BA, Sasson N. Sex differences in social attention in autism spectrum disorder. Autism Res. 2018;11(9):1264–75.
Harrop C, Jones DR, Sasson NJ, Zheng S, Nowell SW, Parish-Morris J. Social and object attention is influenced by biological sex and toy gender-congruence in children with and without autism. Autism Res. 2020;13(5):763–76.
Lai MC, Lombardo MV, Auyeung B, Chakrabarti B, Baron-Cohen S. Sex/gender differences and autism: setting the scene for future research. J Am Acad Child Adolesc Psychiatry. 2015;54(1):11–24.
Nayar K, Sealock JM, Maltman N, Bush L, Cook EH, Davis LK, et al. Elevated polygenic burden for autism spectrum disorder is associated with the broad autism phenotype in mothers of individuals with autism spectrum disorder. Biol Psychiatry. 2021;89(5):476–85.
Patel SP, Nayar K, Martin GE, Franich K, Crawford S, Diehl JJ, et al. An acoustic characterization of prosodic differences in autism spectrum disorder and first-degree relatives. J Autism Dev Disord. 2020;50(8):3032–45.
Holmqvist K, Nyström M, Andersson R, Dewhurst R, Jarodzka H, Weijer JVD. A comprehensive guide to methods and measure. Oxford: Oxford University Press; 2011.
We are grateful to the individuals and families who participated in this study. We are additionally grateful to Nell Maltman, Ph.D. and Michelle Lee, Ph.D. for their contributions to data processing.
This research was supported by grants from the National Institutes of Health (R01DC010191, R01MH091131) and the National Science Foundation (BCS-0820394) and P30 HD03110.
Ethics approval and consent to participate
All procedures performed in this study were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Informed consent. Informed consent was obtained from all individual participants included in the study.
Consent for publication
FS is a paid consultant for Roche and Janssen pharmaceutical companies. All other authors declare that they have no disclosures or conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
. Supplementary information provided outlining details pertaining to PCA analyses (Fig. S1, Table S1, and Table S2). Table S3 displays a correlation matrix of the clinical-behavioral indices with eye-tracking variables among individuals with ASD.
About this article
Cite this article
Nayar, K., Shic, F., Winston, M. et al. A constellation of eye-tracking measures reveals social attention differences in ASD and the broad autism phenotype. Molecular Autism 13, 18 (2022). https://doi.org/10.1186/s13229-022-00490-w
- Eye tracking
- Autism spectrum disorder
- Broad autism phenotype
- Social attention
- Visual processing