Gazefinder as a clinical supplementary tool for discriminating between autism spectrum disorder and typical development in male adolescents and adults
Molecular Autism volume 7, Article number: 19 (2016)
Gaze abnormality is a diagnostic criterion for autism spectrum disorder (ASD). However, few easy-to-use clinical tools exist to evaluate the unique eye-gaze patterns of ASD. Recently, we developed Gazefinder, an all-in-one eye-tracking system for early detection of ASD in toddlers. Because abnormal gaze patterns have been documented in various ASD age groups, we predicted that Gazefinder might also detect gaze abnormality in adolescents and adults. In this study, we tested whether Gazefinder could identify unique gaze patterns in adolescents and adults with ASD.
We measured the percentage of eye fixation time allocated to particular objects depicted in movies (i.e., eyes and mouth in human face movies, upright and inverted biological motion in movies that presented these stimuli simultaneously, and people and geometry in movies that presented these stimuli simultaneously) by male adolescents and adults with ASD (N = 26) and age-matched males with typical development (TD; N = 35). We compared these percentages between the two groups (ASD and TD) and with scores on the social responsiveness scale (SRS). Further, we conducted discriminant analyses to determine if fixation times allocated to particular objects could be used to discriminate between individuals with and without ASD.
Compared with the TD group, the ASD group showed significantly less fixation time at locations of salient social information (i.e., eyes in the movie of human faces without lip movement and people in the movie of people and geometry), while there were no significant groupwise differences in the responses to movies of human faces with lip movement or biological motion. In a within-group correlation analysis, a few of the fixation-time items correlated with SRS, although most of them did not. No items significantly correlated with SRS in both ASD and TD groups. The percentage fixation times to eyes and people, which exhibited large effect sizes for the group difference, could differentiate ASD and TD with a sensitivity of 81.0 % and a specificity of 80.0 %.
These findings suggest that Gazefinder is potentially a valuable and easy-to-use tool for objectively measuring unique gaze patterns and discriminating between ASD and TD in male adolescents and adults.
Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by “deficits in social communication and social interaction” and “restricted, repetitive patterns of behavior, interests, or activities,” according to the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) . The phrase “never looked into anyone’s face” was used in the first report about autism , and this unique gaze fixation pattern is a characteristic included in the diagnostic criteria for ASD . However, because a medical staff subjectively assesses gaze abnormality through clinical examination of patients or interview with caregivers, documentation of the severity of a patient’s gaze abnormality can differ among medical evaluators. To more objectively measure gaze abnormalities in individuals with ASD, it is important that clinicians have access to easy-to-use clinical tools.
A number of studies have identified unique visual gaze patterns in individuals with ASD using eye-tracking systems, for example, Tobii® (Tobii Technology; Stockholm, Sweden) or ISCAN® (ISCAN Inc.; Woburn, MA, USA) [3–19]. Using these systems, gaze abnormalities in individuals with ASD were detected when they observed movies or photographs of human faces [3–12], biological motion [13–16], people [3, 17–23], and the simultaneous presentation of people and geometric stimuli [24, 25]. For instance, compared with age-matched typically developed (TD) individuals, children [3–6, 10, 11, 20–23] and adults [7–9, 12, 19, 26] with ASD spent less time gazing at eye or face regions. These abnormalities in individuals with ASD were consistently observed in various types of tasks, such as free-viewing tasks [3, 5, 6, 9, 10, 19–23], facial emotion discrimination tasks [4, 9], and facial recognition tasks [4, 7, 8, 11]. In addition, several studies have reported abnormal gaze when children with ASD view biological motion [13–16]. Three of these studies used simultaneous presentation of upright and inverted biological motion [13, 15, 16], and two studies revealed that children with ASD gaze less at the upright biological motion. On the other hand, Fujisawa et al.  showed that preschool children with ASD exhibited stronger preference for upright biological motion as compared with age-matched TD children. These findings suggest that the abnormality in the preference for upright biological motion in individuals with ASD might change with age and serve to diagnose ASD. Furthermore, previous studies revealed that children with ASD preferred looking at geometric shapes when people and geometric shapes were presented simultaneously [24, 25]. The report by Shi et al.  showed high sensitivity and specificity using total fixation time with images of people, namely 84.6 and 85.0 %, respectively. These findings imply that fixation time on particular classes of objects as measured by eye-tracking systems might provide an objective assessment of gaze abnormalities in both children and adults with ASD.
Such gaze fixation patterns in individuals with ASD are considered to be associated with particular symptoms (e.g., social deficits). For instance, the social affect score of the autism diagnostic observation schedule (ADOS)  correlated negatively with the fixation time to human faces or eyes in toddlers with ASD [5, 18]. Additionally, scores on the social responsiveness scale (SRS)  were negatively correlated with the fixation time to human eyes in groups including both ASD and TD children . The findings imply that fixation time to a particular object as measured by eye-tracking systems could be used as a predictor of social-deficit severity for each individual.
Although these eye-tracking techniques can objectively evaluate the gaze pattern of individuals with ASD, it is necessary for scientists conducting basic research on ASD-related gaze to develop original and experimental approaches and stimuli expressly designed to discover and explore the unique characteristics of abnormal gaze. However, this design process is not practical in clinical settings because of limited work force and/or time. To address the clinical need for an easy-to-use system, the Gazefinder (JVC KENWOOD Corporation, Kanagawa, Japan), a simple all-in-one eye-tracking system, has been developed for early detection of ASD in toddlers. Gazefinder incorporates movies of human faces, biological motion, and people and geometric shapes, and it provides almost instantaneous data by automatically calculating the percentage fixation time allocated by the participants among regions of interest in the movie. Because Gazefinder was designed for toddlers, the total trial time is short (approximately 2 min), and instructions or verbal answers are not required; the participant simply views a video monitor. We reported that, compared with TD children, preschool children with ASD exhibited a more prominent preference for (i.e., higher percentage of visual attention to) upright biological motion over inverted biological motion when assessed with Gazefinder . Therefore, the percentage fixation time to biological motion, as determined by Gazefinder, could be used for evaluating gaze abnormality in ASD preschool children. Given that gaze abnormality has been found not only in children [3–6, 13–15, 17–19] but also in adults with ASD [7–9, 19], it is possible that Gazefinder could be used for evaluating the gaze patterns of adolescents and adults with ASD. Brugha and colleagues reported that the estimated prevalence of ASD in an adult population was approximately one percent, but all cases detected in this research were not diagnosed . Considering that the concept of adult ASD is gaining increasing acceptance, objective assessments in addition to traditional subjective assessments (e.g., listening or questionnaires) will be helpful in detecting ASD traits that might otherwise go undiagnosed, and Gazefinder could be useful here. However, because it has been discovered that the gaze fixation pattern of adults with ASD is different from that of children with ASD , the gaze fixation patterns measured by Gazefinder should also reveal changes with age. No studies to date have examined gaze patterns in adolescents and adults with ASD using Gazefinder. Therefore, before using Gazefinder with the adolescent-to-adult age group in the clinical setting, it is necessary to examine whether it can detect the specific characteristics of ASD gaze patterns in this age group. In addition, it is also necessary to affirm whether gaze fixation patterns measured by Gazefinder reflect sociality and distinguish individuals with ASD from TD individuals in this age group.
Using Gazefinder, we first examined the gaze characteristics of adolescents and adults with ASD. Specifically, we examined (1) the percentage fixation time allocated to specific objects in individuals with and without ASD and (2) the relationships between the percentage fixation time and the severity of social deficit. We then examined (3) if individuals with and without ASD can be distinguished from each other by the percentage fixation times.
We recruited 26 male adolescents and adults with ASD and 35 age-matched TD male participants. The protocol used for this study was approved by the ethics committee of the University of Fukui. After a complete explanation of the study, all participants or their parents/legal guardians provided written, informed consent. We obtained SRS scores  to determine the severity of social deficit exhibited by participants with ASD and TD. In the present study, we used the 65-item SRS adult self-report form. Each item is scored on the Likert scale, which ranges from 0 (never true) to 3 (almost always true). Total SRS scores range from 0 to 195, with higher total scores indicating more severe social deficits.
The ASD group
A total of 26 male adolescents and adults with ASD (15 to 41 years old) were recruited by the Department of Neuropsychiatry at the University of Fukui Hospital, Japan, and the Department of Psychiatry and Neurobiology at the Kanazawa University Hospital, Japan. Two authors (TM and HK) diagnosed the participants based on the criteria of the DSM-IV-TR  and on the standardized criteria of the Diagnostic Interview for Social and Communication Disorders (DISCO) . The latter has good psychometric properties . DISCO also contains items concerning early development and a section on activities of daily living that provide data regarding functioning in areas other than in the social and communication domains . Participants were excluded if they met the diagnostic criteria for any other psychopathology, e.g., attention-deficit/hyperactivity disorder (ADHD), schizophrenia spectrum, anxiety disorder, or obsessive-compulsive disorder. A total of 23 individuals with ASD completed the Wechsler Adult Intelligence Scale—Third Edition (WAIS-III) , and one participant who was 15 years old completed the Wechsler Intelligence Scale for Children—Third Edition (WISC-III) , for assessment of intelligence quotient (IQ). All participants scored 70 or higher on the full-scale IQ (FSIQ). The IQs of two individuals with ASD who refused WAIS-III were recognized to be average based on their past or current academic performance.
The TD group
We also recruited 35 age-matched TD male participants (20 to 41 years old) from the local community. Individuals with a history of major medical or neurological illness including epilepsy, significant head trauma, or a lifetime history of alcohol or drug dependence were excluded from this study. We performed screenings to exclude individuals who had a first-degree relative with an Axis I disorder diagnosed by DSM-IV-TR criteria .
Eye-tracking system with Gazefinder
We utilized Gazefinder, an all-in-one eye-tracking system, to evaluate the percentage fixation times allocated to specific objects (see Fig. 1) on a video monitor. The experiment was conducted in a quiet laboratory at the University of Fukui.
Measurement of eye position
Participants’ eye position was measured using infrared light sources and cameras located below a 19-inch thin-film transistor (1280 × 1024 pixels). Using corneal reflection techniques, eye position was recorded as X and Y coordinates at a frequency of 50 Hz (i.e., 3000 data collections/min). Calibration of the eye position recording was performed with a five-point method, whereby each participant followed the location of a ball around the screen before a series of movies were presented.
After calibration, eight short movies were presented, including five movies of a human face, a movie of biological motion, and two movies of people and geometry. Human face movie clips consisted of the following: (A) still image (7 s), (B) eye blinking (an actress repeatedly opens and closes her eyes for 7 s), (C) mouth moving (an actress repeatedly opens and closes her mouth for 4 s), (D) silent (an actress with a still face for 3 s), and (E) talking (7 s) (Fig. 1i). In (E), the actress says, “Konnichiwa” (“Hello” in English), “Onamaewa?” (“What is your name?” in English), and “Issyoniasobouyo” (“Let’s play together” in English). Movie (F) presents upright and inverted biological motion simultaneously (20 s) (Fig. 1ii). This movie was accompanied by a soundtrack playing the song Under the Big Chestnut Tree, to which an upright human (i.e., biological motion) danced. Similarly, an inverted human (i.e., upside-down biological motion) was played backwards, relative to the movie of the upright biological motion. Movies of people and geometry consisted of (G) people and geometry presented at the same time and at the same size for 16 s and (H) a movie of geometry depicted in small-frame images in a small window on a movie of people, for 16 s (Fig. 1iii, iv). The movies were sequentially displayed, beginning with the human face (still image) (A) all the way through to the movies of people and geometry (small window) (H). Animations to reorient the viewer’s attention to the stimuli (e.g., animation with a voice saying “Hey! Look!”) were presented on the screen after (B) human face (blinking), (E) human face (talking), (F) biological motion, and (G) people and geometry (same size) and at the midpoint of (G) people and geometry (same size). The rationale for the design of these Gazefinder stimuli is given in Additional file 1.
Analysis of the percentage fixation times
Percentage fixation times allocated to particular areas on the video monitor were automatically calculated (time allocated to a particular area/duration of stimulus presentation), and the results could be printed immediately after the videos were viewed. Figure 1 shows areas-of-interest (AoIs) for each stimulus. Human face included two AoIs (i.e., AoI-1 is the eye region and AoI-2 is the mouth region) (Fig. 1i). The biological motion includes two AoIs (i.e., AoI-1 is upright biological motion involving dancing to the song, and AoI-2 is inverted biological motion that was presented upside down and played backwards relative to the upright biological motion) (Fig. 1ii). For the movie of people and geometry (same size), there were two AoIs (i.e., AoI-1 is the area with people, and AoI-2 is the area with geometry) (Fig. 1iii). The people and geometry (small window) movie contained one AoI (i.e., the geometric shapes window) (Fig. 1iv). In addition to these AoIs, the percentage fixation time allocated to areas other than AoI(s) (i.e., out of AoI) was also calculated during the movies of the human faces and people and geometry.
Analysis of data
Individuals for whom the available percentage fixation time was <80 % were excluded (i.e., Gazefinder could not detect eye position more than 20 % of the time).
We first investigated differences in gaze patterns between the ASD and TD groups. Although we could conduct ANOVA with face stimuli and biological motion, we could not carry out ANOVA that included movies of people and geometry due to a mismatch in the number of AoIs. Therefore, in order to unify statistical methods and to clarify group differences in the effect of each AoI of a stimulus, we conducted independent t tests for percentage fixation times to each AoI. To avoid type 1 statistical errors, we applied Bonferroni corrections and set .05 divided by the number of AoIs as the significance level; we set .025 (.05/2) as the significance level for the stimuli that included human faces, biological motion, and people and geometry (same size). As was the case with the movies having only the AoI-1, we set .05 as the statistically significant level in the people and geometry (small window) condition. We also calculated effect size (i.e., Cohen’s d) for the differences between the ASD and TD groups, setting d > 0.5 as medium and d > 0.8 as large, in accordance with the criteria of Cohen . We then conducted a correlation analysis. Because the unique gaze pattern of ASD may reflect social deficits selectively , we examined whether the percentage fixation times correlated with raw scores on the SRS, which measures the social deficits characteristic of ASD. In addition to this, we also examined the correlation between the percentage fixation times and the FSIQ, to test whether intellectual ability affected group differences or correlations. Finally, we investigated whether the percentage fixation times to AoI discriminate between ASD and TD. More specifically, we conducted receiver operating characteristic (ROC) analysis and calculated the area under the curves (AUCs) to establish cutoff points that would serve as thresholds indicating an ASD-like pattern for each AoI. Incidentally, AUC reflects the discriminant level in ROC analysis, and ≥.7 is considered acceptable and ≥.8 is considered excellent . Based on these results, we initially selected all AoI-1s shown in Fig. 1 and evaluated sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR), broken down by the number of items above the cutoff point. Then, because items that did not show a clear group difference were thought to decrease the accuracy of the discriminant parameters (i.e., sensitivity, specificity, PLR, and NLR), we evaluated these parameters excluding the item that could not discriminate well between the ASD and TD groups. In particular, we found AoI-1s that showed the large effect size (d > 0.8) and calculated the discriminant parameters according to the number of items that met the cutoff condition. All statistical analyses were conducted using IBM SPSS statistical software, version 22.
Demographic data of participants used in data analysis
Five participants in the ASD group for whom the available percentage fixation times were <80 % were excluded from the study (the available percentage fixation times of the excluded participants were 60, 58, 53, 52, and 31 %). There were no excluded individuals in the TD group. Thus, data for 21 individuals with ASD and 35 TD individuals were used for the following analysis. All 21 participants with ASD completed the WAIS-III or WISC-III. After excluding the five participants with ASD, the demographic data were as presented in Table 1. There was no significant group difference in age, and the ASD group showed significantly higher SRS scores (Table 1).
Comparing the percentage fixation times (ASD vs. TD)
Preliminary independent t test found no group difference in the available percentage fixation times between the ASD and TD groups (Table 2). We then compared the percentage fixation times devoted to each AoI (time allocated to each AoI/duration of each stimulus presentation) between the two groups (ASD and TD).
For human face stimuli, the percentage fixation times to the eyes (AoI-1) in (still image), (blinking), and (silent) were significantly lower in the ASD group than those in the TD group, and the percentage fixation times to the mouth were higher in the ASD group than those in the TD group for (blinking) and (silent) (all after Bonferroni corrections). For people and geometry (same size), the percentage fixation times allocated by the ASD group were lower for people (AoI-1) and higher for geometry than the corresponding values in the TD group, after Bonferroni corrections. For people and geometry (small window), the percentage fixation time to geometry (AoI-1) was higher in the ASD group than that in the TD group. We could not find significant group differences in other face stimuli (Table 2 and Fig. 2).
Correlation analysis with social response scale
Because significant group differences were found in the percentage fixation times described above, correlations in whole-group analysis reflect group differences instead of real continuous dimensions. Therefore, we analyzed the within-group correlations between the percentage fixation on each AoI and SRS score to determine whether gaze abnormality reflects social deficits in each group. We found only two significant correlations; one was a positive correlation for time devoted to the mouth region in the face (blinking) in the ASD group, and the other was a positive correlation for the geometry region of people and geometry stimuli in the TD group. Other items were not significantly correlated (Table 3).
We also evaluated the correlations between the percentage fixation times and the FSIQ, in order to confirm if intellectual ability affected any of the group differences or correlations described above. Although FSIQ scores were only measured in the ASD group, FSIQ scores were not found to correlate with any fixation percentages (Table 3).
Finally, we examined whether the percentage fixation time could differentiate between ASD and TD. After conducting an ROC analysis to define the cutoff point/threshold for each AoI, we investigated whether we could distinguish participants with ASD from TD participants using all the AoI-1s. Next, because items that did not reveal a clear group difference were thought to reduce discrimination power, we examined whether we could distinguish participants with ASD from TD participants by using only AoI-1s that had large effect sizes in the group differences for the percentage fixation times.
ROC analysis in each AoI
The AUCs and threshold/cutoff point for each AoI are shown in Table 4. For human faces, the threshold for each AoI-1 (i.e., eye region) was <71 % (still image), <81 % (blinking), <20 % (mouth moving), <32 % (silent), and <11 % (talking). For biological motion, the threshold of each AoI-1 (upright) was <50 %, and those of people and geometry were <57 % for the people region in (same size) and >31 % for the geometric region in (small window) (Table 4).
Discriminant analysis using all AoI-1s
Using all the AoI-1s from all the eight stimuli (Fig. 1), we counted the number of items that met the cutoff condition defined by the ROC analysis for each participant. The highest discriminant parameters were found when we defined participants who had more than four items that met the cutoff condition as “ASD.” The sensitivity, specificity, PLR, and NLR were 61.9 %, 85.7 %, 4.3, and 0.4, respectively.
Discriminant analysis using AoI-1s having the largest effect size
We then examined discrimination parameters utilizing the AoI-1s that had revealed the largest effect size (d > 0.8), which included the eye region in the human face (blinking) and (silent), and the people region in people and geometry (same size). Within these three AoIs, we counted the number of items that met the cutoff condition defined by the ROC analysis for each participant (see Fig. 3 and Table 5). When we defined participants who had more than two items meeting the cutoff condition as “ASD,” we found that the highest discrimination parameters included sensitivity, specificity, PLR, and NLR, which were 81.0 %, 80.0 %, 4.1, and 0.2, respectively (Table 6).
Group differences in percentage fixation times and relationship between percentage fixation times and social disability
In the present study, we found significant group differences in the percentage fixation time allocated to areas within movies of human faces (still image, blinking, and silent) and movies showing people and geometry, while we could not find significant group differences in other movies of human faces (mouth moving and talking), or in the movie of biological motion. Within-group correlation analysis found a few significant correlations between the percentage fixation times and SRS, although most of them did not show significant correlations and there were no items significantly correlated in both the ASD and TD groups.
Group differences in percentage fixation times
The ASD group gazed less at eyes in human face stimuli (still image), (blinking), and (silent), while we could not find a group difference for the eyes in human face (mouth moving) and (talking). One explanation is that the movement of the lips included in the human face (mouth moving) and (talking) reduce attention to the eyes in the TD group, which in turn reduced group differences in fixation time to the eye region. Actually, although we did not perform a statistical comparison among stimulus conditions, our results showed that the fixation percentages of the TD group for the eye region in human faces in (still image), (blinking), and (silent) stimuli were relatively high (80.9, 77.4, and 60.0, respectively), while those in the eye region in human faces in (mouth moving) and (talking) stimuli were relatively low (49.4 and 49.3, respectively). Therefore, our results suggest that the abnormal gaze pattern in individuals with ASD (i.e., reduced attention to the eye and increased attention to the mouth) becomes less prominent when these participants view face stimuli that include movement of the lips. This interpretation is consistent with the report by Chawarska et al. , suggesting that toddlers with ASD tend to gaze at moving objects.
For biological motion, our data did not show different gaze patterns between the ASD and TD groups, unlike previous studies of children with ASD [13–15]. Previous studies using the simultaneous presentation of upright and inverted biological motion, as in the currently reported research, have shown that toddlers with ASD attended less to upright biological motion than did TD toddlers [13, 16], while preschool children with ASD showed stronger preference for upright biological motion, compared to TD preschool children . One possible explanation is that developmental changes in orientation preference for biological motion might continue until adulthood. Comparison of percentage fixation times for upright vs. inverted biological motion, as assessed using Gazefinder, between preschool children  and adults (present study) reveals that TD preschool children show a preference for upright orientation over inverted orientation (51.6 % for upright and 34.5 % for inverted) , while TD adults show equivalent fixation times to upright and inverted biological motion in the current study (52.7 % for upright and 44.7 % for inverted). Similar to TD participants, children with ASD showed a stronger preference for upright orientation (55.5 % for upright and 27.4 % for inverted) , while adults with ASD did not show such a preference in this study (47.7 % for upright and 49.7 % for inverted). The findings suggest that preschool children’s preference for upright biological motion—when upright and inverted biological motion are presented simultaneously—might disappear after adolescence for both individuals with TD and ASD. With age, ASD participants’ preference—relative to upright orientation of biological motion—might become less prominent.
The percentage fixation times of the ASD group were lower for people and higher for geometry than those of the TD group for people and geometry (same size) and (small window). This result replicated previous studies with toddlers and children, which showed participants with ASD preferring to look at geometric images when geometric images and people are simultaneously presented [24, 25]. These findings suggested that the ASD group was consistently less likely to gaze at people in stimuli of this type, regardless of developmental stage.
Relationship between percentage fixation times and social disability
For within-group correlation analysis, only two items, the mouth region of the faces in the (blinking) stimulus and the geometry region of the people and geometry (same size) stimulus, were correlated with SRS scores, and no item showed significant correlations in both the ASD and TD groups. The reason why almost no percentage fixation times to AoIs showed within-group correlations may be due to the different components that Gazefinder and SRS measure. SRS can measure a wide range of social deficits, while Gazefinder can only measure abnormality in eye contact, which is only one of the components in social deficits. Individuals with severe social deficit may show mild gaze abnormality, and vice versa. However, although use of a different scale (ADOS) for measuring social deficit needs to be taken into account, previous research on toddlers with ASD has found a significant correlation of social deficit with the fixation time to salient social information [5, 18]. Moreover, Nakano et al.  reported that children and adults with ASD have different gaze patterns. Thus, individuals with ASD may change their pattern of attention to social information with accumulating social experience, and of course, this is similar to individuals with TD. A reanalysis of the correlation between social deficit and abnormality in eye contact needs to be carried out with a longitudinal design.
However, within-group analysis showed significant correlations in the mouth region of faces in the (blinking) stimulus and in the geometry region of the people and geometry (same size) stimulus. For the mouth region, despite the fact that moving eyes normally attract attention, avoiding gazing to the eye region in this condition might reflect a severe social deficit. In addition, for the people and geometry (same size) stimulus, a previous study reported that 1.9 % of TD toddlers showed a preference for geometry, while 40 % of ASD toddlers did . Thus, individuals with TD showed the strong preference for people in this stimulus, and the geometry region of the people and geometry (same size) may reflect the degree of social deficit sensitively in TD individuals. Therefore, the geometry region of this stimulus correlated with the SRS score significantly only in the TD group. These two items had some factors that reflect the degree of social deficit in each group and may enable measurement of the severity of the individual’s social deficit.
Conclusion regarding group differences in percentage fixation times and relationship to social disability
Considering that IQ did not correlate with the percentage fixation times found with Gazefinder, we conclude that intellectual ability did not have a strong impact on the performance of Gazefinder. Therefore, we can state that Gazefinder could measure the unique patterns of gaze fixation to social information shown by adolescents and adults with ASD, using human face stimuli that omitted lip movement and using people and geometry stimuli, but at the same time, the unique gaze fixation patterns detected by Gazefinder did not sensitively predict the degree of social deficit in this age group. In a previous study using Gazefinder, we reported the unique fixation patterns of preschool children with ASD . However, children and adults with ASD were reported to have a different gaze pattern . Therefore, in order to use the Gazefinder successfully with an older group (i.e., adolescents and adults) with ASD, it was essential that we evaluate gaze patterns in individuals with ASD in this age group. In fact, we found the different gaze abnormalities revealed in our previous study; preschool children with ASD showed a gaze abnormality while viewing biological motion but not while viewing other stimuli . Given these findings, our present study provided important evidence for the validity of using Gazefinder with the adolescent-to-adult participants with ASD.
When we used all the AoI-1s, sensitivity, specificity, PLR, and NLR were 61.9 %, 85.7 %, 4.3, and 0.4, respectively. However, when we selected the data on three AoI-1s that had exhibited large effect sizes (i.e., movies showing the eye region of the human face (blinking), the eye region of the human face (silent), and the people region of people and geometry (same size), the AUCs being .80, .75, and .74, respectively), we found that these were the more accurate discriminant parameters; sensitivity, specificity, PLR, and NLR were 81.0 %, 80.0 %, 4.1, and 0.2, respectively. Thus, we found better discriminant parameters with AoI-1s that showed large effect sizes on the percentage fixation times.
Were the discriminant parameters of Gazefinder at an acceptable level compared to other eye-tracking studies? Only one study with 4- to 6-year-old children by Shi et al.  reported AUCs and discriminant parameters . Although the study design was not intended for clinical application and the participants’ age was different from that of the present study, Shi et al. reported that sensitivity and specificity were 84.6 and 85.0 %, respectively, using total fixation time on people, in data gathered while children viewed movies that simultaneously presented people and geometric stimuli . When we used three items (eye region of the human face blinking) and (silent), and people region of people and geometry (same size)), we found sensitivity and specificity (i.e., above 80 %) that were comparable to that found by Shi et al. . Therefore, we could conclude that the discriminant parameters of Gazefinder were at an acceptable level compared to a previous eye-tracking study, and its discriminant level was sufficient.
Are the discriminant parameters of Gazefinder sufficient compared to other tools that measure the ASD trait? The autism spectrum quotient (AQ), one of the most widely used self-administered questionnaires, discriminated adults with ASD from TD with a sensitivity of 79.3 % and a specificity of 97.7 % . Compared to this, Gazefinder was equal to AQ for sensitivity, although the specificity of Gazefinder was relatively lower than that of AQ. Considering the easy and short administration (approximately 2 min) of Gazefinder, its discriminant parameters are sufficient relative to AQ, especially with regard to sensitivity.
Gazefinder has the advantages of ease of use, short testing time, passive viewing, and immediate calculation of objective results, which we conjectured would overcome the limitations of previously available assessment and diagnostic tools. For example, ADOS-2 and ADI-R, the most widely used diagnostic tools, demand a high level of expertise and a long time for administration. Moreover, individuals with ASD may have difficulty in expressing their ASD trait accurately on self-reported questionnaires . Although we should bear in mind that Gazefinder can measure only a small part of ASD symptomatology, from the Gazefinder’s advantages described above, we conclude that Gazefinder may be useful as a supplementary clinical tool for objectively measuring unique gaze fixation patterns. It is important that anyone in the healing professions be able to assess gaze abnormality objectively and with the same criteria, and we believe that such an achievement will lead to increasing the validity of an ASD diagnosis all over the world. In addition to this, one participant with ASD in our research had difficulty completing the SRS, which underscores the fact that use of Gazefinder, in which participants simply look at a monitor, is especially helpful for diagnosis in such individuals.
Finally, we emphasize a few notes of caution for using Gazefinder in clinical contexts at this moment. Firstly, we should use Gazefinder only as a supplementary tool for ASD assessment and diagnosis, and clinicians should not make definitive ASD diagnoses solely based on it. Although high sensitivity and specificity were shown in our research, there were probabilities of false positives and negatives even in clearly defined ASD and TD groups. This could be because Gazefinder measures only one part of the wide range of ASD symptoms. Secondly, we need to understand the nature of the individuals to whom we try to apply Gazefinder. Because adult ASD is accompanied by other psychiatric disorders at high rates [40, 41], we may have few opportunities to carry out Gazefinder testing with adults with pure ASD in clinical settings; adults with unidentified ASD seen in specialized institutions have a strong probability of meeting the diagnostic criteria for some additional psychiatric disorder. Moreover, previous research has found that individuals with anxiety disorder [42, 43], schizophrenia [12, 44], and ADHD [45, 46] tend to gaze less at eye regions of the human face; a low percentage fixation to social information may emerge from other psychiatric disorders. Given this state of knowledge, clinical examinations of patients and interviews with caregivers remain necessary for diagnosis of comorbid disorders or for differential diagnosis. However, a previous study has reported that persons with schizophrenia oriented to social information more rapidly than persons with ASD , suggesting that we may be able to make definitive diagnoses of comorbid psychiatric disorders or discriminative diagnoses among psychiatric disorders with indexes that were not analyzed in this research. We think that achieving this is a task for the future. At present, we know only that Gazefinder detected patients with pure ASD who were sufficiently affected to visit a psychiatry department.
Limitations and future directions
We note two limitations of our research. First, the sample size may not be sufficient. However, we found similar results in previous studies [3–9, 17–19, 24, 25], and there were significant group differences and large effect sizes in the gaze data from viewing movies of the human face that omitted lip movement and the movies of people and geometry. Therefore, we would predict the same outcomes even with a larger participant pool. Second, five participants in this study’s ASD group were excluded because of insufficient data on percentage fixation time (<80 %), and this high exclusion rate was of great concern. An investigation by JVC KENWOOD Corporation found that glass-wearing might be one reason for failures of eye tracking (percentage wearing glasses in the present study: TD, 35.3; ASD, 73.1). In addition, gazing with the head lowered, which is suggested to be more common in ASD, also might appear to be a factor that reduced the available percentage fixation times. However, Gazefinder has since been updated, with improved robustness against various ambient light conditions, glass lens reflection conditions, and subject head movements. In addition to this, we can assess whether Gazefinder detected participants’ fixations in real time. Therefore, we might well be able to decrease the participant exclusion rate by monitoring the system’s performance and attempting to capture the data again when it fails to obtain participant fixation data on the first attempt.
For the purposes of improving future research, we note two points. First, assessing the validity of Gazefinder in other groups with ASD is needed (e.g., different age groups and females). Confirmation of validity with diverse populations will be important for clinical use. Next, as described in the “Discussion” section, we should also examine the discriminant analysis of Gazefinder between ASD and other disorders. Revealing the qualitative and quantitative differences in gaze fixation between ASD and these disorders, for example anxiety disorder or schizophrenia, could be helpful for both differential diagnosis and refinement of the characterizations of these disorders.
Our results indicated that Gazefinder might be an easy-to-use tool for quantitatively measuring unique gaze fixation patterns of ASD and for discriminating male adolescents and adults with ASD from TD participants in clinical contexts.
autism diagnostic observation schedule
autism spectrum quotient
autism spectrum disorder
area under the curve
Diagnostic Interview for Social and Communication Disorders
negative likelihood ratio
positive likelihood ratio
receiver operating characteristic
social responsiveness scale
Wechsler Adult Intelligence Scale—Third Edition
Wechsler Intelligence Scale for Children—Third Edition
American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Washington: American Psychiatric Pub; 2013.
Kanner L. Autistic disturbances of affective contact. Acta Paedopsychiatr. 1943;35(4):100–36.
Saitovitch A, Bargiacchi A, Chabane N, Phillipe A, Brunelle F, Boddaert N, et al. Studying gaze abnormalities in autism: which type of stimulus to use? Open J Psychiatry. 2013;03(02):32–8. doi:10.4236/ojpsych.2013.32A006.
Dalton KM, Nacewicz BM, Johnstone T, Schaefer HS, Gernsbacher MA, Goldsmith HH, et al. Gaze fixation and the neural circuitry of face processing in autism. Nat Neurosci. 2005;8(4):519–26. doi:10.1038/nn1421.
Jones W, Carr K, Klin A. Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Arch Gen Psychiatry. 2008;65(8):946–54. doi:10.1001/archpsyc.65.8.946.
Speer LL, Cook AE, McMahon WM, Clark E. Face processing in children with autism: effects of stimulus contents and type. Autism. 2007;11(3):265–77. doi:10.1177/1362361307076925.
Corden B, Chilvers R, Skuse D. Avoidance of emotionally arousing stimuli predicts social-perceptual impairment in Asperger's syndrome. Neuropsychologia. 2008;46(1):137–47. doi:10.1016/j.neuropsychologia.2007.08.005.
Sterling L, Dawson G, Webb S, Murias M, Munson J, Panagiotides H, et al. The role of face familiarity in eye tracking of faces by individuals with autism spectrum disorders. J Autism Dev Disord. 2008;38(9):1666–75. doi:10.1007/s10803-008-0550-1.
Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD, Piven J. Visual scanning of faces in autism. J Autism Dev Disord. 2002;32(4):249–61.
Shic F, Macari S, Chawarska K. Speech disturbs face scanning in 6-month-old infants who develop autism spectrum disorder. Biol Psychiatry. 2014;75(3):231–7. doi:10.1016/j.biopsych.2013.07.009.
Chawarska K, Shic F. Looking but not seeing: atypical visual scanning and recognition of faces in 2 and 4-year-old children with autism spectrum disorder. J Autism Dev Disord. 2009;39(12):1663–72. doi:10.1007/s10803-009-0803-7.
Sasson N, Tsuchiya N, Hurley R, Couture SM, Penn DL, Adolphs R, et al. Orienting to social stimuli differentiates social cognitive impairment in autism and schizophrenia. Neuropsychologia. 2007;45(11):2580–8. doi:10.1016/j.neuropsychologia.2007.03.009.
Klin A, Lin DJ, Gorrindo P, Ramsay G, Jones W. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 2009;459(7244):257–61. doi:10.1038/nature07868.
Annaz D, Campbell R, Coleman M, Milne E, Swettenham J. Young children with autism spectrum disorder do not preferentially attend to biological motion. J Autism Dev Disord. 2012;42(3):401–8. doi:10.1007/s10803-011-1256-3.
Fujisawa TX, Tanaka S, Saito DN, Kosaka H, Tomoda A. Visual attention for social information and salivary oxytocin levels in preschool children with autism spectrum disorders: an eye-tracking study. Front Neurosci. 2014;8:295. doi:10.3389/fnins.2014.00295.
Falck-Ytter T, Rehnberg E, Bolte S. Lack of visual orienting to biological motion and audiovisual synchrony in 3-year-olds with autism. PLoS One. 2013;8(7):e68816. doi:10.1371/journal.pone.0068816.
Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiat. 2002;59(9):809–16. doi:10.1001/archpsyc.59.9.809.
Shic F, Bradshaw J, Klin A, Scassellati B, Chawarska K. Limited activity monitoring in toddlers with autism spectrum disorder. Brain Res. 2011;1380:246–54. doi:10.1016/j.brainres.2010.11.074.
Nakano T, Tanaka K, Endo Y, Yamane Y, Yamamoto T, Nakano Y, et al. Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour. Proc Biol Sci. 2010;277(1696):2935–43. doi:10.1098/rspb.2010.0587.
Chawarska K, Macari S, Shic F. Context modulates attention to social scenes in toddlers with autism. J Child Psychol Psychiatry. 2012;53(8):903–13. doi:10.1111/j.1469-7610.2012.02538.x.
Chawarska K, Macari S, Shic F. Decreased spontaneous attention to social scenes in 6-month-old infants later diagnosed with autism spectrum disorders. Biol Psychiatry. 2013;74(3):195–203. doi:10.1016/j.biopsych.2012.11.022.
von Hofsten C, Uhlig H, Adell M, Kochukhova O. How children with autism look at events. Res Autism Spectr Disord. 2009;3(2):556–69. doi:10.1016/j.rasd.2008.12.003.
Hosozawa M, Tanaka K, Shimizu T, Nakano T, Kitazawa S. How children with specific language impairment view social situations: an eye tracking study. Pediatrics. 2012;129(6):e1453–60. doi:10.1542/peds.2011-2278.
Pierce K, Conant D, Hazin R, Stoner R, Desmond J. Preference for geometric patterns early in life as a risk factor for autism. Arch Gen Psychiat. 2011;68(1):101–9. doi:10.1001/archgenpsychiatry.2010.113.
Shi L, Zhou Y, Ou J, Gong J, Wang S, Cui X, et al. Different visual preference patterns in response to simple and complex dynamic social stimuli in preschool-aged children with autism spectrum disorders. PLoS One. 2015;10(3):e0122280. doi:10.1371/journal.pone.0122280.
Elison JT, Sasson NJ, Turner-Brown LM, Dichter G, Bodfish JW. Age trends in visual exploration of social and nonsocial information in children with autism. Res Autism Spectr Disord. 2012;6(2):842–51. doi:10.1016/j.rasd.2011.11.005.
Lord C, Risi S, Lambrecht L, Cook Jr EH, Leventhal BL, DiLavore PC, et al. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000;30(3):205–23.
Constantino JN, Gruber CP. Social responsiveness scale (SRS). California: Western Psychological Services; 2005
Brugha TS, McManus S, Bankart J, Scott F, Purdon S, Smith J, et al. Epidemiology of autism spectrum disorders in adults in the community in England. Arch Gen Psychiatry. 2011;68(5):459–65. doi:10.1001/archgenpsychiatry.2011.38.
Constantino JN, Cruber CP. Social responsiveness scale, second edition (SRS-2). Los Angeles, California: Western Psychological Services; 2012.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. 4th ed., text revision ed. Washington: American Psychiatric Association; 2000.
Wing L, Leekam SR, Libby SJ, Gould J, Larcombe M. The diagnostic interview for social and communication disorders: background, inter-rater reliability and clinical use. J Child Psychol Psychiatry. 2002;43(3):307–25.
Nygren G, Hagberg B, Billstedt E, Skoglund A, Gillberg C, Johansson M. The Swedish version of the Diagnostic Interview for Social and Communication Disorders (DISCO-10). Psychometric properties. J Autism Dev Disord. 2009;39(5):730–41. doi:10.1007/s10803-008-0678-z.
Wechsler D. The Wechsler Adult Intelligence Scale—3rd edition. San Antonio: Psychological Corporation; 1997.
Wechsler D. The Wechsler Intelligence Scale for children—third Edition (WISC-III). San Antonio: Psychological Corporation; 1991.
Cohen J. A power primer. Psychol Bull. 1992;112(1):155–9.
Hosmer DW, Lemeshow S, Sturdivant RX. Applied logistic regression. 3rd ed. Wiley series in probability and mathematical statistics. New Jersey: Wiley; 2013.
Baron-Cohen S, Wheelwright S, Skinner R, Martin J, Clubley E. The autism-spectrum quotient (AQ): evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism Dev Disord. 2001;31(1):5–17.
Johnson SA, Filliter JH, Murphy RR. Discrepancies between self- and parent-perceptions of autistic traits and empathy in high functioning children and adolescents on the autism spectrum. J Autism Dev Disord. 2009;39(12):1706–14. doi:10.1007/s10803-009-0809-1.
Joshi G, Wozniak J, Petty C, Martelon MK, Fried R, Bolfek A, et al. Psychiatric comorbidity and functioning in a clinically referred population of adults with autism spectrum disorders: a comparative study. J Autism Dev Disord. 2013;43(6):1314–25. doi:10.1007/s10803-012-1679-5.
Lugnegard T, Hallerback MU, Gillberg C. Psychiatric comorbidity in young adults with a clinical diagnosis of Asperger syndrome. Res Dev Disabil. 2011;32(5):1910–7. doi:10.1016/j.ridd.2011.03.025.
Horley K, Williams LM, Gonsalvez C, Gordon E. Face to face: visual scanpath evidence for abnormal processing of facial expressions in social phobia. Psychiatry Res. 2004;127(1-2):43–53. doi:10.1016/j.psychres.2004.02.016.
Horley K, Williams LM, Gonsalvez C, Gordon E. Social phobics do not see eye to eye: a visual scanpath study of emotional expression processing. J Anxiety Disord. 2003;17(1):33–44.
Delerue C, Laprevote V, Verfaillie K, Boucart M. Gaze control during face exploration in schizophrenia. Neurosci Lett. 2010;482(3):245–9. doi:10.1016/j.neulet.2010.07.048.
Ahmadi M, Judi M, Khorrami A, Mahmoudi-Gharaei J, Tehrani-Doost M. Initial orientation of attention towards emotional faces in children with attention deficit hyperactivity disorder. Iran J Psychiatry. 2011;6(3):87–91.
Karatekin C, Asarnow RF. Exploratory eye movements to pictures in childhood-onset schizophrenia and attention-deficit/hyperactivity disorder (ADHD). J Abnorm Child Psychol. 1999;27(1):35–49.
We would like to express our sincere appreciation to the participants who generously and courageously participated in this study. We thank K. Mita for helping collect the data.
Part of this research was the result of the project “Integrated Research on Neuropsychiatric Disorders” which was carried out under the Strategic Research Program for Brain Sciences from MEXT and AMED. This work was partly funded by the Center of Community from MEXT, Grants-in-Aid for Scientific Research from the Japan Society for the Promotion of Science (25293248, 15K08093), Implementation-Support Program (Call for proposal Type) from the Japan Science and Technology Agency, and the Takeda Science Foundation.
The authors declare that they have no competing interests.
TF acquired the data, performed the statistical analyses, interpreted the clinical data, and drafted and revised the manuscript. KI acquired the data, performed the statistical analyses, and drafted the manuscript. YO acquired the data, performed the statistical analyses, interpreted the clinical data, and drafted and revised the manuscript. YaM recruited and evaluated the participants, acquired the data, interpreted the clinical data, and revised the manuscript. MI recruited and evaluated the participants, interpreted the clinical data, and revised the manuscript. DNS recruited and evaluated the participants, acquired the data, performed the statistical analyses, and revised the manuscript. MJ recruited and evaluated the participants, acquired the data, performed the statistical analyses, interpreted the clinical data, and revised the manuscript. SA recruited and evaluated the participants, interpreted the clinical data, and revised the manuscript. YuM recruited and evaluated the participants, interpreted the clinical data, and revised the manuscript. TXF acquired the data, performed the statistical analyses, interpreted the clinical data, and drafted the manuscript. KN interpreted the clinical data and drafted the manuscript. KS conceived the study, interpreted the clinical data, and revised the manuscript. KJT conceived the study, acquired the data, performed the statistical analyses, interpreted the clinical data, and drafted and revised the manuscript. NM conceived the study, interpreted the clinical data, and revised the manuscript. TK conceived the study, interpreted the clinical data, and revised the manuscript. MS conceived the study, interpreted the clinical data, and revised the manuscript. TM recruited and evaluated the participants, diagnosed the participants with ASD, interpreted the clinical data, and revised the manuscript. HO conceived the study, interpreted the clinical data, and revised the manuscript. AT recruited the participants and evaluated the participants, interpreted the clinical data, and drafted the manuscript. YW recruited and evaluated the participants, interpreted the clinical data, and revised the manuscript. HK conceived the study, recruited and evaluated the participants, diagnosed the participants with ASD, interpreted the clinical data, and drafted and revised the manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Fujioka, T., Inohara, K., Okamoto, Y. et al. Gazefinder as a clinical supplementary tool for discriminating between autism spectrum disorder and typical development in male adolescents and adults. Molecular Autism 7, 19 (2016). https://doi.org/10.1186/s13229-016-0083-y
- Gaze abnormality
- Autism spectrum disorder
- Biological motion
- Discriminant analysis