Authors: Hilary Galloway-Long; Cynthia Huang-Pollock; Kristina Neely · Research
Can Reaction Time Tests Help Diagnose ADHD?
This study examined whether analyzing reaction time patterns on simple computer tasks could help identify ADHD in children and adults.
Source: Galloway-Long, H., Huang-Pollock, C., & Neely, K. (2022). Ahead of the (ROC) Curve: A Statistical Approach to Utilizing Ex-Gaussian Parameters of Reaction Time in Diagnosing ADHD Across Three Developmental Periods. Journal of the International Neuropsychological Society, 28(8), 821-834. https://doi.org/10.1017/S1355617721000990
What you need to know
- This study looked at whether analyzing reaction time patterns on simple computer tasks could help identify ADHD in preschoolers, school-age children, and young adults.
- People with ADHD showed more variability in their reaction times compared to those without ADHD.
- Measures of inhibitory control and reaction time variability were moderately good at distinguishing between those with and without ADHD.
- However, these cognitive tests were not as accurate as behavior rating scales in identifying ADHD.
Background on ADHD and cognitive testing
Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental condition characterized by persistent inattention, hyperactivity, and impulsivity that interferes with functioning. Diagnosing ADHD typically involves clinical interviews, behavior rating scales, and sometimes cognitive testing.
Many studies have found that people with ADHD tend to perform worse on tests of executive functions like attention, inhibition, and working memory. However, there is a lot of overlap in performance between those with and without ADHD, making it difficult to use these tests to reliably identify the disorder.
Some researchers have suggested that analyzing reaction time patterns, rather than just looking at average scores, may provide more insight into the cognitive differences associated with ADHD. This study aimed to examine whether more detailed analysis of reaction time data could improve the ability to distinguish between people with and without ADHD.
How the study was conducted
The researchers looked at data from three separate samples:
- Preschool children ages 5-6 (75 with ADHD, 33 without)
- School-age children ages 8-12 (216 with ADHD, 93 without)
- Young adults ages 18-25 (62 with ADHD, 72 without)
Participants completed simple computer tasks that measured reaction time and inhibitory control:
- Go/No-Go task: Press a button when you see certain stimuli, but don’t respond to others
- Stop-Signal task: Respond quickly to stimuli, but try to stop your response when you hear a tone
The researchers analyzed several aspects of participants’ performance:
- Stop-signal reaction time (SSRT): How quickly you can stop an initiated response
- Percent of failed inhibits: How often you incorrectly responded on “no-go” trials
- Mean reaction time: Average speed of correct “go” responses
- Standard deviation of reaction time: How variable response speeds were
- Ex-Gaussian parameters: More detailed analysis of reaction time distributions
They then used statistical techniques to determine how well each measure could distinguish between those with and without an ADHD diagnosis.
Key findings
Differences in task performance
Across all age groups, participants with ADHD showed:
- More failed inhibits on go/no-go tasks
- Slower stop-signal reaction times (in school-age sample)
- More variable reaction times (larger standard deviations)
There were no significant differences in mean reaction times between those with and without ADHD.
Ability to identify ADHD
The researchers used a statistical technique called receiver operating characteristic (ROC) analysis to determine how well each measure could identify ADHD. This produces an “area under the curve” (AUC) value between 0.5 (no better than chance) and 1.0 (perfect prediction).
The measures that were best at distinguishing between those with and without ADHD were:
- Stop-signal reaction time (SSRT) in school-age children (AUC = 0.72)
- Percent of failed inhibits in adults (AUC = 0.73)
- Standard deviation of reaction time across all ages (AUC = 0.66-0.73)
The detailed ex-Gaussian analysis of reaction time distributions did not clearly outperform the simpler standard deviation measure.
Overall, these cognitive measures showed moderate ability to identify ADHD, performing similarly to or slightly better than some commonly used neuropsychological tests. However, they were not as accurate as behavior rating scales, which typically have AUC values of 0.70-0.90 for ADHD.
Interpreting the results
The finding that people with ADHD show more variable reaction times fits with a common theory that ADHD involves difficulties with consistent cognitive performance. This may reflect problems with sustained attention or arousal regulation.
The fact that mean reaction times did not differ suggests that it’s not simply that people with ADHD are “slower” overall. Rather, their performance is more inconsistent from moment to moment.
Measures of inhibitory control, like stop-signal reaction time and failed inhibits, also distinguished between groups. This aligns with theories that ADHD involves deficits in behavioral inhibition and cognitive control.
However, the cognitive measures were only moderately accurate in identifying ADHD. There are a few potential reasons for this:
ADHD is heterogeneous - not everyone with the disorder shows the same cognitive profile.
These types of deficits are not unique to ADHD and can occur in other conditions as well.
Brief laboratory tasks may not fully capture real-world difficulties with attention and behavior.
Diagnostic criteria for ADHD are based on observable behaviors, not cognitive performance.
Implications and future directions
While cognitive tests like these are not accurate enough to diagnose ADHD on their own, they may still have value as part of a comprehensive evaluation. Measures of reaction time variability and inhibitory control could potentially help characterize an individual’s cognitive strengths and weaknesses.
The authors suggest these types of tasks may be most useful for:
- Tracking changes in cognitive function over time
- Measuring response to treatments
- Studying the neurocognitive mechanisms underlying ADHD symptoms
Future research could examine whether combining multiple cognitive measures or using more complex analytical techniques could improve diagnostic accuracy. Studies tracking cognitive performance and symptoms over time may also provide insight into how these factors relate to ADHD across development.
Limitations to consider
Some limitations of this study to keep in mind:
The tasks and analysis methods differed somewhat across age groups, making direct comparisons difficult.
The preschool sample had fewer trials, which may have affected the reliability of the reaction time analyses.
Only a go/no-go task was used with preschoolers and adults, while school-age children also completed a stop-signal task.
The study did not look at how these cognitive measures related to real-world functioning or specific ADHD symptoms.
Other factors that could affect cognitive performance, like motivation or test-taking strategies, were not examined.
Conclusions
Analyzing patterns of reaction time variability and inhibitory control on simple computer tasks can help distinguish between people with and without ADHD to a moderate degree.
However, brief cognitive tests are not accurate enough to diagnose ADHD on their own and should not replace thorough clinical evaluation.
These types of measures may be most useful for tracking cognitive changes over time, evaluating treatment effects, and studying the mechanisms underlying attention and behavior regulation.
More research is needed to determine the best ways to integrate cognitive testing into ADHD assessment and develop tasks that better capture real-world difficulties.