Professional Documents
Culture Documents
NIH Toolbox Brochure June 2017 PDF
NIH Toolbox Brochure June 2017 PDF
NIH Toolbox Brochure June 2017 PDF
“Common Currency” across diverse Measures the same constructs eLearning and
2 study designs and populations over the lifespan face-to-face training
SELECTION OF part of field-test, calibration construction, assessment
MEASURES FOR and validation activities. and scoring. consultants was
THE NIH TOOLBOX NORMING
Two of these engaged to
are Item provide testing
More than 1,400 existing
NIH Toolbox conducted a Response guidelines for
measures were identified and
large national standardization Theory (IRT) the very young,
evaluated for inclusion in the NIH study in both English and and Computer to offer input on
Toolbox. The selection criteria Spanish languages to allow for Adaptive Testing measure development,
included a measure’s applicability normative comparisons on each (CAT). Item Response and to review all NIH Toolbox
across the life span, psychometric assessment. A sample of Theory allows tests to be brief, measures as they relate to
soundness, brevity, 4,859 participants, yet still precise and valid. Using the needs of young children.
ease of use, ages 3-85, IRT methodology, sets of items
applicability
in diverse
representative are calibrated along a continuum NIH TOOLBOX APP
of the U.S. that covers the full range of the
settings and Released in 2015, the NIH
population construct to be measured. This
with different Toolbox iPad® app takes
based on calibrated set of items enables
groups, and lack advantage of portable
gender, race/ the creation of Computer Adaptive
of intellectual technology and advanced
ethnicity, and Testing. CAT is a specialized type
property constraints. software to provide users with
socioeconomic of computer-based testing that a flexible and easy-to-use NIH
VALIDATION status was administered all of enables frequent assessments Toolbox test administration and
the NIH Toolbox measures at and immediate feedback with
Validation studies were data collection system. App
sites around the country. NIH minimal burden on participants
conducted for all NIH Toolbox features, including internet-free
Toolbox normative scores are and precise evaluation at the
measures to assure that these test administration, enhanced
now available for each year of individual level. Users can
important tools for research met normative scores, individual
age from 3 through 17, as well administer short, unique tests to
rigorous scientific standards. participant reports, multiple
as for ages 18-29, 30-39, 40-49, every individual, with reliability
Studies were conducted across data export options and both in-
50-59, 60-69, 70-79, and 80-85, and scores equivalent to longer,
the entire age range, typically app and email customer support,
allowing for targeted, accurate fixed-length assessments.
included 450-500 subjects, are designed to facilitate use
comparisons for any research
and were statistically compared in diverse clinical, research
study participant groups EARLY and educational settings. A
against “gold standard” against the U.S. population.
measures whenever available. For CHILDHOOD USE study (N=600) evaluating the
tests using Item Response Theory Development of the NIH Toolbox equivalency of the NIH Toolbox
ADVANCED instruments focused special web-based and app versions
approaches to scoring, calibration
samples generally included
MEASUREMENT attention on assessing young of Cognition showed that, after
several thousand participants, TECHNIQUES children, to ensure that all tests adjustments to the scores of 4
ensuring robust models. In The NIH Toolbox measures utilize given would be developmentally tests, the web-based normative
total, data was collected from several advanced approaches appropriate for ages 3-7. An scores can also be applied to
more than 16,000 subjects as in item development, test expert team of early childhood results obtained from the app.
This battery, recommended for ages 7+, consists of tests to assess Executive Function, Attention, Episodic Memory, Language, Processing
Speed and Working Memory. Administering this battery will yield the following summary scores, in addition to individual measure scores:
Cognitive Function Composite Score, Fluid Cognition Composite Score (includes DCCS, Flanker, Picture Sequence Memory, List Sorting, and
Pattern Comparison measures), and Crystallized Cognition Composite Score (includes Picture Vocabulary and Reading Recognition measures).
This battery, recommended for ages 3-6, includes the DCCS, Flanker, Picture Sequence Memory, and Picture Vocabulary measures. In addition to
individual measure scores, administering this battery will yield an Early Childhood Composite Score.
NIH Toolbox Flanker Inhibitory Control NIH Toolbox Picture Sequence NIH Toolbox List Sorting Working
and Attention Test Memory Test Memory Test
NIH Toolbox Oral Reading NIH Toolbox Dimensional Change NIH Toolbox Pattern Comparison
Recognition Test Card Sort Test Processing Speed Test
Expert Contributors-Cognition
Sandra Weintraub, PhD (Northwestern University), chair. Patricia Bauer, PhD (Emory University), Noelle Carlozzi, PhD (University of Michigan), Kevin Conway, PhD (NIH/National Institute on Drug Abuse), Sureyya
Dikmen, PhD (University of Washington), Emmeline Edwards, PhD (NIH/National Center for Complementary and Integrative Health), Nathan Fox, PhD (University of Maryland), Lisa Freund, PhD
(NIH/Eunice Kennedy Shriver National Institute of Child Health and Human Development), Richard Gershon, PhD (Northwestern University), Richard Havlik, MD (Westat, Inc.), Robert Heaton, PhD (University of
California-San Diego), Jonathan King, PhD (NIH/National Institute on Aging), Jennifer Manly, PhD (Columbia University), Claudia Moy, PhD (NIH/National Institute of Neurological Disorders and Stroke),
Dan Mungas, PhD (University of California-Davis), Jerry Slotkin, PhD (University of Delaware), David Tulsky, PhD (University of Delaware), Ellen Witt, PhD (NIH/National Institute on Alcohol Abuse and
Alcoholism), Philip Zelazo, PhD (University of Minnesota)
KEY:
AGES
min
3–85
age range test time proctored test self-administered hands-on tablet-administered supplies required Supplemental Measures
NIH Toolbox Oral Symbol Digit Test (ages 8+)
Proctored tests require active administrator participation throughout the test.
NIH Toolbox Auditory Verbal Learning Test (Rey) (ages 8+)
Self-administered measures are completed independently by the subject but may still require proctor assistance at the beginning of the
assessment to provide instructional or practice help.
Hands-on measures include some sort of activity typically including movement. Scan the Cognition QR code for
Tablet-administered measures involve active interaction with the tablet by the subject.
detailed features, equipment and
(Note: All of the Toolbox measures have been designed for tablet-based data collection). materials requirements, current
studies, papers, and presentations
This battery, recommended for ages 7+, consists of tests to assess Audition, Visual Acuity, Olfaction, and Pain (Ages 18+).
A Taste test (Ages 12+) is available as an individual measure.
NIH Toolbox Words-in-Noise Test NIH Toolbox Visual Acuity Test NIH Toolbox Dynamic Visual Acuity Test
This battery, recommended for ages 7+, consists of tests to assess Dexterity, Grip Strength, Standing Balance, Gait Speed and Endurance.
This battery, recommended for ages 3-6, includes measures of Dexterity, Grip Strength, Standing Balance, and Endurance.
Dexterity Strength
Dexterity is defined as an individual’s Strength refers to the capacity of a
ability to coordinate the fingers and muscle to produce the tension and power
manipulate objects in a timely manner. In necessary for maintaining posture,
order to assess dexterity, the Nine-Hole- initiating movement, or controlling
Peg Test was selected. This test consists movement during conditions of loading
of a square board with nine holes and a the musculoskeletal system. More simply,
container with nine wooden pegs. It is a muscle strength is the magnitude of force
time-monitored test in which pegs are generated by an isolated muscle or a
picked up from the container one by one, muscle group. For measuring strength, the
put into the holes, and then returned. group chose a grip dynamometer. Several
commercially available instruments have
been validated in persons above the age
of 4 years and have excellent inter-rater
reliability. This instrument assesses upper
extremity strength.
NIH Toolbox 9-Hole Pegboard Dexterity Test NIH Toolbox Grip Strength Test
AGES AGES
3–85 4 3–85 3
AGES
3–85 7
Endurance Locomotion
Endurance is defined as the ability to sustain Locomotion is defined as an act of moving
effort that requires conjoint work capacities from one place to the other place, reflecting
Expert Contributors-Motor
from cardiopulmonary function, biomechanical ambulation ability including walking
David Reuben, MD (University of
and neuromuscular function. This measure distance, velocity, and quality of the gait California-Los Angeles) and W. Zev
focuses on overall physical fitness instead of over different environments and ground Rymer, MD, PhD (Rehabilitation Institute
of Chicago and Northwestern University),
individual muscle endurance. The 2-Minute surfaces. To assess locomotion, the NIH co-chairs. Dallas Anderson, PhD (NIH/
Walk Test was considered to be the best Toolbox 4-Meter Walk Gait Speed Test was National Institute on Aging), Richard
Bohannon, EdD, DPT (University of
measure of endurance. This test measures the selected. In this assessment, participants Connecticut), Deborah Bubela, PhD
distance that a subject can walk, in normal are instructed to walk as quickly as possible (University of Connecticut), Diane
Damiano, PhD (NIH/NIH Clinical Center),
speed, on a flat hard surface in a period of 2 at a pace he or she can maintain; time to Marjorie Garvey, MD (NIH/National
minutes. In doing so, it evaluates the global complete the walk is recorded. Institute of Mental Health), Jin-Shei
Lai, PhD (Northwestern University),
and integrated responses of pulmonary, Susan Magasi, PhD (University of Illinois
cardiovascular, and musculoskeletal systems. at Chicago), Heather McCreath, PhD
(University of California-Los Angeles),
NIH Toolbox 2-Minute Walk Endurance Test NIH Toolbox 4-Meter Walk Gait Speed Test Rose Marie Rine, PhD (Specialty Therapy,
LLC and Marshall University)
AGES AGES
3–85 4 7+ 3
KEY:
AGES
min
3–85
age range test time proctored test self-administered hands-on tablet-administered supplies required
Locomotion Endurance 9
Emotion refers to any strong feelings, such as joy, sorrow, or fear.
It is an affective state of consciousness in which one of these feelings
is experienced, as distinguished from cognitive and volitional states of
consciousness. Emotions can be positive or negative and distressing.
Positive emotions can be reflections of well-being in our lives, and
positive social relationships can buffer stress and enhance health.
The NIH Toolbox Emotion domain includes four major subdomains,
described below. Measures include both self-report and, for certain
ages, parent-report versions.
This battery, recommended for ages 8+, consists of surveys of Positive Affect, General Life Satisfaction, Emotional Support, Friendship,
Loneliness, Perceived Rejection, Perceived Hostility, Self-Efficacy, Sadness, Fear, and Anger. For ages 13+, the battery also includes surveys of
Perceived Stress for 18+, surveys of Meaning and Purpose and Instrumental Support. In addition to scores for individual surveys, each emotion
battery provides summary scores, which allow for general interpretation/evaluation of overall emotional health. Available summary scores
(varies per age and battery) include: Anxiety, Negative Affect, Negative Psychosocial Functioning, Negative Peer Relations, Social
Satisfaction, Negative Social Perception and Psychological Well Being.
This battery, recommended for parents of children ages 3-12, includes measures of Positive Affect, General Life Satisfaction, Positive Peer
Interaction, Social Withdrawal, Peer Rejection, Empathic Behaviors, Fear, Sadness and Anger. For those with children ages 3-7, surveys for Fear
(Over Anxious and Separation Anxiety) are included. For those with children 8-12, surveys for Self-Efficacy and Perceived Stress are included.
Note: Emotion measures are generally delivered as fixed-length forms or computer-adaptive tests, presenting developmentally appropriate
items by age band (typically 3-7, 8-12, 13-17 and 18+). Individual measures are administered in 1-2 minutes.
Self-administered measures are completed independently by the subject but may still require proctor assistance at the beginning of the
assessment to provide instructional or practice help.
Tablet-administered measures involve active interaction with the tablet by the subject.
Scan the Emotion QR code for detailed
(Note: All of the Toolbox measures have been designed for tablet-based data collection). features, equipment and materials
requirements, current studies, papers,
and presentations
Contact Information
Principal Investigator Lead Project Officer
Richard C. Gershon, PhD Molly V. Wagster, PhD
Vice-Chair for Research, Department of Medical Social Sciences Chief, Behavioral and Systems Neuroscience Branch
Feinberg School of Medicine Division of Neuroscience
Northwestern University National Institute on Aging/National Institutes of Health
gershon@northwestern.edu wagsterm@nia.nih.gov
The NIH Toolbox iPad® app provides access to all of the NIH Toolbox measures, as well as the Patient-Reported Outcomes
Measurement Information System (PROMIS®), Neuro-QoL (Quality of Life in Neurological Disorders) and many other NIH
sponsored measurement systems. It enables automatic scoring, several options for data export and access to user support.
Other options for administration of NIH Toolbox Emotion measures can be found on the HealthMeasures website
www.healthmeasures.net. HealthMeasures is a scientific and technical resource supporting expansion
and use of four state-of-the-science measurement systems: PROMIS, NIH Toolbox, Neuro-QoL, and ASCQ-MeSM.
Sponsors
Primary support was provided through the NIH Blueprint for Neuroscience Research, with additional support
from the NIH Office of Behavioral and Social Sciences Research and the National Children’s Study.
This project is funded in whole or in part with Federal funds from the Blueprint for
Neuroscience Research and the Office of Behavioral and Social Sciences Research,
National Institutes of Health, under Contract No. HHS-N-260-2006-00007-C.