North Carolina State University

INFORMED CONSENT FORM for RESEARCH

Title of Study Measures and Models of Aviation Display Clutter

Principal Investigator David B. Kaber Faculty Sponsor N/A

We are asking you to participate in a research study. The purpose of this study is to assess the affect of
different head-up display (HUD) features in various phases of flight on pilot mental workload and
perceptions of display clutter. The research is expected to result in multidimensional subjective measure for
describing aviation display clutter, when advanced features such as SVS (Synthetic Vision Systems) are
incorporated.

INFORMATION
If you agree to participate in this study, you will be asked to complete the experiment during a 4hr. period. The
procedures to be followed include: (1) completing a demographic questionnaire; (2) a briefing on the flight scenario
and flight instructions. (During practice and test trials, you will be given a specific scenario to follow, including
aircraft status, clearance from ATC, and required actions. The scenario will be to control an aircraft during approach
and landing at an airport using a HUD); (3) familiarization with the IFD (Integrated Flight Deck) Simulator and
completion of a practice trial; (4) ranking of the relative importance of workload factors and pairs of display clutter
descriptors based on the practice trial; (5) completion of six test trials. Each trial will consist of three sequential legs
presenting different HUD features. At the end of each leg, you will be asked to provide ratings of workload factors,
semantic pairs of clutter descriptor terms and overall subjective clutter; (6) fill-out a post-experiment ranking
questionnaire for workload and the semantic pairs of clutter descriptors, including alternative terms; (7) debriefing.
This entire procedure will occur in one session.

RISKS
The risks associated with participation in this study are minimal. They include potential visual strain and/or fatigue
from viewing the IFD simulator displays for an extended period, soreness of the hands from use of the simulated
aircraft yoke or a mouse control, and leg fatigue from pushing rudder pedals. The visual workload is expected to be
less than that experienced in actual flight of a commercial aircraft because of the controlled laboratory lighting. Any
fatigue or strain is expected to be less than that associated with real flight and any symptoms are reversible. In the
event that you indicate fatigue or discomfort during the experiment, a rest period will be provided. If abnormal
physiologic conditions persist, you will be excused from further participation in the experiment.

BENEFITS
There are no direct benefits of this research. You may derive some indirect benefits including an understanding of
human factors research methods for aviation systems design and insight into new SVS display technologies. (If the
test SVS displays are introduced into aircraft cockpits in the future, you may benefit from increased safety of
operations.)

CONFIDENTIALITY
The information in our study records will be kept strictly confidential. Data on your responses will be stored
securely and will be made available only to persons conducting the study. We will make a recording of your flight
control actions for analyzing flight performance. All files will be destroyed after the research is complete. No
reference will be made to you in oral or written reports, which could link you to the study.

COMPENSATION
For participation in this study, you will receive an honorarium of $200.00.

CONTACT
If you have questions at any time about the study or the procedures, you may contact Dr. David Kaber, at the
Department of Industrial Engineering, Box 7906, North Carolina State University, or (919) 515 3086. If you feel
you have not been treated according to the descriptions in this form, or your rights as a participant in research have
been violated during the course of this project, you may contact Mr. Matthew Ronning, Assistant Vice Chancellor,
Research Administration, Box 7514, NCSU Campus (919/513-2148).
Do not write below this line. Experimenter use only.
Subject #: __________
PARTICIPATION
Your participation in this study is voluntary; you may decline to participate without penalty. If you decide to
participate, you may withdraw at any time without penalty and without loss of benefits to which you are otherwise
entitled.

CONSENT
“I have read and understand the above information. I have received a copy of this form. I agree to
participate in this study with the understanding that I may withdraw at any time.”

Subject's signature_______________________________________ Date _________________

Investigator's signature__________________________________ Date _________________

Do not write below this line. Experimenter use only.

Subject #: __________
Do not write below this line. Experimenter use only.
Subject #: __________
 NASA-TLX Mental Workload Rankings
For each of the pairs listed below, circle the scale title that represents the more important
contributor to workload in the display.

Mental Demand or Physical Demand

Mental Demand or Temporal Demand

Mental Demand or Performance

Mental Demand or Effort

Mental Demand or Frustration

Physical Demand or Temporal Demand

Physical Demand or Performance

Physical Demand or Effort

Physical Demand or Frustration

Temporal Demand or Performance

Temporal Demand or Frustration

Temporal Demand or Effort

Performance or Frustration

Performance or Effort

Frustration or Effort

Do not write below this line. Experimenter use only.

Subject #: __________
 Definition of Task Demand Factor

Mental demand
How much mental and perceptual activity was required (e.g., thinking, deciding, calculating,
remembering, looking, searching, etc.)? Was the task easy or demanding, simple or complex,
exacting or forgiving?

Physical demand
How much physical activity was required (e.g., pushing, pulling, turning, controlling,
activating, etc.)? Was the task easy or demanding, slow or brisk, slack or strenuous, restful or
laborious?

Temporal demand
How much time pressure did you feel due to the rate or pace at which the tasks or task
elements occurred? Was the pace slow and leisurely or rapid and frantic?

Performance
How successful do you think you were in accomplishing the goals of the task set by the
experimenter (or yourself)? How satisfied were you with your performance in accomplishing
these goals?

Frustration level
How insecure, discouraged, irritated, stressed and annoyed versus secure, gratified, content,
relaxed and complacent did you feel during the task?

Effort
How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Do not write below this line. Experimenter use only.

Subject #: __________
 Subjective Clutter Rankings
For each of the pairs listed below, circle the scale title that represents the more important
contributor to clutter in the display.

Redundancy or Colorfulness

Redundancy or Salience

Redundancy or Dynamics

Redundancy or Variability

Redundancy or Density

Colorfulness or Salience

Colorfulness or Dynamics

Colorfulness or Variability

Colorfulness or Density

Salience or Dynamics

Salience or Variability

Salience or Density

Dynamics or Variability

Dynamics or Density

Variability or Density

Do not write below this line. Experimenter use only.

Subject #: __________
 Definitions of “Clutter” Descriptor Terms
Redundancy

Redundant
 Definition: Exceeding what is necessary or normal; characterized by or containing
an excess; characterized by similarity or repetition.
 Synonyms: Repetitive, superfluous, inessential.
Orthogonal
 Definition: Being mutually independent (relative to something else); composed of
mutually exclusive elements; statistically independent.
 Synonyms: Unique, exclusive, independent.

Colorfulness

Monochromatic
 Definition: Having or consisting of only one color or hue; lacking variety,
creativity, or excitement.
 Synonyms: Colorless, neutral, plain.
Colorful
 Definition: Full of color; having striking colors; characterized by rich variety.
 Synonyms: Vivid, vibrant, striking.

Salience

Salient
 Definition: Standing out conspicuously; of notable significance beyond its
surroundings.
 Synonyms: Prominent, striking, remarkable.
Not Salient
 Definition: Difficult to detect; imperceptible to the senses.
 Synonyms: Inconspicuous, unnoticeable, subtle.

Dynamics

Static
 Definition: Having no motion; showing little change.
 Synonyms: Unmoving, stationary, fixed.
Dynamic
 Definition: Characterized by continuous change, activity, or progress.
 Synonyms: Active, driving, compelling.

Do not write below this line. Experimenter use only.

Subject #: __________
Variability

Monotonous
 Definition: Repetitiously dull or lacking in variety; tediously uniform or unvarying.
 Synonyms: Constant, boring, unvarying.
Variable
 Definition: Likely to vary; likely to change frequently, suddenly, or unexpectedly.
 Synonyms: Unstable, fluctuating, inconstant.

Density

Sparse
 Definition: Thinly scattered or distributed; occurring at widely-spaced intervals.
 Synonyms: Thin, meager, distributed.
Dense
 Definition: Having component parts packed closely together.
 Synonyms: Thick, compact, concentrated.

Do not write below this line. Experimenter use only.

Subject #: __________
 Workload

NASA-TLX Mental Workload Rating Scale

Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--01-L1
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--01-L1 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--01-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--01-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--01-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--01-L3 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--02-L1
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--02-L1 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--02-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--02-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--02-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--02-L3 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--03-L1
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--03-L1 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--03-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--03-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--03-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--03-L3 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--04-L1
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--04-L1 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--04-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--04-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--04-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--04-L3 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--05-L1
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--05-L1 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--05-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--05-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--05-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--05-L3 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--06-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--06-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--06-L2
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--06-L2 High

Temporal Demand
Frustration
Effort
Low High
 Workload
NASA-TLX Mental Workload Rating Scale
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.

Mental Demand: How much mental and perceptual activity was required (e.g., thinking, deciding,
calculating, remembering, looking, searching, etc)? Was the mission easy or demanding, simple or
complex, exacting or forgiving?
Low High

Physical Demand: How much physical activity was required (e.g., pushing, pulling, turning,
controlling, activating, etc.)? Was the mission easy or demanding, slow or brisk, slack or strenuous,
restful or laborious?

Low High

Temporal Demand: How much time pressure did you feel due to the rate or pace at which the
mission occurred? Was the pace slow and leisurely or rapid and frantic?

Low High

Performance: How successful do you think you were in accomplishing the goals of the mission? How
satisfied were you with your performance in accomplishing these goals?

Low High

Effort: How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Low High

Frustration: How discouraged, stressed, irritated, and annoyed versus gratified, relaxed, content,
and complacent did you feel during your mission?

Low High

Do not write below this line. Experimenter use only.

Subject #: __________ Trial #: T0--06-L3
 Clutter
Subjective Clutter Ratings
Please place an “X” along each scale at the point that best indicates your experience with the
display configuration.
Mental Demand
Redundancy
Low High
Redundant Orthogonal

PhysicalDemand
Mental Demand
Colorfulness
Low
Low High
High
Monochromatic Colorful
TemporalDemand
Physical Demand
Mental Demand
Salience
Low
Low High
High
Low High
Not Salient Salient
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Dynamics High
Low High
Low High
Low High
Static
Effort
Dynamic
Performance
Temporal Demand
Physical Demand
Mental Demand
Low
Low
Variability High
High
Low High
Low High
Low High
Variable
Frustration
Monotonous
Effort
Performance
Temporal Demand
Physical Demand
Mental
Low Demand High
Low
Low
Density High
High
Low High
Low High
Low High

Frustration
Sparse
Effort
Performance Dense
Temporal Demand
Physical Demand
Low
Low High
High
Low High
Low High
Low High
Please rate your overall perception of “clutter” for the current display by placing an “X” at the
Mental Demand
Frustration
desired
Effortpoint on the scale below.
Performance
Temporal Demand
Low
Low High
High
Low High
Low High
Low
LowClutter High Clutter
High

Physical Demand
Frustration
Effort
Performance
Low High
DoLow
not write below this line. Experimenter use only. High
Low High
Low #: __________
Subject Trial #: T0--06-L3 High

Temporal Demand
Frustration
Effort
Low High
 NASA-TLX Mental Workload Rankings
For each of the pairs listed below, circle the scale title that represents the more important
contributor to workload in the display.

Mental Demand or Performance

Mental Demand or Effort

Mental Demand or Frustration

Physical Demand or Temporal Demand

Physical Demand or Performance

Physical Demand or Effort

Physical Demand or Frustration

Temporal Demand or Performance

Temporal Demand or Frustration

Temporal Demand or Effort

Performance or Frustration

Performance or Effort

Frustration or Effort

Mental Demand or Performance

Mental Demand or Effort

Do not write below this line. Experimenter use only.

Subject #: __________ Post-trial
 Clutter
Definition of Task Demand Factor

Mental demand
How much mental and perceptual activity was required (e.g., thinking, deciding, calculating,
remembering, looking, searching, etc.)? Was the task easy or demanding, simple or complex,
exacting or forgiving?

Physical demand
How much physical activity was required (e.g., pushing, pulling, turning, controlling,
activating, etc.)? Was the task easy or demanding, slow or brisk, slack or strenuous, restful or
laborious?

Temporal demand
How much time pressure did you feel due to the rate or pace at which the tasks or task
elements occurred? Was the pace slow and leisurely or rapid and frantic?

Performance
How successful do you think you were in accomplishing the goals of the task set by the
experimenter (or yourself)? How satisfied were you with your performance in accomplishing
these goals?

Frustration level
How insecure, discouraged, irritated, stressed and annoyed versus secure, gratified, content,
relaxed and complacent did you feel during the task?

Effort
How hard did you have to work (mentally and physically) to accomplish your level of
performance?

Do not write below this line. Experimenter use only.

Subject #: __________ Post-trial
 Subjective Clutter Rankings
For each of the pairs listed below, circle the scale title that represents the more important
contributor to clutter in the display.

Redundancy or Colorfulness

Redundancy or Salience

Redundancy or Dynamics

Redundancy or Variability

Redundancy or Density

Colorfulness or Salience

Colorfulness or Dynamics

Colorfulness or Variability

Colorfulness or Density

Salience or Dynamics

Salience or Variability

Salience or Density

Dynamics or Variability

Dynamics or Density

Variability or Density

Do not write below this line. Experimenter use only.

Subject #: __________ Post-trial
 Definitions of “Clutter” Descriptor Terms
Redundancy
Redundant
 Definition: Exceeding what is necessary or normal; characterized by or containing
an excess; characterized by similarity or repetition.
 Synonyms: Repetitive, superfluous, inessential.
Orthogonal
 Definition: Being mutually independent (relative to something else); composed of
mutually exclusive elements; statistically independent.
 Synonyms: Unique, exclusive, independent.

Alternative set of descriptor terms

Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Redundant vs. Orthogonal.
 Grouped vs. Ungrouped.
 Dissimilar vs. Similar.

Colorfulness
Monochromatic
 Definition: Having or consisting of only one color or hue; lacking variety,
creativity, or excitement.
 Synonyms: Colorless, neutral, plain.
Colorful
 Definition: Full of color; having striking colors; characterized by rich variety.
 Synonyms: Vivid, vibrant, striking.

Alternative set of descriptor terms

Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Monochromatic vs. Colorful.
 Indiscernible vs. Discernible.

Salience
Salient
 Definition: Standing out conspicuously; of notable significance beyond its
surroundings.
 Synonyms: Prominent, striking, remarkable.
Not Salient
 Definition: Difficult to detect; imperceptible to the senses.
 Synonyms: Inconspicuous, unnoticeable, subtle.
Alternative set of descriptor terms
Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Salient vs. Not Salient.
 Empty vs. Crowded.

Do not write below this line. Experimenter use only.

Subject #: __________ Post-trial
Dynamics
Static
 Definition: Having no motion; showing little change.
 Synonyms: Unmoving, stationary, fixed.
Dynamic
 Definition: Characterized by continuous change, activity, or progress.
 Synonyms: Active, driving, compelling.

Alternative set of descriptor terms

Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Static vs. Dynamic.
 Grouped vs. Ungrouped.

Variability
Monotonous
 Definition: Repetitiously dull or lacking in variety; tediously uniform or unvarying.
 Synonyms: Constant, boring, unvarying.
Variable
 Definition: Likely to vary; likely to change frequently, suddenly, or unexpectedly.
 Synonyms: Unstable, fluctuating, inconstant.

Alternative set of descriptor terms

Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Monotonous vs. Variable.
 Grouped vs. Ungrouped.
 Indiscernible vs. Discernible.

Density
Sparse
 Definition: Thinly scattered or distributed; occurring at widely-spaced intervals.
 Synonyms: Thin, meager, distributed.
Dense
 Definition: Having component parts packed closely together.
 Synonyms: Thick, compact, concentrated.

Alternative set of descriptor terms

Among the following terms, which set would you prefer to describe perceived clutter in
the HUD? (Select one)
 Sparse vs. Dense.
 Empty vs. Crowded.
 Dissimilar vs. Similar.

Do not write below this line. Experimenter use only.

Subject #: __________ Post-trial