Professional Documents
Culture Documents
Factors Affecting Task Management in Aviation
Factors Affecting Task Management in Aviation
Factors Affecting Task Management in Aviation
Address correspondence to Cristina Iani, Dipartimento di Scienze Sociali, Cognitive e Quantitative, Università di Modena e
Reggio Emilia, Via Allegri 9, 42100 Reggio Emilia, Italy; iani.cristina@unimore.it. HUMAN FACTORS, Vol. 49, No. 1, February
2007, pp. 16–24. Copyright © 2007, Human Factors and Ergonomics Society. All rights reserved.
TASK MANAGEMENT IN AVIATION 17
are said to resist interruptions), such circularity has clearly revealed that task importance modu-
can be mitigated to the extent that there is a set lates the allocation of resources between primary
of compelling tasks or display features that may and secondary tasks (e.g., Navon & Gopher, 1979)
be defined a priori and independently of their as well as the distribution of visual attention be-
behavioral consequences. Of direct relevance to tween more or less important tasks (Wickens,
the current research, and to advanced aviation Goh, Helleberg, Horrey, & Talleur, 2003), so it is
in general, is the potential compellingness of intuitive that this factor should also modulate the
flight deck tunnel displays, which are character- interruption pattern between the OT and the IT (Ho
istic of the so-called synthetic vision systems et al., 2004). In aviation, task importance has an
(SVSs; Prinzel et al., 2004). There are indeed inherent ranking in terms of the “aviate-navigate-
some concerns that their high level of realism communicate-systems management” or ANCS
may cause pilots to become tunneled on them, at task hierarchy (Schutte & Trujillo, 1996). How-
the expense of monitoring the outside world ever it is also the case that breakdowns in task
(Society of Automotive Engineers, 2005). In- management often reveal marked departures from
deed, a deep analysis of pilot detection perfor- this hierarchy, whereby tasks lower in the hierar-
mance of “off-normal,” unusual events presented chy inappropriately preempt more important ones
in the outside world, but not visible on the SVS (Chou et al., 1996). In particular, Damos (1997),
displays, suggests that such concerns have some and Dismukes et al. (2001) have reported the fre-
statistical basis (Thomas & Wickens, 2004; quency with which auditory-based communication
Wickens, 2005). Furthermore, it has been shown tasks may “preempt” the higher priority naviga-
that tunnel displays decrease the monitoring of tion tasks, suggesting that bottom-up display fea-
events that are rendered outside those displays tures may sometimes override top-down task
(Olmos, Wickens, & Chudy, 2000; Wickens, features (task importance).
Thomas, & Young, 2000). Given these consider- With these issues in mind, in the current re-
ations, one of the aims of the present study is to search we examined the interplay between these
assess whether the compellingness of tunnel dis- three properties of the OT and the IT found else-
plays renders the task they support more resistant where to influence switching behavior: com-
to interruptions. pellingness of the display supporting the OT, IT
The most familiar property of the IT that is salience, and IT importance. Our interest was in
known to produce interruptions is its salience assessing the extent to which each variable would
(e.g., Yantis, 1993). In the current research we exert its influence in isolation, in a realistic flight
operationally defined the salience of the IT by the simulation, and how the combined influence of
modality of the interrupting cue. Across modali- the three factors might be revealed. In particular,
ties, there is indeed good evidence that an IT sup- we were interested in determining whether a
ported by sound will be more likely to capture reciprocity might be observed, such that, for
attention than will one supported by vision example, a factor inducing greater benefit for an
(Banbury, Macken, Tremblay, & Jones, 2001; IT would reveal greater cost for the OT. Indeed,
Ho, Nikolic, Waters, & Sarter, 2004; Spence & in an air traffic control (ATC) task simulation, Ho
Driver, 1996, 1997; Woods, 1995). The auditory et al. (2004) found that such reciprocity was not
over visual advantage in the aviation field has invariably observed.
been investigated in detail by Latorella (1998). To investigate this issue, we required pilots to
However, her study focused on the effect of inter- fly three simulated landing approaches. On the
rupting and interrupted task modality on task final approach, a weather event – a navigational
performance. As far as we know, research has not IT – was presented during the flight path tracking
examined the interaction between the salience of task (the OT). The weather event, always visible
the event cuing the interrupting task and the on the navigational display, could under some
attention-capturing properties of the display sup- circumstances be announced auditorily (via
porting ongoing task performance. ATC) and was varied to be either more or less
In addition to OT display compellingness and important for the safety of the flight. Flight path
IT salience, a third factor influencing interrup- tracking (the OT) was supported either by a
tions to be examined in the current research is task tunnel display or a separated display suite (here-
importance. The long history of dual-task research in, the baseline display).
18 February 2007 – Human Factors
Figure 1. The baseline (top) and tunnel (bottom) synthetic vision system (SVS) displays used in the study.
TASK MANAGEMENT IN AVIATION 19
continuation of their current path), at the risk of reported noticing the change in the trajectory of
flying into bad weather, or to take a longer and one of the weather systems was analyzed using
more circuitous detour path in order to avoid bad the chi-square test. We did not consider those
weather. The decision required pilots to divert cases in which the pilots reported noticing the
some attention from the “aviate” task of flying weather only after receiving the ATC call.
the plane with yoke and throttle (the OT) to the Detection rates were significantly higher for
navigational choice (the IT). the participants flying with the tunnel display,
The actual movement of the weather across χ2 = 6.67, p < .01 (60% vs. 20% for the tunnel
the display was sufficiently slow that, in con- and baseline displays, respectively). Also, pilots
junction with the rotation of the navigation dis- more frequently reported a weather change when
play upon which weather was situated, the it was cued by the auditory-visual cue (tunnel
directional change event itself was imperceptible display: 40% vs. 80% for visual and auditory-
at the moment that it occurred. In the auditory- visual cues, respectively, χ2 = 3.33, p < .07;
visual condition, the need to pay attention to the baseline display: 0% vs. 40% for visual and
interrupting task was signaled also by an ATC auditory-visual cues, respectively, χ2 = 5.00, p <
call informing the pilot about the presence of a .02). There was no main effect of interrupting
thunderstorm on the shorter approach path. task importance (tunnel display: χ 2 = 0.22, p < .6;
IT importance (high vs. low) was manipulated baseline display: χ 2 = 0.27, p < .6).
by changing the severity of the weather. Under the Participants tended to stay on the shorter,
low-importance condition, the change in weather more risk-prone (because of the weather) path
direction would appear to have little effect on the when the need to divert attention was signaled
safety of the shorter path. In fact, the weather sys- only by a visual cue, χ2 = 3.75, p < .05 (75% vs.
tem was moderate in severity, and even though it 45% for visual and auditory-visual cues, respec-
was moving toward the shorter approach path fol- tively), irrespective of display layout, χ 2 = 2.27,
lowing the change, it would not cross the airplane’s p < .32 (tunnel display: 70% vs. 40% for visual
path. In contrast, under the high-importance con- and auditory-visual cues, respectively; baseline
dition, the weather was of high severity, and the display: 80% vs. 50% for visual and auditory-
change in weather direction was designed to clear- visual cues, respectively). Task importance was
ly decrease the safety of the shorter path. Under significant only when the weather change was sig-
the low-importance condition, ATC stated, “Frasca naled by an auditory-visual cue, χ2 = 5.05, p <
142. Weather advisory. Thunderstorm in the area.” .02. Under this condition, 8 out of 10 pilots
Under the high-importance condition, ATC stated, changed path, whereas only 4 out of 10 changed
“Frasca 142. Weather advisory. Thunderstorm on path when the weather change was signaled sole-
the approach path. Make alternate eastbound ly by a visual cue, χ2 = 2.40, p < .12.
approach.”
Flight Performance: The OT
RESULTS A one-way ANOVA was performed on mean
absolute flight path deviation data with display
Because of the relatively low sample size for layout (tunnel vs. baseline) as the between-
each experimental condition (n = 5), data were ex- subjects factor. Because the data were not nor-
amined only for main effects and two-way inter- mally distributed, we used the Kruskal-Wallis
actions. Deviations in the data larger than three test. Consistent with the results of previous
standard deviations from the means were consid- studies (Wickens, Alexander, Horrey, Nunes, &
ered as outliers and removed (less than 5% of the Hardy, 2004), the tunnel display (M = 14.8 m,
data). Because of technical problems with data SD = 21.9) supported better flight performance,
recording for 1 pilot, all analyses of tracking per- H = 28.98, p < .0001, compared with the baseline
formance were performed on the data of 39 par- display (M = 202.6 m, SD = 137.7).
ticipants.
Interruption of the Ongoing Task: Flight
Weather Change Detection and Path Performance at the Time of Change
Choice: The IT To assess the extent to which IT salience could
The percentage of pilots who retrospectively differentially interfere with primary task (OT)
TASK MANAGEMENT IN AVIATION 21
performance, we compared mean absolute flight H = 3.23, p < .07 (beta = 5.22 vs. –0.23 for the
path deviation before and after the change in high- and low-importance conditions, respec-
weather direction, under the assumption that a tively).
more disruptive interruption would, to a greater
extent, lead to increased deviations. We com- DISCUSSION AND CONCLUSIONS
puted tracking performance in the 10 s following
the change in weather as percentage change The main objective of the present study was to
from tracking performance in the 5 s preceding empirically test the influence of ongoing task dis-
the change (baseline performance). Because data play compellingness, interrupting task salience
for the two SVS display conditions were dif- (presence or absence of an auditory cue), and
ferentially skewed, we performed different interrupting task importance on attention alloca-
transformations on the data: A log transforma- tion patterns.
tion (natural logarithm) was performed on the Table 1 presents a relatively simple model of
data for the tunnel display, whereas a square attention switching, which distinguishes between
root transformation was performed on the data properties of, and influences on, both the ongoing
for the baseline display. For each display lay- task (here flight path tracking) and the inter-
out, the data were then entered into a separate rupting task (here the navigational choice).
ANOVA for repeated measures with IT cue According to this simplified model, factors that
(visual vs. auditory-visual) and IT importance increase the intrusiveness of the IT will improve
(high vs. low) as between-subjects factors and its performance, at the expense of the OT, and a
time (10 s following weather change) as a within- converse, reciprocal relationship should be
subject factor. The Huynh-Feldt correction was expected. On the left side of each column (repre-
used when the sphericity assumption was senting the OT and IT) the expected predictions
violated. of this simplified model are presented in terms of
Surprisingly, for both display layouts, IT cue performance improvement (+) or disruption (–).
had no effect on tracking performance. Instead, According to the model, a compelling OT
as shown in Figure 3, a significant interaction display should protect the OT, preventing or
between task importance and time was evident delaying the switch to the IT. Conversely, an IT
for the tunnel display, F(9, 144) = 2.52, p < .04. that is of great importance and/or announced by
Post hoc comparisons showed that tracking error an auditory salient cue should disrupt the OT. On
after the change significantly increased only the right side of each column, we show the extent
when interrupting task importance was high. No to which these simplified predictions of a “reci-
main effect and no interactions were evident for procity” of effects between the IT and OT were
the baseline display. confirmed in the present study.
In order to better assess the effect of task First, increasing IT salience, through auditory-
importance on tracking performance, we ran a visual cuing, was predicted to produce greater
linear regression on each participant’s data to OT disruption. However, we found that auditory-
obtain a coefficient representing the slope of the visual cue presentation captured attention, as
functions depicted in Figure 3, representing the indicated by the higher rates of weather change
degree of disruption of the OT. These coefficients report and safer flight path choices, but did not
were then entered into a one-way ANOVA produce greater disruption of the flight path
(Kruskal-Wallis test), run separately for each dis- tracking (the OT), thereby replicating the find-
play layout, with task importance as a between- ings of Ho et al. (2004). Second, increasing IT
subjects factor. importance was predicted to increase compliance
For the tunnel display, the main effect of with the IT. Our data showed that when IT
IT importance was significant, H = 4.16, p < salience was low, IT importance had no effect on
.04, with a steep positive slope under the high- either weather detection or path choice. How-
importance condition (beta = 19.65) and a slight- ever, the IT disrupted OT performance, particu-
ly negative slope under the low-importance larly when the latter was supported by the tunnel
condition (beta = –2.28). The difference between display.
high- and low-importance conditions was only Most prominent in the current data is the direct
marginally significant for the baseline display, contradiction with the concerns that the tunnel
22 February 2007 – Human Factors
300
High
Low
250
% change from baseline
200
150
100
50
0
1 2 3 4 5 6 7 8 9 10
Time from weather change (s)
300
High
Low
250
% change from baseline
200
150
100
50
0
1 2 3 4 5 6 7 8 9 10
Time from weather change (s)
Figure 3. Second-by-second tracking deviation in the 10 s following weather change for the baseline (top) and tun-
nel (bottom) displays. Tracking deviation is expressed as percentage change from baseline tracking performance in
the 5 s preceding the weather change.
display produces attentional tunneling (bottom tunnel display can have two counteracting influ-
row of Table 1). Had such a display produced ences on performance, only one of which was
attentional tunneling, it would have better sus- considered in our switching model. On the one
tained performance on the OT and led to greater hand, under some circumstances (not examined
delay of (or less compliance in) responding to the here), it appears that the very compellingness of
IT cue. However, the opposite pattern was the tunnel may prevent pilots from noticing very
observed. For instance, pilots flying with the unusual events (see Wickens, 2005, for a review).
tunnel were more likely to detect the change in On the other hand, the tunnel’s greater ease of
weather and were more easily interrupted when processing, which is well documented here and
the change in weather represented an important in prior studies (e.g., Wickens et al., 2004), avails
threat to the safety of the flight. In interpreting more resources, rather than fewer, to monitor
these latter effects, we should consider that the other important areas and to deal with newly
TASK MANAGEMENT IN AVIATION 23
TABLE 1: Simplified Model Summarizing the Interactions (Predicted and Found) Between Properties of,
and Influences on, the Ongoing Task (OT) and the Interrupting Task (IT)
OT IT
arriving information, hence leading to better pro- to convey the same information. However, given
cessing of that information (fewer high-risk the extremely low salience of the visual change,
choices) and to a more rapid disengagement from we doubt that pilot response in the auditory-
the flight control task (as witnessed by the visual condition would have varied if the visual
increase in flight path error shown in Figure 3). display were absent. More important, in terms
Two factors could explain why in the present of a confound with modality, it should be noted
study the benefits of reduced workload might that the auditory delivery was verbal (speech),
have dominated the attentional tunneling costs ob- whereas our visual delivery was spatial (a slow
served in other studies. First, in the current para- dynamic change). It is quite possible that a dif-
digm, monitoring for the IT event – a weather ferent pattern of results could have emerged had
change – although somewhat unexpected (it had we employed a more salient text version for the
not happened during the first two flights), was visual delivery.
still a part of the pilots’ responsibilities. In con- In conclusion, the results reported here sup-
trast, in other studies (e.g. Wickens, 2005), the port the view that the auditory modality has
unnoticed event was a truly surprising system important attention-capturing features, but they
failure for which little prior expectations existed. also seem to suggest that this capture does not
Second, in the current study, IT delivery occurred necessarily disrupt high-priority ongoing tasks
within the cockpit, whereas in prior studies (e.g. aviating), given the ability of the auditory
demonstrating immersion-driven tunneling (op- modality to support parallel processing of visual
erationally defined by reduced detection), the IT flight control information (Wickens, Alexander,
event was visible only in the outside world. & Hardy, 2003). The general absence of reci-
Also, two aspects of the modality results procity of effects between the OT and the IT
deserve particular mention. First, consider the replicates the pattern of results by Ho et al. (2004)
relatively low rate of weather change detection. and suggests that these effects may not act as
In the visual condition, this low value is under- “two sides of the same coin.”
standable because the changes were subtle and In terms of practical implications, the current
the pilots were not accustomed to flying with results provide another positive data point
dynamic weather displays. However, it should be supporting the utility of the tunnel display. Its
noted that when delivery was auditory-visual and advantages for conventional flight path tracking
important, 8 out of 10 pilots did comply with the have been known for a long time. However, the
ATC instructions. We may simply assume that current data also suggest that some of the con-
those pilots who did not comply with the implicit cerns regarding the negative consequences of its
guidance simply treated the ATC instruction as compelling nature may not be as pronounced as
advisory. once thought. Because the time to detect changes
Second, it should be noted that the difference in the environment signaling the need to switch
between the auditory-visual and visual-only con- to a secondary task seems to be sensitive to the
ditions was confounded with redundancy: In the type of tasks involved (e.g., Goodrich, Quigley,
visual condition information was presented in a & Cosenzo, 2005), future studies should in-
single modality, whereas in the auditory-visual vestigate the effect of task compellingness with
condition two modalities were concurrently used interrupting tasks of a different nature.
24 February 2007 – Human Factors
ACKNOWLEDGMENTS Raby, M., & Wickens, C.D. (1994). Strategic workload management
and decision biases in aviation. International Journal of Aviation
Psychology, 4, 211–240.
This research was supported by a grant from Rubinstein, J. S., Meyer, D. E., & Evans, J. E. (2001). Executive
control of cognitive processes in task switching. Journal of
the NASA Ames Research Center, NASA NAG Experimental Psychology: Human Perception and Performance,
2-1535. The authors wish to thank the grant’s 27, 763–797.
Schutte, P. C., & Trujillo, A. C. (1996). Flight crew task management
technical monitor, David Foyle; Ronald Car- in nonnormal situations. In Proceedings of the Human Factors and
bonari and Jonathan Sivier for software develop- Ergonomics Society 40th Annual Meeting (pp. 244–248). Santa
Monica, CA: Human Factors and Ergonomics Society.
ment; and Ben Hammer for helping with data Society of Automotive Engineers. (2005). Aerospace recommended
collection. practice ARP 5589: Human engineering considerations for
perspective flight guidance displays. Warrendale, PA: Author.
Spence, C., & Driver, J. (1996). Audiovisual links in endogenous covert
spatial orienting. Journal of Experimental Psychology: Human
REFERENCES Perception and Performance, 22, 1005–1030.
Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert
Banbury, S. P., Macken, W. J., Tremblay, S., & Jones, D. M. (2001). spatial orienting. Perception and Psychophysics, 59, 1–22.
Auditory distraction and short-term memory: Phenomena and Thomas, L. C., & Wickens, C. D. (2004). Eye-tracking and individual
practical implications. Human Factors, 43, 12–29. differences in off-normal event detection when flying with a syn-
Chou, C. D., Madhavan, D., & Funk, K. (1996). Studies of cockpit task thetic vision system display. In Proceedings of the Human Factors
management errors. International Journal of Aviation Psychology, and Ergonomics Society 48th Annual Meeting (pp. 223–227). Santa
6, 307–320. Monica, CA: Human Factors and Ergonomics Society.
Damos, D. (1997). Using interruptions to identify task prioritization in Wickens, C. D. (2005). Attentional tunneling and task management
Part 121 air carrier operations. In R. S. Jensen (Ed.), Proceedings (Tech. Rep. AHFD-05-23/NASA). Savoy, IL: University of
of the 9th International Symposium on Aviation Psychology Illinois, Institute of Aviation, Aviation Human Factors Division.
(pp. 871–876). Columbus, OH: Department of Aerospace Wickens, C. D., Alexander, A. L., & Hardy, T. J. (2003). The primary
Engineering, Ohio State University. flight display and its pathway guidance: Workload, performance,
Dismukes, R. K., Loukopoulos, L. D., & Jobe, K. K. (2001). The chal- and situation awareness (Tech. Rep. AHFD-03-02/NASA). Savoy,
lenges of managing concurrent and deferred tasks. In R. S. Jensen IL: University of Illinois, Institute of Aviation, Aviation Human
(Ed.), Proceedings of the 11th International Symposium on Factors Division.
Aviation Psychology (CD-ROM). Columbus, OH: Department of Wickens, C. D., Alexander, A. L., Horrey, W. J., Nunes, A., & Hardy,
Aerospace Engineering, Ohio State University. T. J. (2004). Traffic and flight guidance depiction on a synthetic
Funk, K. H. (1991). Cockpit task management: Preliminary definitions, vision system display: The effect of clutter on performance and
normative theory, error taxonomy, and design recommendations. visual attention allocation. In Proceedings of the Human Factors
International Journal of Aviation Psychology, 1, 271–285. and Ergonomics Society 48th Annual Meeting (pp. 218–222). Santa
Goodrich, M. A., Quigley, M., & Cosenzo, K. (2005). Task switching Monica, CA: Human Factors and Ergonomics Society.
and multi-robot teams. Paper presented at the Third Inter- Wickens, C. D., Goh, J., Helleberg, J., Horrey, W. J., & Talleur, D. A.
national Multi-Robot Systems Workshop, March 14–16, Washing- (2003). Attentional models of multitask pilot performance using
ton, DC. advanced display technology. Human Factors, 45, 360–380.
Ho, C.-Y., Nikolic, M. I., Waters, M. J., & Sarter, N. B. (2004). Not Wickens, C. D., Thomas, L. C., & Young, R. B. (2000). Frames of ref-
now! Supporting interruption management by indicating the erence for the display of battlefield information: Judgment-display
modality and urgency of pending tasks. Human Factors, 46, dependencies. Human Factors, 42, 660–675.
399–409. Woods, D. D. (1995). The alarm problem and directed attention in
Latorella, K. A. (1998). Effects of modality on interrupted flight deck dynamic fault management. Ergonomics, 38, 2371–2394.
performance: Implications for data link. In Proceedings of the Yantis, S. (1993). Stimulus-driven attentional capture. Current
Human Factors and Ergonomics Society 42nd Annual Meeting (pp. Directions in Psychological Science, 2, 156–161.
87–91). Santa Monica, CA: Human Factors and Ergonomics
Society.
Liao, J., & Moray, N. (1993). A simulation study of human performance Cristina Iani is an assistant professor of psychology at
deterioration and mental workload. Le Travail Humain, 56, the University of Modena and Reggio Emilia, Italy. She
321–344. received her Ph.D. in cognitive psychology from the
McFarlane, D. C., & Latorella K. A. (2002). The scope and importance
of human interruption in human-computer interaction design. University of Bologna, Italy, in 2001.
Human-Computer Interaction, 17, 1–61.
Monsell, S. (2003). Task switching. Trends in Cognitive Neuroscience,
7, 134–140.
Christopher D. Wickens is a senior scientist at Alion
Navon, D., & Gopher, D. (1979). On the economy of the human pro- Science Corporation, Micro Analysis & Design
cessing system. Psychological Review, 86, 214–255. Operations, Boulder, Colorado, and professor emeritus
Olmos, O., Wickens, C. D., & Chudy, A. (2000). Tactical displays for at the University of Illinois at Urbana-Champaign. He
combat awareness: An examination of dimensionality and frame of
reference concepts and the application of cognitive engineering.
received his Ph.D. in psychology from the University of
International Journal of Aviation Psychology, 10, 247–271. Michigan in 1974.
Prinzel, L., Comstock, R., Glaab, L., Kramer, L., Jarvis, J., & Barry, J.
(2004). The efficacy of head down and head up synthetic vision
display concepts for retro- and forward-fit of commercial aircraft. Date received: December 22, 2004
International Journal of Aviation Psychology, 14, 53–78. Date accepted: December 21, 2005