Professional Documents
Culture Documents
Discriminating Between Simultaneous Audible Alarms Is Easi - 2022 - Applied Ergo
Discriminating Between Simultaneous Audible Alarms Is Easi - 2022 - Applied Ergo
Applied Ergonomics
journal homepage: www.elsevier.com/locate/apergo
A R T I C L E I N F O A B S T R A C T
Keywords: When more than one audible alarm is heard simultaneously, discrimination may be compromised. This exper
Clinical alarms iment compares near-simultaneous clinical alarms in two styles, the first are the tonal ‘melodies’ from the 2012/
Audible alarms 2006 version of a global medical device safety standard (IEC 60601-1-8) and the second are the auditory-icon-
Alarm design
style recommended in the 2020 version of the same standard. Sixty-six participants were required to identify the
Auditory cognition
Auditory perception
meaning and priority of four different clinical alarms for one of the two styles of alarm (between-subjects).
Auditory alarms Alarms sounded both singly and in pairs (within-subjects). Results showed that the auditory icon alarms out
performed the tonal alarms on all measures except one, both for overall accuracy (recognizing both priority and
function) and for partial accuracy (recognizing priority or function but not both). The results add to the growing
body of evidence supporting the use of auditory icon alarms in clinical environments.
1. Introduction nature, making it easier for listeners to link the sound and the function
that it represents (Belz et al., 1999; Graham, 1999; Keller and Stevens,
For many years it has been recognized that the audible alarms 2004; Perry et al., 2007; Petocz et al., 2008; Stephan et al., 2006), and
associated with the global medical device safety standard IEC 60601-1-8 because they are more varied as a group than a traditional set of tonal
(IEC 2006; 2012; 2020) are less than optimal. These alarms have been alarms (McDougall et al., 2020; Edworthy et al., 2011). They are easier
shown to be difficult to learn (Edworthy et al., 2014, 2017; Sanderson to localize because they are harmonically richer than typical alarm
et al., 2006; Wee and Sanderson, 2008) and exceedingly difficult to sounds, and are more like real sounds (Edworthy et al., 2017, 2018).
distinguish between when more than one is heard at a time (Lacherez These features make them more likely to function as discernible auditory
et al., 2007). More recently, model-checking approaches to the predic objects able to form separate auditory streams and therefore have the
tion of masking between IEC alarms demonstrates that masking between potential to be processed simultaneously, or almost simultaneously
alarms sounding simultaneously is also theoretically possible (Bolton (Bregman, 1990; Carlyon et al., 2003). There a rich and complex liter
et al. 2018, 2019, 2020a, 2020b Hasanain et al., 2017). ature on auditory objects and auditory streaming which is central not
A series of studies have been carried out which have developed and just to how alarms are potentially discriminated from one another, but
tested a set of auditory icons in support of the updated version of the how all sounds in an environment can be thus discriminated through
standard, published in 2020 (IEC, 2020). This series of studies demon interactions and interconnectedness of auditory inputs in terms of
strates that auditory icon alarms outperform the current IEC alarms, spectral and temporal attributes. One of the key concepts in the auditory
which are tonal in nature, on almost all criteria from learnability streaming literature is the idea of sounds as auditory objects, with sets of
(Edworthy et al., 2014, 2017), localizability (Edworthy et al. 2017, properties and commonalities that make it possible to group a set of
2018), performance in simulation (McNeer et al., 2018; Bennett et al., sound parameters as one or more objects (van Noorden, 1975; Rankin
2019) to tasks requiring visual identification of the source of the prob et al., 2017; Chakrabarty and Elhilali, 2019). What we know about
lem (McDougall et al., 2020). auditory objects and streaming makes it much more likely that
The superior performance of auditory icons can be attributed to a simultaneously-sounding auditory icons should be easier to identify
number of reasons. They are easier to learn because they are metaphors individually than simultaneously-sounding tonal alarms. This is because
for the problems that they represent, rather than being abstract in each of the spectral elements of an auditory icon will show similar
* Corresponding author.
E-mail address: jedworthy@plymouth.ac.uk (J.R. Edworthy).
https://doi.org/10.1016/j.apergo.2021.103609
Received 16 February 2021; Received in revised form 3 September 2021; Accepted 11 October 2021
Available online 23 October 2021
0003-6870/© 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
2
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
cardiovascular alarm), and the Ventilation medium-priority alarm was Throughout the study, data for the single and paired sounding alarms
not used. The Cardiovascular high-priority alarm was combined with the was collected for both correct/incorrect priority identification and
Oxygenation and Drug administration medium-priority alarms; Venti correct/incorrect function identification. After completion, participants
lation high-priority was combined with Oxygenation and Cardiovascu were given a debrief and given contact details should they wish to
lar medium-priority alarms; high-priority Drug administration was withdraw their data.
combined with Oxygenation and Cardiovascular medium-priority
alarms; and high-priority Ventilation was combined with medium- 3. Results
priority Oxygenation and Cardiovascular alarms. Figs. 1 and 2 show
the waveforms for the paired alarms for High Priority Cardiovascular For each alarm, it was possible for participants to correctly identify
and Medium priority Drug administration. both the priority and the function of the alarm, or one of these, or neither
(except for the priority only of the paired alarm conditions, which is
discussed later in this section). We first consider completely correct re
2.5. Procedure
sponses, followed by partially correct responses (either function or pri
ority, but not both).
Participants were randomly allocated to either the old or new con
Table 3 shows the means, sds and 95% CIs for all conditions and for
dition and were seated in front of the computer monitor at a comfortable
both completely correct (both function and priority identified correctly)
viewing distance, the headphones having been pre-set to a level of
and partially correct (either function or priority identified correctly, but
approximately 75 dB(A). Instructions for the study were visible on the
not both) responses.
monitor for the participant to read. Participants were told the following:
FOUR ANOVAs were carried out on the data, one two-way ANOVA
‘In this experiment we will measure your ability to accurately identify
on the completely correct responses and three 1-way ANOVAs on the
the priority and the meanings of clinical alarms. First, you are given 10
function-only data and the priority-only correct data (in the latter case
min where you will hear eight different alarms, four of which are high-
for the single alarm conditions only). We selected Analysis of Variance
priority and four of which are the medium-priority versions of those
as an appropriate method of analysis because we were interested not
same alarms. You will hear each alarm three times. After this training,
only in the effects of each of the variables of stimulus style and pairing,
you will hear those same alarms either singly or in pairs, and your task is
but in any possible interaction between the two. The presence of an
to identify the priority (high- or -medium-) and the meaning of the
interaction between the two variables would address the issue of ben
alarm. The meanings of the alarms will be explained in the following
efits to one or other type of alarm beyond mere superiority in detect
segment’. After reading the brief and completing their informed consent,
ability and/or learning. Separate one-way ANOVAs were carried out on
participants were instructed to put on their headphones and begin the
single and paired data for function-only because the context in which the
study. Exposure to the sounds was identical for all participants. They
alarms were presented were different for single and paired alarms. In the
heard each of the eight alarms on which they were to be tested three
single alarm condition the selection of priority and function were two
times before proceeding with the experiment proper. They were not
separate tasks, but for the paired alarms a ‘function-only’ correct answer
asked to identify the alarms during this training, but were simply
would be due to a mismatch between function and priority (see Fig. 3).
exposed to each of them, there was no criterion on which the partici
For example, participants might select ‘Cardiovascular’ for the high
pants’ understanding of or memory for the sounds was judged.
priority alarm whereas that selection was in fact correct for the Medium
Participants allocated to the ‘old’ condition heard the alarms in
Priority alarm, or vice versa. Here, the participant has selected the
Table 1, whereas participants in the ‘new’ condition heard those in
correct function but the wrong priority. The ‘priority-only’ measure is
Table 2. Participants first completed the training phase, and were then
only meaningful for the singly-presented alarms, as participants were
given four practice alarms where they were presented with two single
required to select this separately from function. There is no comparable
and two paired alarms in order to familiarize themselves with the task.
response for the paired stimuli. All data was normally distributed.
In the single alarm trials participants were asked to first select the
Completely correct identification: A two-way alarm style (old, new) x
priority of the alarm (Fig. 3), and then to identify the alarm function
pairing (single, paired) analysis of variance showed that the effect of
(Fig. 4).
alarm style was significant, (F(1, 2108) = 375.78, p < .001, dCohen =
For the paired alarms, participants saw a screen with two response
0.817), with mean accuracy of 0.3 for old alarms (SD= .46, CI = 0.18)
boxes. The first asked the participant to identify the function of the high-
and 0.68 for new alarms (SD= .47, CI = 0.21). Pairing also had a sig
priority alarm. The high-priority alarm was always heard first and then
nificant effect (F(1, 2108) = 108.49, p < .001, dCohen = 0.20), with
followed by the medium-priority alarm, though participants were not
means of 0.6 for single alarms (SD= .49, CI = 0.22) and 0.39 for paired
told this (Fig. 5)
alarms (SD= .49, CI = 0.20). The interaction effect was not significant F
The test phase consisted of thirty-two trials, which consisted of
(1, 2108) = .46, p = .50. Means for the four conditions can be seen in the
sixteen single alarm trials and sixteen paired alarm trials randomly
first column of Table 3.
presented. Trials occurred every 30 s +/- 10 s, thus the whole study took
Correct priority or function identification only: Participants frequently
approximately 30 min. Participants did not complete any other tasks,
identified either the priority or the function of the alarm correctly, but
such as a secondary task as pilot testing suggested that the alarm task
not both. The following one-way ANOVAs consider these responses,
along was sufficiently demanding for participants.
Fig. 1. Old alarm combination: For 1.2 s the HP alarm sounds alone; before it is finished the MP Drug alarm sounds and ends at around 2.2. Seconds; the Car
diovascular alarm completes its 10-pulse cycle at around 3.4 s.
3
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
Fig. 2. New alarm combination: The HP Cardiovascular auditory icon and pointer begin at 0.0 s; the first iteration of the pointer finishes just before 0.5 s; the second
iteration finishes at 1.1. Seconds; the Cardiovascular icon ends at approximately 1.4 s; the MP pointer begins at 1.2 s and ends at about 1.5 s; the MP icon (Drugs)
begins at around 1.4 s and ends at 2.8 s.
Table 3
Means (maximum score = 1), standard deviations (1) and Confidence intervals
(2) for each condition for fully correct answers (both function and priority
identified correctly), function only identified correctly and priority only iden
tified correctly.
Fig. 4. Second screen for single alarm responses. Fully correct Function only Priority only
4
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
5
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
Hasanain et al., 2017; Pereira et al., 2020).We would expect the new 2 Drafting the work or revising it critically for important intellectual
alarms to be more discriminable when played simultaneously because it content; AND
is much clearer that two separate auditory objects are being presented, 3 Final approval of the version to be published; AND
which are unlikely to fuse into a single stream. Further experimentation 4 Agreement to be accountable for all aspects of the work in ensuring
would help to establish how close to simultaneous the new alarms can be that questions related to the accuracy or integrity of any part of the
presented and still be discriminated. work are appropriately investigated and resolved.
In this study we found no interaction between alarm style and
pairing, which is somewhat surprising as the greater probability of the FORMCHECKBOX All listed authors meet the ICMJE criteria.
auditory icons being perceived as individual auditory objects might have We attest that all authors contributed significantly to the creation of this
predicted that this would be the case. We suggest that interactions may manuscript, each having fulfilled criteria as established by the ICMJE.
appear when a range of time intervals are investigated. The easier FORMCHECKBOX We confirm that the manuscript has been read and
learnability of the icons probably accounts for the superior performance approved by all named authors.
of the icons overall. However, it is very clear from the results that par FORMCHECKBOX We confirm that the order of authors listed in the
ticipants found it easier to process one alarm than two, which can be manuscript has been approved by all named authors.
interpreted from a number of perspectives such as shared processing and
workload (Wickens, 2008), inattentional deafness (Dehais et al., 2014), Contact with the editorial office
working memory constraints (Beaman, 2004; Lacherez et al., 2007).
Again, this should be a topic of future investigation. FORMCHECKBOX This author submitted this manuscript using his/
All of the old alarms were the same length (approximately 3.5 s for her account in EVISE.
high priority and 1.1 s for medium priority) whereas the new alarms FORMCHECKBOX We understand that this Corresponding Author is
varied somewhat in length – or at least the icon part of the alarm varied the sole contact for the Editorial process (including EVISE and direct
between 2 and 3 s. The pointer was a fixed length, either 1.1 s for the communications with the office). He/she is responsible for communi
high priority or 0.6 s for the medium priority alarm. Given that per cating with the other authors about progress, submissions of revisions
formance was worse for the old alarms we do not think that stimulus and final approval of proofs.
length and variation in the length of the auditory icons would had much FORMCHECKBOX We confirm that the email address shown below is
overall effect on performance, aside from stimulus length being a very accessible by the Corresponding Author, is the address to which Corre
obvious cue in distinguishing between the old high- and medium- sponding Author’s EVISE account is linked, and has been configured to
priority alarms, where performance was at 96%. accept email from the editorial office of American Journal of Ophthal
We are aware that our study used student participants rather than mology Case Reports:
clinically-trained staff, and that the task set to participants, which was to
listen out for alarms and to report their meaning, is less complex than Declaration of competing interest
those encountered in a real clinical environment. However, our study is
the first to explore near-simultaneous new IEC alarms (and one of only a The authors declare the following financial interests/personal re
few to explore this same question for the old IEC alarms). Our findings lationships which may be considered as potential competing interests:
can be used to develop more complex and realistic experimental para
digms for the future. References
Funding Dehais Andeol, G., Lanzilotti, C., Scannella, S., 2020. Cocktail party training improves
the use of level cues for speech intelligibility: behavioral and fNIRS data. December).
In: Forum Acusticum, p. 2771, 2771.
No funding was received for this work. Andeol, G., Suied, C., Scannella, S., Dehais, F., 2017. The spatial release of cognitive load
in cocktail party is determined by the relative levels of the talkers. Journal of the
Association for Research in Otolaryngology 18, 457–464.
Intellectual property
Beaman, C.P., 2004. The irrelevant sound phenomenon revisited: what role for working
memory capacity? J. Exp. Psychol. Learn. Mem. Cognit. 30 (5), 1106. https://psycne
We confirm that we have given due consideration to the protection of t.apa.org/record/2004-17949-012.
intellectual property associated with this work and that there are no Belz, S.M., Robinson, G.S., Casali, J.G., 1999. A new class of auditory warning signals for
complex systems: auditory icons. Dec Hum. Factors 41 (4), 608–618. https://doi.
impediments to publication, including the timing of publication, with org/10.1518/001872099779656734.
respect to intellectual property. In so doing we confirm that we have Bennett, C., Dudaryk, R., Crenshaw, N., Edworthy, J., McNeer, R., 2019.
followed the regulations of our institutions concerning intellectual Recommendation of new medical alarms based on audibility, identifiability, and
detectability in a randomized, simulation-based study. Aug Crit. Care Med. 47 (8),
property. 1050–1057. https://doi.org/10.1097/CCM.0000000000003802.
Bolton, M.L., Edworthy, J., Boyd, A.D., Wei, J., Zheng, X., 2018. A computationally
Research ethics efficient formal method for discovering simultaneous masking in medical alarms.
Appl. Acoust. 141, 403–415. https://doi.org/10.1016/j.apacoust.2018.06.012.
Bolton, M.L., Edworthy, J.R., Boyd, A.D., 2020a. Masking between reserved alarm
FORMCHECKBOX We further confirm that any aspect of the work sounds of the IEC 60601-1-8 international medical alarm standard: a systematic,
covered in this manuscript that has involved human patients has been formal analysis. Hum. Factors. https://doi.org/10.1177/0018720820967596,
18720820967596.
conducted with the ethical approval of all relevant bodies and that such Bolton, M.L., Zheng, X., Li, M., Edworthy, J.R., Boyd, A.D., 2020b. An experimental
approvals are acknowledged within the manuscript. validation of masking in IEC 60601-1-8:2006-compliant alarm sounds. Hum. Factors.
FORMCHECKBOX IRB approval was obtained (required for studies https://doi.org/10.1177/0018720819862911, 18720819862911.
Bregman, A.S., 1990. Auditory Scene Analysis: the Perceptual Organization of Sound.
and series of 3 or more cases)
MIT Press, Cambridge: MA.
Carlyon, R.P., Plack, C.J., Fantini, D.A., Cusack, R., 2003. Cross-modal and non-sensory
Authorship influences on auditory streaming. Perception 32 (11), 1393–1402. https://doi.org/
10.1068/p5035.
Chakrabarty, D., Elhilali, M., 2019. A Gestalt inference model for auditory scene
The International Committee of Medical Journal Editors (ICMJE) segregation. PLoS Comput. Biol. 15 (1), e1006711. https://journals.plos.org/plos
recommends that authorship be based on the following four criteria: compbiol/article?id=10.1371/journal.pcbi.1006711.
Dehais, F., Causse, M., Vachon, F., Régis, N., Menant, E., Tremblay, S., 2014. Failure to
detect critical auditory alerts in the cockpit: evidence for inattentional deafness.
1 Substantial contributions to the conception or design of the work; or Hum. Factors 56 (4), 631–644. https://journals.sagepub.com/doi/abs/10.1177/001
the acquisition, analysis, or interpretation of data for the work; AND 8720813510735.
6
J.R. Edworthy et al. Applied Ergonomics 99 (2022) 103609
Edworthy, J., Hellier, E., Titchener, K., Naweed, A., Roels, R., 2011. Heterogeneity in McNeer, R.R., Horn, D.B., Bennett, C.L., Edworthy, J.R., Dudaryk, R., 2018. Auditory
auditory alarm sets makes them easier to learn. Int. J. Ind. Ergon. 41 (2), 136–146. icon alarms are more accurately and quickly identified than current standard
https://doi.org/10.1016/j.ergon.2010.12.004. melodic alarms in a simulated clinical setting. Anesthesiology 129 (1), 58–66.
Edworthy, J., Page, R., Hibbard, A., Kyle, S., Ratnage, P., Claydon, S., 2014. Learning https://doi.org/10.1097/ALN.0000000000002234.
three sets of alarms for the same medical functions: a perspective on the difficulty of Perry, N.C., Stevens, C.J., Wiggins, M.W., Howell, C.E., 2007. Cough once for danger:
learning alarms specified in an international standard. Sep Appl. Ergon. 45 (5), icons versus abstract warnings as informative alerts in civil aviation. Dec Hum.
1291–1296. https://doi.org/10.1016/j.apergo.2013.10.003. Factors 49 (6), 1061–1071. https://doi.org/10.1518/001872007X249929.
Edworthy, J., Reid, S., McDougall, S., Edworthy, J.D., Hall, S., Bennett, D., Khan, J., Pereira, F., Marques, R., Vieira, J., 2020. Auditory alarms design tool: spectral masking
Pye, E., 2017. The recognizability and localizability of auditory alarms: setting estimation based on a psychoacoustic model. In: Meeting of Research in Music, Arts
global medical device standards. Hum. Factors: The Journal of the Human Factors and Design. Springer, Cham, pp. 621–639. https://link.springer.com/chapter/10.
and Ergonomics Society 59 (7), 1108–1127. https://doi.org/10.1177/ 1007/978-3-030-55700-3_43.
0018720817712004. Petocz, A., Keller, P.E., Stevens, C.J., 2008. Auditory warnings, signal-referent relations,
Edworthy, J., Reid, S., Peel, K., Lock, S., Williams, J., Newbury, C., Foster, J., and natural indicators: Re-thinking theory and application. J. Exp. Psychol. Appl. 14
Farrington, M., 2018. The impact of workload on the ability to localize audible (2), 165–178. https://doi.org/10.1037/1076-898X.14.2.165.
alarms. Oct Appl. Ergon. 72, 88–93. https://doi.org/10.1016/j.apergo.2018.05.006. Rankin, J., Osborn Popp, P.J., Rinzel, J., 2017. Stimulus pauses and perturbations
Graham, R., 1999. Use of auditory icons as emergency warnings: evaluation within a differentially delay or promote the segregation of auditory objects: psychoacoustics
vehicle collision avoidance application. Ergonomics 42 (9), 1233–1248. https://doi. and modeling. Front. Neurosci. 11, 198. https://www.frontiersin.org/articles/10
org/10.1080/001401399185108. .3389/fnins.2017.00198/full.
Hasanain, B., Boyd, A.D., Edworthy, J., Bolton, M.L., 2017. A formal approach to Sanderson, P.M., Wee, A., Lacherez, P., 2006. Learnability and discriminability of
discovering simultaneous additive masking between auditory medical alarms. Appl. melodic medical equipment alarms. Feb Anaesthesia 61 (2), 142–147. https://www.
Ergon. 58, 500–514. https://doi.org/10.1016/j.apergo.2016.07.008. ncbi.nlm.nih.gov/pubmed/16430567.
IEC, 2006. International electrotechnical commission. Medical electrical Stephan, K.L., Smith, S.E., Martin, R.L., Parker, S.P., McAnally, K.I., 2006. Learning and
equipment—Part 1–8: general requirements for basic safety and essential retention of associations between auditory icons and denotative referents:
performance—collateral standard: general requirements, tests and guidance for implications for the design of auditory warnings. Hum. Factors 48 (2), 288–299.
alarm systems in medical electrical equipment and medical electrical systems, 2012; https://doi.org/10.1518/001872006777724426.
2020, Available at: https://webstore.iec.ch/publication/2599. Wan, Y., 2019. Identifying and overcoming attention limitations in the detection and
Keller, P., Stevens, C., 2004. Meaning from environmental sounds: types of signal- identification of alarms in close temporal proximity (doctoral dissertation). htt
referent relations and their effect on recognizing auditory icons. J. Exp. Psychol. ps://deepblue.lib.umich.edu/handle/2027.42/151387.
Appl. 10 (1), 3–12. https://doi.org/10.1037/1076-898X.10.1.3. Wee, A.N., Sanderson, P.M., 2008. Are melodic medical equipment alarms easily
Lacherez, P., Seah, E.L., Sanderson, P., 2007. Overlapping melodic alarms are almost learned? Anesth. Analg. 106 (2), 501–508. https://doi.org/10.1213/01.
indiscriminable. Hum. Factors 49 (4), 637–645. https://doi.org/10.1518/ ane.0000286148.58823.6c.
001872007X215719. Wickens, C.D., 2008. Multiple resources and mental workload. Hum. Factors 50 (3),
McDougall, S., Edworthy, J., Sinimeri, D., Goodliffe, J., Bradley, D., Foster, J., 2020. 449–455.
Searching for meaning in sound: learning and interpreting alarm signals in visual
environments. J. Exp. Psychol. Appl. 26 (1), 89–107.