Boster 2017 Designing Augmentative and Alternative Communication Applications

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

DISABILITY AND REHABILITATION: ASSISTIVE TECHNOLOGY, 2018

VOL. 13, NO. 4, 353–365


https://doi.org/10.1080/17483107.2017.1324526

ORIGINAL RESEARCH

Designing augmentative and alternative communication applications: the results


of focus groups with speech-language pathologists and parents of children with
autism spectrum disorder
Jamie B. Boster and John W. McCarthy
Department of Communication Sciences and Disorders, Ohio University, Athens, OH, USA

ABSTRACT ARTICLE HISTORY


Purpose: The purpose of this study was to gain insight from speech-language pathologists (SLPs) and Received 10 February 2017
parents of children with autism spectrum disorder (ASD) regarding appealing features of augmentative Revised 25 April 2017
and alternative communication (AAC) applications. Accepted 25 April 2017
Method: Two separate 1-hour focus groups were conducted with 8 SLPs and 5 parents of children with
ASD to identify appealing design features of AAC Apps, their benefits and potential concerns. Participants KEYWORDS
were shown novel interface designs for communication mode, play mode and incentive systems. Speech-generating device;
Participants responded to poll questions and provided benefits and drawbacks of the features as part of autism spectrum disorder;
structured discussion. interface design; speech-
Results: SLPs and parents identified a range of appealing features in communication mode (customiza- language pathology;
tion, animation and colour-coding) as well as in play mode (games and videos). SLPs preferred interfaces stakeholders; augmentative
that supported motor planning and instruction while parents preferred those features such as character and alternative
assistants that would appeal to their child. Overall SLPs and parents agreed on features for future AAC communication
Apps.
Conclusion: SLPs and parents have valuable input in regards to future AAC app design informed by their
experiences with children with ASD. Both groups are key stakeholders in the design process and should
be included in future design and research endeavors.

ä IMPLICATIONS FOR REHABILITATION


 AAC applications for the iPad are often designed based on previous devices without consideration of
new features.
 Ensuring the design of new interfaces are appealing and beneficial for children with ASD can poten-
tially further support their communication.
 This study demonstrates how key stakeholders in AAC including speech language pathologists and
parents can provide information to support the development of future AAC interface designs.
 Key stakeholders may be an untapped resource in the development of future AAC interfaces for chil-
dren with ASD.

The Apple iPadV has become a familiar tool in homes, work set-
R
communicate may feel isolated from their peers [4]. The use of an
tings, classrooms and recreational activities since its release in iPad as a communication device can allow children to feel more
2010. It is frequently used for daily work-related tasks, networking confident and inconspicuous as it is a recognizable tool in our
and entertainment, but it is also serving individuals with complex society [5]. However, the mainstream connectivity of iPads can
communication needs (CCN). There are estimates that over 3.5 mil- also create a distraction. Although mainstream connectivity can
lion individuals across the United States cannot use their natural be locked out, another option is to create highly engaging AAC
speech to communicate and rely on augmentative and alternative applications (Apps). Although a range of Apps is available, each
communication (AAC) strategies such as gestures, alphabet differs greatly in design. There has been limited research con-
boards, picture exchange communication systems and computer- ducted on the appeal of many AAC Apps [6], and most are
based devices with voice output [1]. Approximately 1 million of designed by adults with little input from children or those who
these individuals are children [2]. There are a range of diagnoses know children best. In order to develop new Apps that meet
that can result in children’s inability to use their natural speech children’s communication needs, it is necessary to identify design
such as cerebral palsy, intellectual disabilities and autism spectrum features that will provide the best experiences for them. If chil-
disorder (ASD). Recent estimates suggested that about 50% of dren are uninterested in or unable to operate an AAC App, they
children with ASD do not develop speech adequate to meet their will be less likely to use it effectively [5]. With the rapid produc-
daily communication needs [3]. Research has shown that AAC can tion of new Apps, it is important to inform developers, professio-
provide a variety of benefits related to language and social nals and parents about features that engage children in the most
skills. However, children who must use a device in order to successful manner.

CONTACT Jamie B. Boster jb643713@ohio.edu W218 Grover Center, Ohio University, Athens, OH 45701, USA
ß 2017 Informa UK Limited, trading as Taylor & Francis Group
354 J. B. BOSTER AND J. W. MCCARTHY

AAC and children with ASD speech-language pathologists (SLPs) and parents of children with
ASD in the process of evaluating potential interface designs to
The definition of ASD was recently redefined in the DSM-V to
optimally integrate features and capabilities of mobile devices
include individuals previously diagnosed separately as having
with AAC Apps. In order to identify these design principles and
Asperger’s Disorder or pervasive developmental disorder and calls
gather suggestions on how to improve the design as well as
for the level of support required (very substantial, substantial and appeal of AAC Apps, the following research questions were posed:
requiring support) to be specific along with accompanying intel- 1. What do SLPs and parents of children with ASD consider
lectual and language impairments [7]. It is still primarily defined appealing features to be incorporated into AAC Apps?
as a social communication disorder characterized by repetitive or 2. What do SLPs and parents of children with ASD perceive as
limited interests present in early development. Skill-based inter- benefits to designs that incorporate these features?
ventions with individuals diagnosed with ASD include applied 3. What are SLPs and parents of children with ASD concerned
behavioral analysis, discrete trial training, pivotal response train- about when incorporating such features?
ing, provision of AAC, the picture exchange communication sys-
tem, peer-mediated strategies, incidental teaching and joint action
routines [8]. In a meta-analysis of AAC-based single-case research Method
with children with ASD, it was found that picture exchange sys- A focus group methodology was used to elicit discussion of
tems and speech generating devices had higher effect sizes thoughts and opinions regarding design principles of AAC Apps.
for targeted behavioral outcomes than other picture based A qualitative methodology was selected given the preliminary
approaches [9]. nature of the evidence base in this area. A focus group specifically
In conceptualizing the benefits of AAC strategies with individu- allows participants to answer questions and provide feedback in
als with ASD, there are three critical modes through which these an interactive setting [16]. This style of gathering information
strategies may be effective: the Visual Expressive Mode (for seeks to identify suggestions, opinions and ideas. Focus groups
expressive communication); the Visual Instructional Mode (to have been used in previous investigations to gather information
teach a new skill or concept); and the Visual Organization Mode about key stakeholders in AAC design and service delivery in
(to portray a schedule or event). The idea of using visual supports AAC [15,17].
with individuals with ASD is not a new one [10], however, Shane’s
perspectives on the critical nature for AAC strategies to integrate
several modes was something new. Participants
Two key stakeholder groups in service delivery related to AAC
Current research related to the appeal of AAC systems Apps are SLPs and parents of children with disabilities. Because
the technology needs of children who require AAC can vary
Several research studies have been undertaken to bring the per- widely depending on the needs and skills associated with their
spectives of children into AAC system design [4,11–15]. In disability impact [1], and because individuals with ASD are fre-
responding to children leaving communication Apps in favour of quently cited as using mobile technologies, this project specifically
more “fun” Apps on a device, it is informative to study other focused on individuals with experience or relationships with
research that sought to improve the appeal of AAC systems. For children with ASD [18].
example, children had previously been asked to design an ideal
communication system [13]. One key finding was to not limit an
AAC system solely to communication functions. Systems designed Speech-language pathologists
by children had games, lights and even beverage services. A com- Approximately 3000 SLPs were contacted through an announce-
parison of the hardware features of typical AAC systems with ment on professional listserves such as LinkedIn, American
those of toys reported on the differences toys had in appealing Speech-Language Hearing Association and the United States
lights, sounds and customizable options compared to existing Society for Augmentative and Alternative Communication. SLP
AAC systems [11]. participants had licensure in the United States, experience with
Snyder and McCarthy examined appealing features of popular AAC in the form of training, class, or therapy with a client using a
Apps for children and then followed with potential applications device in the past 3 years and experience with a child with ASD
for AAC in focus groups with children and adults without disabil- that used a high-tech communication systems or mobile device as
ities [13,15]. The results indicated that parents viewed designs a form of AAC in the past 3 years. A total of 10 SLPs contacted
that were practical for daily use most valuable while children fav- the primary investigator with interest in participating, met the
oured designs incorporating game scenarios such as building inclusion criteria, completed a test session and provided times
blocks. Both parents and their children favoured game interfaces and dates for the 1-h focus group session. Based on scheduling
that included popular characters and incentives as well as physical and availability, a total of 8 SLPs participated in the 1-h focus
interactions (i.e., gestures and shaking). For this study, no distinc- group session. All 8 participants were asked to complete a
tion was made between designs for a daily communication mode demographic survey to collect information regarding their age,
and a play mode. The results of this study informed the present ethnicity, number of years in the profession, work setting and
study in that an explicit difference between these modes was approximate caseload of children with ASD, see Table 1.
necessary.
Parents of children with ASD
Research questions
Parents were contacted through the Autism Society of Ohio and
Present research has indicated a need to further explore design announcements through national organizations serving parents of
principles for future AAC Apps. First, it is important to identify fea- children with ASD. SLPs were asked to share the announcement
tures that key stakeholders value most to efficiently address future with parents whom they felt would be interested in participating
designs. The primary goal of this study was to involve professional in the focus group. A total of 8 parents contacted the
DESIGN PRINCIPLES OF AAC APPS 355

Table 1. Demographic information of speech-language pathologists participants.


Participant Age Ethnicity Years in profession Setting Caseload of children with ASDa App development
1 27 White 4 Outpatient 75–100 Yes
2 54 White 31 School 30 No
3 35 White 13 School Cooperative 7 No
4 25 White 2 Outpatient 40 No
5 49 White 13 School 5 No
6 29 White 4.5 School FT Private Practice PT 30 No
7 43 White 13 School 5–10 No
a
SLPs provided estimates of the number of children with Autism they had worked with using an iPad or app as a communication device.

Table 2. Demographic information of parents of children with autism spectrum disorder.


Participant Age Ethnicity Age of child AAC strategies used App development
1 47 White 4 PECS, Sign Language, LAMP No
2 43 White 4 and 6 PECS, Sign Language, LAMP No
3 40 White 6 and 9 PECS, Sign Language, Vantage Lite with Unity, LAMP No
4 35 White 6 and 8 PECS, Sign Language, Vantage Lite, LAMP No
5 49 White 17 and 19 PECS, Sign Language, Proloquo2Go No

primary investigator. During scheduling, 3 parents did not com- shapes, message construction supports and alternatives to a grid,
plete scheduling resulting in a group of 5 parents. Parents pro- see Figure 1.
vided information regarding the age of their child/children, and
the AAC strategies they used as well as whether they had been Play mode
involved in App development. Autism diagnosis and severity was
based on parent report. Children’s ages ranged from 4 to 19. All Play mode designs referred to game interfaces that children
parents identified the use of multiple AAC strategies in the demo- would have access to as a space “play” with language concepts
graphic survey, see Table 2. Additionally, four out of five parents and symbols. These designs offered a chance to explore language
had multiple children diagnosed with ASD. A group of 4 parents representations within the context of familiar games or meta-
completed the one-hour focus group session with the primary phors. Participants were asked to think about how children who
investigator. Because of scheduling conflicts, the remaining parent use AAC can play with language as well as whether the designs
participated in an individual session with the primary investigator. would be appealing or engaging for children. Features examined
in play mode included symbol sets, location of play mode, errors,
popular game characteristics, gestures, character assistants, videos
Setting and points, see Figure 2.
The focus groups were conducted online using AdobeV
R

ConnectTM, a web conferencing platform that allows for hosting Incentives


meetings, video conferencing and webinars1. All participants were
Incentives can be a potentially motivating tool in a traditional
contacted to perform a test session with the primary investigator
behavioral paradigm to increase the likelihood of a behavior con-
to ensure their computer supported the audio and visual compo-
tinuing. Participants were asked their opinions regarding different
nents of the program. Participants were able to troubleshoot
types of incentives as well as how they felt they could be incorpo-
problems as well as learn to navigate the platform. If participants
rated, see Figure 3.
did not have access to a working microphone on their personal
computer, a headset was mailed to them.
Procedures
Materials SLPs and parents of children with ASD participated in separate
focus groups but viewed the same stimulus items and followed
Materials for each focus group included visual representations of the same procedures. Participants completed individual 5–10 min
possible AAC app designs created using MicrosoftV PowerPoint,
R

test sessions with the primary investigator where they provided


poll questions and discussion points. Visual representations were available dates and times for the 1-h focus group session, gave
created for a daily communication mode, play mode and incen- their informed consent, completed a demographic survey and
tives. Materials were developed based on previous work reviewing received instructions for using the program.
features of popular children’s Apps [6] and focus groups of chil- For the 1-h focus group session, participants joined the Adobe
dren without disabilities and their parents [15]. Connect meeting using a link sent to their email address and their
personal computer. The sessions lasted approximately 1-h.
Communication mode Participants could type their responses in a message window or
respond verbally. The message window was available during the
Communication mode referred to designs that would be used as session, and all participants were able to view messages from fel-
a child’s daily communication system. The majority of current AAC low participants. The session began with a brief introduction of
Apps make use of a grid format. While the grid is an efficient lay- the purpose of the group and the structure of the questions that
out, participants were asked to think about how it could be made would be asked. Each group viewed the communication mode
more fun and engaging for a child. Specific features explored designs followed by play mode and incentive designs. The pri-
were enhanced cursors, animation, message window orientation, mary researcher led the discussion. For each design, participants
356 J. B. BOSTER AND J. W. MCCARTHY

Figure 1. Example communication mode interface designs.

were asked for their initial thoughts and opinions, benefits and drawbacks of using an enhanced cursor. Discussion in each group
drawbacks of the design and what could be altered. Discussion indicated this feature might be distracting for some children, for
was also directed to specific aspects of a design following the ini- example a parent stated, “My kids personally would concentrate
tial remarks. The primary researcher would provide a summary of more on the look of it, the different colours, than they would the
the group’s opinion to end a discussion, ensure that all partici- actual communication choices.” Based on a poll, all participants
pants had provided their opinions and determine agreement on agreed that the enhanced cursor feature should be a customizable
specific features. Discussions were followed by poll questions. The option.
discussion was recorded using Adobe Connect and transcribed for
analysis. Participant’s discussions were categorized according to
Animation
each design feature, and benefits and concerns were identified
Overall SLPs and parents were receptive to the use of animation
from comments. Data were also collected from responses to poll
in AAC Apps. In the interface example, animation was used to
questions.
draw attention to the symbol selected. SLPs viewed this as a
potentially motivating aspect of design. SLPs were interested in
Results expanding the animations to symbols (“I really like the animation
for the symbols.”) and text (“I would also like the option of
Communication mode
sending the symbol and text or just the text to the message
Enhanced cursors window.”). Parents also saw potential benefits of animation
SLPs and parents viewed enhanced cursors as a potentially benefi- (“I like seeing that because I think it helps the child see what
cial feature. One parent stated, “I like the wand, I think it makes it they’re saying.”). Drawbacks SLPs and parents identified to this
more fun than just your finger pointing to different things.” The feature were efficiency, (“For my kids the more important factor
SLP group felt enhanced cursors would be helpful for children is that it’s instantaneous.”), visual distraction and unclear commu-
using eye gaze and indicated preferences for additional features nicative intention (“It could become visually distracting-children
the enhanced cursor could facilitate such as hi-lighting cell bor- preferring the animation rather than actually creating genuine,
ders and enlarging cells for direct-selectors. An SLP stated, “I really communicative messages; I can see some of my children select-
like anything that highlights the area around the box to make it ing icons based on the animations they enjoy instead of the
very clear which icon is selected.” SLPs and parents also provided meaning.”).
DESIGN PRINCIPLES OF AAC APPS 357

Figure 2. Example play mode interface designs.

Additionally, SLPs viewed this feature as a potential teaching is necessary to have a vertical display.” As a result of this discus-
tool (“ … for teaching it would be a great tool.”). Using animation sion, SLPs agreed a vertical display was a possible customizable
in this way could potentially slow communication down, which feature.
for some may be a drawback, but SLPs identified this as a poten-
tial strength of the feature, “I kind of like that it might slow you Shapes
down a bit, if you have to wait for the icon to move up before Participants were asked to identify benefits and drawbacks of
selecting the next one. That could be good.” All SLPs were in using shapes in the message window and as a categorization tool.
agreement that this feature should be customizable to best meet SLPs favoured this feature and stated, “Shapes are an interesting
individual needs. idea and would definitely be distinctive, if only because colour-
coding has become so standard.” The idea of using this design as
Message window orientation a teaching tool was supported by SLPs, “I do like the idea of
In regards to message window orientation, 7 SLPs and 4 parents shapes as a teaching tool.” One parent also favoured the use of
agreed that the message window should be oriented left to right. shapes in the message window, “I like that concept of them hav-
When discussing the vertical arrangement with SLPs, literacy was ing to put the right piece in the right shape, and it also teaches
a primary focus. “It doesn’t enforce literacy development,” one matching." A drawback to this design identified by an SLP was its
SLP said of this design. Parents also attested to this point, “I like ability to be used long-term, “It may help as a teaching tool, but
left to right because I feel like it prepares them better for writing it would take up a fair amount of real estate on the grid long-
later in life, and they’d already be familiar with the left to right.” term.” Two parents identified lack of communicative intent as a
While participants were in agreement, discussion around children potential drawback, one stating in reference to her son, “I think
with visual impairments in the SLP focus group revealed that 3 he would concentrate more on the shape than the actual commu-
SLPs had found it necessary to use a vertical arrangement in the nication part of it.”
past, “I have had to use or set up vertical for some students
because it is a more viable option for them and they use the Message construction supports
device and application more with the vertical set-up versus the Participants viewed the design that incorporated the use of colour
horizontal.” “ … a couple of students that I serve find the vertical categories and puzzle pieces to support message construction
arrangement more appealing and more engaging.” “ … at times it and again identified both benefits and drawbacks. The benefits of
358 J. B. BOSTER AND J. W. MCCARTHY

Figure 3. Example incentives to incorporate into interface designs.

this design were noted in the following comments by SLPs, “I like rather than making meaning of their intent.” Parent participants
it for teaching.” “Some of my kiddos using a topic display could were primarily concerned that this design could be visually con-
benefit.” “I think within a topic display like grid this could poten- fusing for children. The use of colour-coding in the design was
tially be helpful.” In the individual parent session this design was identified as an important component within this design, one par-
also seen as a potential game interface, “I’d rather see this as a ent stated, “I’ve always liked that. My son doesn’t quite get verbs
game.” The general consensus for the group was that this design so the colour helps them understand which one is an action
would be more suited as a game or learning tool compared to a word. So I like that.”
daily communication design. Drawbacks included limited variabil-
ity in sentence structure a puzzle design could offer and limitation Navigation
of novel utterances: “I think it would potentially promote a type Alternate navigation options were explored based on an interface
of sentence rather than true generative language,” “It makes me in which a child could move through vocabulary items with the
feel that novel utterance could be more difficult, I see some of swiping gesture available on the iPad. A benefit of this design
my students becoming more rigid in connecting the puzzle pieces was identified during the SLP group, “I like the idea of swiping as
DESIGN PRINCIPLES OF AAC APPS 359

Figure 4. Preferred features in communication mode.

a feature. A lot of students want to swipe anything with a screen.” language is critical. That is what all children do!” A second SLP
SLPs also favoured the idea of incorporating this feature as part of added, “I like when children are allowed to get it wrong and must
a game. Parent participants did not identify benefits with this rearrange to get it right, there’s a lot of thinking going on there.”
design. The drawbacks identified by SLPs and parents centered on Another SLP suggested errorless learning in a beginning level of
the lack of a consistent organization pattern. The majority of par- games but greater flexibility as the child progresses, “Why not
ticipants, 5 SLPs and 2 parents, felt that if this design were cre- both? Have multiple levels in the game, an early level that is lim-
ated a consistent organization pattern for the symbols should be ited to correct word order (errorless learning), and a later level
used. SLPs were primarily concerned that no consistent motor that allows children to arrange words in various orders, hear the
plan would be developed and that speed would be negatively playback and get feedback.” In response to the poll question
impacted by this design. One SLP stated, “Swiping possibly to get regarding which types of messages children should be able to
to more vocabulary, but swiping in general doesn’t allow for a construct 5 out of 7 SLPs chose both incorrect and correct mes-
motor plan to develop for access.” Additional SLPs agreed and sages and 3 out of 5 parents chose only correct messages.
added their comments: “I am also concerned about the motor
planning in learning to construct messages quickly and Popular game characteristics
efficiently.” Visual distraction, overstimulation and efficiency were SLPs and parents identified motivation as a benefit for designs
also identified as primary concerns by both parents and SLPs. incorporating popular game characters. An SLP commented, “It
would definitely be a high-interest game for some kids.” A parent
Comparison poll of features in the daily communication mode stated, “We've actually never played Angry BirdsTM oddly, but I
Coloured categories emerged as being the feature preferred most would think for kids who do, just the fact that they're there would
in the daily app designs for SLPs and parents. The majority also make this appealing.” In response, 3 additional parents agreed
favoured grid displays with only 1 participant identifying the use with this statement. When asked whether it would be helpful for
of an alternative to a grid layout as a possible route for a daily the symbols to fall to blanks according to where they fit in the
app. Other features received support from less than half of the sentence, SLPs generally felt this was a good idea, “I could see
participants, see Figure 4. that being a benefit; “I think that’s a good idea, especially for an
early learning mode.” Parent participants also favoured this idea.
SLPs added additional opinions regarding potential changes to
Play mode
the game, “ … maybe in a later mode they have to arrange the
Location and availability of play mode words in the correct order, but then they get extra points for it.”
The majority of participants, 4 SLPs and 3 parents, selected play This brought about the idea of scaffolding the game to build
mode as a separate app instead of an embedded feature. Having children’s skills in the SLP group, “You could initially even set up
an in-app play mode option was viewed as beneficial by only 2 where they have to release them in a specific order, so that it has
SLPs due to funding. One stated, “I agree that teaching Apps to be correct, later they can release them in any order and earn
should be an in-App feature versus their own app because some- points for putting it into sentence construct that’s appropriate.”
times insurance doesn’t allow us to open the iPads purchased Concerns regarding motor difficulty were the primary drawback
through insurance.” In contrast, 2 SLPs stated their preference on for SLPs. Additional drawbacks identified by SLPs included access
having a separate app for play mode. The concern identified was issues, the order a child may hit a word, and obsessive behaviors.
that an in-app play mode would limit a child’s access to their
communication system, “I tend to use other technology to teach Point systems
or play so that their communication or words are always available Participants were asked their thoughts regarding earning points in
to the end user. If you include games within the app then their play mode. Five SLPs and 5 parents felt this would be appealing
access to language while playing is gone.” to children; however 2 in each group felt points should exist only
in play mode. During their discussion, participants appeared to
Errors like the idea of earning points to unlock levels in the game rather
SLPs were in favour of allowing children to create both correct than as a means of earning incentives, “I think points to unlock
and incorrect messages in play mode, an SLP stated, “Playing with levels and short videos of the Angry Birds actually acting out the
360 J. B. BOSTER AND J. W. MCCARTHY

sentence constructed.” One SLP felt the game itself was the incen- not understand the job of the character assistant, “I don’t think
tive/motivator, “I'm not sure that would really be rewarding, I my son would understand that that person is there to help him.”
think earning points to unlock higher levels for kids who are
gamers makes sense. I think earning points for other kids is not Videos
really a motivator just playing the game is the motivator.” SLPs and parents each identified benefits when presented with
the idea of having a stage where children could drag symbols
Gestures and see a video of the message they create. SLPs stated, “Helping
An interface was presented in which stacked symbols would fall to add meaning is beneficial, I like it,” “I like this to reinforce sen-
when the iPad was shaken. A benefit identified in the SLP group tence construction,” “Yes, I like it. Videos are of high interest with
was the incorporation of the effect to clear the message window. many of my students. I would like to have the option to have ani-
Parents favoured this design compared to SLPs and began to dis- mation and/or real people.” In the parent group 2 participants
cuss it as a possible game. All 5 parents found this design appeal- stated their children would love this game. A drawback men-
ing, one stated, “My kids would find this incredibly appealing and tioned by SLPs for this design was related to motor abilities,
enjoyable.” They have an App called Stack the StatesV, and they
R
“Dragging can be hard, selecting may be better.” The only draw-
know the states on the map simply because they can sit and do back identified in the parent group was the simple sentence struc-
this. Additional parents supported the design and provided con- ture in the example interface. A parent proposed longer
structive feedback, “I think my daughter would like this if you had sentences, “you could just match a few, say three words out of
to build a sentence and then it played a video of whatever sen- the sentence structure, that way they would get more language
tence you made,” “I feel like if there were blanks up here, like for than just the three words.”
a noun, pronoun or verb, they could just play with it or they
Comparison poll of features in play mode
could even line them all up and read the words.” Parents contin-
Popular game characteristics and video clips of messages were
ued to build on this idea and suggested additional modes of the
the features of play mode that received the greatest support from
design, “If it had both modes where they had to make a sentence,
both SLPs and parents, see Figure 5. Although in the discussion,
or we can just play.” In contrast, the majority of SLPs were not in
parents supported the use of character assistants it was not
favour of this design concept. Drawbacks identified included vis-
recorded as a preferred feature in the poll results.
ual confusion, lack of consistent motor plan, and lack of a learning
component. The only drawback identified by parents was poten-
tial excessive shaking of the communication device. Incentives
SLPs felt incentives would appeal to some children more than
Character assistants others. It appeared to be a feature that would be highly depend-
SLPs and parents felt including popular children’s characters ent on the child and need to be customizable. An SLP stated “ …
would appeal to children and benefit future AAC Apps. One par- I would think this need to be an option as with other things.”
ent stated, “If it was customizable, and if there were 100 cartoon Visual distraction was a potential drawback. Parents stated con-
characters and you got to pick the one your child loves, that cerns that their child would focus only on the character, “If a char-
would be huge.” In response, 3 additional parents agreed stating acter is present, my son only sees the character, he’s not going to
their child would “love having a character they like.” Parents pro- notice Elmo’s eating, just Elmo,” “My son would really pay atten-
vided ideas regarding the character assistant stating, “he would tion to that … he would also only look at the character.”
want to move him around or line him up, and he could click on Discussion revealed parents favoured the character assistants com-
the words and say them out loud.” Parents also provided the idea pared to the character sets.
that the character should “say the words,” and that his lips could
be moving. A potential idea for this design also evolved during Features of the iPad
discussion in the SLP group, “Maybe if the child touched the icon Specific features of the iPad itself were examined, see Figure 6.
the superhero could get it and deliver it to the sentence area.” A Touch screen controls such as swiping and dragging features
drawback identified by SLPs was lack of motor planning and a were identified as being an area of interest for inclusion in AAC
potential drawback mentioned by a parent was that a child may Apps. However, only 3 SLPs identified responses to movements as

Figure 5. Preferred features in play mode.


DESIGN PRINCIPLES OF AAC APPS 361

a desirable feature to be incorporated into AAC Apps. While these turn them off could be a potential avenue to explore. The inclu-
movements can be attractive and interesting to children, SLPs sion of menus that allow features to be quickly turned on or off
stated this could be a distracting feature. Other possible features would allow for experimentation to best meet a child’s individual
were discussed in the SLP group including feedback in the form needs. The desire for customization also appears to reflect a desire
of vibration. This was a desired feature by several SLPs, “I still for “easy” customization. This process as it exists now in AAC
think some feedback such as a vibration for icon selection could Apps and devices is often time consuming and may or may not
be a good feature.” A final idea brought up in the SLP discussion benefit an individual’s experience and there has been a call for
was the use of character voices for auditory scanning, “Also audio Apps to incorporate Just in Time (JIT) solutions that allow for
scanning, could character voices be used,” “That would be great,” rapid changes. Removing the time it takes to include customized
“Character voices would be a fun incentive!” All participants felt features can only benefit a child’s experience with their communi-
the camera should be incorporated into future AAC Apps. A par- cation device. Customization may also allow an AAC App to “grow
ent participant also identified the microphone, as another feature with a child.”
of the iPad they felt should be incorporated, “microphone for kids Animation also emerged as an appealing design feature for
would be cool to record their voice.” parents and SLPs. Although studies have found value in animation
[19–21] the optimal way to realize animation within AAC displays
is not yet clear. As an increasing amount of research is generated
Discussion relative to animation in AAC, it will be important to translate the
The responses to discussion points and poll questions during the research into options within AAC interfaces. In the current study,
focus groups provided insight on appealing design features for participants appeared to like animation as it related to feedback.
future AAC Apps. SLPs and parents of children ASD provided sup- The use of animation as a feedback mechanism appears the most
port for their opinions and actively expanded upon the ideas and logical place to start as it is a relatively easy to customize feature
thoughts presented by others. The groups agreed on several fea- already available in varying forms on some Apps. For example,
tures that should be customizable such as cursors and animation. the app, Avaz2, includes feedback on selection in an animated
They also identified features that would be appealing such as col- form as an option, where the item grows bigger to indicate that
our-coding, and agreed that certain features were not as import- an item was selected. This feature is consistent with research from
ant including alternative navigation abilities and incentives. McCarthy et al. [19].
Finally, based on the results of discussion and polls, colour-
Results showcased the range of stakeholder opinions, how they
coding was identified as an appealing feature among both SLPs
overlap and also how they converge. This input can be used to
and parents, with 4 SLPs and 2 parents in agreement. As this fea-
further guide future developments in AAC interface design.
ture has been included in many AAC devices to date it may be a
feature that not only helps a child but also those assisting them
Appealing features and their perceived benefits with their communication. Colour-coding was viewed as a helpful
teaching feature and may be a type of visual cue to help children
Communication mode
construct messages correctly. Colour has been implicated as
Based on the results of both focus groups, the primary appealing important particularly as it relates to a logical match with the col-
features associated with designs for communication mode were our of the desired item [22] or the means it may organize displays
customization options, animation and colour-coding. Benefits and reflect the underlying emotional content of items [23]; how-
were noted for each of these features as well. ever, there is not necessarily consensus on the exact colours to
Customization capabilities that allow for changes to be made use to organize items beyond conventional and arbitrary designa-
for teaching purposes and daily use were appealing to SLPs. This tions of orange for nouns and green for verbs [24]. The ability to
result is not surprising as SLPs would have perspectives on mul- change backgrounds and line colours is currently possible but can
tiple children and their call for features to be customizable likely vary in difficulty from being done per individual symbol or page
reflects their desire to options for a variety of children on their to being something that could be chosen at the outset, but not
caseload. It is possible that the parents’ agreement reflects the necessarily be changed globally with ease.
fact that many children with ASD vary in their ability to handle
certain stimuli. Parents may also be especially sensitive to their Play mode
child’s changing needs and interests that may necessitate frequent
changes to their AAC system. Customizable options could also The results of the focus groups indicated that both SLPs and
support the need for children to have additional supports early parents viewed play mode as a positive support for a child who
on in the teaching process that can be faded later. Having the requires AAC. The interface designs that aimed to support lan-
ability to include features during an instruction session and then guage learning and message construction with popular game
characteristic and videos were seen as both appealing for children
and beneficial. These designs received the largest support from
participants in comparison to other features displayed in play
mode, 6 of 7 SLPs and 4 out of 5 parents selected the Angry Birds
design as preferred and all participants selected movie clips of
messages as a preferred feature.
Spaces that allow children to play with language can be
powerful teaching tools and allow parents and SLPs to work with
children while playing games that are interesting and motivating
for children. Use of popular game characteristics and characters is
potentially motivating and appealing to children. Several parents
felt that including these characters would interest their child. This
Figure 6. Appealing features of the iPad to incorporate. sentiment of interest also supports the idea of children who “lose”
362 J. B. BOSTER AND J. W. MCCARTHY

interest in AAC Apps and go elsewhere on the device. As [11] an interface would need to return to a grid format for efficiency
noted, taking lessons from toy manufacturers rather than trying to purposes, such alternatives could potentially be incorporated as
re-invent, or out-invent them might be a better means toward part of a hybrid display or transition from a visual scene. Without
developing more appealing systems. further investigation it may remain unknown whether such
The use of videos embedded into AAC Apps was also an changes can positively impact children’s abilities to navigate their
appealing feature with associated benefits. Both SLPs and parents AAC devices as well as whether children find such interfaces more
favoured these designs as a means to represent messages a child appealing than current designs.
created and as a tool to help children learn semantic and syntac-
tic concepts. Researchers explored the use of YouTube style vid-
Play mode
eos that represented concepts such as “on” or “in” [25]. Videos
such as this may be incorporated for instructional purposes to Despite positive feedback on play mode designs, SLPs and parents
teach concepts. These findings also support the findings in that did note potential concerns. Specifically, the SLP group indicated
children with Autism benefit from visual materials and video rep- concern regarding how children would communicate when
resentations [18]. Once children display an understanding of such engaged in a play interface. A possible reason for this is their
concepts, videos can be expanded to further provide children focus on the importance of maintaining constant access to the
practice. For example, children may only receive one word and communication device for a child. SLPs felt that having access to
view the corresponding video initially, additional words can be play mode as an in-app feature would separate children from their
added to further emphasize meaning and then provide increasing ability to communicate. It is important to consider how games in
levels to practice with the word. Providing a means for children to play mode can be developed to best support children’s learning.
see what they create may also help them to see whether the mes- Currently there are reports of children having multiple tablets
sage they create is what they intended. Further investigation is with different covers where one is designated as the videos and
necessary to examine whether including video representations of games iPad and the other as the communication iPad [28].
constructed messages would support acquisition of vocabulary Because play mode appears to be a valuable feature, it is import-
items and use of grammatical structures. ant to further investigate how children can move back and forth
between play and communication modes. The exact marking of
how to switch between modes was not explored in the current
Concerns study. It is possible it could be done through a physical event
Communication mode such as shaking the device or pressing the home button a desig-
nated number of times. Also uncertain is who should be in charge
A primary concern of SLPs evident in the discussion of daily com- of being able to switch back and forth between communication
munication interface designs was “motor planning.” SLPs were and play mode.
concerned that cursors and alternative navigation capabilities A second concern regarding play mode was the availability of
would interfere with the creation of a “stable motor plan.” This the feature for children. The concern that play mode should not
preference most likely comes from the background several SLPs be available at all times was evident in both SLP and parent ses-
had in the Language Acquisition through Motor Planning sions. However, it may be necessary to further examine reasons
(LAMPTM3) approach [26]. Parents did not appear to have a prefer- why children navigate away from their daily App. If they are navi-
ence for a particular organization pattern for symbols and did not gating away from their daily communication App, one could
discuss motor planning as a priority despite the fact that many argue that the option of a play mode that supports language
parent’s children had experience with this approach. This may be learning is preferable to other Apps with no educational supports.
because the parents included in these groups were not as attuned Incorporating popular characters and games may also aid in
to this concept as the SLPs. In keeping with features that support including children who use AAC with their peers. Peers may find
motor planning, SLPs also preferred consistent organization pat- the inclusion of these characters interesting and participate in
terns for symbols. popular games with children who are involved with an app that
Consistent location approaches frequently use a feature of sim- includes recognizable features. Same-age peers familiar with
plifying a grid by reducing the number of items in a selection set popular game constructs could also be potential models for chil-
but leaving gaps for new items to be added. For example, in dren who use AAC. If the Apps are appealing to same-age peers,
learning to type an individual could see a QWERTY keyboard with this could also be motivating for the child. The shared experience
only the “j, h, f” and “d” keys shown and blank spaces for the of playing a game with a peer invites a variety of communication
remaining letters. The idea of a grid that could eventually be skills and psychosocial skills and could be an overarching benefit
populated with other concepts in a predictable way while not of having a play mode available.
moving items already learned was not presented for consider-
ation. While the idea of reinventing the current grid design or
developing alternatives appeared to be more controversial, SLPs
Appeal, benefit and concerns regarding incentives
and parents felt designs presented in the daily communication The most appealing incentives for SLPs and parents were those
mode could be suited as teaching tools for language learning. that included popular children’s characters. Play mode itself was
Exploring whether these designs are more suited as teaching viewed as an incentive and parents were interested in incorporat-
tools compared to daily communication solutions is needed. It is ing popular characters within games. Parents viewed character
also important to investigate alternative designs that take advan- assistants as more appealing that character sets (symbol sets
tage of additional features of the iPad that may currently be incorporating a popular children’s characters) but SLPs supported
underused in existing designs (e.g., touchscreen pressure sensitive each equally. Parents felt their children took great interest in any
response, gestures, etc.). It is important to investigate whether activity that incorporated their favourite character. SLPs favoured
there is merit in adhering to current grid designs. Current research characters as well and agreed characters embedded in an AAC
into Visual Scene Displays for children relies on embedded sym- interface would be appealing and motivating feature for children.
bols underneath photographs of actual scenes [27]. It is likely that These results are consistent with findings that found that popular
DESIGN PRINCIPLES OF AAC APPS 363

character customization was desirable. The concerns identified disagreement between SLPs and parents may have arisen based
regarding inclusion of characters were related to customization on trainings and beliefs about which features are most important.
and symbol representation [11,15], These concerns were raised by For example, those with experiences with LAMP may be more apt
parents only. Parents discussed how their children’s favoured char- to support designs, which foster motor planning. Due to the
acters often changed weekly. If characters were to be included, it nature of the profession, SLPs may also be more focused on only
would be important to support the ability to change them quickly the speech and language benefits of an App design whereas
based on children’s preferences. In terms of symbol representa- parents may be more considerate of other factors such as moti-
tion, parents preferred character assistants to character sets vating characteristics for their children. Parents also appeared to
because they felt altering symbols may blur their meaning. They draw their opinions from known interests of their children while
were also concerned their child may focus only on the character SLPs based their opinions on clients. While SLPs did remark that
and not understand the action or concept the character is desired features were dependent on a particular client’s abilities,
attempting to convey as part of the symbol. their responses were often more general in nature. The overall
Currently, many AAC Apps do not offer characters unless agreement between SLPs and parents allows for designs that
they are customized and included by those setting up the meet both groups expectations without sacrificing features pre-
device. Characters may be included in a variety of manners ferred by one group over another. The opinions of children should
such as in symbol sets, operating as a separate assistant, or also be explored to assess how their values and preferences com-
incorporating their familiar voices. It would be of interest to pare to SLPs and parents.
explore how children would like characters to be added to AAC
Apps as well as whether this inclusion would impact children’s
ability to understand a symbol’s meaning. In order to determine Limitations
the best way to include characters into AAC Apps, future A limitation of this study lies in the small number of parent partic-
designs may need to be developed and presented to children ipants. Focus groups typically consist of 6–8 participants where
for their feedback. this group consisted of 4. The amount of information collected
about the parent’s children is also a limitation of this study. ASD
Appeal, benefit and concerns regarding features of the diagnosis and severity were based on parent report without add-
iPad itional verification. Individual characteristics, speech and language
skills of the children were also not addressed in the current study.
Overall features of the iPad that were seen as beneficial by SLPs Participants in this study were also predominantly white females,
and parents were the camera and touchscreen capabilities. These which may not be representative of all cultural, economic, and
features are not only unique to the iPad, but are included in social backgrounds. The preference for left-to-right message win-
many technologies with which children have experiences: dow orientation for example would likely not be seen in Arabic or
Phones, tablets, and some children’s toy make use of cameras Hebrew speaking participants.
and touchscreens. Children may observe their parents using
these devices on a regular basis and take interest in learning
how to control them. Many parents also provide these devices Conclusion
to their children at an early age to allow them to play games
and watch cartoons. The ease with which the camera can be This study highlights important future directions based on the
accessed through Apps likely plays a role in the desire to con- input of key stakeholders interfacing with AAC Apps. The desire
tinue to include the camera in future Apps. Many AAC Apps for customizable interface features, games that support language
interface with the iPad’s onboard camera allowing users to learning, and motivating designs that include popular children’s
import their own pictures into interfaces and personalize their characters are each aspects that researchers and App developers
systems. Identifying additional uses for the camera beyond cus- must take into consideration. Not only is it important to develop
tomizing buttons would be a potential avenue to explore. The such features, but it is also necessary to conduct additional
touchscreen capabilities of the iPad also offer additional options research to determine which features support children who
for AAC Apps. It is important to consider how this specific require AAC to the fullest extent possible. Consideration should
aspect of the iPad impacts interface designs. It is imperative to be given to the skills that both researchers and developers offer
capitalize on new features of technology that can provide add- when preparing to design new AAC Apps. Developing a partner-
itional benefits to children who use AAC. Limiting interfaces to ship can ensure that future interfaces are properly informed by
their current designs based on devices without touchscreen the knowledge of both SLPs and developers. It is also important
capabilities may exclude designs that help children navigate and for all parties involved to be open to changes. Technologies will
create messages. continue to transform over time with advances in engineering
and research. These new developments may potentially present
new opportunities that can benefit the field of AAC but only if
those involved are open to change as well.
Comparison of SLP and parent responses
Overall SLPs and parents appeared to share opinions regarding
design features of AAC Apps. The opinions of both groups in
Notes
terms of appealing features, benefits and concerns overlapped for 1. Adobe Systems is a computer software company. Adobe
both communication mode and play mode. Divergence of opin- Systems Complex, 345 Park Avenue, San Jose, CA 95110.
ions occurred primarily regarding the importance of motor plan- 2. Avaz is an AAC App developed for children who are non-
ning and the specific use of characters as incentives. Differences verbal or have difficulty speaking designed by Avaz, Inc.
in opinions may have occurred due to specific experiences with 3. Language Acquisition through Motor Planning (LAMP) is an
Apps SLPs and parents have used before as well as an awareness augmentative and alternative communication (AAC)
of the particular features incorporated in current Apps. Potential approach designed for speech-generating devices that focus
364 J. B. BOSTER AND J. W. MCCARTHY

on concepts such as readiness to learn, joint engagement, [11] Light JC, Drager KD, Nemser JG. Enhancing the appeal of
unique and consistent motor plan, auditory signals and AAC technologies for young children: lessons from the toy
natural consequences [26]. manufacturers. Augment Altern Commun. 2004;20:137–149.
[12] Fallon KA, Light J, Achenbach A. The semantic organization
patterns of young children: implications for augmentative
Acknowledgements and alternative communication. Augment Altern Commun.
2003;19:74–85.
The study was funded by internal funding from Student Research
[13] Light J, Paige R, Curran J, et al. Children’s ideas for the
Award of the College of Health Sciences and Professions at Ohio
design of AAC assistive technologies for young children
University, Athens, OH, USA.
with complex communication needs. Augment Altern
Commun. 2007;23:274–287.
Disclosure statement
[14] McCarthy J, Benigno J, Snyder M, Adams A, Cooley J,
The authors report no conflict of interest related to the study. Symbol organization and representation in children with
autism spectrum disorders using AAC. Paper presented at:
Funding American Speech-Language-Hearing Association annual
meeting; 2013, Chicago, IL.
The study was funded by internal funding from Student Research
[15] Snyder C, McCarthy J, Increasing children’s interest in aug-
Award of the College of Health Sciences and Professions at Ohio
mentative and alternative communication Apps for iPad.
University, Athens, OH, USA.
Poster session presented at: Ohio State Speech-Language-
Hearing Association annual meeting; 2014 March,
ORCID Columbus, OH.
[16] Barbour R, Focus groups: In: Bourgeault Ivy, Dingwall,
Jamie B. Boster http://orcid.org/0000-0001-9317-0700
Robert, de Vries, Raymond, editors. The SAGE handbook of
qualitative methods in health research. London (UK): Sage
Publications Ltd; 2010. p.327–352.
References [17] O’Keefe BM, Kozak NB, Schuller R. Research priorities in
augmentative and alternative communication as identified
[1] Beukleman D, Mirenda P. Augmentative and alternative by people who use AAC and their facilitators. Augment
communication: supporting children and adults with com- Altern Communn. 2007;23:89–96.
plex communication needs. 4th ed. Baltimore: Paul H. [18] Shane H. Enhancing communication for individuals with
Brookes; 2013 autism: a guide to the visual immersion system. 1st ed.
[2] Binger C, Light J. The effect of aided AAC modeling on the Baltimore, MD: Brookes Publishing; 2015.
expression of multi-symbol messages by preschoolers who [19] McCarthy J, Light J, Drager K, et al. Re-designing scanning
use AAC. Augment Altern Commun. 2007;23:30–43. to reduce learning demands: the performance of typically
[3] Data and statistics: autism spectrum disorder [Internet]. developing 2-year olds. Augment Altern Commun.
Centers for Disease Control and Prevention. [Cited 2016 2006;22:269–283.
Jan 10]. Available from: http://www.cdc.gov/ncbddd/autism/. [20] Kearns J, McCarthy J. The effects of animated feedback on
[4] Light J, Drager KD. AAC technologies for young children locating verbs in a dynamic contextual scene display on an
with complex communication needs: state of the science augmentative and alternative device. Contemp Issues
and future research directions. Augment Altern Commun. Commun Sci Disord. 2012;39:43–53.
2007;23:204–216. [21] Schlosser RW, Raghavendra P, Sigafoos J, Koul R, Shane H,
[5] Light J, McNaughton D. Communicative competence for Augmentative and Alternative Communication. In: Luiselli
individuals who require augmentative and alternative com- JL, editor. Children and youth with autism spectrum disor-
ders (ASD): recent advances and innovations in assessment,
munication: a new definition for a new era of communica-
education, and intervention. New York: Oxford University
tion? Augment Altern Commun. 2014;30:1–18.
Press; 2014. p. 101–122
[6] Snyder C, McCarthy J, Comparison of popular & AAC Apps:
[22] Wilkinson KM, Carlin M, Thistle J. The role of color cues in
increasing the appeal. Poster session presented at:
facilitating accurate and rapid location of aided symbols by
American Speech-Language-Hearing Association annual
children with and without Down syndrome. Am J Speech
meeting; 2013 Nov; Chicago, IL. Lang Pathol. 2008;17:179–193.
[7] American Psychiatric Association. Diagnostic and statistical [23] Wilkinson KM, Snell J. Facilitating children's ability to disti-
manual of mental disorders. 5th ed. Washington (DC): guish symbols for emotions: the effects of background color
American Psychiatric Association; 2013 cues and spatial arrangement of symbols on accuracy and
[8] Mirenda P, Iacono T, Autism spectrum disorders and AAC. speed of search. Am J Speech Lang Pathol. 2012;20:288–301.
Baltimore: Paul H. Brookes Pub; 2009. [24] Wilkinson KM, Jagaroo V. Contributions of visual cognitive
[9] Ganz JB, Earles-Vollrath TL, Heath AK, et al. A meta-analysis science to AAC system display design. Augmen Altern
of single case research studies on aided augmentative and Commun. 2004;20:123–136.
alternative communication systems with individuals with [25] Huist A, McCarthy J, Teaching graphic symbols to children
autism spectrum disorders. J Autism Dev Disord. 2012; with complex communication needs through video and
42:60–74. play. Paper presented at: International Society for
[10] Mirenda P. Autism, Augmentative and Alternative Augmentative and Alternative Communication biennial
Communication and Assistive Technology: What do we meeting; 2012; Pittsburgh, PA.
really know? Focus Autism Other Dev Disabil. 2001; [26] The Center for AAC and Autism. LAMP: Language Acquisition
16:141–151. through Motor Planning. Wooster (OH); 2006.
DESIGN PRINCIPLES OF AAC APPS 365

[27] Wilkinson KM, Light J, Drager K. Considerations for the [Internet]. [Cited 2017 Jan 15]. Available from: http://
composition of visual scene displays: Potential contribu- praacticalaac.org/praactical/one-mobile-device-or-two-
tions of information for visual and cognitive sciences. things-to-consider-about-ipadstablets-as-communication-
Augment Altern Commun. 2012;23:137–147. devices/.
[28] Zangari C. One mobile device or two? Things to consider
about iPads/Tablets as communication devices
Copyright of Disability & Rehabilitation: Assistive Technology is the property of Taylor &
Francis Ltd and its content may not be copied or emailed to multiple sites or posted to a
listserv without the copyright holder's express written permission. However, users may print,
download, or email articles for individual use.

You might also like