Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

R E S E A R C H R E P O R T

Functional Symmetry Observation Scale, Version 2: Development and Content


Validation Using a Modified Delphi Method
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

Mary Rahlin, PT, DHS; Joyce Barnett, PT; Bernadette Sarmiento, PT


Rosalind Franklin University of Medicine and Science (Dr Rahlin), North Chicago, Illinois; Ability Occupational Therapy Services, LLC (Ms Barnett),
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

Anchorage, Alaska; Independent Practitioner (Ms Sarmiento), Skokie, Illinois.

Purpose: To describe the development of the Functional Symmetry Observation Scale (FSOS) Version 2 and its content
validation.
Methods: The FSOS Version 2 is an observational assessment that quantifies symmetry in spontaneous movement and
posture in infants with congenital muscular torticollis, age birth to 18 months. Twenty expert pediatric physical therapists
were identified through purposive sampling and invited to participate in a modified Delphi study. Survey data were
collected on Qualtrics. Consensus was evaluated using median ratings and percent agreement on Likert Scale items.
Thematic analysis was performed for open-ended question responses.
Results: Thirteen experts completed Round 1 and 2 surveys. In Round 1, consensus was achieved on all but 1 item. The
scale was modified based on received feedback. In Round 2, consensus was achieved on all items (median rating of 4,
agreement at 85%-100%).
Conclusions: This study established the content validity of the FSOS Version 2. (Pediatr Phys Ther 2022;34:37–44)
Key words: infant, observation, scale, symmetry, torticollis, validity

INTRODUCTION AND PURPOSE careful observation of asymmetry is recommended by the CMT


One of the priority areas of the Academy of Pediatric Phys- evidence-based clinical practice guideline,2 until now, there
ical Therapy research agenda 2018-2020 was to “develop and have been no torticollis-specific assessment instruments vali-
refine measurement tools to identify impairments and monitor dated for an observational evaluation targeting the infant’s use of
changes in the musculoskeletal, neuromuscular, and cardiores- both sides of the body during spontaneous movement and play.
piratory systems.”1 Infants with congenital muscular torticollis Still photography is used to assess the habitual head devi-
(CMT) frequently present with postural and functional asym- ation from midline,3 the Muscle Function Scale captures the
metry attributed to the impairments of the musculoskeletal imbalance in the neck lateral flexor musculature,4 and the
and neuromuscular systems.2-5 Besides the characteristic asym- arthrodial protractor measurements are helpful in documenting
metrical head posturing, usually with neck lateral flexion the differences in cervical rotation and lateral flexion range
to one side and head rotation to the opposite side, infants of motion.6 However, none of these 3 instruments allows the
with CMT typically demonstrate restricted cervical range of examiner to capture the infants’ spontaneous adaptations of
motion and asymmetrical use of the trunk and upper and movement and posture to task and environment without restric-
lower extremities when engaged in functional tasks.2-5 Although tions imposed on them by physical handling.3,4,6 Furthermore,
none of these instruments captures the entire range of motor
behaviors that are observed in the infant’s body, in addition to
the head and neck.3,4,6 The first observational outcome measure
0898-5669/110/3401-0037
Pediatric Physical Therapy
that addressed these problems, a short form of the Functional
Copyright © 2021 Academy of Pediatric Physical Therapy of the American Symmetry Observation Scale (FSOS), was developed for a ran-
Physical Therapy Association domized clinical trial of 2 interventions for infants with CMT.5,7
The FSOS Version 1 was a 1-page video-based assessment
Correspondence: Mary Rahlin, PT, DHS, Department of Physical Therapy,
instrument that consisted of 9 items (Hand to Mouth, Head
Rosalind Franklin University of Medicine and Science, 3333 Green Bay Rd,
North Chicago, IL 60064 (Mary.Rahlin@rosalindfranklin.edu). Rotation, Head Righting, Trunk Incurvation, Functional Upper
Supplemental digital content is available for this article. Direct URL cita-
Extremity Use, Lower Extremity Position/Movement, Movement
tions appear in the printed text and are provided in the HTML and PDF Transitions, Prone Mobility, and Upright Mobility). Each item
versions of this article on the journal’s Web site (www.pedpt.com). was scored on a 5-point ordinal scale from 0 to 4, with 0 desig-
The authors declare no conflicts of interest. nated as “not observed,” and the score of 4 assigned to the equal
DOI: 10.1097/PEP.0000000000000847 use of both sides of the body.5 Scores 1 through 3 quantified
the amount of asymmetry by the percentage of time unequal

Pediatric Physical Therapy Functional Symmetry Observation Scale, Version 2 37

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
use of both sides of the body was observed. The infant’s pos- inal FSOS Version 2 Record Form and its Individual Score
ture and movement were video recorded in 4 positions (supine, Descriptors, respectively.
prone, sitting, and standing). Each item was scored based on
the infant’s performance in all 4 positions while using a set of
individual score descriptors. Content Validation of the FSOS Version 2
The intrarater reliability of the FSOS Version 1 was This was an online survey study that employed modi-
examined in a small pilot study of 20 observations (intra- fied Delphi methodology8,9 to build consensus among a group
class correlation coefficient [ICC](3,1) = 0.91, 95% confidence of experts. Delphi methodology uses several rounds of open-
interval: 0.79-0.96). Some difficulties with following the video ended questionnaires to generate consensus among experts who
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

recording procedure were reported. In addition, the require- remain anonymous to each other, and to obtain and refine group
ment that the examiner estimate the percent of time that opinions on a topic while considering the individual views
asymmetry was observed across all 4 positions, and not in each of each participant. After the first survey round, researchers
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

position separately, made the score assignment process chal- analyze the feedback received from the expert panel and for-
lenging. The results suggested the need for a more detailed form mulate the questions to be used in the second round. The
of this instrument and for further standardization of its video feedback summary is shared with the participants between
recording procedure.5 the survey rounds. This process continues until consensus is
The purpose of this article is to describe the development achieved.8,9 Delphi surveys have been used in a variety of
of the FSOS Version 2 and to report on content validation and research areas, including the development and validation of
refinement of this scale using a modified Delphi method.8,9 outcome measures.11-13
In the current study, we aimed to establish the content
validity of the FSOS Version 2, as defined by Portney and
METHODS Watkins,14 by determining, via expert opinion, that its indi-
Development of the FSOS Version 2 vidual sections adequately sampled the entire set of postures
and movements physical therapists typically observe in infants
The FSOS Version 2 was developed through a series of mod-
with CMT in each of the test positions, and that the Individual
ifications applied to the first version of the scale. As the FSOS
Score Descriptors accurately reflected the entire range of motor
Version 1, its Version 2 was designed as an observational assess-
behaviors represented by the test items.
ment instrument for infants with CMT, age range birth to 18
One of the modifications to the classical Delphi method8,15
months. Both versions of the scale target the body structures
was made because this study examined an already existing scale.
and functions, and activity components of the International
Instead of an open-ended questionnaire typically used in a
Classification of Functioning, Disability, and Health (ICF)10 by
Delphi study with an aim to develop a new instrument,9,16 our
assessing the spontaneous movement and posture in infants
survey included a combination of Likert Scale items and open-
engaged in functional tasks. Similar to Version 1, the FSOS,
ended follow-up questions that invited the experts to explain the
Version 2 is a video-based assessment, with a 5- to 10-minute
ratings they selected and provide suggestions for improvement.
recording made using a standardized procedure and scored at
The second modification was that we planned an additional
a later time, with each item to be assessed on a 5-point ordinal
intermediate step for a designated researcher to contact a spe-
scale from 0 to 4 using a set of individual score descriptors. How-
cific expert or experts individually when a clarification of their
ever, while the FSOS Version 1 had been focused on the amount
answers was deemed necessary based on the collected survey
of observed asymmetry,5 Version 2 scoring criteria were modi-
responses. Such contact could occur via e-mail or Internet-based
fied to quantify symmetry in the use of both sides of the body as
audio- or videoconferencing.
the desired outcome of intervention for infants with CMT, with
Consensus on each Likert Scale questionnaire item was
the total score to be calculated as the sum of 4 positional scores.
defined as a 75% or greater agreement among respondents in
The 1-page FSOS Version 1 Record Form was modified to
assigning a rating of 3 or greater to that item on a 4-point
include a separate page for each of the 4 positional sections
scale, with 1 designated as “strongly disagree” and 4 as “strongly
of the new instrument (supine, prone, sitting, and standing),
agree.”16 The absence of a neutral answer option encouraged the
with each section containing 8 items. The first 7 items were
experts to select a more definitive response.11
identical to those in the FSOS Version 1, except for the Head
Two survey rounds were planned, with an option to include
Righting item, which was replaced with Head Lateral Flexion
only one additional round, if necessary, because large changes
to reflect both the infant’s habitual head position at rest and
leading to consensus typically occur between Rounds 1 and 2.11
active antigravity movement of the head. The eighth item was
In each round, the experts received a link to an online Qualtrics
designated for the method of mobility specific to each posi-
survey via e-mail, with attached documents to review, and had
tional section (Supine Mobility/Scooting, Prone Mobility, Sitting
3 weeks to enter their answers.16 The study flow is depicted in
Mobility/Scooting, and Upright Mobility).
the Figure.
Finally, the Individual Score Descriptors were modified to
reflect the changes made to the FSOS Record Form, including
the scoring criteria, item renaming, and inclusion of the new Participants
mobility items. Supplemental Digital Content 1 (available at: This study was approved by the Institutional Review
http://links.lww.com/PPT/A343) and 2 (available at: http:// Board. Purposive sampling was used to identify the potential
links.lww.com/PPT/A344) represent the first page of the orig- participants9 who were known to the researchers through their
38 Rahlin et al Pediatric Physical Therapy

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
Introductory E-mail sent Although some of the experts knew each other, their identity
Recruitment completed in 3
to 20 potential expert weeks
was not disclosed within the group, and their survey responses
group participants,
Interest in participating were presented only in aggregate in the Results and Feedback
followed by 2 weekly Summary documents they received after each round. At the end,
expressed by 14 experts
reminders
all participants were asked and gave permission via e-mail for
their names to be acknowledged in a publication or presentation
FSOS Version 2 Record of the study results.
Form, Score Data collected for 3 weeks
Descriptors, and Round Survey completed by 13
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

1 Survey link sent to 14 experts Survey Content and Data Analyses


experts, followed by 2
weekly reminders
The Round 1 survey asked the participants for their names
Consensus achieved on all but and credentials, their years of experience as a pediatric phys-
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

1 item ical therapist, and the areas of expertise in managing infants


Round 1 Survey data Instrument revisions and User with CMT. After reviewing the FSOS Version 2 Record Form
analysis completed Guide development necessary and its Individual Score Descriptors (see Supplemental Digital
No individual interviews
Content 1, available at: http://links.lww.com/PPT/A343 and 2
required
Round 2 Survey constructed
available at: http://links.lww.com/PPT/A344, respectively), the
Round 1 Expert experts answered a series of questions about the scale struc-
Feedback Summary,
FSOS Version 2 User
ture, content, and scoring criteria, and were invited to make
Guide, revised FSOS Data collected for 3 weeks suggestions for improvement. They were asked to keep in mind
documents, and Round 2 Survey completed by 13 that this instrument targets the child’s spontaneous movement
experts
Survey link sent to 13 and play, and that its administration does not involve physical
experts, followed by 2 assistance or facilitation provided by the therapist or caregiver.
weekly reminders
Consensus achieved on all Based on the participants’ responses to the Likert Scale
items items, the median ratings were identified and percent agree-
Round 2 Survey data One clarification e-mail ment calculated to determine whether consensus was achieved.
analysis completed message sent The open-ended question responses were grouped by their key
No further FSOS Version 2 themes. The results of these analyses guided the revisions made
revisions necessary
to the FSOS documents and the researchers’ response to the
Thank you e-mail, experts’ feedback, and the development of the Round 2 Survey.
All of the experts agreed to be
Round 2 Expert The items on which consensus was achieved in Round 1 were
identified by name in the
Feedback Summary, and
study publications and dropped unless the changes made to the FSOS Record Form
Study Results Summary and the Individual Score Descriptors required that they remain
presentations
sent to 13 experts
in the survey. The documents reviewed by the experts prior to
the completion of the Round 2 Survey are listed in the Figure.
Fig. Study flow and step-by-step outcomes. FSOS indicates Functional Symmetry
The obtained data were analyzed similarly to Round 1.
Observation Scale.

work experience, clinical practice, or research and publication


in the area of management of infants with CMT. Twenty pediatric RESULTS
physical therapists with at least 10 years of clinical, academic, or After receiving an introductory e-mail, 14 of 20 pediatric
research experience and expertise in management of infants with physical therapists (70%) expressed interest in participating in
CMT were invited to participate, with a goal to recruit at least this study (Figure). Thirteen of 14 experts completed the sur-
10. This sample size was selected to achieve balance between the veys in Rounds 1 and 2. Table 1 contains the information on the
desire to obtain a robust number of ideas and points of view with participants’ level of education, specialty certification, pediatric
the need for the amount of generated data to be manageable.9 physical therapy experience, and areas of expertise in managing
The selected sample size was comparable with that reported in infants with CMT. The members of the expert group resided
the 54 of 100 Delphi studies reviewed by Diamond et al,17 in in Alaska, Arizona, California, Florida, Georgia, Illinois, New
which the number of participants in the final round ranged from Jersey, and New York, thus representing all of the 5 major
fewer than 10 to 25. geographic regions of the United States.
Informed consent was obtained electronically from those
experts who agreed to take part in the study and checked the
appropriate box after reading the survey preamble. One of the Round 1
experts completed the entire Round 1 survey but did not mark As indicated by data in Table 2, in the Round 1 survey, con-
the box indicating the agreement to participate; however, that sensus among 13 experts was achieved on all but 1 item. The
consent was confirmed via a follow-up e-mail within 1 day of median rating of 3 or greater was obtained on all Likert Scale
the survey completion. questions, with percent agreement ranging from 75% to 100%
The researchers maintained the participants’ quasi- for those on which consensus was reached. The percent agree-
anonymity9 throughout the study. ment was lower than required (69%) for the item that examined

Pediatric Physical Therapy Functional Symmetry Observation Scale, Version 2 39

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
TABLE 1 Supplemental Digital Content 4, available at: http://links.lww.
Expert Group Characteristics (N = 13) com/PPT/A346). In addition, the FSOS Version 2 User Guide
was developed that contained the scale purpose, design, and
Characteristic n (%)
administration and scoring instructions. The authors’ response
Entry-level PT degree to the experts’ feedback and changes to the instrument imple-
BS 6 (46) mented after Round 1 are listed in Table 3 and displayed in
MS 1 (8) Supplemental Digital Content 3 (available at: http://links.lww.
DPT 6 (46)
Additional academic degrees
com/PPT/A345 and 4 (available at: http://links.lww.com/PPT/
MA, MS, or MBA 5 (38) A346. Specifically, the criteria for assigning the FSOS scores
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

PhD 3 (23) were modified, several items were renamed, and extensive
PCS certification 3 (23) revisions were made to the Individual Score Descriptors.
Experience as a pediatric physical therapist, y
19 1 (8)
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

22-30 6 (46)
Round 2
40-48 6 (46)
Areas of expertise in management of infants with CMT As indicated by data in Table 4, in Round 2, consensus
Clinical 12 (82) among 13 experts was achieved on all Likert Scale items, with
Academic 4 (31)
the median rating of 4 obtained throughout, and percent agree-
Research 5 (38)
ment ranging from 85% to 100%. One participant marked
Abbreviations: BS, bachelor of science; CMT, congenital muscular torticollis; “strongly disagree” in response to the question regarding the
DPT, doctor of physical therapy; MA, master of arts; MBA, master of business extent to which the experts agreed that the criteria for assigning
administration; MS, master of science; PCS, board-certified clinical specialist
in pediatric physical therapy; PhD, doctor of philosophy.
the FSOS scores listed in the Record Form were clearly stated.
Because no comment was provided for that rating, a follow-up
e-mail asking for clarification was sent, and the expert replied
the criteria for assigning the FSOS scores. Three researchers that the response should have been “strongly agree.”
reviewed the experts’ comments and identified 10 major themes The major themes identified in the open-ended question
listed in Table 3. The participants’ answers to survey ques- responses included the appreciation of the following improve-
tions did not suggest the need for individual interviews, and, ments to the instrument: clarity of the score assignment criteria,
therefore, none were conducted (Figure). a greater ease of differentiation between the scores of 2 and 3, the
These results guided the revisions to the FSOS Record Form scale’s ability to quantify the amount of symmetry observed in an
(see Supplemental Digital Content 3, available at: http://links. infant with CMT, and clarity and scope of the Individual Score
lww.com/PPT/A345) and the Individual Score Descriptors (see Descriptors. In addition, the experts expressed their excitement

TABLE 2
Status of Consensusa Among Experts on Likert Scale Questions: Round 1 (N = 13)

Questions Median Percent of Consensus


Please rate the extent to which you agree that: Rating Ratings ≥3 Reached

The FSOS items in the supine section represent the entire set of postures and movements physical therapists 3 100% Yes
typically observe in infants with CMT in that position
The FSOS items in the prone section represent the entire set of postures and movements physical therapists 4 92% Yes
typically observe in infants with CMT in that position
The FSOS items in the sitting section represent the entire set of postures and movements physical therapists 3 85% Yes
typically observe in infants with CMT in that position
The FSOS items in the standing section represent the entire set of postures and movements physical therapists 4 92% Yes
typically observe in infants with CMT in that position
The criteria for assigning the FSOS scores (0-5) listed on the Record Form are clearly stated. 3 69% No
The FSOS scoring criteria adequately quantify the amount of symmetry an infant with CMT may demonstrate. 3 92% Yes
The Individual Score Descriptors are clearly stated. 3 87% Yes
The Individual Score Descriptors accurately reflect the entire range of motor behaviors represented by each of
the FSOS items listed below:
• Hand to mouth 4 85% Yes
• Head rotation 4 92% Yes
• Head lateral flexion or head righting 4 92% Yes
• Trunk incurvation 4 92% Yes
• Upper extremity use 4 82% Yes
• Lower extremity position/movement 4 92% Yes
• Movement transitions 4 92% Yes
• Supine or prone mobility 4 92% Yes
• Sitting or upright mobility 4 75% Yes

Abbreviations: CMT, congenital muscular torticollis; FSOS, Functional Symmetry Observation Scale.
a Consensus on each Likert Scale questionnaire item was defined as a 75% or greater agreement among experts in assigning a rating of ≥3 to that item, with 1

designated as “strongly disagree” and 4 as “strongly agree.”

40 Rahlin et al Pediatric Physical Therapy

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
TABLE 3
Round 1 Feedback Themes, Authors’ Responses, and Changes Implemented to the Functional Symmetry Observation Scale Version 2

Feedback Themes Authors’ Response/Implemented Changes

1. Excitement about the new scale and its potential benefits, and N/A
suggestions for future validation of the FSOS for other patient
populations
2. Insufficient clarity of the FSOS design, administration, and scoring • Reminded participants that the FSOS was a video-based assessment and
acknowledged that this had not been emphasized in the Round 1 survey
preamble
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

• Emphasized the lack of a penalty for the items that are not observed during the
FSOS administration as stated in the scoring instructions on each page of the
FSOS Record Form
• Developed the FSOS User Guide containing the scale purpose, design, and
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

administration and scoring instructions


3. Comments related to the FSOS score range being 0 to 4, not 0 to 5 • Apologized for the error in the wording of this survey question
as stated in the question asking to rate the score assignment criteria • Clarified that the FSOS is scored on a 5-point scale, from 0 to 4
4. Difficulty differentiating between the scores of 2 and 3 based on the • Adopted a new wording which was still based on the observation frequency
percentage of observation time; proposed alternative options for but without the need to estimate the percentage of time a posture or
the descriptors of scores 1-4 movement is observed
• Modified the FSOS Record Form and Individual Score Descriptors for all scale
items accordingly
5. Limited utility of the “hand to mouth” item; issues with the “upper • Moved the “hand to mouth” item after the “upper extremity use,” and
extremity use” item scoring and score descriptors; requests to combined it with object manipulation into a “hand use” item
include object manipulation under “upper extremity use” • Renamed the “upper extremity use” item as “arm use”
• Eliminated the percentage of observation time from the Individual Score
Descriptors
6. Requests for clarification of the head rotation score descriptors; • Modified the Individual Score Descriptors for the head rotation item to
requests for inclusion of the amount of head extension and flexion simplify scoring
into the head rotation score descriptors • Emphasized head rotation and lateral flexion as the major determinants of
symmetry in head movements
• Clarified that the FSOS is not intended to be used for differential diagnosis but
rather to identify the lack of and quantify the amount of observed symmetry
7. Observations related to head lateral flexion, head righting, and head • Renamed this item as “head lateral flexion and lateral head righting,” with its
tilt, and requests for clarification of how these terms should be new definition provided in the second column of the Individual Score
interpreted Descriptors document.
• Modified the Individual Score Descriptors for this item to simplify scoring
8. Requests to include the symmetry of weight-bearing through trunk • Clarified the “trunk incurvation” item as an observation that is made in the
in supine and prone positions, weight-bearing through pelvis in frontal plane and defined as the elongation on one side of the trunk and
sitting; and suggestions to add trunk rotation to the “trunk shortening on the other, which can be observed with or without trunk rotation
incurvation” item • Explained that the FSOS is not intended to be used for differential diagnosis,
including when triplanar motions are observed, nor is it intended to measure
range of motion
• Explained that the FSOS is intended to easily identify and quantify postural
and functional symmetry or lack thereof
9. Requests to include additional positions • Clarified that the FSOS uses 4 positions (supine, prone, sitting, and standing),
in which different postures (configurations of body parts) and movements are
observed
• Renamed prone position as prone/quadruped
• Modified the definition of the “movement transitions” item to “transitioning
from an observed position to any other”
10. Relationship between the FSOS items and infant development • Clarified that its focus on postural and functional symmetry makes the FSOS
Version 2 distinct from the tests and measures that document the
developmental milestones achieved by the infant or target range of motion,
strength, or muscle tone
• Explained that this instrument is intended to quantify observed symmetry in
posture and movement regardless of the infant’s age or level of development,
and that this intent is reflected in its Individual Score Descriptors.
Abbreviation: FSOS, Functional Symmetry Observation Scale.

regarding the future clinical use of the FSOS and provided Digital Content 3 (available at: http://links.lww.com/PPT/A345
suggestions for future research. The thematic analysis of the and 4 (available at: http://links.lww.com/PPT/A346.
participants’ comments indicated that no further revisions to
the FSOS Version 2 were necessary. This information, together
with the Rounds 1 and 2 Results Summary, was conveyed to the Final Draft of the FSOS Version 2
experts via e-mail. The description of the final draft of the FSOS As stated previously, the FSOS Version 2 is an observational,
Version 2 is provided next and accompanied by Supplemental video-based assessment instrument, which allows the examiner

Pediatric Physical Therapy Functional Symmetry Observation Scale, Version 2 41

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
TABLE 4
Status of Consensusa Among Experts on Likert Scale Questions: Round 2 (N = 13)

Questions Median Percent of Consensus


Please rate the extent to which you agree that: Rating Ratings ≥3 Achieved

The criteria for assigning the FSOS scores (0-4) listed on the Record Form are clearly stated 4 92% Yes
The FSOS scoring criteria adequately quantify the amount of symmetry an infant with CMT may demonstrate 4 92% Yes
The Individual Score Descriptors are clearly stated 4 92% Yes
The Individual Score Descriptors accurately reflect the entire range of motor behaviors represented by each of
the FSOS items listed below:
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

• Head rotation 4 100% Yes


• Head lateral flexion and head righting 4 92% Yes
• Trunk incurvation in frontal plane 4 100% Yes
• Arm use 4 100% Yes
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

• Hand use 4 100% Yes


• Lower extremity use 4 85% Yes
• Movement transitions 4 100% Yes
• Supine or prone/quadruped mobility 4 100% Yes
• Sitting or upright mobility 4 100% Yes

Abbreviations: CMT, congenital muscular torticollis; FSOS, Functional Symmetry Observation Scale.
a Consensus on each Likert Scale questionnaire item was defined as a 75% or greater agreement among experts in assigning a rating of ≥3 to that item, with 1

designated as “strongly disagree” and 4 as “strongly agree.”

to capture the infants’ spontaneous adaptations of movement sides of the body (see Supplemental Digital Content 3, avail-
and posture to task and environment without any restrictions able at: http://links.lww.com/PPT/A345). The score of 0 (“not
imposed on them by physical handling. The FSOS Version 2 observed”) indicates that the infant did not demonstrate a spe-
User Guide that will be included with the tool once it becomes cific movement during the assessment. The number of items that
available to clinicians and researchers contains the following were not observed does not affect the positional score.
description of the standardized video recording procedure: The finalized scale items include Head Rotation, Head Lat-
The test set-up includes a safe, padded observation area eral Flexion and Head Righting, Truck Incurvation, Arm Use,
(therapy mat, soft carpeting, etc) bordered on one side with a Hand Use, Lower Extremity Use, Movement Transitions, and
stable elevated support surface (cube chairs, sofa, low table, etc). Mobility in a specific position (see Supplemental Digital Con-
The elevated area provides an opportunity for the infant to pull tent 3, available at: http://links.lww.com/PPT/A345). The first
to stand and take multiple cruising steps to both sides. Addi- column of the Individual Score Descriptors form (see Supple-
tional necessary equipment includes a video camera, a tripod, mental Digital Content 4, available at: http://links.lww.com/
and age-appropriate toys to be used to encourage looking, PPT/A346) includes the scale items, with Item 8 (Mobility)
reaching, movement transitions, and independent mobility. divided into 2 sections: (a) supine or prone/quadruped mobility
The examiner positions the camera to capture the entire and (b) sitting or upright mobility. The second column lists
observation area and guides the caregiver to do the following: the definitions of the FSOS items intended to guide the related
observations by the examiner. The rest of the form contains
Undress the infant to the diaper or onesie.
the FSOS scores 1 through 4, and their individual descrip-
Place the infant within the observation area for filming in
tors customized for each of the 8 items. The Individual Score
each of the 4 positions.
Descriptors form is intended to guide the examiner’s selection of
Provide appropriate manual trunk support in sitting and
the appropriate score on the FSOS Record Form while watching
standing positions when necessary for the infant’s skill
the video recording of the infant’s posture and movement. The
level.
scoring instructions are provided in every positional section of
Use toys, sounds, and other stimuli (but not physical han-
the Record Form (see Supplemental Digital Content 3, available
dling) to encourage visual tracking and spontaneous
at: http://links.lww.com/PPT/A345), and the FSOS total score is
movement to both sides in each of the 4 positions to test
obtained by adding the positional scores.
as many of the scale items in each position as appropriate
for the infant’s skill level.
Maintain the infant within the observation area throughout DISCUSSION
filming and reposition to capture all necessary views in
In this article, we described the development of the FSOS
each position.
Version 2 that quantifies symmetry in posture and sponta-
The FSOS Version 2 Record Form consists of 4 positional neous, unrestricted movement observed in infants with CMT,
sections (supine, prone/quadruped, sitting, and standing). Each and reported the results of its content validation conducted
section includes 8 items scored on a 5-point ordinal scale using a modified Delphi method. Only 2 survey rounds were
(0-4), with 1 indicating the absence of symmetry character- necessary to achieve consensus among experts on all items,
ized by consistent use of one and the same side of the body which established the content validity of this instrument. Exten-
by the infant, and 4 indicating consistent, equal use of both sive modifications of the Record Form and Individual Score

42 Rahlin et al Pediatric Physical Therapy

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
Descriptors were undertaken after Round 1, and the FSOS User CMT during spontaneous movement and play, but also, as sug-
Guide was developed. The User Guide clarified for the experts gested by one of the experts, to educate their parents/caregivers
that the focus of the FSOS Version 2 on postural and functional about the behaviors infants develop because of this condi-
symmetry makes this instrument distinct from the tests and tion. Additional potential uses of this instrument will be to
measures that document the developmental milestones achieved track the child’s progress over time and evaluate and compare
by the infant or target range of motion, strength, or muscle tone. intervention outcomes in future research studies.
Such measures may assist clinicians in determining the possible
reasons for the lack of postural and functional symmetry that CONCLUSIONS
the FSOS identifies and quantifies.
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

The FSOS Version 2 is the first observational instrument


The inherent reliability and validity concerns of the Delphi
that quantifies symmetry in spontaneous posture and movement
method9 need to be discussed in relation to the current study.
in infants with CMT engaged in functional tasks. Its content
According to Hasson et al,9 the reliability may be questioned
validity has been established by a panel of experts using a mod-
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

because it is not known whether the same results may be


ified Delphi method. Further studies are necessary to bring this
obtained when the same information is provided to several
instrument to the clinic, expand its use to other patient popu-
expert panels. One way to address this issue may be by ensuring
lations, and allow for its application as an outcome measure in
the replicability of the study procedure. This may be accom-
intervention efficacy research.
plished by proper reporting of the study aim, sampling method
and criteria, the definition of consensus, the modifications to
the classical Delphi process, the criteria for dropping the survey ACKNOWLEDGMENTS
items in successive rounds, and to what extent the planned
steps were implemented.9,17 We believe that we followed these The authors would like to thank the members of the expert
recommendations. Additionally, the validity of results may be panel who participated in this study, including Elaine Becker,
affected by the survey response rates.9 In the current study, PT, DPT, MA, PCS; Colleen Coulter, PT, DPT, PhD, MA; Char-
the response to the introductory e-mail was high (70%); 13 of lene Fregosi, PT; Patricia Gallo, PT, MA; Nancy Haney, PT, MS;
14 experts who expressed their interest in participating (93%) Sandra L. Kaplan, PT, DPT, PhD, FAPTA; Magdalena Oledzka,
completed the Round 1 survey, and 100% of them finished the PT, DPT, PhD, MBA, PCS; Lisa Pinson, PT, DPT; Mary Pomeroy,
study. Furthermore, the fact that the expert panel in our study PT; Joanne Pygon, PT, DPT, PCS; Lisa N. Scher, PT; Monica
included highly-qualified individuals (Table 1) strengthened Sheppard, MS PT; and Myla Teemer, PT. We appreciate all of
the validity of results. their time, effort, attention to detail, opinions, comments, and
Although the content validity of the FSOS Version 2 has suggestions that contributed greatly to the refinement of the
been established, further research is necessary before this test FSOS Version 2 and validation of its content.
can be used in the clinic. Based on our original plan for estab-
lishing the psychometric properties of this instrument and REFERENCES
the comments received from the expert panel participants,
suggestions for future research include the following steps: 1. Christy JB, Sargent B, DeJong S, Lobo M, O’Shea R, Fetters L.
APTA, Academy of Pediatric Physical Therapy (APPT) Research Agenda
1) Pilot test the FSOS Version 2 to examine the feasibility 2018-2020. https://pediatricapta.org/pdfs/APTA-Pediatrics-Research-
of its clinical use in infants with CMT. Agenda.pdf. Accessed January 17, 2021.
2. Kaplan SL, Coulter C, Sargent B. Physical therapy management of con-
2) Examine the intra- and interrater reliability of this genital muscular torticollis: a 2018 evidence-based clinical practice
instrument. guideline from the APTA Academy of Pediatric Physical Therapy. Pediatr
3) Examine the construct validity of the FSOS Version 2 by Phys Ther. 2018;30(4):240-290.
determining whether infants with greater limitations in 3. Rahlin M, Sarmiento B. Reliability of still photography measuring
cervical range of motion or greater habitual head devia- habitual head deviation from midline in infants with congenital
muscular torticollis. Pediatr Phys Ther. 2010;22(4):399-406.
tion from midline measured by still photography score 4. Öhman AM, Nilsson S, Beckung ERE. Validity and reliability of the
lower on this test. Muscle Function Scale, aimed to assess the lateral flexors of the neck
4) Compare the FSOS Version 2 scores obtained by clini- in infants. Physiother Theory Pract. 2009;25(2):129-137.
cians new to working with infants with CMT and those 5. Rahlin M, Haney N, Barnett J. Development and Intrarater Reliability
who are experienced in this area of practice. of Functional Symmetry Observation Scale for Infants with Congenital
Muscular Torticollis. Poster presented at: APTA NEXT 2019; Chicago,
5) Develop a “live” scoring procedure and compare its feasi- IL: June 2019.
bility and reliability to that of a video-based assessment. 6. Öhman AM, Beckung ER. Reference values for range of motion and
6) Examine the FSOS Version 2 responsiveness to change muscle function of the neck in infants. Pediatr Phys Ther. 2008;20(1):
with intervention. 53-58.
7) Validate this instrument for use in children with condi- 7. Rahlin M, Haney N, Barnett J. Comparison of perception-action
approach and passive stretching interventions for infants with congen-
tions other than CMT that are characterized by decreased ital muscular torticollis: a single-blind randomized clinical trial. https:
postural and functional symmetry. //clinicaltrials.gov/ct2/show/NCT02824848?term=Rahlin&rank=2.
Updated May 12, 2020. Accessed January 17, 2021.
Once the FSOS Version 2 is properly piloted and its reli- 8. Humphrey-Murto S, Varpio L, Gonsalves C, Wood TJ. Using con-
ability is established, it can be used clinically not only to sensus group methods such as Delphi and Nominal Group in medical
document the amount of symmetry exhibited by infants with educational research. Med Teach. 2017;39(1):14-19.

Pediatric Physical Therapy Functional Symmetry Observation Scale, Version 2 43

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.
9. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi 14. Portney LG, Watkins MP. Validity of Measurements. In: Portney
survey technique. J Adv Nurs. 2000;32(4):1008-1015. LG, Watkins MP, eds. Foundations of Clinical Research Applications to
10. World Health Organization. International Classification of Functioning, Practice. 3rd ed. Philadelphia, PA: F.A. Davis Company; 2015: 97-
Disability and Health. Geneva, Switzerland: World Health Organization; 118.
2001. 15. Hanafin S. Review of literature on the Delphi Technique.
11. de Villiers MR, de Villiers PJT, Kent AP. The Delphi technique in health https://www.academia.edu/4609242/Review_of_literature_on_the_
sciences education research. Med Teach. 2005;27(7):639-643. Delphi_Technique. Accessed January 22, 2021.
12. Ardolino EM, Mulcahey MJ, Trimble S, et al. Development and initial 16. Hsu C-C, Sandford BA. The Delphi technique: making sense of
validation of the Pediatric Neuromuscular Recovery Scale. Pediatr Phys consensus. Pract Assessment Res Eval. 2007;12(10):1-8.
Ther. 2016;28(4):416-426. 17. Diamond IR, Grant RC, Feldman BM, et al. Defining con-
13. Palisano RJ, Rosenbaum P, Bartlett D, Livingston MH. Content validity sensus: a systematic review recommends methodologic criteria
Downloaded from http://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1A

of the expanded and revised Gross Motor Function Classification for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401-
System. Dev Med Child Neurol. 2008;50(10):744-750. 409.
WnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC4/OAVpDDa8KKGKV0Ymy+78= on 10/22/2023

44 Rahlin et al Pediatric Physical Therapy

Copyright © 2021 Academy of Pediatric Physical Therapy of the American Physical Therapy Association.
Unauthorized reproduction of this article is prohibited.

You might also like