Professional Documents
Culture Documents
Factor Analysis To Evaluate Hospital Resilience
Factor Analysis To Evaluate Hospital Resilience
Factor Analysis To Evaluate Hospital Resilience
Abstract: Health care facilities should be able to quickly adapt to catastrophic events such as natural and human-made disasters. One way to
reduce the impacts of extreme events is to enhance a hospital’s resilience. Resilience is defined as the ability to absorb and recover from
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
hazardous events, containing the effects of disasters when they occur. The goal of this paper is to propose a fast methodology for quantifying
disaster resilience of health care facilities. An evaluation of disaster resilience was conducted on empirical data from tertiary hospitals in the
San Francisco Bay area. A survey was conducted during a 4-month period using an ad hoc questionnaire, and the collected data were analyzed
using factor analysis. A combination of variables was used to describe the characteristics of the hidden factors. Three factors were identified
as most representative of hospital disaster resilience: (1) cooperation and training management; (2) resources and equipment capability; and
(3) structural and organizational operating procedures. Together they cover 83% of the total variance. The overall level of hospital disaster
resilience (R) was calculated by linearly combining the three extracted factors. This methodology provides a relatively simple way to evaluate
a hospital’s ability to manage extreme events. DOI: 10.1061/AJRUA6.0000952. © 2018 American Society of Civil Engineers.
Author keywords: Resilience evaluation; Factor analysis; Emergency; Disaster; Hospital; Performance.
© ASCE 04018002-1 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
Fig. 1. Tertiary hospitals in the San Francisco’s Bay Area (map data ©2017 Google)
State of the Art efficiency using factor analysis. They also provided indexes to
evaluate hospital financial status and make a comparison in terms
Factor analysis is a multivariate statistical approach commonly of stability between the outcomes from factor analysis and the date
used to investigate how many latent variables underlie a set of envelopment analysis (DEA), a traditional method to evaluate the
items. Historically, factor analysis was used primarily in psychol- efficiency of public sectors.
ogy and education; however, its use within the health science sector In this paper, a fast and simple methodology is proposed to
has become much more common during the last two decades evaluate a hospital’s ability to manage extreme events. In particular,
(Williams et al. 2010). Reducing the data to a smaller set of var- the method identifies the main factors that define hospital resilience
iables could help in understanding some aspects of hospitals’ during an emergency to take actions to increase the overall level of
behavior during an emergency. Indeed, the primary aim of hospital resilience of the hospital system.
planners during a crisis should not be trying to create plans for even
more contingencies, since contingencies are numerous, but rather
to create capabilities for resilience (Stemberg 2003). Bruneau et al. Methodology
(2003) define a resilient system as a system that reduces failure
probabilities, limits consequences from failures and decreases time In this research, a study was conducted on tertiary hospitals located
to restore a normal level of functional performance. A conceptual in the San Francisco Bay area in California. Tertiary hospitals are
understanding of hospital resilience is essential for an integrated referral hospitals that provide comprehensive and multidisciplinary
approach to enhance hospital resilience to cope with future disas- care that requires highly specialized equipment as well as full
ters (Cimellaro et al. 2010, 2016). A similar concept was presented departmentalization and facilities with the service capabilities.
recently and applied at the country and state levels (Kammouh A questionnaire with 33 questions (Supplemental Data) was devel-
et al. 2017). oped to collect relevant data for the hospitals’ resilience analyses.
Several researchers are aware of the utility to adopt factor analy- The survey was conducted between April 2014 and July 2014.
sis to analyze guidelines associated with hospital emergency man- Among all the selected hospitals in San Francisco’s Bay area, 16
agement (Pett et al. 2003). For example, O’Malley et al. (2005) complete questionnaires were collected, representing an approxi-
analyzed the quality of care and service in hospitals using factor mate 71% response rate. The locations of the analyzed hospitals
analysis and tried to identify the important dimensions of health are shown in Fig. 1.
care to improve hospital quality. Cimellaro et al. (2010b) analyzed The survey was conducted by interviewing the hospital’s emer-
the seismic resilience of a hospital network located in the United gency staff or by sending the questionnaire by e-mail. For each
States using an analytical function that is based on a loss estimation hospital, a person who is familiar with the emergency plan was
performance indicator. selected for filling out the questionnaire (in most cases, the director
Later, Nakajima et al. (2012) analyzed public hospitals in Japan of the emergency department or someone designated by that
in terms of financial managements, medical services, and cost person). All the selected hospitals were informed about the research
© ASCE 04018002-2 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
goals and developments. Before starting the factor analysis, the col- where zj ¼ jth standardized variable; F1 ; F2 ; : : : ; Fn = common
lected questionnaires were reviewed to check their completeness factors independent and orthogonal each other (with m < n); and
and consistency. kjh = calculated coefficients. Then, applying the inverse factor
model, it is possible to obtain the factors’ equations as a linear
Description of the Questionnaire combination of the original variables
The questionnaire consisted of 33 questions grouped in eight sec- F1 ¼ c11 z1 þ c12 z2 þ · · · þ c1n zn
tions. All the questions are in multiple choice format, for which the
only two possible answers are yes or no. Yes answers received a F2 ¼ c21 z1 þ c22 z2 þ · · · þ c2n zn
score of 1, and no answers received a score of 0. The answer ···
yes represents the hospital’s ability to resist and absorb the shock
of disasters, whereas the answer no is related to a less-resilient Fm ¼ cm1 z1 þ cm2 z2 þ · · · þ cmn zn ð2Þ
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE 04018002-3 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
Table 2. Communalities each approach is beyond the scope of this paper; however in most
Variable Extraction cases, these two methods usually yield very similar results.
Hospital safety (a) 0.869
Hospital disaster leadership and cooperation (b) 0.929 Rotating the Factor Structure
Hospital disaster plan (c) 0.834
The rotation phase of factor analysis attempts to transform the ini-
Emergency stockpiles and logistics management (d) 0.891
Emergency staff (e) 0.711
tial matrix in one that is easier to interpret by rotating the factor
Emergency critical care capability (f) 0.752 axes. Typical rotational strategies are varimax, quartimax, and
Emergency training and drills (g) 0.775 equamax. Varimax rotation was used in this research to improve
Recovery and reconstruction (h) 0.910 result analysis and interpretability. In short, varimax rotation is
an orthogonal rotation developed by Kaiser (1960). Analytically,
varimax searches for a rotation (i.e., a linear combination) of the
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE 04018002-4 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
Table 4. Rotated Component Matrix Table 6. Factor Score Coefficient Matrix
Component Component
Variable F1 F2 F3 Variable 1 2 3
Hospital safety (a) 0.479 0.216 0.770 a 0.142 −0.063 0.479
Hospital disaster leadership and 0.947 0.178 0.006 b 0.322 0.006 −0.038
cooperation (b) c 0.135 0.122 −0.579
Hospital disaster plan (c) 0.353 0.014 −0.842 d 0.349 −0.184 −0.032
Emergency stockpiles and logistics 0.919 −0.202 −0.083 e 0.056 0.331 0.010
management (d) f −0.120 0.505 −0.286
Emergency staff (e) 0.359 0.733 0.211 g 0.273 0.059 −0.021
Emergency critical care capability (f) −0.120 0.834 −0.208 h −0.042 0.358 0.172
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
Each of the variables describing the hospital’s behavior after an R ¼ αF1 þ βF2 þ χF3 ð14Þ
emergency was expressed as a linear combination of the extracted
factors, taking into account the weight factors obtained by the com- where F1 , F2 , and F3 = extracted factors, calculated using
ponent matrix shown in Table 5. Eqs. (11)–(13); and α, β, and χ = corresponding weight factors,
Therefore, the eight hospital variables are defined as follows: which were calculated as a ratio between the percentage of variance
corresponding to each factor and the cumulative variance of the
a ¼ 0.7F1 − 0.292F2 − 0.541F3 ð3Þ three main factors. Substituting the numerical values of the weight
factors in Eq. (14), the following expression for hospital disaster
b ¼ 0.877F1 þ 0.4F2 þ 0.002F3 ð4Þ resilience is obtained:
d ¼ 0.643F1 þ 0.676F2 − 0.146F3 ð6Þ The weight for hospital cooperation and training manage-
ment is 0.503, for hospital resource and equipment is 0.311,
e ¼ 0.715F1 − 0.388F2 þ 0.223F3 ð7Þ and for hospital structural and organizational operating proce-
dures is 0.186. This means that the first factor is more relevant
f ¼ 0.259F1 − 0.489F2 þ 0.668F3 ð8Þ to assess the resilience of health care facilities, representing ap-
proximately 50% of the hospital emergency preparedness and
g ¼ 0.842F1 þ 0.255F2 þ 0.029F3 ð9Þ response.
Three levels for hospital disaster resilience were identified. In-
h ¼ 0.624F1 − 0.716F2 þ 0.094F3 ð10Þ deed, when the questionnaire is filled out, each of the eight items
will have an overall score, obtained by summing the scores of each
A performance index to assess hospital resilience was proposed question (with the score 0 or 1). Using these scores, the three ex-
combining the three factors that have different contributions on the tracted factors can be calculated. Knowing the factors’ value, the
overall resilience. hospital disaster resilience index can be obtained using Eq. (15).
The numerical quantification of each factor was determined The R values are in the range of
using the regression analysis based on the factor score coefficient
matrix given in Table 6, which shows the correlation between the 0<R<1 ð16Þ
© ASCE 04018002-5 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
Table 7. Levels of Hospital Disaster Resilience
Parameter Value
Low level of resilience R ≤ 0.25 (25%)
Moderate level of resilience 0.25 < R < 0.75 (25–75%)
High level of resilience R ≥ 0.75 (75%)
1 0.836
2 0.813
3 0.771 Fig. 2. Overall level of resilience in the San Francisco Bay area
4 0.772
5 0.391
6 0.831
7 0.904 Table 9. Extracted Factors Scores for the Considered Hospitals
8 0.818
9 0.871 Hospital F1 F2 F3
10 0.681 1 1 0.48 1
11 0.787 2 0.88 0.71 0.78
12 0.607 3 1 0.52 0.85
13 0.739 4 0.55 0.62 0.93
14 0.663 5 0.67 0.29 0.57
15 0.892 6 1 0.47 0.93
16 0.581 7 0.98 0.76 0.92
8 0.99 0.48 0.94
9 1 0.57 0.93
10 0.78 0.56 0.71
where 0 represents no resilience, and 1 means a maximum level 11 0.89 0.62 0.86
of resilience corresponding to the ability to absorb any damage 12 0.77 0.48 0.64
without suffering complete failure. 13 0.77 0.58 0.92
If the resilience value is greater than 0.75, the hospital has a high 14 0.66 0.53 0.72
level of resilience to emergencies, whereas if the resilience value is 15 0.89 0.71 1
16 0.56 0.57 0.65
below 0.25, the hospital is not able to adequately absorb disastrous
events and reduce the consequences from such failures before,
during, and after the event (Table 7).
Although the resilience indicator given in Eq. (15) gives a global means that there are no health care facilities with an insufficient
description of hospital resilience, the indicators given in Eqs. (11)– level of resilience. These results indicate that the San Francisco
(13) correspond respectively to cooperation and training manage- Bay area’s hospitals have a generally high level of resilience.
ment, resources and equipment capability, and structural and Furthermore, the scores of the three extracted factors were
organizational operating procedures. These additional indicators calculated to identify the areas within the hospital with a lower
can help understand which parts of the hospital system requires resilience level. In fact, the central goal of this research is not
attention to increase its level of resilience. only to provide a measure of the overall resilience level in the
San Francisco Bay area, but also to identify the factors with a lower
level of resilience. This analysis allows focusing on the areas that
Analysis of the Numerical Results need improvement and helps to find information about the most
effective strategies for improving the quality of care. The results
The proposed methodology was applied to each health care facility were standardized so the score range from 0 to 1. The factors’
of the hospital network located in the San Francisco Bay area to values are listed in Table 9.
analyze the level of resilience in the considered geographical region The results were plotted in Fig. 3, which shows the trend of the
considered as the case study. The disaster resilience score was cal- extracted factors (F1 , F2 , F3 ) for each hospital and indicates that
culated for each hospital as listed in Table 8. For confidentiality the three extracted factors have a generally acceptable performance
reasons, hospitals’ names were replaced with a number. level. Among them, factor F2 (resources and equipment capability)
The results were plotted in Fig. 2 representing the resilience has the lowest performance level. Fig. 3 shows clearly that if some
trend of health care facilities in the San Francisco’s Bay area. improvement is to be made to increase the overall level of resilience
The chart was divided into three sections corresponding to of the hospital network, the resource and equipment capability of
the three levels of hospital disaster resilience (low level, moderate the network should be analyzed.
level, high level).
According to Fig. 2, 10 hospitals, which account for approxi-
mately 62.5% of the sample, have an high level of resilience Concluding Remarks
(R ≥ 0.75), whereas six hospitals, representing the remaining
37.5%, are in the moderate resilience zone (0.25 < R < 0.75). Hospitals and other health facilities are vital assets to communities
There are no hospitals whose resilience score is under 0.25, which when a disaster strikes. Therefore, the capacity of a community to
© ASCE 04018002-6 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002
Fig. 3. Overall level of the three extracted factors F1 , F2 , F3
Downloaded from ascelibrary.org by University of Minnesota - Twin Cities on 02/02/18. Copyright ASCE. For personal use only; all rights reserved.
© ASCE 04018002-7 ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng.
ASCE-ASME J. Risk Uncertainty Eng. Syst., Part A: Civ. Eng., 2018, 4(1): 04018002