Professional Documents
Culture Documents
Systemic BIM Adoption: A Multilevel Perspective: Danny Murguia Peter Demian, M.ASCE and Robby Soetanto
Systemic BIM Adoption: A Multilevel Perspective: Danny Murguia Peter Demian, M.ASCE and Robby Soetanto
Abstract: Systemic innovations require multiple interdependent actors to change their practices simultaneously in order to realize the ben-
efits of the innovation. Building information modeling (BIM) has been classified as a systemic innovation that is adopted by building projects,
firms, and users. However, the slow diffusion of BIM in the architecture, engineering, and construction (AEC) sector has maintained the gap
between BIM visions and actual BIM practice. Some governments are planning to enact policies to promote BIM adoption in construction.
Downloaded from ascelibrary.org by Georgia Tech Library on 02/19/21. Copyright ASCE. For personal use only; all rights reserved.
However, in some countries, BIM adoption has already started with large construction organizations (i.e., the middle-out diffusion approach).
To learn from previous experience and before enacting top-down interventions, policymakers require a model to stimulate systemic BIM
adoption for entire supply chains with fragmented project and organizational structures. The current paper investigates the systemic adoption
of digital innovations in construction and is aimed at formulating a model of systemic BIM adoption (MSBA). Three primary datasets
consisting of 133 BIM users, 30 chief executive officers, and 20 project managers were collected in Peru and collectively analyzed using
cross-classified multilevel modeling (CCMM). It was found that MSBA has five user-, three firm-, and two project-level factors, explaining
28%, 75%, and 50% of the variance in users’ BIM adoption, respectively. The proposed model would provide useful guidance for corporate
decision makers and government policymakers to develop BIM-diffusion policies to accelerate adoption. It would also provide a useful
practical implementation framework as the industry progresses toward a digital mode of working and could underpin further digitalization
of the sector worldwide. DOI: 10.1061/(ASCE)CO.1943-7862.0002017. © 2021 American Society of Civil Engineers.
Author keywords: Building information modeling (BIM) adoption; User; Firm; Project coalition; Systemic innovation; Middle-out
diffusion.
Building information modeling (BIM) is defined as the set of tech- Systemic innovations are innovations that require multiple actors to
nologies, processes, and policies adopted by users, firms, and proj- change and align their practice simultaneously in order to achieve
ects to make decisions effectively across the project life cycle. BIM the benefits of the innovation (Taylor and Levitt 2004). To realize
is revolutionizing the architecture, engineering, and construction this potential, the set of innovations requires implementation from
(AEC) industry around the world. The global BIM movement is the earliest stages, intrafirm collaboration, and organizational au-
spreading from developed to developing countries (Jin et al. 2017). thority to ensure integration (Slaughter 1998). BIM has been clas-
However, some scholars suggest that the diffusion of BIM has been sified as a systemic innovation (Murphy 2014). Murguia et al.
slow and that BIM adoption across the project life cycle is yet to (2017) defined systemic BIM innovation as the set of BIM-related
occur (Gu and London 2010; London et al. 2008; Manderson et al. technologies, processes, and organizational innovations that re-
2015). BIM is intended to bring together all project partners, who quires multiple firms and users to change their practices simul-
will use the same information to design, build, and operate better taneously. Davies et al. (2015) argued that BIM is a systemic
projects. However, there is a significant gap between BIM visions innovation that is enacted and adopted by firms, projects, users,
and practice (Davies and Harty 2013). Notably, BIM is hardly used and institutional actors. Moreover, BIM is a systemic interfirm in-
at the same level by all users and firms in a temporary project co- novation predicted to have a great impact on the efficiency of the
alition. This uneven distribution of firm capabilities and user adop- construction process (Lindblad and Gustavsson 2018; Lindgren
tion hinders the desired outcome at the supply-chain level. and Widén 2018).
Systemic BIM adoption requires users from different firms to
change their interfirm and intrafirm working practices. Hence, in
this research, the user is placed at the center of systemic BIM adop-
1
Doctoral Researcher, School of Architecture, Building, and Civil En- tion. Adoption is ultimately in the hands of users who create, use,
gineering, Loughborough Univ., Loughborough, LE11 3TU, UK (corre- and exchange information and then go on to make decisions using
sponding author). ORCID: https://orcid.org/0000-0003-1009-4058. Email:
D.Murguia@lboro.ac.uk
BIM. Nevertheless, at any point in time, users work for firms and
2
Reader in Building Information Management, School of Architecture, on projects. As such, factors from the firm and project can influence
Building, and Civil Engineering, Loughborough Univ., Loughborough, users’ BIM adoption. Thus, systemic BIM adoption is multilayered
LE11 3TU, UK. Email: P.Demian@lboro.ac.uk and directly influenced by its immediate context, the firm, and the
3
Senior Lecturer in Construction Management, School of Architecture, broader project context.
Building, and Civil Engineering, Loughborough Univ., Loughborough,
LE11 3TU, UK. Email: R.Soetanto@lboro.ac.uk
Note. This manuscript was submitted on February 20, 2020; approved The Need for a Model of Systemic BIM Adoption
on October 28, 2020; published online on January 31, 2021. Discussion
period open until June 30, 2021; separate discussions must be submitted BIM has been adopted primarily for productivity improvement by
for individual papers. This paper is part of the Journal of Construction individual organizations; consequently, it has not led to systemic
Engineering and Management, © ASCE, ISSN 0733-9364. change across the sector (Aksenova et al. 2019). The reasons for
measure adoption by members of the same firm or project coalition; BIM adoption, rather than those of the actual users.
(3) In some studies, data were obtained from participants who did
not answer questions at the level appropriate to their own position. Firm-Level Adoption Models
For example, users were asked about firm- or project-level factors,
and decision makers were asked about user-level factors; (4) There BIM-adoption models at the firm level focus on small and medium
is a lack of evidence regarding the effect of firm- and project-level enterprises (SMEs) (Hong et al. 2019a, b; Hosseini et al. 2016),
factors on users’ BIM adoption; and (5) None of the previous mod- architecture firms (Ahmed and Kassem 2018), engineering firms
els have holistically combined different analytical levels into a uni- (Cao et al. 2016), construction firms (Bosch-Sijtsema et al. 2017;
fied model to explain users’ BIM adoption. Hong et al. 2019a), and all types of firms (Chen et al. 2019). Studies
A model that is grounded on BIM adoption by the user but ac- have been conducted in China (Hong et al. 2019a), Australia (Hong
counts for contextual firm- and project-level factors would be an et al. 2019b), Turkey (Ozorhon and Karahan 2017), Sweden
original and valuable contribution. Therefore, a unified model is (Bosch-Sijtsema et al. 2017), the United Kingdom (Ahmed and
deemed to be a model of systemic BIM adoption (MSBA) that Kassem 2018), and the United States (Lee et al. 2015). As with
could assist decision makers and policymakers in formulating strat- user-level models, there are more studies of the intentions to use
egies to accelerate users’ BIM adoption in the industry. The over- BIM than the firm’s actual BIM use (Hong et al. 2019a, b). How-
arching aim of this research is to develop a model that identifies the ever, some other studies set out to measure actual BIM use (Cao
user-, firm-, and project-level factors that influence users’ BIM et al. 2016; Chen et al. 2019).
adoption. First, from the literature, factors related to the user, firm, Hosseini et al. (2016) presented a model of BIM adoption for
and project were identified. Second, three different data sets were SMEs in Australia. In the study, 80% of the respondents were
carefully collected and analyzed. Project-level data were collected project directors. Other studies, however, collected data from end-
from 20 project managers of BIM-enabled projects in Peru. Firm- users instead of senior executives (Cao et al. 2017; Lee et al. 2015).
level data were collected from 30 chief executive officers (CEOs) of Hong et al. (2019b), despite adopting the firm as their unit of analy-
AEC firms working on these projects. User-level data were col- sis, did not report the job positions of the 80 respondents within
lected from 133 professionals working simultaneously for these their firms.
firms and projects. The value of these original datasets lies in the
purposive data collection from an ecosystem of users, firms, and Project-Level Adoption Models
projects within an industry context. Third, the empirical data were
analyzed using cross-classified multilevel modeling (CCMM) that Fewer studies were encountered of BIM-adoption models at the
allows for combining datasets at different analytical levels such as project level. The foci of such studies are the effects of client and
individuals simultaneously grouped into firms and into projects. As environmental factors on BIM applications (Cao et al. 2014), 4D
such, the variability of the outcome variable (users’ BIM adoption) performance impact (Gong et al. 2019), project performance (Franz
could be explained by factors at the user, firm, and project levels. and Messner 2019), and the decision to adopt BIM in refurbishment
Finally, theoretical and managerial implications are discussed. projects (Okakpu et al. 2019). Nonetheless, these studies did not
incorporate project-level variables that would potentially influence
users’ BIM adoption within the project coalition.
Existing BIM Adoption Models
This section presents a critical review of existing BIM-adoption The Proposed Model of Systemic BIM Adoption
models at the user, firm, and project levels that informed the devel-
opment of the MSBA. The design or construction professional working for a firm and on a
project is the unit of analysis in MSBA. User-level variables might
explain variation between users. Firm-level factors might explain the
User-Level Adoption Models
variation between firms in users’ BIM adoption. Similarly, project-
BIM-adoption models at the user level have become prominent level factors could explain the variation between projects in users’
since 2014. Studies have been conducted in China (Ding et al. BIM adoption. Therefore, MSBA examined the cross-level relation-
2015), India (Ahuja et al. 2016), South Korea (Kim et al. 2016; ships of macrolevel factors (firm and project) and microlevel out-
Park et al. 2019), United Kingdom (Howard et al. 2017), Australia comes (users’ BIM adoption). Table 1 summarizes the proposed
(Sargent et al. 2012), Thailand (Ngowtanasawan 2017), Malaysia factors in each analytical level found in the literature. Fig. 1 shows
(Enegbuma et al. 2016), and the United States (Lee and Yu 2016). the proposed research model. The dashed lines represent
Research has mainly focused on BIM adoption by design and con- the boundaries between analytical levels. Arrows intersecting the
struction professionals. Moreover, the outcome variable of most dashed lines represent cross-level hypotheses. Table 2 summarizes
BIM adoption
Firm Size There are contradictory findings in the literature about whether Ayinla and Adamu (2018), Dainty et al.
the firm size is one of the firm-level contextual factors that (2017), Peansupap and Walker (2005), and
influence users’ BIM adoption Poirier et al. (2015)
Technology Readiness Positive view of BIM, including its flexibility, convenience, and Foroozanfar et al. (2017), Liljander et al.
(optimism) efficiency. CEO’s optimism might influence users’ adoption (2006), and Parasuraman (2000)
Technology Readiness Tendency to position the firm as a technology pioneer. CEO’s
(innovativeness) innovativeness might influence users’ adoption
Top-Management Degree to which the CEO understands the importance of BIM Ahuja et al. (2016), Lee and Yu (2016), Park
Support and is involved in BIM activities. Normally assessed at the user et al. (2019), and Sargent et al. (2012)
level (users’ perception)
Firm’s Facilitating The firm has invested in technology, training, and consulting to Ahuja et al. (2016), Howard et al. (2017),
Conditions adopt BIM Sargent et al. (2012), Son et al. (2015), and
Venkatesh et al. (2003)
Firm’s BIM Adoption Firms exhibit a mixture of competences, capacity, resources, Ahmed and Kassem (2018) and Mahamadu
culture, and attitude to compete in the market. Therefore, et al. (2017)
employees deploy intrafirm and interfirm BIM practices
Project System Integrator The system integrator steers the innovation process, aligns Erbil et al. (2013), Harty (2008), Lindblad
objectives, and overcomes individuals’ and organizations’ and Gustavsson (2018), and Renier and
resistance. The system integrator (client versus contractor) Volker (2008)
might explain the variation between projects in users’ BIM
adoption
Diffusion Dynamic In the client-led approach, the client or owner requires BIM Eadie et al. (2015), Elmualim and Gilder
adoption, while in the supply-lead approach, the general (2014), Lindblad and Guerrero (2020),
contractor leads BIM implementation in the project. The Linderoth (2010), and Poirier et al. (2015)
diffusion dynamic (client-led versus supplier-led) might explain
the variation between projects in users’ BIM adoption
Authorship of BIM BIM models can be maintained in-house or outsourced to Fountain and Langar (2018), Gu and London
Models service providers, a decision made early in the project. (2010), and Kim et al. (2016)
However, the author of BIM models (consultant versus
in-house) might explain the variation between projects in
users’ BIM adoption
Governance Mode The market mode is a self-regulated BIM process in which Keast and Hampson (2007)
diffusion happens in a colearning process without a mandate.
The question remains whether a mandate or a colearning
process facilitates or deters users’ BIM adoption
Project-Coalition Some firms are unable or unwilling to engage with BIM. If one Dainty et al. (2017)
Technology Capability or more firms are not prepared to use BIM, or they use CAD
and BIM simultaneously, it could affect users’ BIM adoption
within the project coalition
Project-Coalition Collaboration can be defined as the commitment of actors to the Arayici et al. (2011), Eadie et al. (2013), and
Collaboration Level attainment of common project objectives by means of effective Mahamadu et al. (2019)
and transparent communication. If one or more firms are not
fully engaged in the collaborative process, it could affect users’
BIM adoption within the project coalition
the hypothesized relationships. The proposed model extends user- Research Method
level models by investigating the effect of firm- and project-level
factors on users’ BIM adoption. Moreover, there is a lack of studies A quantitative approach was selected as the primary methodology
investigating the effect of firm- and project-level factors on users’ in view of the defined objectives of the study. Cross sectional ques-
BIM adoption. This research aims to fill this gap. tionnaire data were used to test the research model shown in Fig. 1.
Fig. 1. Research model. Ovals are multiitem factors; rectangles are observed variables.
Table 2. Hypotheses in the research model If the sample is deemed to be representative, findings become appli-
Number Hypothesis cable to the larger population. Three different questionnaires were
designed in order to collect data at three different analytical levels.
H1 Behavioral Intention will have a significant influence on Therefore, our targeted respondents were project managers of BIM-
users’ BIM adoption
enabled projects, CEOs or senior executives of the firms working
H2 Facilitating Conditions will have a significant influence on
users’ BIM adoption
for these projects, and design and construction professionals work-
H3 Performance Expectancy will have a significant influence on ing for these firms and projects. The sampling strategy was purpos-
Behavioral Intention ively nested, as we aimed to investigate cross-level relationships;
H4 Effort Expectancy will have a significant influence on thus, the interdependence and the group functioning of these pro-
Behavioral intention fessionals in a hierarchical system is of focal interest.
H5 Social Influence will have a significant influence on
Behavioral Intention
H6 Firm Type will have a significant influence on users’ BIM Cross-Classified Modeling
adoption
H7 Firm Size will have a significant influence on users’ BIM
Cross-classified modeling can be used to analyze complex data
adoption when lower units belong to pairs of higher-level units (Leckie 2013).
H8 Technology Readiness (optimism) will have a significant This is the nature of users’ BIM-adoption data, as users work for a
influence on users’ BIM adoption firm and on a project simultaneously, as shown in Fig. 2. Therefore,
H9 Technology Readiness (innovativeness) will have a BIM users are nested within firms and are separately nested within
significant influence on users’ BIM adoption projects. Firms and projects are not typically nested within one an-
H10 Top-Management Support will have a significant influence other, as not all BIM users from the same firm work on the same
on users’ BIM adoption project. Thus, firms and projects are crossed with one another, with
H11 Firm’s Facilitating Conditions will have a significant each user potentially belonging to a combination of firm and project.
influence on users’ BIM adoption
The cross-classified model breaks down the outcome-variable vari-
H12 Firm’s BIM Adoption will have a significant influence on
users’ BIM adoption
ance into separate variable components associated with the higher
H13 The System Integrator will have a significant influence on cross-classified levels and lower user levels. The model can be writ-
users’ BIM adoption ten as shown in Eq. (1) (Leckie 2013)
H14 The project’s Diffusion Dynamic will have a significant
influence on users’ BIM adoption yijk ¼ β o þ ν k þ μj þ εijk ; with
H15 The Authorship of BIM Models will have a significant
νk ∼ Nð0; σ2ν Þ; μj ∼ Nð0; σ2μ Þ; εijk ∼ Nð0; σ2ε Þ ð1Þ
influence on users’ BIM adoption
H16 The Governance Mode will have a significant influence on
users’ BIM adoption where yijk = BIM adoption of user i who works for firm j and
H17 The Project-Coalition Technology Capability will have a project k; β o = mean score across projects and firms; ν k = effect
significant influence on users’ BIM adoption of project k; μj = effect of firm j; and εijk = user-level residual error
H18 The Project-Coalition Collaboration Level will have a term. Therefore, the total variance of the outcome variable yijk is
significant influence on users’ BIM adoption
split into the differences between users (between-user variance σ2ε ),
differences between firms (between-firm variance σ2μ ), and differen- Questionnaire Design
ces between projects (between-project variance σ2ν ). The firm and Three questionnaires were designed to obtain empirical data to test
project effects on the total variance can be measured with the intra- the influence of the factors identified on users’ BIM adoption. The
class correlation coefficient (ICC), as shown in Eqs. (2) and (3) questionnaires were originally designed in English; however, they
(Leckie 2013). The ratio of the firm-level variance to the total vari- were translated into Spanish to reduce language bias (Harzing et al.
ance is ICCμ and can be expressed as follows:
2009). To guarantee accuracy, the questionnaires were carefully
σ2μ translated by the first author of this paper, whose native language
ICCμ ¼ ð2Þ
σ2ε þ σ2μ þ σ2ν is Spanish. Survey items were identified from existing literature,
with additional measurements purposively designed for this re-
The ratio of the project-level variance to the total variance is search. Questionnaire 1 (Q1) was designed for professionals repre-
ICCν and can be expressed as follows: senting their design and construction firms in BIM-enabled projects.
Q1 had two sections. Section 1 included control questions such as
σ2ν
ICCν ¼ ð3Þ profession, professional experience, and BIM experience. Section 2
σ2ε þ σ2μ þ σ2ν included the measurement items on a five-point scale (1 = strongly
ICC ranges from 0 (no inter-group differences) to 1 (no differ- disagree, 5 = totally agree) adapted from Venkatesh et al. (2003) and
ences between users in the same group). A low ICC value means Howard et al. (2017). However, “BIM Adoption” was designed for
high variability within groups and low variability between groups. this study, as shown in Table 3.
A high ICC value means high variability between groups and low Questionnaire 2 (Q2) was designed for CEOs or senior execu-
variability within groups. For example, if ICCμ is 0.2 and ICCν is tives with decision making power. Q2 had two sections. Section 1
0.1, we would say that 20% of the variation lies between firms, 10% included control questions such as firm type, firm size, respond-
lies between projects, and 70% lies between users (Leckie 2013). ent’s years of professional experience, and firm’s years of experi-
ICC values over 0.10 are indicators to perform a multilevel analysis ence with BIM. Section 2 included the measurement items on a
(Snijders and Bosker 1999). five-point Likert scale (1 = strongly disagree, 5 = totally agree),
Firm’s BIM Adoption (FBIMAD) FBIMAD1 The firm is actively using BIM
FBIMAD2 Employees collaborate with others using BIM within the organization
FBIMAD3 Employees collaborate with others using BIM outside the organization
adapted from Venkatesh et al. (2003), Howard et al. (2017), and Research Setting: The Context of Peru
Parasuraman (2000). Firm’s BIM Adoption was also operational-
Peru is located in the Latin American region and is considered
ized as a multiitem construct and was introduced for this study, as
a country with an upper-middle income economy (World Bank
shown in Table 4.
2020). From anecdotal sources, BIM adoption in Peru dates back
Questionnaire 3 (Q3) was designed for project managers. The
to 2010. A recent industry report found that 24.5% of building proj-
factors System Integrator, Diffusion Dynamic, Authorship of BIM
ects in Lima use BIM (Murguia et al. 2018). The study also found
Models, and Governance Mode are nominal and were measured
that the industry diffusion dynamic exhibits a middle-out approach
as dummy variables. System Integrator options were 0: Client’s
(Succar and Kassem 2015) where large contractors started BIM
project manager and 1: Contractor. Diffusion Dynamic options
adoption and therefore exerted pressure on other members of the
were 0: Client-led and 1: Contractor-Led. Authorship of BIM
supply chain (e.g., architects, engineers, and clients) to use BIM.
Models options were 0: In-house team and 1: Outsourced consul-
At present, contractors are leading BIM adoption, whereas archi-
tant. Governance Mode options were 0: Hierarchical (mandate) and
tects and engineers are behind.
1: Colearning (no BIM contracts).
With the success of the Pan American Games in Lima in 2019,
The questionnaire also included a section to assess the techno-
logical capability of each firm participating in the project (1 = very where infrastructure was built in record time using BIM and col-
low, 5 = very high). To construct a standardized measurement laborative contracts, a national BIM Steering Committee led by the
for project-coalition technology capability (PTECH), we created a Ministry of Economy has initiated a National BIM Plan for Public
measure consisting of the summation of each firm’s technology Projects. The Peruvian government has defined BIM as a collabo-
capability multiplied by the lowest technology capability as shown rative methodology based on the use of digital models with the aim
in the following equation. This indicator strengthens the effect of of centralizing project information throughout the asset lifecycle.
the digital disparity between firms by scaling the project’s technol- Peru is a representative country for understanding BIM adoption
ogy capability by the lowest capability in a middle-out context, before top-down approaches are imple-
mented by governments. While acknowledging cultural differen-
ces, the findings of the model would be a valuable reference for
X
i¼5
other countries planning to implement a top-down approach to ac-
PTECH ¼ xi × minfi1 ; : : : ; i5 g;
i¼1
celerate wider adoption.
where xi is the ith firm’s BIM technology capabilty
Data Collection
Similarly, the indicator project-coalition collaboration level The questionnaires were piloted with four construction professio-
(PCOL) was calculated in the following equation. This indicator nals, two CEOs of architectural practices, and three project man-
strengthens the effect of the collaboration disparity between firms agers. A few suggested revisions in the wording of assessment
by scaling the project’s collaboration level by the lowest level items were incorporated into the final questionnaire. The data were
collected in Lima. The first author had access to influential organ-
X
i¼5 izations and industry partners leading BIM-enabled projects. The
PCOL ¼ xi × minfi1 ; : : : ; i5 g; selection criteria were: (1) BIM adoption was led by the client/
i¼1 contractor at the project level; (2) access to the list of design and
construction firms and professionals working on these projects; and
where xi is the ith firm’s collaboration level
(3) the project was under design or construction during data col-
lection. First, 25 project managers were contacted to solicit project
To standardize both indicators across projects, the following participants’ contact details and to ask them to complete question-
firms were considered: architecture (i ¼ 1); structural engineering naire Q1. In total, 20 project managers completed questionnaire Q1
(i ¼ 2); mechanical and electrical engineering (i ¼ 3); plumbing (an 80% response rate). Second, 33 different firms were identified
engineering (i ¼ 4); and contractor (i ¼ 5). as working for these projects, with some firms working for one or
At the firm level, the results suggest that Firm Type (Design Discussion
versus Contractor), Top-Management Support, and Firm’s BIM
Adoption significantly influence BIM practice (β ¼ −0.558, Theoretical Contributions
p < 0.01; β ¼ −0.750, p < 0.001; and β ¼ 0.422, p < 0.01, respec-
tively). Therefore, hypotheses 6, 10, and 12 were supported. The This study examined user, firm, and project factors that influence
explained variance for the systemic BIM-diffusion model at the users’ BIM adoption. At the user level, the MSBA showed that
Behavioral Intention directly influences users’ BIM adoption. This
firm level was R2 ¼ 0.751; thus, 75% of the variation between
result was consistent with Venkatesh et al. (2003) and Howard et al.
firms in users’ BIM adoption is explained by factors at the firm
(2017). The MSBA also confirmed the mediating role of Behav-
level.
ioral Intention between Performance Expectancy and users’ BIM
At the project level, the model suggests that between-project
adoption. This result suggests that users who think that BIM will
variation of Authorship of BIM Models (Consultant versus help to increase productivity and do a better job will have more
In-house) was found significantly to impact BIM practice (β ¼ incentives to use BIM. However, this result contradicts the results
−0.664, p < 0.01). Thus, Hypothesis 15 was supported. Addition- of Howard et al. (2017), who reported that there is no significant
ally, Project-Coalition Technology Capability positively influences connection between Performance Expectancy and Behavioral In-
Users’ BIM Adoption (β ¼ 0.023, p < 0.01). Therefore, Hypothe- tention. Howard et al. (2017) also inquired about the characteristics
sis 18 was supported. The explained variance for the systemic BIM- that make BIM unique among information systems and argued that
diffusion model at the project level was R2 ¼ 0.503; therefore, 50% since BIM is imposed at the organizational and project level, it is
of the variation between projects in users’ BIM adoption was ex- therefore perceived as an obstacle to completing tasks with no
plained by factors at the project level. effect on their job performance. Addy et al. (2018) claimed that
H11c BIM assistance to Employees will have a significant influence on users’ BIM adoption Rejected
H12 Firm’s BIM Adoption will have a significant influence on users’ BIM adoption Accepted
H13 The System Integrator will have a significant influence on users’ BIM adoption Rejected
H14 The project’s Diffusion Dynamic will have a significant influence on users’ BIM adoption Rejected
H15 The Authorship of BIM Models will have a significant influence on users’ BIM adoption Accepted
H16 The Governance Mode will have a significant influence on users’ BIM adoption Rejected
H17 The Project-Coalition Technology Capability will have a significant influence on users’ BIM adoption Accepted
H18 The Project-Coalition Collaboration Level will have a significant influence on users’ BIM adoption Rejected
Ghanaian quantity surveyors do not regard BIM as important in 2017). However, this finding might be interpreted as follows. Chief
improving productivity and are yet to comprehend the system’s executives might see BIM as a commercial strategy to win contracts
benefits. Nonetheless, this study has shown that design and con- rather than a way to digitalize working processes and gain overall
struction professionals from this study have developed performance firm productivity. As such, BIM teams are created to lead BIM
expectations to justify their intention to adopt BIM. This is in line practices, but other professionals within the firm carry out tradi-
with adoption studies in other developing countries such as China tional working practices and their adoption is slow. Since this study
(Son et al. 2015; Xu et al. 2014). excluded responses from BIM teams, respondents’ BIM adoption is
Effort Expectancy was found positively to influence Behavioral lower than that of BIM team members.
Intention, meaning that users who think that BIM is easy to use will At the firm level, the model showed that Firm Type (Design
have a greater intention to use BIM in their projects. Effort Expect- versus Contractor) influences the difference between firms in users’
ancy has been found as a significant factor across contexts such as BIM adoption. This result suggests that users working for construc-
Australia (Bataresh et al. 2019; Sargent et al. 2012), the United tion firms perform better than users working for design firms. This
Kingdom (Howard et al. 2017), Ghana (Addy et al. 2018), and is an important finding for contexts such as Peru, in which Tier 1
China (Son et al. 2015; Xu et al. 2014). Similarly, Social Influence contractors have exerted pressures to use BIM on smaller firms—
had a positive influence on Behavioral Intention, meaning that normally designers and subcontractors—within the supply chain. If
users who think that using BIM makes the user more prestigious, public or private clients are to mandate BIM use, some strategies
both inside and outside the company, will have a greater intention should be deployed to assure a seamless BIM diffusion within sup-
to use BIM. Among the three factors influencing Behavioral Inten- ply chains. For example, firms’ BIM capability should be assured
tion, Performance Expectancy stood out as having the strongest prior to the contract award. If contractors mandate BIM in the
influence on users’ intentions toward BIM, followed by Social In- project, they should assume the role of a system integrator in order
fluence and Effort Expectancy. to stimulate collaborative work between engineering consultants
The present study also found that Facilitating Conditions and construction teams.
influences users’ BIM adoption, which is consistent with theory Although differences in BIM adoption between SMEs and large
(Howard et al. 2017; Sargent et al. 2012; Venkatesh et al. 2003). engineering firms have been reported in major regions in China
Hong et al. (2019a) found that Technical Support is an important (Chen et al. 2019), this study did not find a significant impact of
factor to BIM adoption in all types of firms regardless of their size firm size on the differences between firms in users’ BIM adoption.
and the project type delivered. Facilitating Conditions encompasses However, the difference could be attributed to the outcome variable
BIM assistance to users. This suggests the need for an in-house in each study. Whereas Chen et al. (2019) studied adoption at the
BIM team or outsourced consultants working closely with users firm level, the present study investigated adoption at the user level.
to foster BIM adoption. However, firm-level facilitating conditions This result suggests that the collaborative process of model creation
(as stated by top managers) were not associated with users’ BIM and federation led by the system integrator will allow users to en-
adoption. This finding reinforces the idea that there is an uneven gage with BIM practices due to the mimetic pressures of larger
distribution of software, hardware, training, and technical support firms. The model also showed that Firm’s BIM Adoption positively
among professionals within the firm other than BIM teams. influences the differences between firms in users’ BIM adoption.
Contrary to the common belief, there exists a surprising negative The high correlation of Firm’s BIM Adoption with Technology
relationship between Top-Management Support and users’ BIM Readiness (optimism) (r ¼ 0.433, p < 0.05) and Technology Read-
adoption. This finding suggests that Top-Management Support iness (innovativeness) (r ¼ 0.758, p < 0.001) suggests that firms
negatively influences the differences between firms in users’ BIM with senior executives that understand BIM as a means to improve
adoption. This is counterintuitive and obviously contradicts pre- productivity and control over operations perform better than firms
vious research (Ahuja et al. 2016; Son et al. 2015; Wang and Song that use BIM only to meet client requirements.
with low technology capability are not managing and exchanging early in the project.
their own 3D object-based models; however, system integrators The model would be particularly effective for policymakers
have the authority to involve them in the collaborative process. planning to mandate BIM in construction. Charef et al. (2019)
The Governance Mode (hierarchical versus colearning) was not found that 25% of European countries have mandated BIM. None-
found to be a significant factor influencing the difference between theless, 50% are only planning to mandate and 25% do not have
projects in users’ BIM adoption. Thus, there is no evidence to sup- plans yet. Moreover, there are a growing number of governments in
port that a hierarchical contractor- or client-led project (mandate) Latin America, in countries such as Mexico, Colombia, and Peru,
performs better than a colearning project (no mandate). Therefore, that are working on BIM-adoption strategies for public construc-
a top-down approach would not be directly associated with users’ tion. Furthermore, Kassem and Succar (2017) surveyed 21 coun-
BIM adoption but creates the environment needed at the institutional
tries, and 16 of those contexts exhibited the middle-out diffusion
level to promote users’ and decision makers’ acceptance of BIM.
dynamic. Therefore, most countries develop BIM capabilities, led
by large organizations, before adopting top-down approaches to
Managerial Implications maximize diffusion. Murguia (2019) found that the industry diffu-
sion dynamic in Peru exhibited a middle-out approach where large
Systemic BIM adoption constitutes a radical shift in the digital contractors exert pressures on other members of the supply chain.
delivery of the built environment that has significant implications Therefore, the findings of this study are an important contribution
in the way design, construction, and operation are organized. The
to the practicalities of systemic BIM adoption in the middle-out
model indicated that the majority of users’ BIM adoption variance
context. This may include practitioners and firms in a more devel-
occurs at the user level. It is common to find that within BIM-
oped context but not yet engaged with BIM.
enabled projects and firms, users are reluctant to embrace BIM.
Nonetheless, BIM practice is fostered by Facilitating Conditions
that are entirely in the hands of decision makers. Moreover, pur-
poseful interventions on training could improve BIM users’ Per- Conclusions
formance Expectancy, Effort Expectancy, and Social Influence.
This study extends the body of knowledge of BIM diffusion by
Firms should strike a balance between adoption driven by client/
presenting a model of systemic BIM adoption that holistically com-
system integrator demand or adoption driven by internal produc-
bines factors at the user, firm, and project levels that explain users’
tivity improvement and create a BIM strategy accordingly. For
BIM adoption. The model is particularly needed in a context where
instance, in-house BIM teams are created, or BIM authoring is out-
governments are planning to mandate BIM in construction. A model
sourced. However, chief executives may argue that BIM will not
of systemic BIM adoption is a useful framework for policymakers to
reach its full potential due to the unreadiness of other partner firms
or lack of client demand, thus making BIM an investment with a understand the BIM journey process and implement policies to ac-
low return. The presence of outsourced consultants, however, cre- celerate wider adoption within supply chains. The model is effective
ates a paradox in systemic BIM adoption. On the one hand, they are in providing a richer picture of the determinants influencing BIM
required to foster practice at the user level, especially in the early adoption in a system of firms and users working on BIM-enabled
stages of the diffusion process. On the other hand, when consultants projects. Three original datasets consisting of 133 BIM users, 30
carry out BIM works, the BIM practice of design and construction CEOs, and 20 project managers were collected in Peru and merged
professionals will decrease. Therefore, chief executives should using CCMM. CCMM has not been previously applied to investi-
carefully consider the extent of BIM outsourcing and the impact gate the systemic adoption of innovations. The analysis of the em-
on users’ practice, particularly for firms implementing it to control pirical data has found that user-level factors influencing BIM
their operations. practice are Performance Expectancy, Effort Expectancy, Social
The model did not find a significant difference in BIM adoption Influence, Behavioral Intention, and Facilitating Conditions. Addi-
between projects with client-led mandates and projects with a tionally, the model has pinpointed the firm-level factors influencing
contractor-led colearning environment. However, the model re- the differences between firms in users’ BIM adoption, namely, Firm
flects that firms with low technology capability deepen the digital Type, Top-Management Support, and Firm’s BIM Adoption. Fi-
disparity within the project and negatively influence users’ adop- nally, Authorship of BIM Models and Project-Coalition Technology
tion. Asset owner operators and public agencies are commonly ac- Capability were found to be the most prominent factors at the
knowledged as key drivers of BIM adoption. However, most clients project level explaining the differences between projects in users’
are unaware or unwilling to adopt BIM. As such, contractor-led ini- BIM adoption. The data showed that 69% of users’ BIM adoption
tiatives in the traditional, fragmented procurement system will only variance occurs at the user level, whereas 17% and 14% of the vari-
use BIM for specific needs (e.g., 3D modeling and clash detection ance happens at the firm and project levels, respectively. The model
control their operations. Fourth, firms with low BIM capability af- 43rd Australasian Universities Building Education Association Conf.,
fect the adoption of other project members. Fifth, the model has 684–693. North Rockhampton, QLD, Australia: Central Queensland
shown the critical role of system integrators as the driving force Univ.
of systemic BIM adoption. Clients are required to lead system in- Bosch-Sijtsema, P., A. Isaksson, M. Lennartsson, and H. C. J. Linderoth.
tegration, request BIM use to their supply chain, and adopt new de- 2017. “Barriers and facilitators for BIM use among Swedish medium-
sized contractors—‘We wait until someone tells us to use it.’” Visuali-
livery models such as integrated project delivery (IPD) to allow
zation Eng. 5 (1): 1–12. https://doi.org/10.1186/s40327-017-0040-7.
benefits in the project delivery as well as in asset management and
Cao, D., H. Li, and G. Wang. 2014. “Impacts of isomorphic pressures
performance. Therefore, traditional procurement routes would fail on BIM adoption in construction projects.” J. Constr. Eng. Manage.
to sustain systemic BIM adoption. 140 (12): 04014056. https://doi.org/10.1061/(ASCE)CO.1943-7862
This study has some limitations. First, the sample included de- .0000903.
sign and construction firms. However, subcontractors and facility Cao, D., H. Li, G. Wang, and T. Huang. 2017. “Identifying and contextu-
managers were not included. Further studies might investigate the alising the motivations for BIM implementation in construction projects
BIM practices of these actors within project coalitions. Second, the an empirical study in China.” Int. J. Project Manage. 35 (4): 658–669.
study is cross sectional and does not capture different stages of in- https://doi.org/10.1016/j.ijproman.2016.02.002.
novation in users and firms. Third, results may not be directly rep- Cao, D., H. Li, G. Wang, and W. Zhang. 2016. “Linking the motivations and
licable to different countries, as data were collected solely in Peru, a practices of design organizations to implement building information
developing country planning a BIM mandate. However, the find- modeling in construction projects: Empirical study in China.” J. Man-
ings of this study can be a valuable reference for context with a age. Eng. 32 (6): 04016013. https://doi.org/10.1061/(ASCE)ME.1943
middle-out diffusion dynamic. Further research can be extended -5479.0000453.
Charef, R., S. Emmitt, H. Alaka, and F. Fouchal. 2019. “Building informa-
to projects with prevalent client-led initiatives and the examination
tion modelling adoption in the European Union: An overview.” J. Build.
of in-depth case studies to scrutinize the intrafirm and between-firm Eng. 25 (Sep): 100777. https://doi.org/10.1016/j.jobe.2019.100777.
users’ BIM adoption. Similar datasets could be collected in other Chen, Y., Y. Yin, G. J. Browne, and D. Li. 2019. “Adoption of building
countries to assess the presence and influence of cultural factors on information modeling in Chinese construction industry: The technology-
systemic BIM adoption. organization-environment framework.” Eng. Constr. Archit. Manage.
26 (9): 1878–1898. https://doi.org/10.1108/ECAM-11-2017-0246.
Dainty, A., R. Leiringer, S. Fernie, and C. Harty. 2017. “BIM and the
Data Availability Statement small construction firm: A critical perspective.” Build. Res. Inf. 45 (6):
696–709. https://doi.org/10.1080/09613218.2017.1293940.
The data that support the findings of this study are openly available Davies, R., F. Crespin-Mazet, Å. Linné, C. Pardo, M. I. Havenvid, C. Harty,
in Loughborough University’s Repository at https://doi.org/10 C. Ivory, and R. Salle. 2015. “BIM in Europe: Innovation networks in
.17028/rd.lboro.11876535.v1. the construction sectors of Sweden, France and the UK.” In Proc., 31st
Annual Conf.—ARCOM 2015, 1135–1144. Manchester, UK: Associa-
tion of Researchers in Construction Management.
Acknowledgments Davies, R., and C. Harty. 2013. “Measurement and exploration of individ-
ual beliefs about the consequences of building information modelling
This research was funded by the School of Architecture, Building, use.” Constr. Manage. Econ. 31 (11): 1110–1127. https://doi.org/10
and Civil Engineering at Loughborough University, UK. The .1080/01446193.2013.848994.
authors thank all survey respondents for their participation. Ding, Z., J. Zuo, J. Wu, and J. Y. Wang. 2015. “Key factors for the BIM
adoption by architects: A China study.” Eng. Constr. Archit. Manage.
22 (6): 732–748. https://doi.org/10.1108/ECAM-04-2015-0053.
References Eadie, R., M. Browne, H. Odeyinka, C. Mc keown, and S. Mc niff. 2015.
“A survey of current status of and perceived changes required for BIM
Addy, M., E. Adinyira, and J. Ayarkwa. 2018. “Antecedents of building adoption in the UK.” Built Environ. Project Asset Manage. 5 (1): 4–21.
information modelling adoption among quantity surveyors in Ghana: https://doi.org/10.1108/BEPAM-07-2013-0023.
An application of a technology acceptance model.” J. Eng. Des. Tech- Eadie, R., M. Browne, H. Odeyinka, C. McKeown, and S. McNiff. 2013.
nol. 16 (2): 313–326. https://doi.org/10.1108/JEDT-06-2017-0056. “BIM implementation throughout the UK construction project lifecycle:
Ahmed, A. L., and M. Kassem. 2018. “A unified BIM adoption taxonomy: An analysis.” Autom. Constr. 36 (Dec): 145–151. https://doi.org/10
Conceptual development, empirical validation and application.” Autom. .1016/j.autcon.2013.09.001.
Constr. 96 (Dec): 103–127. https://doi.org/10.1016/j.autcon.2018.08 Elmualim, A., and J. Gilder. 2014. “BIM: Innovation in design manage-
.017. ment, influence and challenges of implementation.” Archit. Eng. Des.
Ahuja, R., M. Jain, A. Sawhney, and M. Arif. 2016. “Adoption of BIM Manage. 10 (3–4): 183–199. https://doi.org/10.1080/17452007.2013
by architectural firms in India: Technology–organization–environment .821399.
able technology.” In Proc., 34th Int. Symp. on Automation and Robotics Lindblad, H., and J. R. Guerrero. 2020. “Client’s role in promoting BIM
in Construction, 925–936. Oulu, Finland: International Association for implementation and innovation in construction.” In Construction man-
Automation and Robotics in Construction. agement and economics, 1–15. Abingdon, UK: Routledge.
Fountain, J., and S. Langar. 2018. “Building information modeling (BIM) Lindblad, H., and T. K. Gustavsson. 2018. “Project managers as involun-
outsourcing among general contractors.” Autom. Constr. 95 (Nov): tary policy implementers? The case of implementing BIM.” In Proc.,
107–117. https://doi.org/10.1016/j.autcon.2018.06.009. 34th Annual Conf. Association of Researchers in Construction Man-
Franz, B., and J. Messner. 2019. “Evaluating the impact of building infor- agement, ARCOM 2018, 465–474. Manchester, UK: Association of Re-
mation modeling on project performance.” J. Comput. Civ. Eng. 33 (3): searchers in Construction Management.
04019015. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000832. Linderoth, H. C. J. 2010. “Understanding adoption and use of BIM as the
Gong, P., N. Zeng, K. Ye, and M. König. 2019. “An empirical study on the creation of actor networks.” Autom. Constr. 19 (1): 66–72. https://doi
acceptance of 4D BIM in EPC projects in China.” Sustainability 11 (5): .org/10.1016/j.autcon.2009.09.003.
1–19. https://doi.org/10.3390/su11051316. Lindgren, J., and S. Emmitt. 2017. “Diffusion of a systemic innovation: A
Gu, N., and K. London. 2010. “Understanding and facilitating BIM adop- longitudinal case study of a Swedish multi-storey timber housebuilding
tion in the AEC industry.” Autom. Constr. 19 (8): 988–999. https://doi system.” Constr. Innov. 17 (1): 25–44. https://doi.org/10.1108/CI-11
.org/10.1016/j.autcon.2010.09.002.
-2015-0061.
Hair, J., W. Black, B. Babin, and R. Anderson. 2010. Multivariate data
Lindgren, J., and K. Widén. 2018. “Diffusing building information man-
analysis: A global perspective. Upper Saddle River, NJ: Prentice Hall.
agement–knowledge integration, mechanisms and knowledge develop-
Hall, D. M., A. Algiers, and R. E. Levitt. 2018. “Identifying the role
ment.” Archit. Eng. Des. Manage. 14 (5): 347–362. https://doi.org/10
of supply chain integration practices in the adoption of systemic inno-
.1080/17452007.2017.1394260.
vations.” J. Manage. Eng. 34 (6): 04018030. https://doi.org/10.1061
London, K., V. Singh, C. Taylor, N. Gu, and L. Brankovic. 2008. “Building
/(ASCE)ME.1943-5479.0000640.
information modelling project decision support framework.” In Proc.,
Harty, C. 2008. “Implementing innovation in construction: Contexts, rel-
24th Annual Conf., 665–673. Manchester, UK: Association of Re-
ative boundedness and actor-network theory.” Constr. Manage. Econ.
searchers in Construction Management.
26 (10): 1029–1041. https://doi.org/10.1080/01446190802298413.
Mahamadu, A. M., L. Mahdjoubi, C. Booth, P. Manu, and E. Manu. 2019.
Harzing, A. W., et al. 2009. “Rating versus ranking: What is the best way to
“Building information modelling (BIM) capability and delivery success
reduce response and language bias in cross-national research?” Int. Bus.
on construction projects.” Constr. Innov. 19 (2): 170–192. https://doi
Rev. 18 (4): 417–432. https://doi.org/10.1016/j.ibusrev.2009.03.001.
.org/10.1108/CI-03-2018-0016.
Hong, Y., A. W. A. Hammad, and A. Akbarnezhad. 2019a. “Impact of
Mahamadu, A. M., L. Mahdjoubi, and C. A. Booth. 2017. “Critical BIM
organization size and project type on BIM adoption in the Chinese con-
struction market.” Constr. Manage. Econ. 37 (11): 675–691. https://doi qualification criteria for construction pre-qualification and selection.”
.org/10.1080/01446193.2019.1575515. Archit. Eng. Des. Manage. 13 (5): 326–343. https://doi.org/10.1080
Hong, Y., A. W. A. Hammad, S. Sepasgozar, and A. Akbarnezhad. 2019b. /17452007.2017.1296812.
“BIM adoption model for small and medium construction organisations Manderson, A., M. Jefferies, and G. Brewer. 2015. “Building information
in Australia.” Eng. Constr. Archit. Manage. 26 (2): 154–183. https://doi modelling and standardised construction contracts: A content analysis
.org/10.1108/ECAM-04-2017-0064. of the GC21 contract.” Constr. Econ. Build. 15 (3): 72–84. https://doi
Hosseini, M. R., S. Banihashemi, N. Chileshe, M. Oraee Namzadi, C. .org/10.5130/AJCEB.v15i3.4608.
Udaeja, R. Rameezdeen, and T. McCuen. 2016. “BIM adoption within Murguia, D. 2019. 2019 macro BIM adoption study in Peru. Lima, Peru:
Australian small and medium-sized enterprises (SMEs): An innovation Pontifical Catholic Univ. of Peru.
diffusion model.” Constr. Econ. Build. 16 (3): 71–86. https://doi.org/10 Murguia, D., P. Demian, and R. Soeatanto. 2017. “A Systemic BIM Inno-
.5130/AJCEB.v16i3.5159. vation Model in the Construction Supply Chain.” In Proc., 33rd Annual
Howard, R., L. Restrepo, and C.-Y. Chang. 2017. “Addressing individual Conf., 15–24. Manchester, UK: Association of Researchers in Con-
perceptions: An application of the unified theory of acceptance and use struction Management.
of technology to building information modelling.” Int. J. Proj. Manage. Murguia, D., G. Tapia, and J. Collantes. 2018. BIM adoption survey in
35 (2): 107–120. https://doi.org/10.1016/j.ijproman.2016.10.012. Lima and Callao. Lima, Peru: Pontifical Catholic Univ. of Peru.
Jin, R., C. Hancock, L. Tang, C. Chen, D. Wanatowski, and L. Yang. 2017. Murphy, M. E. 2014. “Implementing innovation: A stakeholder competency-
“Empirical study of BIM implementation-based perceptions among based approach for BIM.” Constr. Innov. 14 (4): 433–452. https://doi.org
Chinese practitioners.” J. Manage. Eng. 33 (5): 04017025. https://doi /10.1108/CI-01-2014-0011.
.org/10.1061/(ASCE)ME.1943-5479.0000538. Ngowtanasawan, G. 2017. “A causal model of BIM adoption in the
Kassem, M., and B. Succar. 2017. “Macro BIM adoption: Comparative Thai architectural and engineering design industry.” Procedia Eng.
market analysis.” Autom. Constr. 81 (Sep): 286–299. https://doi.org/10 180 (Jan): 793–803. https://doi.org/10.1016/j.proeng.2017.04.240.
.1016/j.autcon.2017.04.005. Okakpu, A., A. GhaffarianHoseini, J. Tookey, J. Haar, and A.
Keast, R., and K. Hampson. 2007. “Building constructive innovation net- Ghaffarianhoseini. 2019. “Exploring the environmental influence on
works: Role of relationship management.” J. Constr. Eng. Manage. BIM adoption for refurbishment project using structural equation mod-
133 (5): 364–373. https://doi.org/10.1061/(ASCE)0733-9364(2007) elling.” Archit. Eng. Des. Manage. 16 (1): 41–57. https://doi.org/10
133:5(364). .1080/17452007.2019.1617671.
of innovation: BIM adoption and implementation for a specialty con- 27 (3): 425–478. https://doi.org/10.2307/30036540.
tracting SME.” Constr. Innov. 15 (1): 42–65. https://doi.org/10.1108/CI Wang, G., and J. Song. 2017. “The relation of perceived benefits and
-01-2014-0013. organizational supports to user satisfaction with building information
Renier, B., and L. Volker. 2008. “The architect as a system integrator?” In model (BIM).” Comput. Hum. Behav. 68 (Mar): 493–500. https://doi
Proc., 24th Annual Conf., 125–134. Manchester, UK: Association of .org/10.1016/j.chb.2016.12.002.
Researchers in Construction Management. Whyte, J. 2019. “How digital information transforms project delivery
Sargent, K., P. Hyland, and S. Sawang. 2012. “Factors influencing the adop- models.” Project Manage. J. 50 (2): 177–194. https://doi.org/10.1177
tion of information technology in a construction business.” Australas. J. /8756972818823304.
Constr. Econ. Build. 12 (2): 72–86. World Bank. 2020. “World Bank country and lending groups.” Accessed
Singh, V. 2014. “BIM and systemic ICT innovation in AEC.” Constr. June 17, 2019. https://datahelpdesk.worldbank.org/knowledgebase
Innov. 14 (3): 292–306. https://doi.org/10.1108/CI-02-2013-0006. /articles/906519-world-bank-country-and-lending-groups.
Slaughter, E. 1998. “Models of Construction Innovation.” J. Constr. Eng. Xu, H., J. Feng, and S. Li. 2014. “Users-orientated evaluation of building
Manage. 124 (3): 226–231. https://doi.org/10.1061/(ASCE)0733-9364 information model in the Chinese construction industry.” Autom. Constr.
(1998)124:3(226). 39 (Apr): 32–46. https://doi.org/10.1016/j.autcon.2013.12.004.