Tripathi Et Al 2023 People Process and Technology Maturity Levels For Successful Technology Implementation by State

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

Research Article

Transportation Research Record


2024, Vol. 2678(1) 12–21
Ó National Academy of Sciences:
People, Process, and Technology Maturity Transportation Research Board 2023
Article reuse guidelines:
Levels for Successful Technology sagepub.com/journals-permissions
DOI: 10.1177/03611981231170002

Implementation by State Departments journals.sagepub.com/home/trr

of Transportation

Amit Tripathi1 , Hala Nassereddine2, Roy E Sturgill1 ,


Gabriel B Dadi2, Makram Bou Hatoum2 ,
and Ashtarout Ammar2

Abstract
The demand for safe, reliable, and higher-quality infrastructure systems often increases the complexity of transportation con-
struction projects and necessitates more comprehensive evaluation methods. This often leads to the incorporation of tech-
nologies for oversight and management. With a focus on effective technology implementation, this research stretches beyond
simply evaluating technologies to consider integrating the technology with personnel and procedures at departments of
transportation (DOTs). Drawing from literature and a survey of state DOT personnel, this study applies and evaluates matu-
rity models for people, process, and technology with regard to technology implementation at DOTs. The findings support
the need for understanding technology implementation in the aspects of people, process, and technology maturity to improve
the probability of implementation success. The framework allows DOTs to move toward higher maturity levels and improve
the likelihood of implementation success. The study’s objective is to assess the importance of people, process, and technol-
ogy as implementation dimensions that state DOTs need to focus on for successfully implementing technologies. The idea
and scope of the paper can be extended to any new technology implementation efforts at DOTs, including Automatic
Identification and Data Capture technologies, emerging sensing and wireless technologies, safety technologies, and others.
The maturity models presented enable organizations to audit and benchmark their status for technology implementation, and
the relative levels allow these organizations to advance from basic to advanced stages. This paper introduces three maturity
models for people, process, and technology, their adaptation to DOT operations, and their possible future use, as presented
through preliminary survey results. The final result of this study provides a maturity model methodology for successful tech-
nology implementation and a self-assessment tool for state DOTs to gauge and improve their current maturity levels.
Preliminary validation of these products was conducted via a workshop of subject matter experts, and the results indicate
that state DOTs can use these products to self-assess their organization’s maturity and devise a plan as required for improved
technology implementation.

Keyword
technology maturity, people, process, technology, technology implementation, maturity models

The complexity of modern transportation construction effectively manage construction and assets that are key to
and asset management systems is driving for more timely,
accurate, reliable, and robust information. Evidence-
1
based research has demonstrated that a range of sensing Department of Civil, Construction, and Environmental Engineering, Iowa
technologies, including barcodes, radio frequency identi- State University, Ames, IA
2
Department of Civil Engineering, University of Kentucky, Lexington, KY
fication (RFID), ultra-wideband tracking systems, global
positioning, and at times a combination of these and Corresponding Author:
other advanced technologies, improve the ability to more Amit Tripathi, amittri@iastate.edu
Tripathi et al 13

highway project execution. Other non-sensing technolo- experienced in technology implementation in construc-
gies such as augmented reality, building information tion and asset management at DOTs. These adaptions
modeling, e-ticketing, e-construction, and digital twins were further influenced and validated by a survey of state
are equally useful in highway construction and asset DOT professionals and an in-person workshop with a
management. second group of experts. It can be concluded that matu-
At a time where more lane miles are being managed rity levels of at least 3 or more are required for successful
by fewer transportation agency staff, the opportunities technology implementation, and any maturity levels of 2
for technology to be leveraged are vast (1). However, the or below 2 will likely result in unsuccessful technology
success of technology implementation efforts is often not implementation. State DOTs need to focus on all people,
guaranteed. The variability in success is attributable to process, and technology if they want to increase the likeli-
many factors, including regulations, funding, personnel hood of their implementation success, as the combination
resistance, management support, and others. Within this of people, process, and technology results in successful
research, it is proposed that these factors may be cate- technology implementation efforts.
gorized within areas concerning people, process, or tech-
nology itself. The focus on these three areas as
considerations for technology implementation success Literature Review
presents an opportunity to provide guidance and support State DOTs continually implement technology to
for state departments of transportation (DOTs) when improve construction and asset management, among
implementing technologies. This study attempts to high- other areas. Studies have shown that the level of success
light the necessary maturity levels of people, process, and of these efforts varies (2), indicating the need to under-
technology for successful technology implementation at stand what is needed for successful technology imple-
state DOTs. The motivation for this study comes from mentation. Any technology implementation effort that
the increasing digital transformation in the construction only focuses on technology has the potential for failure
industry and the need for successful technology imple- in the construction industry; therefore, combining peo-
mentation to complement and supplement the work- ple, process, and technology was a core idea for building
force. It is very important to have successful technology the holistic framework (3). A review of technology imple-
implementations to achieve higher efficiency and digitize mentation in other fields revealed widespread use of
the industry. The main objective of the study is to use maturity models as assessment tools in gauging prepa-
maturity models to assess technology implementation at redness for these implementations, yet there was a void
state DOTs and provide guidelines to DOTs to improve of models specific to state DOT use. However, from
the prospects of technology implementation success. these studies and others, it is thus theorized that maturity
Through literature review, surveys, interviews, and in people, process, and technology are predicting factors
validation of metrics, the research team was able to in determining the success of technology implementation
assemble a framework for assessing maturity levels in and were applicable to state DOT use (2–4).
people, process, and technology, as well as establishing The People, Process, and Technology (PPT) frame-
baselines for indicating probable success and failure in work has been around since the early 1960s. The business
technology implementation efforts at state DOTs. This management specialist and expert Harold Leavitt coined
research identifies the required maturity levels of people, the original model, which consisted of four elements:
process, and technology that state DOTs need for prob- people, structure, tasks, and technology (5). The PPT
able success in technology implementation. This research framework first received attention in the Information
also sets levels for the probable failure of technology and Technology field when computer security and pri-
implementation that state DOTs must overcome. The vacy specialist Bruce Schneier built on the Leavitt frame-
study’s findings allow state DOTs to self-assess their cur- work and introduced people, process, and technology as
rent maturity levels, identify areas needing improvement, the three dimensions needed for successful organizational
and devise a plan to reach the levels needed for probable management (5). The PPT framework maps the entire
success in technology implementation. Although this value streams of people, process, and technology and
paper presents results of ongoing research, the findings highlights their interaction: the people do the work; pro-
relay the importance of maturity in people, process, and cesses make this work more efficient; and the technology
technology for probable success in technology enables people to do their tasks efficiently and automate
implementation. the process. This framework achieves harmony within an
The research methodology for this study relied on the organization and is mostly used when implementing new
use of well-established maturity models. These existing technologies (5). Thus, for a technology implementation
models, which were developed for other disciplines, were to be successful, the three dimensions of people, process,
adapted under the guidance of a panel of experts and technology must be mature to achieve success. These
14 Transportation Research Record 2678(1)

concepts led to the development of maturity models to improving individual abilities, creating compelling
assess the three dimensions. groups, propelling improved execution, and forming the
State DOTs can benefit from already established labor force the association needs to achieve its future
maturity models to assess each of the three dimensions field-tested strategies. The PCMM can be applied as a
of maturity needed to implement technologies success- standard for assessing workforce practices and as a guide
fully. Adopting existing models and modifying them to in planning and implementing improvement activities.
meet certain needs and requirements is a common prac- The PCMM is an integrated set of best practices that
tice in highway construction. The research uses the simi- improves performance and key capabilities for organiza-
lar approach of using established maturity models and tions that want to improve their critical people manage-
modifying them to meet the research objectives in DOT ment process (10).
context. The maturity models for people, process, and The research team used the PCMM to determine and
technology are helpful to understand what levels are assess people maturity for this research project. The five
required, and their relevance in highway construction levels of the PCMM are:
and asset management. These models provide framework
to systematically study people, process, and technology.  Level 1: Initial; Inconsistent Management
For instance, in the NCHRP: Web-Only Document 214  Level 2: Managed; People Management
‘‘Transportation Agency Self-Assessment of Data to  Level 3: Defined; Competency Management
Support Business Needs: Final Research Report,’’ the  Level 4: Predictable; Capability Management
research team modified the original Capability Maturity  Level 5: Optimizing; Change Management
Model to meet the study objectives of testing the feasibil-
ity of the data program self-assessment process and pro- Project Management Process Maturity Model (PM)2:
ducing a guide for transportation agencies to implement The (PM)2 is developed by integrating previous maturity
data self-assessment methods (6). In NCHRP Project 08- models that measure the Project Management (PM) lev-
36, Task 100, the authors used the Capability Maturity els of different companies and industries. The model
Model to create a tool to help transportation agencies evaluates the position of an organization’s current PM
assess their data programs (7). The State of Michigan maturity level. It illustrates a series of steps to help an
created the State Unified Information Technology organization incrementally improve its overall PM effec-
Environment (SUITE), built on the concepts of the tiveness (11).
Capability Maturity Model Integration (CMMI) and The (PM)2 model integrates previous PM practices,
project management methodologies. SUITE was origi- processes, and maturity models to improve PM effective-
nally used by the DOT and later became the statewide ness in the organization. The (PM)2 model motivates the
standard. The statewide implementation was possible as organization and related people to accomplish higher
SUITE has matured the process for all technology proj- and more sophisticated PM maturity through a systema-
ects (8). tic and incremental approach. It is well suited to assess
The study presented here adopts a similar approach an organizational PM level.
where three common maturity models for people, pro- The following five levels present the maturity model
cess, and technology are reviewed and adapted for con- for (PM)2 as mentioned in the article Project
struction and asset management for state DOTs uses. Management Process Maturity Model written by Kwak
The three models considered for this study for people, and Ibbs (11).
process, and technology, are further detailed in their orig-
inal form below:  Level 1: Initial; Basic PM Process
People Capability Maturity Model (PCMM): The  Level 2: Planned; Individual Project Planning
PCMM is a maturity framework that focuses on con-  Level 3: Managed at Project Level; Systematic
tinuously improving the management and development Project Planning and Control
of an organization’s human assets. It describes an evolu-  Level 4: Managed at Corporate Level; Integrated
tionary improvement path from ad hoc, inconsistently Multi-Project Planning and Control
performed practices to a mature, disciplined, and con-  Level 5: Continuous Learning; Continuous PM
tinuously improving the development of the workforce’s Process Improvement
knowledge, skills, and motivation that enhances strategic
business performance (9). Capability Maturity Model Integration (CMMI): The
The PCMM guides organizations in improving orga- CMMI is a process and behavioral model that helps
nizational processes for managing and developing work- organizations streamline process improvement and
forces. The PCMM comprises five development levels encourage productivity (11). The Software Engineering
that set up progressive establishments for consistently Institute at Carnegie Mellon University (CMU)
Tripathi et al 15

Table 1. Summary of the Assessment of the Three Dimensions of People, Process, and Technology

Maturity dimension
Level People Process Technology

1 Initial Initial Initial


2 Managed Planned Managed
3 Defined Managed at project level Defined
4 Predictable Managed at corporate Level Quantitatively managed
5 Optimizing Continuous learning Optimizing

developed the CMMI model with support from the (13). Obsolete evaluation tools will not help DOTs evalu-
Department of Defense and the U.S. Government. ate and implement technology successfully. There is a
Currently, the CMMI Institute is controlled by the need for a better approach and procedure to holistically
CMMI Institute, which was bought by the Information review technology implementation, as there is a growing
Systems Audit and Control Association (ISACA) in interest in technology nationally.
2016. CMU holds the patent for CMMI in the U.S.
Patent and Trademark Office (12).
The CMMI framework for defining technology matu-
Methods
rity within the context of DOT construction and asset After reviewing the existing maturity models for people,
management applications is adapted through this process, and technology, the description of each maturity
research project. The following are the five maturity lev- level for the PCMM, (PM)2, and CMMI was adjusted to
els defined by the CMMI: fit the objective of this research by matching the require-
ments of technology implementation for state DOTs
 Level 1: Initial; Processes unpredictable, poorly with regard to construction and asset management. The
controlled, and reactive three maturity models are referred to hereafter as matu-
 Level 2: Managed; Processes characterized for rity dimensions. Table 1 lists the five levels used for each
projects and is often reactive dimension. A description of each level is provided below.
 Level 3: Defined; Projects tailor their processes to The five levels for people maturity using the PCMM
the organization’s standards were defined and modified under the supervision of
 Level 4: Quantitatively Managed; Processes mea- research team members, subject matter experts, and with
sured and controlled relevant DOT technology implementation experiences as
 Level 5: Optimizing; Focus on process follows:
improvement.
 Level 1: Initial—DOTs do not have enough
These three models were adapted for this research for talented human resources required to handle proj-
two reasons: (1) they have been extensively used in prior ects and cannot retain qualified employees.
studies (NCHRP Project 08-92, NCHRP Project 8-36/  Level 2: Managed—DOTs provide a good work-
Task 100, State of Michigan), and (2) they all are mea- ing environment and training to empower staff
sured along a five-level scale, which brings uniformity and provide a clear line of communication within
across the models of people, process, and technology. units.
In the NCHRP Synthesis 582, the authors asked  Level 3: Defined—DOTs onboard the proper peo-
DOTs about current technology evaluation methods in ple in the proper position based on competency,
different state DOTs. There are different drivers for experiences, and roles and responsibilities, which
selecting technologies: improve efficiency, promote e- are well defined and developed across an
construction, and enhance inspectors’ safety and staffing. organization-wide infrastructure.
DOTs use wide arrays of technologies: geospatial tech-  Level 4: Predictable—DOTs have confidence in
nologies, remote sensing and monitoring technologies, their employees and delegate tasks to empowered
mobile devices and software applications, and nondes- groups. The managers operate at higher levels with
tructive evaluation methods. Out of forty-two respon- the ability to focus on more strategic issues.
dents, only 14% responded that DOTs have some system  Level 5: Optimizing—The entire DOTs are focused
and policies for effectively reviewing technologies. Some on continual improvement and improvement,
86% of the respondents do not have systems and policies including the improvement of individuals and the
to review the effectiveness of implementing technologies improvement of units for the betterment of the
16 Transportation Research Record 2678(1)

overall organization while focusing on central levels are achieved for people, process, and technology.
organizational objectives. With the definitions of the models above, there was a
need to match the requirements for DOT technology
Similarly, the five levels of process were defined and implementation to these metrics. A survey was developed
modified for this research project using the (PM)2 as under the guidance of subject matter experts with DOT
follows: experience and reviewed for institutional compliance.
The intent of the survey was to have potential end-users
 Level 1: Initial—DOTs understand and establish a evaluate the maturity models and their levels for assess-
basic PM process. ments of technology implementation at state DOTs. This
 Level 2: Planned—DOTs plan the projects on the research used an electronic survey developed in Qualtrics
individual process and are not team oriented. to seek feedback on the factors and perceptions of suc-
 Level 3: Managed at project level—DOTs provide cessful and unsuccessful technology implementations
informal PM training and manage projects based along the defined model maturity levels. The survey
on available systems with few team members. request was sent to the American Association of State
 Level 4: Managed at corporate level—DOTs pro- Highway and Transportation Officials (AASHTO)
vide formal PM training, and multiple projects are Committee on Construction, the AASHTO Committee
integrated and planned with maximum team on Maintenance, the AASHTO Committee on Data
participation. Management & Analytics, the AASHTO Committee on
 Level 5: Continuous learning—DOTs fully under- Innovation Initiative, the AASHTO Committee on
stand and implement PM procedures to create Knowledge Management, and the AASHTO
dynamic and energetic organizations able to man- Subcommittee on Asset Management. AASHTO is a
age complex projects into the future. nonprofit, nonpartisan association representing highway
and transportation departments in the fifty states, the
Finally, the five levels of maturity for technology were District of Columbia, and Puerto Rico. These committee
defined and modified to fit the DOT setting for this members are middle-to-late career state DOT experts
research project using the CMMI model as follows: who often are involved in piloted approaches and tech-
nology implementation. Its primary goal is to foster the
 Level 1: Initial—DOTs have access to technolo- development, operation, and maintenance of an inte-
gies, but the technologies are not managed grated national transportation system. A definition of
properly. each maturity level was provided in the survey to ensure
 Level 2: Managed—DOT staff are using technolo- all participants had the same understanding of the five
gies but only on a handful of projects. levels for each model.
 Level 3: Defined—DOTs use and implement tech- Respondents were asked to assess the maturity levels
nologies in many projects. of each dimension (i.e., people, process, and technology)
 Level 4: Quantitatively managed—DOTs fully use for two scenarios: successful technology implementation
technologies in all possible projects throughout and unsuccessful technology implementation. A defini-
the state organization, in appropriate applications, tion of each level was provided in the survey to ensure all
and are managed properly. participants had the same understanding across the five
 Level 5: Optimizing—DOTs fully implement tech- levels of each model. Respondents were also asked to ela-
nologies and find ways to implement them in borate on their state DOT experience relating to success-
other projects and areas, technologies collaborate, ful and unsuccessful technology implementation efforts.
and the DOT updates its implementation plan as The maturity assessment results were aggregated for each
required (14). model, leading to the establishment of maturity bound-
aries for successful and unsuccessful technology imple-
Each level is representative of a stage of preparedness mentation at state DOTs.
of a state DOT for implementing a specific technology The survey results were also validated during an in-
for a specific purpose. The levels are self-assigned based person workshop that hosted eighteen state DOT
on these considerations and point to areas of potential middle-to-late career professionals with significant tech-
improvement for technology implementation success. nology experience. There was an opportunity for the
The levels are generalized in that specific assessment or NCHRP 03-140 research team to host the workshop for
improvement criteria would drastically limit the func- their projects. Considering the experienced and diversi-
tionality and applicability of the model framework. This fied participants from different DOTs, the authors
research proposes that implementation success can be decided to take opportunity of the workshop to validate
more likely to succeed once the appropriate maturity the research finding in-person and compare them with
Tripathi et al 17

the online survey responses. These workshop attendees


were selected for their experience in implementing tech-
nologies at their respective DOT. The workshop feed-
back was collected through a questionnaire mirroring
the digital survey. The research results were then incor-
porated into a tool that state DOTs can use to self-assess
their maturity levels across people, process, and technol-
ogy metrics when planning a technology implementation.
Notably, this study highlights the importance of people,
process, and technology for successful technology imple-
mentation for construction and asset management at
state DOTs. It presents professionally determined and
validated maturity limits for successful and unsuccessful
technology implementation. An example of how a state
DOT can use the tool to evaluate its implementation Figure 1. Levels of people, process, and technology for both
maturity is also presented here. successful and unsuccessful technology implementation.

when a state DOT has a level 2 ‘‘Managed’’ (average value


Results
of 1.92) maturity level or less for people, a level 2,
A total of eighty-nine responses representing all fifty state ‘‘Managed’’ (average value of 2.20) maturity level or less
DOTs (at least one response from each of the fifty state for process, and level 2 ‘‘Managed’’ (average value of 2.21)
DOTs) was collected from the online survey distributed maturity level or less for technology. The two lines in
to the AASHTO members described above. The collected Figure 1 define the boundaries for successful and unsuc-
data were checked for reliability and validity before the cessful technology implementation, informing state DOTs
analysis was done. The power analysis was done to find that the maturity levels of people, process, and technology
the smallest sample size requirements to test the hypoth- below or at the dashed line is expected to yield an unsuc-
esis, and it was found that a minimum sample size of cessful technology implementation effort, whereas matu-
twelve was required. The sample is considered appropri- rity levels at or above the solid line support the successful
ate as each state DOT is represented, professionals were implementation of technology. Furthermore, if assessed
focused on construction and asset management imple- levels are between the defined bands or if one metric is
mentation, and responses indicated repetition. The results below the desired level, the state DOT understands where
were further corroborated by the secondary group of effort needs to be expended to improve the likelihood of
experts during the validation workshop. Each respondent technology implementation success.
was asked to identify (1) the people, process, and technol- After the maturity levels of each scenario were
ogy maturity levels that lead to successful technology obtained from the survey, the levels were assembled and
implementation, and (2) the people, process, and technol- validated during an in-person workshop that hosted
ogy maturity levels that result in unsuccessful technology eighteen transportation professionals. The workshop
implementation. The average maturity level was com- participants have significant technology-related experi-
puted for each dimension (people, process, and technol- ences and expertise in state DOTs. They were asked if
ogy) for each scenario (successful and unsuccessful they agreed with the survey results or not. If they did not
technology implementation). Figure 1 illustrates the agree with the results, they were asked to provide new
results for both scenarios by displaying (1) the maturity responses to questionnaires. The aggregate results from
level required for each dimension to achieve a successful the in-person workshop were calculated similarly to the
technology implementation (solid line) and (2) the matu- survey results. Tables 2 and 3 illustrate the average matu-
rity level for each dimension that, below which, results in rity levels from the survey (online survey) and workshop
an unsuccessful technology implementation (dashed line). validation (in-person workshop) for successful and
From the results and validation, state DOTs should unsuccessful technology implementation, respectively.
have at least level 3, ‘‘Defined’’ (average value of 3.25) The maturity levels from the survey entail an aggregated
maturity level for people, at least level 3, ‘‘Defined’’ average maturity level of eighty-nine responses, whereas
(average value of 3.34) maturity level for process, and at the maturity level from the workshop is the aggregated
least level 3, ‘‘Defined’’ (average value of 3.31) maturity average maturity level of eighteen responses. Comparing
level for technology to lead to probable success in tech- the maturity levels from the survey and the in-person
nology implementation. The findings also present that workshop reveals nearly identical average maturity levels
unsuccessful technology implementation can be expected for successful and unsuccessful technology
18 Transportation Research Record 2678(1)

Table 2. Average Maturity Levels for Successful Technology visible within their DOT and include the technology as
Implementation from Survey and Workshop Validation an aspect of the roles and responsibilities in alignment
with job function. It should be noted that the tool
Maturity level Maturity level
involves a self-assessment, and the models are broad in
Dimension from survey from workshop
nature to provide applicability across a wide range of
People 3.26 3.27 technologies and modes of implementation. The study’s
Process 3.34 3.35 novel findings include an evaluation of technology imple-
Technology 3.37 3.32 mentation using people, process, and technology matu-
rity to increase the successful technology implementation
likelihood. The study also recommended levels of matu-
rity along people, process, and technology for successful
Table 3. Average Maturity Levels for Unsuccessful Technology
technology implementation
Implementation from Survey and Workshop Validation

Maturity level Maturity level


Dimension from survey from workshop Discussion
People 1.94 1.89 The collective maturity of people, process, and technol-
Process 2.25 2.15 ogy is a distinguishable factor in the success or failure of
Technology 2.23 2.20 technology implementation. To gain a deeper under-
standing of the interactions between the three dimensions
of people, process, and technology, the previously men-
implementation. The results point to the same bands as tioned survey respondents were asked to elaborate on
illustrated in Figure 1. how the three dimensions (1) collectively contributed to
To assist state DOTs self-assess their current levels of a successful technology implementation effort, or (2)
people, process, and technology maturity and compare resulted in an unsuccessful technology implementation
these with the maturity boundaries established through effort.
this research, a Microsoft Excel tool was developed to The analysis of these collected data showed that the
disseminate the research results to state DOTs. The con- examples of successful technology implementation
cept of the tool is illustrated here in the form of a table, involved good coordination between people, process,
as shown in Table 4. Table 4 also illustrates an example and technology. One of the respondents provided the fol-
of how a state DOT might assess its maturity and use this lowing explanation of how their state DOT leveraged the
information to improve the probability of its technology three dimensions to achieve success in an implemented
implementation success. Table 4 displays the five levels technology by stating:
for each dimension (people, process, and technology) of
the model and allows the state DOT to select their cur- The very first step is to understand the current business pro-
rent level (seventh column) using a dropdown list. The cesses/standards established by agency guidelines/standards/
maturity boundaries established through this research for processes. Once these are identified, the project/technology
each dimension are available in columns 8 and 9. Once was tailored to improve or suit the identified guidelines/
standards/processes. A core team of employees was selected
the user has selected their state DOT’s current level of
as part of the implementation team based on experiences
maturity for each dimension, a chart like a Figure 2 will
and capabilities. The core team manages the project at a
be displayed, showing the maturity boundaries as well as project level, with occasional inputs from experts or man-
the current assessment of the state DOT’s maturity levels agement when needed. This process allowed for flexibility at
(represented by the dotted line). the project level and adaptation of technology to the current
Table 4 and Figure 2 enable state DOTs to identify business processes/standards to avoid any unintended
where their maturity levels reside and contemplate the interruptions.
probability of the success of their implementation effort.
The table and figure also allow the state DOT to discri-
minate where improvements are needed for an improved Other survey respondents noted that their state DOT
likelihood of technology implementation success. The took a proactive approach and developed research cap-
levels selected in Table 4 are provided for illustrative pur- abilities where technologies are thoroughly vetted before
poses only, but point to the need of the example state actual implementation. The analysis of the responses
DOT to consider improvements along People and shared on the unsuccessful technology implementation
Technology to have an improved likelihood of successful efforts showed that the increased emphasis on technol-
technology implementation. In this example, the state ogy while neglecting the people dimension is a common
DOT may decide to make technology, in general, more theme among those experiencing technology
Table 4. Maturity Assessment of People, Process, and Technology for State Departments of Transportation (DOTs)

Successful Unsuccessful
implementation implementation
Criteria Level 1: Initial Level 2: Managed Level 3: Defined Level 4: Predictable Level 5: Optimizing Your DOT level level level

People DOTs do not have DOTs provide a DOTs inboard the DOTs have The entire DOTs Level 2 3 2
enough talented good working right people in confidence in are focused on
human resources environment, the right position employees and continual
required to training to based on delegate tasks to improvement and
handle projects empower staff, competency, empowered improvement of
and cannot retain and a clear line of experiences, and groups. The individuals to the
qualified communication roles and managers at improvement of
employees. within units. responsibilities higher levels can units to the
that are well focus more on overall
defined and strategic issues. organization
develop an while focusing on
organization-wide main objectives.
infrastructure.
Process DOTs understand DOTs plan the DOTs provide DOTs provide DOTs fully Level 4 3 2
and establish projects on the informal Project formal Project understand and
basic Project individual process Management Management implement
Management and are not team training and training, and Project
Process. oriented. manage project multiple projects Management
based on available are integrated procedures to
systems with few and planned with create a dynamic,
team members. maximum team energetic
participation. organization and
be able to
manage complex
projects in the
future.
Technology DOTs have access DOTs staff using DOTs use and DOTs fully use DOTs fully Level 2 3 2
to technologies, technologies only implement technologies in all implement
and technologies in a handful of technologies in possible projects technologies and
are not managed projects. many projects. throughout the find ways to
properly. state for implement them
appropriate in other projects,
applications and technologies
are managed collaboration, and
properly. updating their
implementation
plan as required.

19
20 Transportation Research Record 2678(1)

success in technology implementation. It presents self-


assessment metrics for state DOTs in considering tech-
nology implementations, and provides baseline limits
illustrating areas of probable success and failure. These
metrics and limits are provided and validated by a signif-
icant sampling of experts. With ongoing associated
efforts, this work is expected to significantly assist state
DOTs as they consider implementing technologies in
highway construction and asset management.
The associated research based on the preliminary
results here aims to find implementation factors for tech-
nology implementation capabilities. The ongoing
NCHRP 03-140 research project ‘‘Guidelines for
Figure 2. Department of Transportation (DOT) current level, Applications of RFID and Wireless Technologies in
successful, and unsuccessful technology implementation levels Highway Construction and Asset Management’’ identi-
visualization. fied five factors as the requirements for implementing the
technologies at DOTs. The panel, which includes a repre-
sentative from Federal Highway Administration
implementation failures. Moreover, respondents also (FHWA), DOTs, and other industry experts, has identi-
noted that although the people and process dimensions fied Organization Structure, IT Infrastructure, Data
might be mature, when the technology is not compatible Security, Information workflow, and Personnel Training
with existing systems, a failure is imminent. This as five important factors of technology implementation.
emerged as a critical challenge, especially when the tech- In addition to the five factors identified in the RFP of
nology was driven from outside the organization and the NCHRP 03-140, the research team identified
state DOT did not have the right processes to train their Stakeholder Engagement as the sixth factor important
employees or understand their needs. Additionally, for technology implementation at state DOTs.
implementation efforts were often challenged where sta- Understanding these implementation factors is a criti-
keholders were not engaged in the process, resulting in cal consideration for technology implementation. The
little end-user input, lack of personnel training at roll- combination of assessing maturity levels along people,
out, no direct support and commitment from leadership, process, and technology, using weighted importance of
and unaddressed concerns or no long-term support. these levels of people, process, and technology, and asses-
Ultimately, the key difference between a successful and sing the implementation factors for technology imple-
unsuccessful technology implementation is the presence mentation capabilities will provide state DOTs with a
of the right people with the right mindset working detailed framework with which to assess their proposed
together. A successful implementation will improve by technology implementations and gauge their potential
increasing levels of maturity across people, process, and success or failure before incurring the expenses and risks
technology, whereas an unsuccessful implementation will of these attempts.
typically have maturity below the baselines previously Noted limitations of the study include that the deter-
described. mination of technology implementation success is
founded on a subjective measure of the subject matter
experts having witnessed those implementations.
Conclusions
Further, the study was limited to the identification of six
This research holistically analyzed the recommended lev- technology implementation factors. Although these six
els of maturity along people, process, and technology for factors were identified by experts, there are potentially
successful technology implementation. For any technol- other factors of importance in the success of technology
ogy implementation efforts to be successful, state DOTs implementations. Future work can explore and expand
need to focus not only on the technology itself but also on these factors. The research is also limited by its broad
be mindful of the needs within the metrics of people and nature so as not to focus on any specific technology.
process. As noted by experts, success in technology This limitation is also viewed a strength so that the mod-
implementation is based on the adoption and emphasis els can be broadly applicable. This aligns with other
of people who drive the processes that allow for piloting work on maturity models, that are also broad in nature
and implementing the technology in all criteria per the and provide opportunities for organizations to modify
requirements. This research relays the importance of them per their own requirements. Although the defini-
maturity in people, process, and technology for probable tions for the maturity levels may vary or be altered, the
Tripathi et al 21

approach and main concept of maturity and maturity 450. Transportation Research Board of the National Aca-
models remains the same. demies Press, Washington, D.C., 2013. https://doi.org/10.
Future research will include more detailed investiga- 17226/22514.
tion in criteria for each technology implementation fac- 2. Tripathi, A., H. Nassereddine, G. Dadi, and R.E. Sturgill
tor. The authors also plan to validate findings with Toward a Readiness Assessment for wireless Technologies
detailed case investigations at selected state DOTs. Cases for Highway Construction and Infrastructure Asset Man-
agement. Proc., Construction Research Congress, Arling-
will be planned with state DOTs successfully implement-
ton, VA, 2022. https://doi.org/10.1061/9780784483961.014.
ing technologies and those that require assistance with 3. Love, P. E. D., C. MacSporran, and S. N. Tucker The
technology implementation efforts. Application of Information Technology by Australian
Contractors: Toward Process Re-Engineering. Proc., 4th
Acknowledgment Annual International Group for Lean Construction Confer-
ence, Birmingham, 1996.
The authors wish to thank all the DOT participants in the sur-
4. The National B2B Center. Three keys to IT System Success:
vey, interview, and workshops for their participation and sup-
People, Process, Technology. https://www.nb2bc.co.uk/
port in this study.
three-keys-to-it-system-success-people-process-technology/.
5. Simon, B. Complete Guide to the PPT Framework. Smart-
Author Contributions sheet, June 14, 2019. https://www.smartsheet.com/content/
people-process-technology. Accessed July 19, 2022.
The authors confirm their contribution to the paper as follows:
6. NCHRP Web-Only Document 214. Transportation Agency
study conception and design: Amit Tripathi, Makram Bou
Self-Assessment of Data to Support Business Needs: Final
Hatoum, Ashtarout Ammar, Roy Sturgill; data collection:
Research Report. Transportation Research Board, 2015.
Amit Tripathi, analysis and interpretation of results: Amit
http://onlinepubs.trb.org/onlinepubs/nchrp/nchrp_w214.pdf.
Tripathi, Roy Sturgill, Hala Nassereddine, Gabriel Dadi; draft
7. NCHRP 08-36, Task 100 Transportation Data Self-Assess-
manuscript preparation: Amit Tripathi, Hala Nassereddine. All
ment Guide. Transportation Research Board, 2011. https://
authors reviewed the results and approved the final version of
the manuscript. onlinepubs.trb.org/onlinepubs/nchrp/docs/NCHRP 08-
36(100)_FR.pdf.
8. Department of Technology, Management & Budget. State
Declaration of Conflicting Interests Unified Information Technology Environment (SUITE).
The author(s) declared no potential conflicts of interest with https://www.michigan.gov/dtmb/services/suite.
respect to the research, authorship, and/or publication of this 9. Francis, A.People Capability Maturity Model (PCMM).
article. https://www.mbaknol.com/human-resource-management/
introduction-to-people-capability-maturity-model-pcmm/.
10. ISACA. CMMI Institute. https://cmmiinstitute.com/pm.
Funding 11. Kwak, Y. H., and C. W. Ibbs. Project Management Process
The author(s) received no financial support for the research, Maturity (PM)2 Model. Journal of Management in Engi-
authorship, and/or publication of this article. neering, Vol. 18, No. 3, 2002, pp. 150–155.
12. White, S. What is CMMI? A Model for Optimizing Develop-
ment Processes. Cio.com, 2021. https://www.cio.com/article/
ORCID iDs 274530/process-improvement-capability-maturity-model-inte-
Amit Tripathi https://orcid.org/0000-0002-2286-0154 gration-cmmi-definition-and-solutions.html.
Roy E Sturgill https://orcid.org/0000-0002-0702-8351 13. Tran, D., C. Harper, and R. Sturgill. Highway Infrastruc-
Makram Bou Hatoum https://orcid.org/0000-0002-8824- ture Inspection Practices for the Digital Age. Transportation
3941 Research Board, Washington, D.C., 2022.
Ashtarout Ammar https://orcid.org/0000-0002-9656-4761 14. Tripathi, A., G. B. Dadi, H. Nassereddine, R. E. Sturgill,
and A. Mitchell. Assessing Technology Implementation
Success for Highway Construction and Asset Manage-
References ment. Sensors, Vol. 23, No. 7, 2023, p. 3671. https://doi.
1. Taylor, T. R. B, and W. F. Maloney. Forecasting Highway org/10.3390/s23073671.
Construction Staffing Requirements. NCHRP Synthesis

You might also like