Professional Documents
Culture Documents
The National Academies Press
The National Academies Press
DETAILS
CONTRIBUTORS
GET THIS BOOK Jorge Rueda-Benavides, Cesar Mayorga, Auburn University, Arizona State
University Cliff Schexnayder, Ghada Gad, California State Polytechnic
University, and Daniel D Angelo, Applied Research Associates, Inc.; National
FIND RELATED TITLES Cooperative Highway Research Program; Transportation Research Board; National
Academies of Sciences, Engineering, and Medicine
SUGGESTED CITATION
Visit the National Academies Press at NAP.edu and login or register to get:
Distribution, posting, or copying of this PDF is strictly prohibited without written permission of the National Academies Press.
(Request Permission) Unless otherwise indicated, all materials in this PDF are copyrighted by the National Academy of Sciences.
N AT I O N A L C O O P E R AT I V E H I G H W AY R E S E A R C H P R O G R A M
Jorge Rueda-Benavides
Cesar Mayorga
Auburn University
Auburn, AL
Cliff Schexnayder
Arizona State University
Tempe, AZ
Ghada Gad
California State Polytechnic University
Pomona, CA
Daniel D’Angelo
Applied Research Associates, Inc.
Champaign, IL
Subscriber Categories
Administration and Management • Finance
Research sponsored by the American Association of State Highway and Transportation Officials
in cooperation with the Federal Highway Administration
2020
The National Academy of Sciences was established in 1863 by an Act of Congress, signed by President Lincoln, as a private, non-
governmental institution to advise the nation on issues related to science and technology. Members are elected by their peers for
outstanding contributions to research. Dr. Marcia McNutt is president.
The National Academy of Engineering was established in 1964 under the charter of the National Academy of Sciences to bring the
practices of engineering to advising the nation. Members are elected by their peers for extraordinary contributions to engineering.
Dr. John L. Anderson is president.
The National Academy of Medicine (formerly the Institute of Medicine) was established in 1970 under the charter of the National
Academy of Sciences to advise the nation on medical and health issues. Members are elected by their peers for distinguished contributions
to medicine and health. Dr. Victor J. Dzau is president.
The three Academies work together as the National Academies of Sciences, Engineering, and Medicine to provide independent,
objective analysis and advice to the nation and conduct other activities to solve complex problems and inform public policy decisions.
The National Academies also encourage education and research, recognize outstanding contributions to knowledge, and increase
public understanding in matters of science, engineering, and medicine.
Learn more about the National Academies of Sciences, Engineering, and Medicine at www.nationalacademies.org.
The Transportation Research Board is one of seven major programs of the National Academies of Sciences, Engineering, and Medicine.
The mission of the Transportation Research Board is to provide leadership in transportation improvements and innovation through
trusted, timely, impartial, and evidence-based information exchange, research, and advice regarding all modes of transportation. The
Board’s varied activities annually engage about 8,000 engineers, scientists, and other transportation researchers and practitioners from
the public and private sectors and academia, all of whom contribute their expertise in the public interest. The program is supported by
state transportation departments, federal agencies including the component administrations of the U.S. Department of Transportation,
and other organizations and individuals interested in the development of transportation.
AUTHOR ACKNOWLEDGMENTS
The research reported herein was performed under NCHRP Project 10-101, “Improving Mid-Term,
Intermediate, and Long-Range Cost Forecasting: Guidance for State Departments of Transportation.”
Principal Investigator Dr. Jorge Rueda-Benavides, Assistant Professor, Department of Civil Engineering,
Auburn University (AU) led the research. All research efforts were performed with the support of the
AU Highway Research Center. The co-principal investigators in this project were Dr. Cliff Schexnayder,
Arizona State University, Tempe, AZ (retired); Dr. Ghada Gad, Assistant Professor, California State
Polytechnic University, Pomona, CA; and Daniel D’Angelo, Principal Civil Engineer, Applied Research
Associates, Inc., Champaign, IL. Cesar Mayorga, doctoral candidate in the Department of Civil Engineer-
ing at AU, served as a graduate research assistant on this project.
The research team also acknowledges the valuable support and contributions made by the AASHTO
Technical Committee on Cost Estimating, which served as an expert advisory panel for this study.
The Minnesota Department of Transportation, Colorado Department of Transportation, and Delaware
Department of Transportation also made valuable contributions to this study by providing the research
team with sufficient historical bid data to develop and assess the long-term performance of various cost
forecasting approaches.
FOREWORD
By Ann M. Hartell
Staff Officer
Transportation Research Board
NCHRP Research Report 953 presents a cost forecasting method for use by state trans
portation agencies that better accounts for cost variability and economic volatility over
time. The method will be of interest to those responsible for developing and updating
cost forecasts for mid-term State Transportation Improvement Programs (3 to 5 years),
intermediate-range plans (up to 15 years), and Long-Range Transportation Plans (20 years)
as well as those who manage transportation investment programs, administer the bid-letting
process, and oversee contracts.
The ability to create accurate forecasts of project costs is a core competency for state
departments of transportation (DOTs). Cost forecasting is used to develop and update
transportation plans; program projects; manage transportation improvement programs;
administer the bid-letting process; and oversee contracts. Forecasts are used to demonstrate
fiscal constraint and to track performance measures of on-time, within-budget delivery.
Reliable and accurate cost forecasts help agencies improve decision-making and transparency
and build trust by supporting reliable program delivery.
Because transportation investment programs have extended time horizons, state DOTs
must forecast costs well into the future. This poses a serious challenge: the longer the
time horizon, the more uncertainty and risk that forecasted costs will vary from actual,
future costs. The sources of forecasting uncertainty include variation in market conditions,
construction conditions, and inflation of costs for materials and labor, which increase or
decrease at different rates over time and by region.
NCHRP Report 953 presents a multilevel construction cost index (MCCI) for use by state
DOTs to develop forecasts from initial cost estimates. The MCCI can be used to improve
the accuracy of cost forecasting by accounting for differences in inflation rates for different
materials and work items included in a program as well as regional differences within a state.
By incorporating these differences and drawing from state-specific data, the MCCI offers
considerable improvement over the use of a single, generalized inflation rate to forecast the
future cost of a transportation investment program.
Under NCHRP Project 10-101, “Improving Mid-Term, Intermediate, and Long-Range
Cost Forecasting: Guidance for State Departments of Transportation,” Auburn University
was asked to review current practice in cost forecasting and develop a practical approach to
improving cost forecasting methods. The resulting method—the MCCI—was developed in
partnership with three DOTs that contributed data and vetted the method: the Minnesota
DOT, the Delaware DOT, and the Colorado DOT. The AASHTO Technical Committee on
Cost Estimating also provided feedback.
CONTENTS
1 Chapter 1 Introduction
1 1.1 Introduction and Background
2 1.2 Overview of Guidebook
3 1.3 Business Case for Implementation of Effective Cost Forecasting Programs
3 1.4 Inflation Rates and Cost Indexes
4 1.5 Factoring Inflation Rates into the Cost Forecasting Process
6 1.6 Current Practice Versus Ideal Practice
54 Acronyms
55 References
Note: Photographs, figures, and tables in this report may have been converted from color to grayscale for printing.
The electronic version of the report (posted on the web at www.trb.org) retains the color versions.
CHAPTER 1
Introduction
1
2 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
read the NCHRP Web-Only Document 283: Improving Mid-Term, Intermediate, and Long-Range
Cost Forecasting for State Transportation Agencies (Rueda-Benavides et al. 2020) which includes
additional background information that facilitates a better understating of the forecasting
methodologies presented in the following chapters.
Introduction 3
4 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
a period of time (usually annual rates). A negative inflation rate is called deflation, and it
corresponds to an overall decrease in the price of goods and services.
Calculating a single inflation rate for a group of goods and services is a challenging process,
since it usually involves a wide variety of inputs with different levels of relevance. For example,
a transportation-related combined inflation rate calculated for asphalt and steel would be more
affected by a 10% increase in the price of asphalt than by the same percentage increase in the
price of steel. That is because asphalt is significantly more relevant for STAs than steel. Although
that may be easily concluded from the hypothetical scenario, the quantification of the impact
of the different inputs on the inflation rate is a more complicated process. The first step in
quantifying an inflation rate with these two commodities would be determining how much
more relevant asphalt is as compared with steel. After determining the relative relevance of each
commodity, the agency would need to find a mechanism to facilitate an “apples-to-apples”
integration of these two commodities into a single inflation rate. That mechanism is a cost
index, which can then be used to generate the required inflation rate. Cost indexes can track
prices for a single item or can be designed to integrate multiple cost inputs into a single eco-
nomic indicator that takes into consideration the level of relevance (relative weight) of each
item. In this example, a cost index developed with asphalt and steel prices could be used to
estimate an overall combined inflation rate for both commodities, which in turn could be
used to forecast a combined cost.
Cost indexes developed with construction-related inputs are called CCIs. A CCI is a time
series aimed to quantify average price fluctuations in the construction market or a specific
sector of the construction industry. Although cost indexes are popular cost estimating tools
among STAs, they are not commonly used for cost forecasting purposes. Most agencies seem
to rely on standard inflation rates suggested by external entities, such as FHWA, other federal
or state agencies, or financial consultants. Externally suggested inflation rates are most likely
estimated from the quantitative analysis of cost indexes. However, that analysis is not internally
performed by STAs, who decide to accept the suggested rates, ignoring their associated implica-
tions and limitations.
The 4% annual inflation rate proposed by FHWA is being used by a number of STAs.
However, according to FHWA, preference should be given to the use of in-house or external
CCIs to generate applicable inflation rates (FHWA 2017a). Some external CCIs available to
STAs include the National Highway CCI (NHCCI) calculated by FHWA and CCIs published by
the Engineering News-Record (ENR) and RSMeans. A number of STAs have developed their
own CCIs, but only in a few cases have they used these to support forecasting efforts over long
periods of time. As explained in Chapter 3, there are a number of limitations associated with
the use of traditional in-house or external cost indexes. Chapter 3 of this guidebook provides
information on the development and implementation of an MCCI system that has been
designed to overcome the limitations of traditional CCIs and allow the implementation of the
ideal cost forecasting process described in Section 1.6. NCHRP 10-101 found that MCCIs are
significantly more effective at tracking price fluctuations in the construction market and, hence,
are a more reliable source of inflation rates than traditional CCIs (Rueda-Benavides et al. 2020).
Introduction 5
there are different approaches used to incorporate inflation rates into the cost forecasting
process. There are two main types of inflation rates:
• Simple annual inflation rate (not compounded) and
• Compound annual inflation rate.
An annual inflation rate represents the average expected annual growth in construction
prices during the intended forecasting period. Some STAs use simple inflation rates, while
others prefer compound rates. When a simple inflation rate is used, the projected cost is
increased by the same number of dollars every year. The magnitude of the equal annual
increase is equal to the cost estimate in current dollars multiplied by the simple annual infla-
tion rate. For example, some agencies were found to use a simple annual inflation rate of
3% to forecast construction costs. Assuming that this inflation rate is reasonably accurate,
the cost of a $10 million construction program (current-dollar estimate) would be expected
to increase by $300,000 per year ($10 million × 0.03) for a total increase of $1.5 million in
5 years. Equations 1-1 and 1-2 show the calculations for this example.
where
n = length of forecasting time horizon in years,
FCEn = forecast cost estimate over n years (in future dollars),
CCE = current cost estimate (in current dollars), and
i = fixed annual inflation rate.
On the other hand, a compound annual inflation rate is applied every year to the cumulative
inflation up to the previous year. Other agencies were also found to use a 3% annual inflation
rate but compounded annually. Equations 1-3 and 1-4 show how a 3% compound annual
inflation rate would be applied to develop a 5-year forecast for the same current-dollar estimate
used in Equations 1-1 and 1-2.
where
n = length of forecasting time horizon in years,
FCEn = forecast cost estimate over n years (in future dollars),
CCE = current cost estimate (in current dollars), and
i = fixed annual inflation rate.
Figure 1-1 shows the difference between a 5% simple and a 5% compound inflation rate
when applied to the same $10 million program over 20 years. Even though the two curves start
deviating from each other after the first year, the difference between them starts becoming
evident after the fifth year, which suggests that there is no significant difference in applying
a simple or a compound inflation rate for midterm forecasts. The difference between these
two types of inflation rates increases as the forecast time horizon is extended. Therefore, and
given that the linear regression process is slightly more straightforward than the exponential
regression approach, the framework for selecting a cost forecasting approach presented in the
next chapter gives preference to the use of simple inflation rates for midterm forecasts and
compound rates for intermediate and long-range time frames.
6 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
$24,000,000
$22,000,000
$20,000,000
$18,000,000
$16,000,000
$14,000,000
$12,000,000
$10,000,000
$8,000,000
0 2 4 6 8 10 12 14 16 18 20
Number of Years
5% Simple Inflation Rate 5% Compounded Inflation Rate
Figure 1-1. Compound inflation rate versus simple inflation rate.
One-size-fits-all inflation
rate or derived from a
non-scope-based CCI
Introduction 7
periods. For example, long-range programs usually involve a broad scope of work. However,
sometimes they could include specific capital projects defined at a higher level of detail and
whose associated costs are forecast over 20–25 years. An ideal cost forecasting process should
also provide decision-makers with a forecasting timeline showing the progression of the cost
forecast as it moves across the desired forecasting time period. Likewise, traditional fore
casting practices need to evolve from deterministic into risk-based outputs to account for
estimating uncertainty and to facilitate the communication of such uncertainty to different
types of stakeholders and decision-makers. The combination of those ideal requirements led
the research team to develop a methodology that facilitates the generation of reliable risk-
based forecasting timelines, such as the one shown in Figure 1-3. That methodology, which is
discussed in Chapter 4, is called moving forecasting error (MFE).
From FHWA’s perspective, an ideal cost forecasting system would use in-house historical cost
data as the main reference for the determination of applicable inflation rates. “Local historic
cost data and experience with cost inflation are valuable data sources for use in projecting future
rates” (FHWA 2017b). This logic explains the use of in-house historical cost data suggested
in Figure 1-3.
The ideal cost forecasting methodology also requires the implementation of flexible cost
indexing techniques that allow the customization of CCIs to the specifics of each project,
such as the scope-based CCIs shown in Figure 1-3, which in turn facilitate the generation
scope-based inflation rates. Cost indexing systems with that level of flexibility have been
developed by separate studies conducted for the Minnesota Department of Transportation
(DOT) (Gransberg and Rueda-Benavides 2014) and the Alabama DOT (Pakalapati 2018). Those
studies demonstrated the ability of an innovative cost indexing system to overcome the limita-
tions of traditional CCIs. This innovative system is the MCCI mentioned earlier in this chapter.
An MCCI consists of a group of indexes organized in a multilevel arrangement that allows
the forecasting of each cost element in a program or project with the MCCI index that best
matches its scope. Thus, costs for different programs or projects are forecast with different sets
of indexes, which offers great flexibility in customizing the forecasting process to the specifics
of each scope of work.
As explained before, the framework for selecting a cost forecasting approach presented in the
next chapter is intended to guide STAs on a wide range of cost forecasting options; however,
not all these options would allow the ideal cost forecasting process shown in Figure 1-3. That
ideal process offers the best cost forecasting performance, but it is also associated with greater
staff and IT efforts and requirements that may discourage some STAs from taking that path.
The ideal process in Figure 1-3 is mainly associated with the use of the proposed MCCI and
MFE methodologies explained in Chapters 3 and 4, respectively.
CHAPTER 2
2.1 Introduction
The framework for selecting a cost forecasting approach presented in this chapter is
intended to serve as a map to guide planners and estimators through different sets of guide-
lines and tools according to the unique set of requirements, preferences, and constraints of
each state transportation agency (STA) in terms of data quality and availability, information
technology (IT) and staff capabilities, the intended cost forecasting time horizon, and risk
tolerance. The five-module framework is intended to be the first stop for any STA interested in
implementing the guidance and tools described in this guidebook. The flow chart in Figure 2-1
shows the role of each module as part of the overall cost forecasting process.
In summary, the planning team starts with Module 1, which assists STAs with the selection
of a suitable cost indexing alternative that meets the needs and capabilities of the agency.
The agency could opt for the use of a standard inflation rate without the analysis of a cost
index. In that case, the planning team would be referred to Module 2, which is a compilation
of annual inflation cost indexes that showed an effective performance for the three case studies
conducted under NCHRP 10-101 (Rueda-Benavides et al. 2020). If an index-based forecast-
ing process is selected in Module 1, the framework would direct STAs to Module 3, 4, or 5,
depending on whether the intended cost forecast corresponds to a midterm, intermediate,
or long-range forecast, respectively.
Module 1.
Cost Index Selection
Standard or
Index-Based
Inflation Rate?
Index-Based Standard
Module 2.
Standard Inflation
Forecasting Rate Selection
Time Horizon
Mid-Term Long-Range
Horizon Horizon
Intermediate-Range Horizon
their associated forecasting error ranges. Module 2 is intended for agencies that decide not to
calculate applicable inflation rates from the internal assessment of a cost index but rely instead
on other STAs’ experiences.
The three levels of magnitude for construction market inflation (low, medium, high) were
identified on the basis of the three case studies conducted under NCHRP 10-101 (Rueda-
Benavides et al. 2020). They were considered in Module 2 to facilitate more effective forecasting
outputs for STAs on the low and high ends of the spectrum. The use of medium annual inflation
rates could be considered by agencies that do not have reliable information from which to
infer the level of magnitude of upcoming inflation rates. However, it should be noted that the
forecasting error ranges in Table 2-3 are applicable under the assumption that the agency would
appropriately place itself in one of the inflation magnitude categories. An error in doing so
would increase the level of uncertainty and thus widen the forecasting inflation rate. To illustrate,
for an intermediate-range forecast of concrete paving activities, if the agency considers that the
inflation rate is going to be high for this forecasting period, Module 2 would suggest a compound
inflation rate of 4%. On the basis of the forecasting error ranges in Table 2-3, the agency could
expect, with a 90% confidence level, a ±30% forecasting error. It should be noted that this error
is associated with the forecast value. For example, if the forecast estimate obtained for a given
concrete paving program with this inflation rate is $10 million, the agency could expect, with
a 90% confidence level, to have an actual program cost between $7 and $13 million.
Although Module 2 constitutes an improvement in the quality of guidance for users of
standard inflation rates, a better cost forecasting performance can still be achieved by calculating
annual inflation rates through more formal quantitative procedures that use the guidelines
provided in this guidebook. Formal quantitative approaches allow a more effective calculation
of annual inflation rates on a case-by-case basis and result in a considerable reduction of cost
forecasting uncertainty.
Note: MCCI = multilevel construction cost index; CCI = construction cost index.
12 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Selection of
forecasting approach
intermediate-range forecasts, and between 15 and 20 years (20 years ideally) of historical bid
data for long-range forecasting procedures. As mentioned in Section 1.5, simple annual infla-
tion rates could be used for midterm forecasts, while compound rates are more appropriate
for intermediate and long-range time horizons.
If no recent abnormal behavior is identified, or if it is not expected to continue along the
intended forecasting period, the moving forecasting error (MFE) method would be more
appropriate. The MFE method, which is explained in detail in Chapter 4, is an innovative data-
driven cost forecasting approach proposed by NCHRP 10-101 (Rueda-Benavides et al. 2020).
This methodology proved to be effective at producing forecast values from the analysis of
historical bid data. The MFE method is designed to produce forecasting outputs in the form of
risk-based forecasting timelines, such as the one shown in Figure 1-3.
All forecasting error ranges in Tables 2-4 to 2-6 are associated with the use of the MFE
approach. Those tables show different sets of error ranges for the two different types of work
under consideration as well as for two different sources of market data: the innovative MCCI
approach or traditional CCIs. A comparison of the latter two reveals a clear reduction in cost
Selection of
forecasting approach
14 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Selection of
forecasting approach
The main difference between the proposed MFE method and regression analysis techniques
lies in their assumptions of risk. The MFE can be classified as a more conservative, or risk-
averse, approach, since it produces a cost forecasting output that combines results from
several forecasting scenarios created within the available data. However, regression models are
the result of a single configuration of the available data, making them more appropriate for
risk-seekers who decide to rely on a single scenario and thereby underestimate cost forecasting
uncertainties. That is the classification used in Module 5 (risk-seeking versus risk-averse) to
help STAs decide between the MFE method and regression analysis techniques. In the case of
intermediate-range forecasts, and in view of evident market corrections, Module 4 suggests
the assessment of both MFE and regression analysis (linear and exponential), if possible. The
final inflation rate selection would be made after reviewing the different MFE and regression
analysis outputs.
CHAPTER 3
3.1 Introduction
This chapter discusses cost indexing alternatives available to state transportation agencies
(STAs) to support cost forecasting procedures. In order from the least- to the most-effective
cost indexing method for construction cost forecasting, these alternatives are as follows:
1. Macroeconomic indexes,
2. Traditional external and in-house construction cost indexes (CCIs), and
3. The innovative multilevel construction cost index (MCCI) system.
The benefits and drawbacks associated with each alternative are addressed.
It should be noted that two different CCIs would most likely always yield different inflation
rates (Rueda-Benavides 2016), even if they had been developed for the same purpose and with
the same inputs. Output differences depend on several factors, including, but not limited to,
data sources, data processing and cleaning procedures, index composition, and index calcula-
tion approach. This poses a challenge for STAs when an inflation rate needs to be determined.
How can an STA know which cost index is offering the best inflation rates? To help with that
challenge, the last part of this chapter describes a protocol for the comparative analysis of cost
indexing alternatives that is designed to identify the best cost indexing approach among a set of
available alternatives.
15
16 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
impact that a drastic change in asphalt prices would have on the construction industry. Likewise,
some STAs have found that “construction inflation generally outpaces consumer inflation”
(Duncan et al. 2017), implying that the use of the CPI or PCE could lead to an underestimation
of future construction costs.
bid data to develop in-house CCIs enables STAs to indirectly account for the unique conditions
of the local construction market (to a certain extent): “Pricing changes in any single state can be
affected by influences that are muted or lost in national prices and price indexes. One example
of this is contractor competition, which has a strong influence on prices but has only a local or
regional effect” (Molenaar et al. 2013).
∑ j =1 p j,t q j,0
n
L( p) = n Eq. 3-1
∑ j =1 p j,0q j,0
∑ j =1 p j,t q j,t
n
P ( p) = Eq. 3-2
∑ j =1 p j,0q j,t
n
F ( p) = × n Eq. 3-3
∑ j =1 p j,0q j,0 ∑ j =1 p j,0q j,t
n
where pj,t is the prevailing price of item j in period t and qj,0 is the quantity of item j purchased
in period 0.
Research results from NCHRP 10-101 revealed a significant issue associated with these typical
procedures for calculating a price index (Rueda-Benavides et al. 2020). These equations are not
able to factor the economies of scale principles into the cost indexing process. “Economies of
scale refers to a reduction in total cost per unit as output increases” (Betts 2007); that is, lower
unit prices should be expected for larger quantities of work, and vice versa.
It is important to understand that these traditional price index equations were proposed in
the 1920s, or even earlier (Fisher 1922)—before the era of computers, when the estimation of
index values was limited to hand-made calculations, which constrained data processing and
analysis capabilities. This could explain the simplicity of these equations and the reason why
they are unable to consider the principles of economies of scale. Their limited ability to factor
the relationship between unit prices and quantities is better illustrated with the following
simple example.
18 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Asphalt Concrete
$1,000 $1,000
$900
$800
$800
Price [USD]
Price [USD]
$600 $700
$400 $600
(250, $495.24)
(200, $134.06) $500
$200
$400
$0 $300
0 500 1,000 1,500 2,000 0 1,000 2,000 3,000
Quantity [tons] Quantity [CY]
Note: CY = cubic yards.
Figure 3-1. Asphalt and concrete quantity versus unit price curves for Period 1.
Figure 3-1 shows two curves that represent the market conditions for two commodities for
a given STA: asphalt and concrete. These curves were created with historical cost data from
a given indexing period (Period 1). To illustrate, the highlighted point in the asphalt curve in
Figure 3-1 indicates that the average unit price for 200 tons of asphalt during that period was
around $135 per ton. For the purposes of this example, it is assumed that market conditions
remain unchanged during the next indexing period (Period 2). Thus, the same curves would
also represent the market in Period 2, as shown in Figure 3-2. Since the market has not changed
in between these two indexing periods, an effective composite cost index calculated with two
inputs should show no change in Period 2 with respect to Period 1. In order words, the index
values for both periods should be the same. However, if only the four data points shown in
Figures 3-1 and 3-2 are used in the calculation of the index values in their respective periods,
the traditional cost indexing equations would perceive an inexistent overall decrease of about
23% [(1.00 – 0.77)/100%] in market prices, as shown in Table 3-2.
There are other limitations to traditional CCIs in addition to their inability to consider
quantity–unit price relationships. Rueda-Benavides and Gransberg (2015) introduced two prin-
ciples that are repeatedly violated when traditional CCIs are used for cost estimating purposes
at the program or project level: the matching principle and the proportionality principle.
Asphalt Concrete
$1,000 $1,000
$900
$800
$800
Price [USD]
Price [USD]
$600 $700
Figure 3-2. Asphalt and concrete quantity versus unit price curves for Period 2.
The matching principle refers to the degree of similarity between the components used
in the calculation of a CCI and the scope to be forecast. Once the matching principle has
been reasonably met, the proportionality principle comes into play. It refers to the degree of
consistency between the relative weights of index components and the actual contribution of
the same components to the total cost of the intended program/project. Therefore, an ideal,
but unlikely, scenario would be one in which each cost element in the program is represented
by an input element in the CCI, and the relative weight of each element is the same in the
CCI as in the program. It should be noted that a violation of the matching principle implies
a violation of the proportionality principle, since not sharing the same components would
make it impossible to match the weights. Moreover, while there is considerable variability in
the scope and configuration of programs and projects within an STA during the planning and
programming phases, the set of input components in a typical CCI usually remains unchanged
over time. This means that the matching principle cannot always be met.
The lack of ability to meet the matching and proportionality principles is preventing STAs
from developing scope-based CCIs such as those required by the ideal cost forecasting pro-
cess proposed in Section 1.6. The MCCI methodology discussed in the next section not only
addresses this issue by offering a high degree of flexibility to adapt to the specific needs of each
program or project, but also allows the consideration of the economies of scale principle into the
cost forecasting process. Likewise, an MCCI has the capacity to address another problem faced
by STAs in the calculation of cost indexes: the absence or lack of sufficient data with which to
calculate index values at some indexing periods. The following section has more information
about the process of developing MCCIs and about the capabilities of this alternative cost
indexing approach.
The rest of this section provides additional information about this alternative cost indexing
approach and details the MCCI development process, starting with procedures for data
collection and cleaning. Some parts of this section use examples from the case studies conducted
under NCHRP 10-101 (Rueda-Benavides et al. 2020), to better illustrate the MCCI develop-
ment process.
20 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
All collected data should then be formatted into a tidy format that merges all projects
into a single data set. Figure 3-3 shows a screen capture of a small portion of the tidy data
set created for the Minnesota Department of Transportation (DOT). This was one of the case
studies conducted under NCHRP 10-101 (Rueda-Benavides et al. 2020). “Tidy data sets are easy
to manipulate, model and visualize, and have a specific structure: each variable is a column,
each observation is a row, and each type of observational unit is a table” (Wickham 2014).
There is only one observational unit in this study: pay items included in the collected projects.
Thus, there is only one table, with each row referring to a single pay item used in a given
project. The columns show all the available information associated with each pay item and its
respective contract. Information provided for each pay item on each row includes, but is not
limited to, item identification number, item description, awarded quantity, unit of measure-
ment, contract identification number, project location (e.g., county, district), and unit price
submitted by each bidder.
Any efforts to create a tidy data set are greatly rewarded with easier and more expedited data
manipulation and processing procedures. Although some of the information included in the
tidy data set will not be immediately used for the development of the MCCI, it could be required
for future market or financial analysis or to optimize MCCIs by modeling additional cost
influencing factors.
Data cleaning efforts should also include the identification and removal of outliers, which
would also be considerably easier with a tidy data set. “Usually, the presence of an outlier
indicates some sort of problem. This can be a case that does not fit the model under study, or
an error in measurement” (Cho et al. 2010). Two outlier detection filters strategically selected
and applied to serve different purposes are used in this guidebook. The first filter is the modi-
fied Z-score method (Iglewicz and Hoaglin 1993), which is applied at the pay item level (i.e., to
each row) to identify outliers among the unit prices received for the same item under the same
contract. While some of those errors could correspond to typographical mistakes or the mis-
interpretation of the scope contained within the unit price, a number of them are the result of
unbalanced bids (Rueda-Benavides 2016).
“A bid is considered unbalanced if the unit rates are substantially higher or lower, in relation
to the estimate and the rates quoted by other bidders” (JICA 2000). There are three main reasons
that could lead a contractor to unbalance a bid:
1. To protect its intended profit or fixed cost, which could be partially lost if actual quantities
of work are less than the bid quantities;
2. To maximize profits by taking advantage of errors in the quantities of work listed in the
solicitation documents; or
3. To inflate prices for early activities to reduce financial costs (the cost of borrowing money).
Regardless of the ethical implications usually associated with unbalanced bids, this is a common
practice among construction contractors and could mislead STAs when tracking market
changes over time.
22 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Equation 3-4 is used to apply the modified Z-score method. The reason behind the use of
this method is that outliers are identified by using the sample median (x̃) and the median
absolute deviation, which makes it more suitable for small samples. Since this method is used
on bids submitted by different contractors under the same contract, it is applied to relatively
small samples. The average number of bids received by some agencies for a single contract is
between three and four. Other more commonly used outlier detection methods rely on the
sample mean and standard deviation to identify outliers. However, these two statistics are more
sensitive to extreme values in small samples, which increases the risk of not detecting outliers
that should be discarded (Iglewicz and Hoaglin 1993). On the basis of Iglewicz and Hoaglin’s
guidelines, all unit prices with an absolute modified Z-score greater than 3.5 (|Mi| > 3.5) were
removed from the data set.
0.6745 ( X i − x )
Mi = Eq. 3-4
MAD
where
Mi = modified Z score for observation i,
MAD = median absolute deviation = {|Xi – median|},
Xi = value of observation i, and
x̃ = median of all observations.
The second outlier detection approach is used as a secondary filter to remove outliers over-
looked by the modified Z-score method. The missed outliers could have resulted from unusual
project requirements that may have forced all contractors to bid outside the typical unit price
ranges. Since the modified Z-score method compares unit prices for the same item under a
given contract, it may find no outliers if all bidders are forced to submit unit prices substantially
higher (or lower) than those typically paid by the agency for the same pay item in other projects.
The robust regression and outlier removal (ROUT) method (Motulsky and Brown 2006) is a
suitable second detection filter. This method combines robust regression and nonlinear regression
techniques to identify values that could be significantly apart from the regression equation,
similar to those shown in Figures 3-1 and 3-2.
The ROUT method can be applied with GraphPad Prims 7, a statistical software equipped
with a ROUT function that can be activated during the development of nonlinear regression
models. Figure 3-4 shows an example of the output yielded by this software. All red data
points are outliers detected by the ROUT method and excluded from the regression analysis.
800
600
Unit Price
400
200
0
0 10,000 20,000 30,000 40,000 50,000
Quantity
Figure 3-4. Example of GraphPad Prims 7
output.
24 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Sub-Division Level 2, and so on, until the top level was reached, where a single general index was
calculated at the agency level.
All indexes were developed with a semiannual updating frequency, with index values updated
twice every year, once on June 30 and again on December 31. A semiannual recalculation
approach was selected because an exploratory data analysis anticipated an inconsistent quarterly
supply of data for some of the chosen pay items. Likewise, a semiannual updating frequency
was preferred over annual updates because shorter periods can better reflect the volatility of the
construction market (Molenaar et al. 2013).
Even though STAs execute hundreds of contracts per year, it is not possible to ensure that
every item in a representative group of cost items will be used during each index period, which
could result in missing index values. Unlike traditional CCIs, the multilevel arrangement of
MCCIs facilitates a mechanism to avoid missing index values by allowing the use of correspond-
ing upper indexes to fill the gaps.
Calculations to develop MCCIs are divided into two major steps: (1) calculation of all indexes
at the pay item level and (2) bottom-up calculation of indexes at upper levels.
Step 1.1 Extract all historical bid data from the tidy data set (after removing outliers) for all
selected MCCI pay items.
Step 1.2 Identify a 5-year period with sufficient data to effectively model the relationship
between quantities and unit prices for each item. The selection of the same 5-year period for
all items would simplify the calculation process. Quantity–unit price relationships can be
modeled with power regression curves like the one shown in Figure 3-6. Power regression
40
35
30
Unit Price ($/CY)
25
20
y = 29.338x-0.165
15
10
0
0 50,000 100,000 150,000 200,000 250,000 300,000 350,000
Quantity (CY)
Figure 3-6. Minnesota DOT unit price model for common excavation
2008–2012.
curves are commonly used to explain the reduction in construction prices as the quantities of
work increase (Rueda-Benavides 2016, Pakalapati 2018, Molenaar et al. 2013). Power regression
models are defined by Equation 3-5:
where A and B are constant values determined for each set of observations to be modeled. The
power regression models developed with the selected 5-year periods are hereinafter referred
to as “base curves.”
Step 1.3 Base curves are assumed to represent average unit prices for their respective
items at the midpoint of the selected five-year period. It would be June 30, 2010, for the
curve shown in Figure 3-6 (midpoint between January 2008 and December 2012). Thus,
the price variation at each indexing period is calculated as the average deviation from the
base curve. There could be indexing periods before and after the selected 5-year period. For
example, Figure 3-7 shows the average deviation between the same base curve shown in
Figure 3-6, in June 2010, and recorded unit prices for the same item during the first index-
ing period of 1999 (P1 = January to June 1999). The calculation of the average deviation in
Figure 3-7 was performed with Equation 3-6. This equation was applied to each indexing
period for each pay item.
where
ADij = average deviation for item i in index period j,
Pijk = unit price for observation k for item i in index period j,
Qijk = quantity for observation k for item i in index period j,
Ai and Bi = constant values for base curve for item i, and
n = number of observations for item i at index period j.
Step 1.4 Use calculated average deviations to define index values for each item at each
indexing period. Starting the index for each item with a value of 100 at the first indexing period
16
14
8
Average change:
6 –36%
0
0 50,000 100,000 150,000 200,000 250,000 300,000
Quantity (CY)
Figure 3-7. Example of base curve and calculation of price fluctuations.
26 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
in the available data would facilitate a future development of scope-based cost indexes. In the
Minnesota DOT case study, the first indexing period was P1-1999. Thus, this period was assigned
a value of 100 for all pay items. This value was set at the end of that period, June 30, 1999. The
average deviation shown in Figure 3-7 indicates that P1-1999 for that item should be 36%
lower than P1-2010. Therefore, the index value for P1-2010 would be 156.25 [(100/(1 – 0.36)].
The rest of the index values for all pay items can now be calculated by using their respective
P1-2010 index value and the average deviations measured at each index period.
Step 1.5 All four steps detailed above would produce a cost index for each of the MCCI
pay items by using the available historical bid data. After that, the agency needs to establish a
system to constantly update all indexes at the end of each indexing period by repeating the same
calculation process.
MCCIs developed for different agencies would have different configurations from the one
shown in Table 3-3, but the bottom-up calculation process and upward ramifications would
follow the same general principles. Each STA’s MCCI configuration should be adjusted to its
unique pay item classification system. A complete version of Table 3-3 as well as examples
of MCCI configurations for two other agencies can be found in Appendix B of the NCHRP
Web-Only Document 283: Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting
for State Transportation Agencies (Rueda-Benavides et al. 2020).
The bottom-up process for producing higher-level indexes is just a weighted average calcula-
tion of the grouped items at the lower levels, as shown in Figure 3-8. This figure shows how two
of the Colorado DOT’s pay item indexes (203-00010 and 203-00060) are combined to generate
28 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
their corresponding index at Sub-Division Level 1 (230-000). Weights for this calculation are
proportional to the dollar amounts awarded on the items under consideration during each
indexing period within the group. It means that during Index Period 1, 203-00010 contributed
to 25% of the combined awarded amount and 203-00060 contributed to the remaining 75%.
The final project-specific CCI is just the weighted average of the selected MCCI indexes.
The weighted average calculation is similar to the one shown in Figure 3-8 for the bottom-up
calculation process. However, this time weights were calculated for each item and not for
each indexing period. The weight for each pay item is proportional to its contribution to the
total engineer’s estimate. Actual awarded prices cannot be used to calculate weights because
they will only be known after the project has been awarded. Engineer’s estimates are calculated
on the basis of current prices observed at the moment of developing the project-specific CCI.
It should be noted that, at this point in the process, the relative relevance of each item is more
important than predicting the actual prices to be submitted by the successful contractor at
the letting date.
Table 3-4 shows the weight and MCCI index selected for each item. The latter refers to the
index identification labels in the last column of the table [see the configuration of the Minnesota
DOT’s MCCI in Appendix B of NCHRP Web-Only Document 283 (Rueda-Benavides et al. 2020)].
Those labels are equivalent to the labels shown in Table 3-3 for the Colorado DOT. For example,
an item such as 2580603/00010, interim pavement marking, (Table 3-4) has its own index
at the pay item level. On the other hand, item 2582502/41104, 4-inch solid line white epoxy,
had to move up to the MCCI division level to find its best-matching index. It should be noted
that cost indexes at the Minnesota DOT’s division level are identified with three-digit labels
(e.g., 258). Likewise, the identification number for all Minnesota DOT pay items always starts
with 2; therefore, that is the single-digit label for the Minnesota DOT’s agency level index. Some
indexes in Table 3-4 are used to represent more than one item. For example, MCCI Index 258
represents five items.
Table 3-5 and Figure 3-9 show an example of a project-specific CCI generated for the asphalt
paving project in Table 3-4. All project- and program-specific CCIs developed with the proposed
methodology were set to start with an index value of 100. Therefore, all the selected indexes
in the last column of Table 3-4 should start with an index value of 100 in order to produce the
index shown in Table 3-5.
Table 3-5. Example of project-specific CCI for the Minnesota DOT’s asphalt
paving project.
30 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
300
250
Index Value
200
150
100
50
6/30/1999
6/29/2000
6/29/2001
6/29/2002
6/30/2003
6/29/2004
6/29/2005
6/30/2006
6/30/2007
6/29/2008
6/30/2009
6/30/2010
6/30/2011
6/29/2012
6/30/2013
6/30/2014
6/30/2015
6/30/2016
6/30/2017
6/30/2018
Date
Figure 3-9. Example of project-specific CCI for the Minnesota DOT’s asphalt
paving project.
example, the asphalt paving project in Table 3-4 was initially identified as a good representative
of the Minnesota DOT’s typical asphalt paving activities. Thus, a planning program focused
only on asphalt paving could use the index shown in Table 3-5 to determine a program-specific
inflation rate.
The process for developing program-specific indexes for programs that involve various
types of work has a few additional steps but is still a simple four-step process:
1. Identify the different types of work contained in the program.
2. Approximate the percentage of the total program that corresponds to each type of work.
These percentages will be used as weights in Step 4.
3. Identify a sample project that reasonably represents each type of work and develop project-
specific CCIs for those projects. This step may not always be required, since the agency could
create and maintain a library of generic cost indexes for typical types of work.
4. Using the weights defined at Step 2, combine all project-specific indexes through a weighted
average calculation. This weighted average calculation is also similar to the one shown in
Figure 3-8, but this time it is used to combine multiple project-specific indexes into a single
program-specific CCI.
The simplicity of this methodology also facilitates sensitivity analyses with which to evaluate
multiple scenarios or to quantify the risk of having drastic changes in the anticipated distribution
of work within the program. For example, Figure 3-10 shows three possible program-specific
indexes that could be developed by the Minnesota DOT for a statewide pavement program that
combines asphalt paving and concrete paving activities.
The three program-specific indexes in Figure 3-10 correspond to three different distributions
of the amounts of work associated with each pavement material (50%–50%; 30%–70%; and
70%–30%). These hybrid indexes are the result of a weighted average calculation between an
asphalt paving and a concrete paving CCI. The asphalt paving CCI is the same project-specific
CCI shown in Figure 3-9, which is assumed to represent all asphalt paving activities. Similarly,
the concrete paving CCI in Figure 3-10 is a project-specific CCI for a representative concrete
paving project.
280
180
160
140
120
100
80
6/30/1999
6/29/2000
6/29/2001
6/29/2002
6/30/2003
6/29/2004
6/29/2005
6/30/2006
6/30/2007
6/29/2008
6/30/2009
6/30/2010
6/30/2011
6/29/2012
6/30/2013
6/30/2014
6/30/2015
6/30/2016
6/30/2017
6/30/2018
Date
Figure 3-10. Example of program-specific CCI—Minnesota DOT Paving Program.
32 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
the fact that statewide indexes are developed with larger data sets that allow for a more effective
representation of construction market changes. The only region that showed an overall better
performance of regional indexes was Colorado’s northeast region. This could be because this
region is the most densely populated in Colorado; it leads the Colorado DOT in spending large
portions of its annual construction budget in that part of the state and in making its regional
historical bid database sufficiently large to produce reliable cost indexes.
Although regional MCCIs were not the best option for most regions, it was found that
different statewide MCCI versions were more suitable for different regions within the same
state. This finding still allowed the study to conclude that construction activities in different
geographic regions could be affected by different inflation patterns. In other words, it would
be reasonable to consider the use of different inflation rates for different regions across the
state. Those different regional inflation rates would be the result of using a different construction
cost index in each region. Thus, as part of the MCCI development process, this guidebook
suggests the development of and evaluation of various MCCI versions, mimicking the case study
methodology in NCHRP 10-101 (Rueda-Benavides et al. 2020). To optimize implementation
efforts, STAs could evaluate only statewide MCCIs, considering regional versions only for those
parts of the state that consume considerable portions of the construction budget. Implementa-
tion efforts could be further optimized by considering only MCCIs developed with awarded unit
prices and with all the unit prices received by the agencies. The most suitable MCCIs for 10 of
the 11 regions evaluated in the case studies were built with those two price inputs.
After it has developed all MCCI versions under consideration, an STA can proceed to
perform a comparative suitability analysis by using the protocol presented in the next section.
This protocol helps in identifying the most suitable MCCI alternative for each region. It can
also be used to assess and compare the performance of traditional cost indexing alternatives.
In fact, the case study methodology in NCHRP 10-101 included the application of this protocol
to a large group of alternatives, including various MCCIs and a number of traditional CCIs
(Rueda-Benavides et al. 2020).
34 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
relevant construction division. Table 3-7 shows the items selected for the Minnesota DOT’s case
study. These items were selected to represent the three main construction activities performed
by the Minnesota DOT: asphalt paving, concrete paving, and earthwork.
Likewise, the analysis period used for the identification of the most suitable cost indexing
alternative does not need to be the same 20-year period suggested for the development of
MCCIs. The analysis period for the proposed protocol should be long enough to include a
good amount of cost indexing data, but not too long, so that the indexing alternatives are still
evaluated on their suitability to the current construction industry. If a given cost index shows
the best effectiveness at tracking price fluctuations over the past 20 years but a different one is
found to be more effective over the past 10 years, preference should be given to the latter. Thus,
the guidebook suggests an analysis period of about 10 years.
3.7.3 Base Power Regression Curves and Base Unit Price Estimates
The base power regression curves used in the comparative analysis of cost indexing alter
natives are similar to those used to develop the MCCI in Section 3.6.3, but they are built with
bid data from projects awarded during the first year of the analysis period. In the case of the
Minnesota DOT case study, one power regression curve was developed for each of the items
listed in Table 3-7. The analysis period for that case study started in January 2007 and ended in
December 2018; therefore, base power regression curves were created with historical bid data
from 2007.
Those curves are then used to estimate base unit prices for all bid quantities awarded for each
of the selected pay items throughout the analysis period. Since the regression curves were devel-
oped with data from the first year of the analysis period, all unit price estimates produced with
those curves are assumed to yield average unit prices in the middle of that year. Thus, the
Minnesota DOT’s base power regression curve for structural concrete (second item in Table 3-7)
was used to estimate a unit price for a quantity awarded in 2018, but the output corresponded
to the average price for that amount of structural concrete in mid-2007.
I jt
Pkij = Ai × (Qki )Bi × Eq. 3-9
I j0
where
Lkij = location in letting date axis for observation k for item i with index j,
Lki = actual letting date for observation k,
Qkij = location in quantity axis for observation k for item i with index j,
Qki = actual awarded quantity for observation k,
Pkij = location in unit price axis for observation k for item i with index j,
Ai and Bi = constant values for base curve for item i,
Ijt = index value for index j at letting date, and
Ij0 = base index value for index j.
36 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
data and the index-based data point clouds and the more suitable the cost indexing alternative.
It should be noted that corresponding points have the same letting date and awarded quantity.
Thus, the average distance between them is only the difference between the actual awarded unit
price and the index-based unit price.
Average distances between the bid data and the index-based data point clouds were quan-
tified in the form of mean absolute percentage error (MAPE) values: one MAPE value per
pay item per indexing alternative. MAPE values are commonly used in the cost estimating
literature to measure and compare accuracy between cost estimating approaches (Gransberg
et al. 2015), but in this study, those values were aimed at indicating the degree of overlap
between data point clouds for each selected pay item. For instance, for the Minnesota DOT
case study, five MAPE values (one per pay item listed in Table 3-7) were calculated for each
cost indexing alternative under consideration. Equation 3-10 was used to calculate the MAPE
for value under each cost index.
where
MAPEij = mean absolute percentage error for item i with index j,
Paki = awarded unit price for observation k for item i,
Pekij = index-based unit price for observation k for item i with index j, and
n = number of observations for item i.
The MAPE values associated with each cost indexing approach are then combined into
a single overall MAPE that takes into consideration the relative weight of each pay item
shown in Table 3-7 for the Minnesota DOT’s case study. The result of this combination is a
weighted MAPE, which is just the weighted average of all pay item MAPE values, as shown in
Equation 3-12. The relative weight for each item is calculated with Equation 3-11.
Tai
Wi = Eq. 3-11
Ta
W_MAPE j = ∑ i =1 MAPE ij × Wi
n
Eq. 3-12
where
Wi = relative weight for item i,
Tai = total amount ($) awarded for item i during analysis period,
Ta = total amount ($) awarded for all items i during analysis period,
MAPEij = MAPE for item i with index j,
W_MAPEj = weighted MAPE for index j, and
n = number of items.
After the steps explained above are repeated to generate a weighted MAPE for each cost
indexing alternative in each region, the most suitable alternative for each region is then assumed
to be the one with the lowest-weighted MAPE.
CHAPTER 4
Index-Based Cost
Forecasting Approaches
4.1 Introduction
This chapter provides guidance on quantitative cost forecasting methodologies that can
be used to generate effective inflation rates from the suitable cost indexes identified by the
protocol explained in Chapter 3. Chapter 2 has already explained the implications associated
with the methodologies addressed in this chapter as well as the circumstances under which
they would be more appropriate. This chapter mainly covers some technical aspects of those
methodologies.
y = a + bx Eq. 4-1
b
simple annual inflation rate = Eq. 4-2
a
where
y = forecast index value,
x = intended forecasting time horizon,
a = slope of linear function, and
b = current index value.
Similarly, Equation 4-3 shows a typical exponential regression output yielded by statistical
software packages. As occurs with linear regression analysis, the outputs of statistical software
packages do not typically provide annual compound inflation rates, but Equation 4-4 shows
how to calculate them from an exponential equation.
y = ae bx Eq. 4-3
37
38 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
330
Index Value
230
180
130
80
6/29/1999 3/25/2002 12/19/2004 9/15/2007 6/11/2010 3/7/2013 12/2/2015 8/28/2018
Date
where
y = forecast index value,
x = intended forecasting time horizon,
a and b = constants, and
e = exponential constant.
Figures 4-1 and 4-2 show the simple and compound annual inflation rates obtained from a
linear and an exponential regression model, respectively, for the scope-based asphalt paving
construction cost index (CCI) developed for the Minnesota DOT in Section 3.6.4. A visual
comparison of these models and their R2 values suggests that an exponential equation would be
more suitable for modeling the Minnesota DOT’s long-term market trends. The same conclu-
sion was obtained from all case studies for both asphalt and concrete paving activities.
330
Compounded Annual Inflation Rate = 5.4%
280
R2 = 0.877
Index Value
230
180
130
80
6/29/1999 3/25/2002 12/19/2004 9/15/2007 6/11/2010 3/7/2013 12/2/2015 8/28/2018
Date
risk-based forecasting outputs. This is an iterative process designed to maximize the value of
the available data.
For instance, a state transportation agency (STA) with only 20 years of historical bid data with
which to produce long-range forecasts would be forced to rely on this single 20-year data set to
predict the market behavior during the next 20 years. It seems to be common knowledge that
not all 20-year periods would show the same market trends. Thus, in an ideal world, the agency
would have access to multiple 20-year periods to consider multiple possible scenarios. Unfor-
tunately, that is not the case for most STAs. The MFE method recognizes that there are several
3-, 5-, 10-, and 15-year periods within the available data and takes advantage of those smaller
data partitions to better infer long-range market conditions. The proposed MFE methodology
is applied to any cost index through the following six-step process:
I t − I 0 × (1 + i )t
FE t = × 100% Eq. 4-5
I 0 × (1 + i )t
where
FEt = forecasting error over t years,
I0 = first known index value,
It = known index value at time t, and
i = compound inflation rate.
40 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
errors from Figure 4-3, but this time with its respective confidence intervals. On the basis of
this figure, the Colorado DOT could reasonably assume, with a 90% confidence level, that any
15-year asphalt paving cost forecast estimated in this region with a 4% compound inflation rate
would offer a forecasting error between +12% and −27%.
Confidence levels are defined by assuming that forecasting errors at each forecasting period
follow a normal distribution. Thus, the confidence bands in Figure 4-4 are calculated from
50%, 70%, and 90% confidence intervals from those normal distributions at each forecasting
time horizon. For example, the upper 90% limit in Figure 4-4 is the result of a regression model
developed with the upper 90% confidence intervals of all forecasting time periods from 0.5 to
15 years. Average errors calculated with less than 10 observations are also discarded.
42 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Figure 4-5. Example of MFE output: Risk-based forecasting timeline for forecasting factors.
Note: FF = forecasting factor; CAIR = compound annual inflation rate; FE = forecasting error; CL = confidence level; PCTL = percentile.
Average Forecast 50% Confidence Level 70% Confidence Level 90% Confidence Level
$35,000,000
$30,000,000
Forecasted Cost Estimate ($)
$25,000,000
$20,000,000
$15,000,000
$10,000,000
$5,000,000
0 5 10 15 20 25 30
Forecasting Time Horizon (Years)
Figure 4-6. Example of MFE output: Risk-based forecasting timeline for $10 million program.
Instead of directly producing risk-based forecasting timelines from the calculated forecasting
factors, the Colorado DOT could also use Figure 4-4 to estimate an annual inflation rate for
asphalt paving activities in the region under consideration. This inflation rate could be shared
with other estimators across the region to facilitate cost forecasts without the need of sharing
a spreadsheet with all forecasting factors. Assuming that the target inflation rate is intended to
match the average trend in Figure 4-4, the Colorado DOT could perform a simple statistical
analysis (probably by using Equation 4-4) to find that the average trend in Figure 4-4 would be
matched by a 3.1% annual compound inflation rate, as shown in Figure 4-7.
All case study results presented in this section to illustrate the use of the proposed MFE
methodology were obtained by using an arbitrary 4% compound annual inflation rate as a
3
Forecasted Cost Estimate ($)
2.5
1.5
0.5
0 5 10 15 20 25 30
Forecasting Time Horizon (Years)
Figure 4-7. Example of MFE output: Risk-based forecasting timeline with applicable inflation rate.
44 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
point of reference. In a perfect world, any arbitrary inflation rate (even simple inflation rates)
would yield the same results shown in Figures 4-4 and 4-5, but that is not the case. The use
of regression analysis to approximate trends in market average error makes outputs from
different inflation rates slightly different. The results from this study suggest that the use of
reasonable inflation rates as a point of reference produces more accurate results, which is
the reason that motivated the selection of the suggested rate (4%). However, future research
efforts will further investigate this matter to determine whether a different input would offer
better forecasting effectiveness.
Even though the calculation processes presented in this section—or in this guidebook—
may look complicated or highly technical, these are easy quantitative tasks when performed
with the assistance of data processing technologies and tools available today, such as the
Cost Forecasting Tool Kit that accompanies and is described in the following chapter.
CHAPTER 5
5.1 Introduction
The Cost Forecasting Tool Kit consists of three spreadsheet-based tools designed to facilitate
the implementation of both traditional and advanced cost forecasting methodologies:
• Tool 1 is intended for state transportation agencies (STAs) that prefer to use standard
inflation rates.
• Tool 2 can make all moving forecasting error (MFE) calculations discussed in Section 4.3
in a matter of seconds.
• Tool 3 is focused on linear and exponential regression techniques and yields regression
outputs tailored to better serve the forecasting process.
This tool kit is available on the TRB website on the summary web page for NCHRP Research
Report 953 (http://www.trb.org/main/blurbs/181093.aspx).
Although the tool kit itself provides instructions for its implementation, users are encouraged
to review this guidebook and NCHRP Web-Only Document 283 (Rueda-Benavides et al. 2020),
which together provide the theoretical background required to take full advantage of these
tools. For example, that theoretical knowledge would help in identifying the circumstances
under which a regression analysis (Tool 3) would be more effective than the advanced MFE
methodology (Tool 2). It would also facilitate a better interpretation and more effective use
of the tool kit’s outputs.
Even though the assessment of preforecast estimation of risks and uncertainties is outside
the scope of this guidebook and NCHRP Web-Only Document 283, the Cost Forecasting Tool Kit
allows the use of risk-based current-dollar estimates as inputs to the cost forecasting process.
This produces final risk-based forecasting outputs that account for uncertainties that affect all
cost estimating phases. The tool kit provided with this guidebook should be considered a pre-
liminary functional version. It still needs to be adapted to the needs of each agency. One of the
purposes of providing this tool kit as a deliverable from NCHRP 10-101 was to give STAs access
to the complete set of calculations behind the proposed cost forecasting techniques. The provided
tool kit can be used as a reference for developing more sophisticated and effective cost forecasting
spreadsheets or software applications. The tool kit allows for the use of both multilevel con-
struction cost indexes (MCCIs) and traditional CCIs and facilitates the generation and analysis
of project- and program-specific CCIs from an MCCI. However, it cannot be used to actually
create MCCI systems. The use and capabilities of the cost forecasting tools are detailed below.
45
46 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Worksheet Description
Introduction Provides an overview of the Cost Forecasting Tool Kit, including a brief description of
each tool.
Agency information Provides a fact sheet with general information about the agency. This worksheet was created
for informative purposes but also serves as a source of information for the cost forecasting
tools. Most drop-down menus in the tools are linked to this worksheet.
Tool 1: Forecast with Facilitates the generation of forecast cost estimates for any simple or compound annual
inflation rate inflation rate along any forecasting time horizon. It is intended for estimators who already
know the applicable inflation rate and for agencies that prefer the use of external standard
inflation rates without the internal analysis of a cost index. Users in the latter group are
provided with a link to suggested inflation rates.
Tool 2: Forecast with Facilitates the generation of simple or compound inflation rates from scope-based or
moving forecasting error traditional CCIs with the proposed MFE methodology. Outputs are provided in the form of
risk-based forecasting outputs with error ranges at 50%, 70%, and 90% confidence levels.
Tool 3: Forecast with Facilitates the generation of simple or compound inflation rates applying linear or exponential
regression analysis regression analyses, respectively. It can use either scope-based or traditional CCIs.
Suggested standard Although this worksheet is available to all users, it is mainly intended to provide standard
inflation rates inflation rates to the users of Tool 1. This worksheet is actually Module 2 in the framework
for selecting a cost forecasting approach (see Section 2.3).
Multilevel CCI Calculations for Tools 2 and 3 in the Cost Forecasting Tool Kit are performed with
project- or program-specific CCIs developed with the MCCI presented in this worksheet.
This is an MCCI for one of the case study agencies in NCHRP 10-101. This MCCI can
be easily replaced by other MCCIs or by a traditional CCI.
Project-specific CCI Facilitates the calculations described in Section 3.6.4 for the development of
project-specific CCIs. The project-specific CCI in this worksheet is developed with
the provided MCCI. Depending on the settings selected by the user, the CCI
developed in this worksheet can be used in forecasting processes in Tools 2 and 3.
Program-specific CCI Facilitates the calculations described in Section 3.6.4 for the development of program-
specific CCIs. The program-specific CCI in this worksheet is developed with the provided
MCCI. Depending on the settings selected by the user, the CCI developed in this
worksheet can be used in forecasting processes in Tools 2 and 3.
to better meet their needs and preferences. Each of the three tools included in the tool kit is
presented in its own worksheet. There are other supplementary worksheets intended to provide
instructions about the use of the tool kit, present relevant information to users, and feed the
cost forecasting tools with required information and data. The provided tool kit includes a total
of nine worksheets. Each of them is briefly described in Table 5-1.
likely value, and (3) maximum possible value. Any of the three tools can easily be modified to
change the way risk-based estimates are represented. For example, they could be modified to use
normal distributions (or any other type of probability distribution) as the value to be forecast.
Screen captures in Figures 5-1 and 5-2 show example calculations for Tool 1 that use single-
value and risk-based cost inputs, respectively. All inputs and outputs in Tool 1 are briefly
described in Table 5-2. Numbering in this table matches the numbers in Figures 5-1 and 5-2.
48 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
the three-point estimate, as shown in Figures 5-3 and 5-4. In both cases, outputs are provided
with three error ranges at 50%, 70%, and 90% confidence levels. Screen captures in Figures 5-3
and 5-4 show example calculations for Tool 2 that use single-value and risk-based cost inputs,
respectively. All inputs and outputs in Tool 2 are briefly described in Table 5-3.
Input Description
1. Inflation rate Desired simple or compound inflation rate provided by the user.
2. Maximum forecasting period Maximum forecasting time horizon shown in the horizontal axis of the figures.
3. Desired forecasting time Forecasting time horizon to be used to generate the forecast cost estimates in
horizon the output cells.
4. Type of estimate Drop-down menu to indicate the use of a single-value or a three-point
current-dollar estimate.
5. Current- Single-value Best estimate in current dollars.
dollar Three-point Minimum, most likely, and maximum current-dollar estimates.
estimate estimate
Output Description
6. Forecast cost Single-value Deterministic forecast cost estimate that uses the inflation rate in Input 1 as a
estimates with simple rate at the forecasting time horizon indicated in Input 3.
simple Three-point Minimum, most likely, and maximum forecast cost estimates that use the
inflation rate estimate inflation rate in Input 1 as a simple rate at the forecasting time horizon
indicated in Input 3.
7. Forecast cost Single-value Deterministic forecast cost estimate that uses the inflation rate in Input 1 as a
estimates with compound rate at the forecasting time horizon indicated in Input 3.
compound
Three-point Minimum, most likely, and maximum forecast cost estimates that use the
inflation rate
estimate inflation rate in Input 1 as a compound rate at the forecasting time horizon
indicated in Input 3.
8. Forecasting Single-value Deterministic forecasting timeline that uses the inflation rate in Input 1 as a
timeline with simple rate. Highlights forecast value at the forecasting time horizon
simple indicated in Input 3.
inflation rate Three-point Risk-based forecasting timeline that uses the inflation rate in Input 1 as a
estimate simple rate. Risk considered in this output is only preforecast risk. Highlights
forecast values at the forecasting time horizon indicated in Input 3.
9. Forecasting Single-value Deterministic forecasting timeline that uses the inflation rate in Input 1 as a
timeline with compound rate. Highlights forecast value at desired forecasting time horizon
compound indicated in Input 3.
inflation rate Three-point Risk-based forecasting timeline that uses the inflation rate in Input 1 as a
estimate compound rate. Risk considered in this output is only preforecast risk. Highlights
forecast values at desired forecasting time horizon indicated in Input 3.
50 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Input Description
1. Type of inflation rate Desired type of inflation rate to be calculated by the MFE method: simple
or compound.
2. Maximum forecasting period Maximum forecasting time horizon shown in the horizontal axis of the
figure.
3. Desired forecasting time Forecasting time horizon to be used to generate the forecast cost estimates
horizon in the output cells.
4. Level of forecast Scope-based CCI to be used with the MFE method. If a project-level
forecast is selected, Tool 2 extracts the required index data from the
project-specific CCI worksheet; otherwise, Tool 2 uses the program-
specific worksheet. This input is not required if a traditional CCI is used
instead of an MCCI.
5. Type of estimate Drop-down menu to indicate the use of a single-value or a three-point
current-dollar estimate
6. Current- Single-value Best estimate in current dollars.
dollar Three-point Minimum, most likely, and maximum current-dollar estimates.
estimate estimate
Output Description
7. Estimated inflation rate Inflation rate estimated by the MFE method. Depending on type of
inflation rate indicated in Input 1, it would be a single or a compound rate.
8. Forecast cost estimate with Expected forecast cost estimate calculated with the inflation rate in Output
confidence intervals 7 at the desired forecasting time horizon indicated in Input 3. This
estimate is provided with confidence intervals at 50%, 70%, and 90%.
9. Risk-based forecasting Risk-based forecasting timeline that uses the inflation rate in Output 7.
timeline Highlights forecast values at desired forecasting time horizon indicated in
Input 3.
52 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Figure 5-6. Tool 3: Index-based forecast with regression analysis—three-point estimate input.
Input Description
1. Lookback period Number of years of index values to be considered for the intended cost
forecasting process.
2. Maximum forecasting period Maximum forecasting time horizon shown in the horizontal axis of the
figures.
3. Desired forecasting time Forecasting time horizon to be used to generate the forecast cost estimates
horizon in the output cells.
4. Level of forecast Scope-based CCI modeled through regression analysis. If a project-level
forecast is selected, Tool 3 extracts the required index data from the
project-specific CCI worksheet; otherwise, Tool 3 uses the program-
specific worksheet. This input is not required if a traditional CCI is used
instead of an MCCI.
5. Type of estimate Drop-down menu to indicate the use of a single-value or a three-point
current-dollar estimate.
6. Current-dollar Single-value Best estimate in current dollars.
estimate Three-point Minimum, most likely, and maximum current-dollar estimates.
estimate
Output Description
7. Estimated simple inflation rate Simple inflation rate estimated through regression analysis with the
provided CCI.
8. Forecast cost Single-value Deterministic forecast cost estimate that uses the simple inflation rate in
estimates with Output 7 at the forecasting time horizon indicated in Input 3.
simple inflation Three-point Minimum, most likely, and maximum forecast cost estimates that use the
rate estimate simple inflation rate in Output 7 at the forecasting time horizon indicated
in Input 3.
9. Estimated compound inflation Compound inflation rate estimated through regression analysis with the
rate provided CCI.
10. Forecast cost Single-value Deterministic forecast cost estimate that uses the compound inflation rate
estimates with in Output 9 at the forecasting time horizon indicated in Input 3.
compound Three-point Minimum, most likely, and maximum forecast cost estimates that use the
inflation rate estimate compound inflation rate in Output 9 at the forecasting time horizon
indicated in Input 3.
11. Forecasting Single-value Deterministic forecasting timeline that uses the simple inflation rate in
timeline with Output 7. Highlights forecast value at the forecasting time horizon
simple inflation indicated in Input 3.
rate Three-point Risk-based forecasting timeline that uses the simple inflation rate in
estimate Output 7. Risk considered in this output is only preforecast risk.
Highlights forecast values at the forecasting time horizon indicated in
Input 3.
12. Forecasting Single-value Deterministic forecasting timeline that uses compound inflation rate in
timeline with Output 9. Highlights forecast value at the forecasting time horizon
compound indicated in Input 3.
inflation rate Three-point Risk-based forecasting timeline that uses the compound inflation rate in
estimate Output 9. Risk considered in this output is only preforecast risk.
Highlights forecast values at the forecasting time horizon indicated in
Input 3.
Acronyms
54
References
American Society of Civil Engineers (ASCE). (2013). 2013 Report Card for America’s Infrastructure. http://
www.infrastructurereportcard.org/.
Anderson, S., K. R. Molenaar, and C. J. Schexnayder. (2007). NCHRP Report 574: Guidance for Cost Estimation
and Management for Highway Projects During Planning, Programming, and Preconstruction. Transportation
Research Board of the National Academies, Washington, DC.
Betts, M. (2007). Standardization in Information Technology Industries: Emerging Issues under Section Two of
the Sherman Antitrust Act. Oklahoma Journal of Law and Technology, 3(1), Article 6. https://digitalcommons.
law.ou.edu/okjolt/vol3/iss1/6.
Bureau of Labor Statistics. (2018a). Consumer Price Index: Frequently Asked Questions. https://www.bls.gov/cpi/
questions-and-answers.htm.
Bureau of Labor Statistics. (2018b). Handbook of Methods. https://www.bls.gov/opub/hom/.
Byrnes, J. E. (2002). Best Practices For Highway Project Cost Estimating. Arizona State University, Tempe.
Cho, Y. K., J. H. Youn, and D. Martinez. (2010). Error Modeling for an Untethered Ultra-Wideband System for
Construction Indoor Asset Tracking. Automation in Construction, 19(1):43–54.
Colorado Department of Transportation (Colorado DOT) (2019). Standard Specifications Book. https://www.
codot.gov/business/designsupport/cdot-construction-specifications/2019-construction-specifications/
2019-specs-book.
Duncan, G. M., L. M. Sibaja Vargas, P. K. Ram, and K. A. Zimmerman. (2017). Development of a Pavement
Management Manual and Data Quality Plan for the Mississippi Department of Transportation. FHWA/
MDOT-RD-17- 268. Mississippi Department of Transportation, Jackson.
Federal Highway Administration (FHWA). (2017a). Financial Planning and Fiscal Constraint for Transportation
Plans and Programs—Questions & Answers. https://www.fhwa.dot.gov/planning/guidfinconstr_qa.cfm/.
Federal Highway Administration (FHWA). (2017b). National Highway System. https://www.fhwa.dot.gov/
planning/national_highway_system/.
Fisher, I. (1922). The Making of Index Numbers: A Study of Their Varieties, Tests, and Reliability. Boston, New York:
Houghton Mifflin Company.
Gransberg, D. D., H. D. Jeong, I. Karaca, and B. Gardner. (2015). Appendix F, Research Paper 3: Rationally
Selecting Data for Highway Construction Cost Estimating at the Conceptual Stage. In Top-Down Construc-
tion Cost Estimating Model/Guide Using a Neural Network, Iowa State University Institute for Transportation,
Ames, pp. 75–92.
Gransberg, D. D., and J. Rueda-Benavides. (2014). Indefinite Delivery/Indefinite Quantity Final Report.
MN/RC 2014-31. Minnesota Department of Transportation, St. Paul.
Iglewicz, B., and D. Hoaglin. (1993). How to Detect and Handle Outliers. ASQC Quality Press, Milwaukee, WI.
Janacek, J. (2006). Construction Costs Going Through the Roof? Presented at 2006 Public Works Officer
Institute, Los Angeles, CA.
Japan International Cooperation Agency (JICA). (2000). Evaluation Guide for Prequalification and Bidding
Under Japanese ODA Loans: Procurement of Goods and Services. Tokyo, Japan.
Molenaar, K., S. Anderson, and C. Schexnayder. (2013). AASHTO Practical Guide to Estimating. AASHTO Technical
Committee on Cost Estimating, Washington, DC.
Motulsky, H. J., and R. E. Brown. (2006). Detecting Outliers When Fitting Data with Nonlinear Regression:
A New Method Based on Robust Nonlinear Regression and the False Discovery Rate. BMC Bioinformatics,
7(1), Article 123.
Munday, S. C. R. (1996). Microeconomics and Macroeconomics. In Current Developments in Economics.
Palgrave, London, pp. 33–44.
55
56 Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting: Guidebook for State Transportation Agencies
Pakalapati, K. (2018). Data Usage Optimization for Cost Estimating in Asphalt Paving Projects Using a Cost
Indexing System. Master’s thesis. Auburn University, Auburn, AL.
Rueda-Benavides, J. (2016). Indefinite Delivery/Indefinite Quantity Project Selection Framework Using
Stochastic Techniques. PhD dissertation. Iowa State University, Ames.
Rueda-Benavides, J., and D. D. Gransberg. (2015). Suitability Analysis of Existing Construction Cost Indexes
for Minnesota Department of Transportation Construction Projects. Presented at 94th Annual Meeting of
the Transportation Research Board, Washington, DC.
Rueda-Benavides, J., C. Schexnayder, G. Gad, D. D’Angelo, and C. Mayorga. (2020). NCHRP Web-Only Document
283: Improving Mid-Term, Intermediate, and Long-Range Cost Forecasting for State Transportation Agencies.
Transportation Research Board, Washington, DC.
Wickham, H. (2014). Tidy Data. Journal of Statistical Software, 59(10):1–23.
ADDRESS SERVICE REQUESTED
Washington, DC 20001
500 Fifth Street, NW
TRANSPORTATION RESEARCH BOARD
ISBN 978-0-309-67344-0
NON-PROFIT ORG.
COLUMBIA, MD
PERMIT NO. 88
U.S. POSTAGE
90000
PAID
9 780309 673440