Professional Documents
Culture Documents
Construction Bidding Markup Estimation Using A Multistage Decision Theory Approach
Construction Bidding Markup Estimation Using A Multistage Decision Theory Approach
Abstract: Determining an optimum bid value maximizes the probability of winning a construction project while realizing proper profit.
Thus, this issue has been one of the important research topics in construction-related research. Various models have provided different
methodological approaches for bid pricing using statistical analysis of competitors’ prior bids. However, the accuracy of these models
Downloaded from ascelibrary.org by Budi Atmoko on 05/09/17. Copyright ASCE. For personal use only; all rights reserved.
is compromised in cases where the data set of competitors’ historic bids is not complete and/or where such competitors utilize a dynamic
behavior (i.e., having bidding schemes that change significantly with time). Through a multistage decision theory approach, this paper
presents a more advanced model for construction bidding markup estimation that uses a Bayesian analytic framework. To this effect, a
three-stage research methodology was utilized. First, the authors established a systematic procedure to fit competitors’ historical data into
appropriate Bayesian prior density functions while taking the stochastic variability of cost estimates into consideration. Second, the authors
developed stochastic likelihood functions through the most recent observation(s). Third, the authors created the posterior distributions from
which the joint probability of winning and the expected profit can be calculated. To this end, the use of the Bayesian statistics in the model
enables it to draw sound statistical inferences even in cases of data incompleteness and dynamic behaviors of competitors, thus tackling two
important weak spots in the previous models. The proposed model was applied to two case studies from the literature with different scenarios
to demonstrate its use and to illustrate the effect of different parameters on the resulting optimum markup. It was shown that the more recent
bidding strategies of competitors play a significant role in predicting the future ones. Also, as the contractor becomes more certain about its
competitor’s behavior, both its probability of winning and optimum bidding markup increase. This research should be beneficial for the
construction stakeholders to better understand the bidding decision-making processes and consequently help create a healthy contracting
environment. DOI: 10.1061/(ASCE)CO.1943-7862.0001204. © 2016 American Society of Civil Engineers.
Author keywords: Contracting; Construction bidding; Markup estimation; Decision theory; Bayesian statistics.
Introduction scope of this research focuses on the lowest bid method for its
widespread use in the construction market.
The process of project awarding in the construction industry is It is only logical to consider that all contractors participating in a
mostly based on competitive bidding. There are many methods bid have the intention to win the bid. Accordingly, each contractor i
for evaluating and selecting bidders; the typical one in the United attempts to submit the lowest possible bid price Bi . In the process of
States is the low-bid method, in which the contractor submitting the bid preparation, each contractor estimates the project’s total costs
lowest bid is awarded the project provided that the contractor pos- Ci that include direct and indirect costs. The critical decision is
sesses the required technical qualifications. The main advantage of which markup percentage M i to select. The markup percentage ac-
this method is that it forces bidders to lower their costs by adopting counts for the unforeseen risks and the desired profit. The bid price
cost-saving technological and managerial innovations. Accord- function is formulated as
ingly, owners get the best value for money through free competition
(Trickey 1982; Lingard et al. 1998). Other methods, albeit not com- Bi ¼ Ci ð1 þ M i %Þ ð1Þ
monly used, include average-bid and below-average-bid selections.
In the average-bid method, the bidder whose price is closest to the Bid ratioi ¼ Bi =Ci ð2Þ
average bid is awarded the contract (Ioannou and Leu 1993). In the
below-average-bid method, the winning bid is the one closest to but
Profit ¼ Bi − ðCi þ NCi Þ þ CCi ð3Þ
below the average of all bids (Ioannou and Awwad 2010). The
For a contractor, a high markup value Mi is desired to maximize
1 profits. But a high Mi means a high bid price Bi , leading to an
Graduate Student, Dept. of Civil and Environmental Engineering,
Univ. of Tennessee—Knoxville, 851 Neyland Dr., 324 John D. Tickle increase in the probability of another competing contractor submit-
Engineering Bldg., Knoxville, TN 37996. E-mail: abotaleb@vols.utk.edu ting a lower bid. This eventually lowers the chances of winning the
2
Associate Professor of Civil Engineering and Construction Engineering bid. On the other hand, to maximize chances of winning the bid, the
and Management Program Coordinator, Dept. of Civil and Environmental contractor would set a very low M i, which is very risky. A project
Engineering, Univ. of Tennessee—Knoxville, 851 Neyland Dr., 417 John might encounter additional noncompensable costs NCi higher than
D. Tickle Engineering Bldg., Knoxville, TN 37996 (corresponding author).
the additional compensable costs CCi , with a value exceeding the
E-mail: eladaway@utk.edu
Note. This manuscript was submitted on December 8, 2015; approved allocated markup. In this case, the contractor encounters losses.
on May 24, 2016; published online on July 15, 2016. Discussion period Determining the optimal bid value that maximizes both the
open until December 15, 2016; separate discussions must be submitted probability of winning and the profit has been the subject of
for individual papers. This paper is part of the Journal of Construction construction research for a long time. The different approaches
Engineering and Management, © ASCE, ISSN 0733-9364. of researchers are categorized into mainly those abstracted from
all the current models are based on the assumption that the historical The utility theory approach is based on the assumption that con-
behavior of competitors, no matter how recent or old it is, governs tractors consider numerous criteria in determining the bid markup,
their future bidding behavior. Such an assumption is risky and might and hence the bid price (Dozzi et al. 1996). Such criteria are a mix
produce inaccurate inferences, especially in the following two cases. of project-specific factors such as job complexity, duration, level of
The first case is when the available data for a specific competitor are competition, completion of designs, and global factors such as the
very old and do not represent that competitor’s current bidding strat- country’s economic performance and the firm’s need for work. In
egies. The second case is when the available historical data are recent utility theory, for a newly tendered project, an expected utility value
and have good quality, but the competitor decides to shift its bidding is obtained using predetermined criteria and is compared to a
strategy, deeming the available older data misleading. This shifting of markup utility function to obtain a bid markup (Dozzi et al. 1996).
strategy is referred to as dynamic behavior in this paper. A model Noteworthy works utilizing utility theory in the domain of bidding
that takes into consideration the stochastic variability of historical strategies are those of Ahmed and Minkarah (1987), Hegazy
cost estimates and the dynamic behavior of competitors, while (1993), Dozzi et al. (1996), Fayek (1998), Liu and Ling (2005),
reducing the need for extensive information and mathematical Dikmen et al. (2007), and Cheng et al. (2011). Utility-theoretic
complexities, is hence required. models are beneficial in capturing the contractor’s knowledge for
simulating its behavior and for applying this knowledge to new
projects recommending appropriate bid markups. However, such
Goal and Objectives models are not appropriate for calculations of the probability of
winning because the probability of winning is primarily dependent
The goal of this research is to present an advanced model for con- on the level of competition (Christodoulou 2004a). Accordingly,
struction bidding markup estimation. The objective is to draw the value of markup resulting from such models cannot be consid-
sound statistical inferences even in cases of data incompleteness ered the optimum value (Awwad 2015). For that reason, researchers
and dynamic behaviors of competitors, which are two areas iden- and practitioners prefer the use of decision theory, which is a
tified for improvement in previous models available in the litera- broader form of utility theory, in bid markup estimation.
ture. The developed model utilizes a multistage decision theory The decision theory bases the bid markup decision of a contrac-
approach in a Bayesian framework. Ultimately, this research should tor in a future bid on the statistical analysis of historical bidding
be beneficial for the construction stakeholders to better understand patterns of competitors. The main assumption is that bidders can
the bidding decision-making processes and consequently help cre- improve their strategic competitiveness by studying their compet-
ate a healthy contracting environment. itors’ bidding pattern (Friedman 1956; Capen et al. 1971). There is
no fully practical way to validate such an assumption but it is
widely accepted by most, if not all, researchers in this field. In de-
Literature Review cision theory, the bidder follows two main steps. The first step is to
assess the probability distribution of the competitive bidders’
Different Approaches to Construction Bidding markup history separately and jointly through statistical analysis.
Strategies The classical approach in this step is that a bidder compares its cost
Researchers have tackled the construction bidding markup estima- estimates Cj with bidders’ bid prices Bij for previous bids, where i
tion problem using different approaches from game theory, utility is the competitor number and j is the historical bid number. Then, it
theory, and decision theory. All discussions regarding game theory, uses an inverted form of Eq. (1) to obtain the different markup val-
utility theory, and decision theory in this paper are in the context of ues of each competitor M ij, eventually characterizing the markup
construction bidding. The terminologies and definitions may not be values of each bidder with a probability density function f i ðrÞ,
the same in other contexts. where r ∈ M. A more realistic approach is the stochastic one, in
The game theory approach in bidding involves finding equilib- which the cost estimate of each competitor is expected to vary from
rium strategies in a static noncooperative game model. Such strat- that of the firm. Accordingly, the competitors’ bid prices are treated
egies are almost impossible to conclude because no bidder is able to as density functions, instead of discrete values, to eventually form
determine the game model, obtain private values, and estimate the fi ðrÞ. The probability Pi ðrÞ of winning competitor i at markup
utility functions of its competitors (Rothkopf 2007). Game theory value r is equal to the probability of that competitor bidding with
works best in open auction, in which two or more competitors con- a higher r as shown in Eq. (4)
tinually bid openly until they reach a value that encourages no one Z ∞
to bid lower. However, bids in the construction market are closed Pi ðrÞ ¼ fi ðrÞdr ð4Þ
bids, in which no bidder knows its competitors’ prices until their r
Pwin ðrÞ ¼ þ1 ð6Þ mum markup calculation that attempts to combine decision theory
i¼1
Pi ðrÞ
and utility theory is provided by Christodoulou (2004b). His
approach uses neurofuzzy systems and a multidimensional risk-
Both the Friedman model and Gates model are widely accepted analysis algorithm. However, the used model factors have yet to
in the literature despite the debates about which of them is more be statistically validated. Other significant works in the decision-
accurate (Crowley 2000). Crowley (2000) did an extensive review theoretic approach of bidding strategies are the ones of Stark
of the literature regarding the different opinions about Friedman’s (1968), Rosenshine (1972), Dixie (1974), Winkler and Brooks
and Gates’s models. In the same paper, he also used a third model to (1980), Ranasinghe (2000), Lo and Lam (2001a, b), Touran
visually demonstrate both similarities and differences between the (1993, 2003), Cooper (2005), Skitmore et al. (2007), and
models, and he concluded, from a purely statistical point of view, Yuan (2012).
that “both models are simultaneously correct and incorrect. Fried- Despite all of the previously mentioned efforts, the developed
man’s model is theoretically correct, yet the bid problem is incor- decision-theoretic models so far face one main theoretical problem
rectly specified. Gates’s model is practically correct, yet the and one main limitation from the authors’ point of view. The theo-
formula is incorrectly specified.” From a practical point of view, retical problem is that the models assume that all historical bidding
Sparks (1999) stated that Friedman’s model results in an optimum strategies have similar weights in determining their future bidding
bid with lower markup to a project than Gates’s model. As a result, strategy. In fact, a competitor might shift its bidding strategies; thus,
Friedman’s model helps the contractor win more projects than it would be misleading to give older strategies weights similar to
Gates’s model. However, because of the low markup, Friedman’s the newer ones in this case. It also would be misleading to totally
model does not provide the contractor with as high long-term prof- disregard the old strategies since there is a probability that the com-
its as those of Gates’s model. According to Benjamin and Meador petitor shifts back to them or close to them. The limitation is that
(1979), a contractor using Friedman’s model would need to obtain the current models require extensive historical data to provide
approximately twice the volume of work to attain the same profits sound statistical inferences. In many cases, the data might be in-
as one using Gates’s model. Based on the previously mentioned complete, deeming these models unusable. The presented model
theoretical and practical views, it is not clear which model is better. addresses the previously mentioned issues throughout a proposed
What is clear is that the selection of the model depends on the con- Bayesian framework. In Bayesian statistics, it is possible to differ-
tractor’s situation. To the authors’ best knowledge, both Friedman’s entiate between the old and recent observations of competitors’
and Gates’s equations are still currently heavily used in calculating bidding strategies, thus taking the dynamic behavior into consid-
the probability of winning multiple competitors. Selecting which eration. Moreover, the Bayesian framework allows for the inclusion
one to use depends on whether the contractor views the competitors’ of educated belief for data points with missing information. Edu-
bids as independent or dependent. It also depends on whether the con- cated belief is when a contractor hypothesizes certain historical bid-
tractor pursues long-term profits or winning more bids. The authors ding behaviors for a competitor in case such a piece of information
used both models in this paper to satisfy both schools of thought. is missing in a solid quantitative manner. Such a hypothesis is based
The second step in the decision theory approach is to optimize on the contractor’s experience in bidding and in analyzing the mar-
the choice of bid value against the assessed competitors given the ket conditions, a skill that contractors usually do not lack. The con-
calculated probability of winning from Step 1. Such optimization is cept of educated belief, albeit not used in conventional statistics, is
straightforward and one-dimensional, and it is abstracted from an legitimate and reliable in Bayesian statistical approaches (Press and
optimality expected value function (Rothkopf 2007; Gilboa 2009). Press 1989; Stevens 2009; Bolstad 2007). The methodology section
The expected value is the sum of all possible events multiplied by provides further details about how the dynamic behavior and the
their chance of occurrence (Capen et al. 1971). In the case of con- educated belief are utilized in the model.
struction bidding, the expected value is represented by the expected
profit, which is the multiplication of the markup percentage and the
corresponding probability of winning as shown in Eq. (7). The op- Statistical Background
timum markup value r is the one that maximizes the expected profit
This section provides a simple description of some of the statistical
EPðrÞ ¼ r · Pwin ðrÞ ð7Þ methodologies used in this paper.
cording Bayes’s equation [Eq. (8)] Metropolis-Hastings algorithm, given an initial random variable X t ,
generate Y t ∼ qðyjxt Þ, and then obtain X tþ1 , where
pðθjDÞ ∝ fðDjθÞπðθÞ ð8Þ
Y t with probability ρðxt ; Y t Þ
In general, two sources of information about the unknown X tþ1 ¼ ð9Þ
parameters of interest are collected, not one as in frequentist X t with probability 1 − ρðxt ; Y t Þ
statistics.
The first of these is the prior distribution, which represents the fðyÞ qðxjyÞ
ρðx; yÞ ¼ min ;1 ð10Þ
original prior data based on the available information to the inves- fðxÞ qðyjxÞ
tigator. The second is the likelihood function, which is the sample
data or the observed behavior of uncertainty. If the data are repre- The resulting chain can be considered a sample, albeit a depen-
sented by D, and the set of unknown parameters is represented by θ, dent sample, that is distributed from f with resilient approximation.
then the likelihood function is fðDjθÞ, which is the probability of Because of the Markovian nature of the simulation, the first values
observing the data D being conditional on the values of the param- are highly dependent on the starting value X 0 and usually removed
eter θ. If the prior distribution for θ is represented by πðθÞ, then the from the samples as burn-in. The burn-in is for the purpose of en-
posterior function is calculated as shown in Eq. (8). suring, in theory, that the Markov chain is intrinsically equivalent to
The proportionality symbol ∝ expresses the fact that the right- a standard iid simulation from f (Robert 2015). There is no defini-
hand side of the equation has to be normalized so that its integration tive measure of estimating the number of burn-in variables that it
over its full support must be equal to 1. The posterior function takes for the chain to reach stationarity; however, the effect of initial
pðθjDÞ provides a weighted compromise between the prior infor- values diminishes if the chain is long enough. See the work of
mation and the likelihood data in a statistically sound environment Hobert and Robert (2004) for suggested burn-in estimation
(Stevens 2009). methodologies.
Gibbs sampling is another famous methodology for forming the
Markov transition kernel and has its advantages, especially in high-
Markov Chain Monte Carlo and the Metropolis-Hastings
dimensional multivariate analysis. However, the authors only
Algorithm
focused on the Metropolis-Hastings algorithm in this paper for two
It is not difficult, using simple heuristics or simple built-in software reasons. First, to use a Gibbs sampler to sample from a joint dis-
functions, to generate independent and identically distributed (iid) tribution pðθ1 ; : : : ; θk Þ, full conditional distributions for each
random variables following a probability density function (PDF) f parameter have to be calculated. The full conditional distribution
of well-known distributions such as the normal, gamma, and beta is the distribution of the parameter conditional on the known infor-
distributions. However, this is not the case in ad hoc distributions mation and all the other parameters pðθj jθ−j ; yÞ. Many times, such
following unusual PDFs. In such cases, one of the most widely used as the case in this paper, the full conditionals do not follow a stan-
techniques for sampling is the Markov chain Monte Carlo. Markov dard distribution with known density functions. Second, if the tar-
chain is a stochastic process in which future states X nþ1 ; X nþ2 ; : : : get function does not follow a standard distribution, Gibbs
are dependent on past states X 0 ; : : : ; X n only through the present sampling will not be practical for the lack of conjugacy (Gilks
state X n (Serfozo 2009). 2005). In short, the Metropolis-Hastings algorithm is more flexible,
Markov chain Monte Carlo (MCMC) is a technique of generat- generic, and best fits the type of data in the scope of the research.
ing random variables following any desired PDF, named the target
distribution, throughout simulated draws from an easy-to-sample
Kolmogorov-Smirnov Test
PDF, named the proposal distribution. MCMC methods have been
used for almost as long as the original Monte Carlo techniques The one-sample Kolmogorov-Smirnov test, referred to as the K-S
(Robert and Casella 2010). For the MCMC to work, the successive test, is a statistical nonparametric test for comparing a sample with
sampling from the proposal distribution has to follow a Markov a reference probability distribution. In the scope of this research,
chain that abides by the ergodic theorem (Gilks 2005). An ergodic the K-S test is used to measure the goodness of fit, which is a valid
Markov chain is a one that is aperiodic, irreducible, and positive and widely employed use of the test (Wilcox 2005). Given N-
recurrent. A Markov chain is aperiodic when it is not repeating an ordered data points X 1 ; : : : ; X n , an empirical cumulative distribu-
identical cycle of states. A Markov chain is irreducible when, no tion function ECDF is formed using EN ¼ nðiÞ=N, where nðiÞ is
matter the starting value X 0 , the sequence X n has a positive prob- the number of points less than X i and the X N are ordered from
ability of eventually reaching any region of the state space (Robert smallest to largest value (Marsaglia et al. 2003). The ECDF is plot-
and Casella 2009). Finally, a Markov chain is positive recurrent if ted and compared to the reference cumulative distribution function
0.05 means that there is not enough evidence to reject the null hy-
pothesis that the tested sample follows the reference probability a simple function of dividing their bid values by the cost estimate of
distribution. contractor x. This is so because it assumes that the cost estimate is the
same for all competitors, including the studied contractor.
In the proposed model, instead of fitting the competitors’
Methodology markup density functions from points directly obtained from dis-
crete bid ratios, the density functions are fitted from points sampled
A three-stage research methodology was utilized in this research. from a preliminary distribution density function pdi ðrÞ. In the
First, the authors established a systematic procedure to fit compet- pdi ðrÞ, bid ratios are considered as density functions themselves
itors’ historical data into appropriate Bayesian prior density func- to take the stochastic variability of cost estimates into consideration
tions while taking the stochastic variability of cost estimates into [Eq. (12)]
ni
consideration. Second, the authors developed the stochastic likeli-
hood function through the most recent observation(s). Third, the X Bij × 100
pdi ðrÞ ∝ N r − 100; σij ð1 − ∅ij Þ
authors created the posterior distributions from which the joint j¼1
Cj
probability of winning and the expected profit can be calculated.
þ Γðrjαij ; β ij Þð∅ij Þ ð12Þ
The General Structure
To clarify the sense in which the Bayesian framework is used in the where r ∈ ð0; ∞Þ; ni = total number of available bid value data
context of construction bidding, the historical bidding data of com- points for competitor i; Nðrja; bÞ = normal distribution probability
petitors are not going to be treated equally and fitted in probabilistic density function with mean a and standard deviation b, calculated
densities as usually treated in the frequentist statistical approach. as shown in Eq. (13); and Γðrja; bÞ = gamma distribution proba-
However, recent observations are going to have a significant role bility density function with shape a and rate b, calculated as shown
in shaping the statistical inferences more than the role of the less in Eq. (14)
recent ones in the following manner. In simple words, less recent 1 ðr−aÞ2
−
historical data are the ones forming the prior distribution πðθÞ. Nðrja; bÞ ¼ pffiffiffiffiffiffi e 2b2 ð13Þ
Even if such data are not available, contractors can incorporate b 2π
the concept of the average bidder described by Friedman
(1956). The most recent observation or set of observations of com- ba
Γðrja; bÞ ¼ R ∞ ra−1 e−br ð14Þ
petitors is the one forming the likelihood function fðDjθÞ. Of 0 ra−1 e−r
course the different prior and likelihood functions take the stochas-
tic variability and uncertainty of each single data point for each A preliminary density function is calculated for each competitor.
competitor into consideration. Statistical inference about future For each historical bid j, a contractor knows its cost estimate Cj and
bid strategies of competitors is then made from a series of posterior the bid value of each of its competitors Bij . The stochastic variance
functions that modify the uncertainties about the different posterior in the cost estimation between a contractor and its competitors is
values in light of evidence presented by the likelihood function. represented by σ. The generic nature of the model allows for a dif-
Fig. 1 details the methodology utilized in developing the proposed ferent σ in each historical data point. Thus, σij reflects the contrac-
model. tor’s perception of variance between its cost estimate for bid j and
The following paragraphs detail the aforementioned three-stage the cost estimate of its competitor i for the same bid. Each historical
research methodology as related to calculating prior, likelihood, data point is represented by a normal distribution with mean equal
and posterior functions within the Bayesian framework. The first to the estimated markup and a standard deviation of σij . The normal
stage is concerned with fitting of the historical data of competitors distribution is widely accepted as a measure for stochastic uncer-
into probability density functions forming the prior distribution. tainty in similar cases (Carr 1982; Ioannou and Leu 1993; Ioannou
The second is concerned with forming the likelihood functions. Fi- and Awwad 2010). The value of σij is project dependent. Every
nally, the third stage is concerned with forming the posterior dis- project has unique circumstances. For example, in a simple instal-
tribution, calculating the probability of winning, and determining lation project with complete drawings and specifications, the vari-
the optimum markup value at which the expected profit is at its ance of cost estimates of competitors is less than that in a more
highest. For simplicity to readers, each stage is organized into steps. complex project. There are no validated generic values that can be
Stage 1 is performed in Steps 1 to 4, Stage 2 is performed in Step 5, used for σij found in the literature. The contractor can obtain σij
and the last stage is performed in Steps 6 to 8. either from statistical analysis of historical cost estimates of its
random walk Metropolis-Hastings algorithm is used, where the to find the best parameters for any selected distribution to fit the
random variable Y t is generated as shown in Eq. (15) data set. For example, assume that in a hypothetical case, the
Cullen-Frey graph shows two suitable distributions, namely normal
Y t ¼ X t þ εt ð15Þ and Weibull, fitting a certain data set. Then assume that the best
parameters for those distributions are mean = 4.52, SD = 3.33
where εt = random perturbation with distribution g. In this case, g is for the normal distribution and shape = 1.42, scale = 4.99 for
a normal distribution with mean = 0 and standard deviation = 2. So the Weibull distribution. One indicator to judge which distribution
for each simulation, a random variable εt is generated from g best fits the data set is the plotting of the histogram against
[Eq. (16)] and added to the preceding X t [Eq. (15)] each of the parametric distributions and selecting by visual
inspection the one that best matches the histogram. Another indi-
εt ∼ Nð0,2Þ ð16Þ cator is the plotting of the quantile–quantile (Q–Q) plots and
probability–probability (P–P) plots of the theoretical and empirical
The random walk allows for local exploration of random vari- probabilities, and taking the decision based on visual inspection of
ables all over the support of the target function while maintaining the plots. To minimize subjectivity in evaluating the quality of
the ergodic properties of the chain. The values of Y t can then be fitness, the one-sample Kolmogorov-Smirnov test is performed.
used in Eq. (9). Moreover, the use of such a symmetric function for The distribution that results in a p-value higher than 0.05 is selected
g simplifies the acceptance probability previously shown in as the one that best fits the data set.
Eq. (17) For a histogram with significant multiple peaks, the previously
mentioned procedure will not be of benefit because the traditional
fðyÞ parametric distributions mostly have one peak. Thus, fitting inap-
ρðx; yÞ ¼ min ;1 ð17Þ
fðxÞ propriate density functions to data sets leads to low K-S test p-
values, deeming the output statistically questionable. In cases of
Roberts et al. (1997) specifies that an acceptance rate of 23.4% data sets with two or more peaks in their histograms, the logspline
or more provides a good indication on the convergence of the chain fitting is recommended. The logspline fitting forms a function from
and the suitability of the candidate function. The flow chart of a space of cubic splines that have a finite number of prespecified
the random walk Metropolis-Hastings algorithm was shown in knots and are linear in tails (Kooperberg and Stone 1991). A de-
the right part of Fig. 1. The generated Markov chain for each tailed mathematical description for fitting a set of points into a logs-
competitor, which is the output of this step, is referred to as pline density is given by Kooperberg and Stone (1991). There are
½X 1,001 ; X 1,002 ; : : : ; X 10,000 i . The numbering starts from 1,001 be- software packages that can automatically fit logspline densities of
cause the first 1,000 points are eliminated for the chain’s burn and data sets such as the package logspline in R.
ends at 10,000 because the total number of simulations (draws)
is 10,000.
Step 4: Developing the Prior Functions
The fitted distribution for each competitor i from Step 3 is recorded
Step 3: Fitting Proper Distribution to the Preliminary as the competitor’s prior distribution πðθÞi . πðθÞi should be normal-
Density Functions ized with a positive support.
In this step, the Markov chains from Step 2 are processed to form For competitors with little accurately recorded previous histori-
prior distributions to be used in the Bayesian framework. Each of cal bid data, the corresponding πðθÞi of such competitors would be
the random variables ½X 1,001 ; X 1,002 ; : : : ; X 10,000 i is named M ij , obtained based on the expert judgment of the bidding firm or based
where M stands for the markup percentage, i stands for the number on the concept of educated belief, discussed earlier in the paper, or
of competitors, and j stands for the number of generated random the concept of the average bidder. The concept of average bidder
variables in the Markov chain of each competitor. The purpose of was proposed by Friedman (1956) and acknowledged by other re-
this step is to fit a parametric distribution to the set of Mij . searchers later (Hanssmann and Rivett 1959; Capen et al. 1971).
Fitting distributions to data consists of selecting the best-fitting The average bidder is a composite of all bidders that the contractor
probability distribution from a predefined family of distributions. It has faced in the past (Sparks 1999). If the user has very limited
requires judgement and expertise and generally needs an iterative information about the competitor’s history and intends to form
process of distribution choice, parameter estimation, and quality of its corresponding prior distribution without sufficient information
evaluation (Pouillot and Delignette-Muller 2010). This step pro- to form a good educated belief, the authors encourage the user
vides a systematic and objective approach to distribution fitting. to use a probability distribution with parameters that result in a
ferent parameters on the resulting optimum markup. parameters αij and β ij in the cases of negative bid ratios. For
In the first case study, the total number of competitors was 3. For i ¼ 1, the value of αij was 3 and the value of β ij was 1.3; for
each competitor, there were 30 direct markup percentages avail- i ¼ 55, the value of αij was 3 and the value of β ij was 2; and
able. So the available data points were in the form of M ij , where for i ¼ 134, the value of αij was 5 and the value of β ij was 2. There
i ∈ f1,2; 3g, J ¼ 30, and j ∈ f1,2; : : : ; Jg. Steps 1 and 2 were not were no cases of negative bid ratios in bids related to competitor
required in this case study since the data were already in the form of 221 so the gamma distribution part is not used for that competitor.
direct markups. In each scenario, several values of σik were simulated to provide
In the second case study, the total number of competitors con- some kind of a sensitivity analysis for the effect of σik on optimum
sidered was 4. The gathered data were for actual bids entered by a markup selection and the corresponding probability of winning. A
firm. The firm recorded the bid prices Bij of each of its competitors higher σik means a higher variability between the firm’s cost esti-
(including other participants than the considered 4) and its own cost mate and the competitors’ cost estimate in the bids considered in
estimates Cj . Each competitor had a code, namely 1, 55, 134, and the likelihood function. Lastly, σik ¼ σ for all i and all k, where
221. So, i ∈ f1,55,134,221g. There are different data points for σ ∈ f1,2; 3,4g. The case studies were programmed in R-language.
each competitor, where J i ∈ f33,20; 12,6g.
The data available in the case studies did not provide sufficient
information about the dates and conditions of the bids because the Results of Case Study 1
previous statistical models did not require such information. Ac- Since the data provided the historical direct markup values, the
cordingly, some assumptions were made regarding the stochastic Cullen-Frey graph of each competitor was plotted directly from
variability in cost estimates, the selection of data points that provide the data points. Fig. 3 shows the Cullen-Frey graph of Competitor
the likelihood function, and the distribution parameters in cases 1 (as a sample), indicating that the normal, lognormal, and Weibull
where certain bid ratios were negative. In reality, when the pro- distributions are possibly good fits for the corresponding markup
posed model is used, the assumptions will be minimal because data. The MASS package in R was used to obtain the optimum
the firm using the model will have all the proper information. parameters for each of the three nominee distributions throughout
Fig. 4. Fitting the markup data of Competitor 1 to Weibull distribution, Case Study 1
the maximum-likelihood fitting routine. Afterward, the K-S test package in R. The Cullen-Frey graph and distribution fitting figures
was conducted to select the most suitable fit throughout the for Competitors 2 and 3 are not shown for the sake of the paper’s
p-values. For Competitor 1, the best-fit distribution, eventually length.
forming the prior function, was the Weibull distribution with the The likelihood and posterior functions were calculated in accor-
parameters scale = 10.575 and shape = 2.147. This distribution dance to the model’s methodology and the aforementioned stated
was also visually compared to the data points throughout the histo- assumptions. The probability of winning against each contractor
gram Q–Q, cumulative distribution function (CDF), and P–P plots was obtained and the combined probability of winning against
for verification as shown in Fig. 4. The same steps were conducted all competitors was calculated once using Friedman’s formula
for the rest of the competitors. The resulting prior function of the and once using Gates’s formula. The expected profit and probabil-
second competitor was obtained from a uniform distribution with ity of winning curves for each σ in the two scenarios are shown in
parameters min = 0.4 and max = 19.4. The histogram of the third Figs. 5 and 6. The optimum markup and its corresponding prob-
competitor showed two significant peaks, so the logspline approxi- ability of winning for each σ in the two scenarios are shown in
mation was used to obtain its prior function using the logspline Table 1.
Fig. 5. Expected profit and probability of winning against all competitors in Scenario 1, Case Study 1
Fig. 6. Expected profit and probability of winning against all competitors in Scenario 2, Case Study 1
Table 1. Optimum Markup Determination and Corresponding Probability of Winning, Case Study 1
Scenario 1 Scenario 2
Bidding
σ ¼ 1% σ ¼ 2% σ ¼ 3% σ ¼ 4% σ ¼ 1% σ ¼ 2% σ ¼ 3% σ ¼ 4%
against
competitor M Pwin M Pwin M Pwin M Pwin M Pwin M Pwin M Pwin M Pwin
number (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%) (%)
1 7.6 0.86 7.3 0.80 7.2 0.75 7.2 0.71 8.5 0.94 8.2 0.85 8.2 0.79 8.1 0.75
2 12.6 0.92 11.9 0.87 11.4 0.82 11.1 0.76 13 0.96 12.1 0.92 11.6 0.86 11.1 0.81
3 9.9 0.92 9.4 0.89 9.2 0.84 9.1 0.79 10.9 0.61 9.8 0.55 8.9 0.57 8.6 0.59
Winning alla 7.5 0.87 7.1 0.80 6.7 0.75 6.4 0.69 8.5 0.60 7.6 0.56 7.1 0.57 6.7 0.58
Winning allb 7.5 0.87 7.1 0.81 6.9 0.74 6.7 0.68 8.8 0.59 8.2 0.55 7.6 0.56 7.3 0.56
a
Based on Friedman’s formula.
b
Based on Gates’s formula: M (%) = optimum markup; Pwin = probability of winning corresponding to M (%).
In Scenario 1, where the likelihood function is formulated from values were higher than those of Scenario 1 because the corre-
the latest observation, the optimum markup for winning against all sponding observations, especially for Competitors 1 and 2, pro-
three competitors in a future bid ranged from 6.7 to 7.5% as shown vided stronger evidence that the competitors’ current bidding
in Table 1. The 7.5% corresponded to the lowest σ and the 6.5% scheme was more risk inclined. In this scenario, the differences be-
corresponded to the highest σ. The probability of winning in such tween Friedman’s and Gates’s formulas increased but were still not
markups ranged from 87 to 64% depending on σ. There were no very noteworthy. The gaps between them increased in higher values
significant differences between the results of Friedman’s and of markups, where the probability of winning was lower.
Gates’s formulas in this scenario. As the variability, or the belief of variability, between cost
In Scenario 2, where the likelihood function was formulated estimates (represented by σ) decreased, the optimum markup in-
from the latest two observations, the optimum markup for winning creased and the probability of winning also increased, as shown
against all competitors ranged from 6.7 to 8.8%. These markup in Fig. 7. This means that if a firm has high certainty that its cost
Fig. 7. Effect of σ on optimum markup selection and the corresponding probability of winning, Case Study 1
shows the histograms of the resulting points and their fitted prior markups were in very low ranges. Such an assumption was made
distributions after performing the K-S tests on them. for demonstration of the effect of belief on the results. In reality, if
Fig. 8. MCMC convergence of competitors and the resulting prior distributions, Case Study 2
Fig. 9. Expected profit and probability of winning against all competitors in Scenario 1, Case Study 2
Fig. 10. Expected profit and probability of winning against all competitors in Scenario 2, Case Study 2
Table 2. Optimum Markup Determination and Corresponding Probability of Winning, Scenario 1, Case Study 2
Combined probability based on Friedman’s equation Combined probability based on Gates’s equation
Winning against
σ¼2 σ¼3 σ¼4 σ¼2 σ¼3 σ¼4
the following
competing bidders M (%) Pwin (%) M (%) Pwin (%) M (%) Pwin (%) M (%) Pwin (%) M (%) Pwin (%) M (%) Pwin (%)
1 þ 55 þ 134 1.20 62.4 1.24 61.4 1.26 59.9 1.33 59.5 1.41 57.7 1.46 55.7
1 þ 55 1.57 64.5 1.55 62.5 1.51 61.4 1.58 64.4 1.61 61.4 1.62 59.3
1 þ 134 1.21 62.1 1.29 61.4 1.35 61.3 1.33 59.7 1.43 58.6 1.5 58.2
55 þ 134 1.67 62.4 1.81 61.0 1.9 59.7 1.69 61.9 1.90 59.9 2.12 56.4
55 þ 221 2.41 66.7 2.55 63.4 2.58 60.4 2.47 65.9 2.78 61.0 2.9 57.1
All 1.12 62.5 1.17 61.5 1.2 60.6 1.28 58.6 1.36 57.1 1.41 56.1
Fig. 11. Effect of σ on optimum markup selection and the corresponding probability of winning, Case Study 2
and Yuan (2011), given that they used the same combinations ex- range or not does not make the proposed model any more or less
cept for the last one. Figs. 5 and 6 show the expected value and validated because Christodoulou’s model works in an entirely dif-
probability of winning graphs for the last combination only, which ferent methodological approach. However, it surely substantiates
is bidding against all four competitors. the abilities of the proposed model in generating sensible results.
Similar to Case Study 1, as σ decreased, the probability of win- In the second case study, for bidding against competitors 1, 55,
ning increased. However, as σ decreased, the optimum markup in- and 134, Skitmore and Pemberton (1994) suggested an optimum
creased as shown in Fig. 11, which is contrary to what is in Case markup of 13.47%, while Yuan (2011) suggested an optimum
Study 1. Also, as the value of σ increased, the gap between the markup of 2.79% (Table 4). The proposed model suggests an op-
outcomes of Friedman’s and Gates’s formulas increased. Further timum markup ranging from 1.20 to 1.46%, with a winning prob-
discussion is available in the next section. ability ranging from 55.7 to 62.4%, given the assumption of the
first scenario. For the second scenario, where the likelihood func-
tion is formulated from the latest two observations, the optimum
Discussion markup ranges from 1.32 to 1.51% with a winning probability that
ranges from 58.4 to 63.7%. The values of optimum markups and
In the first case study, the optimum markup for winning against all the winning probabilities within each range depend on the value of
competitors ranged from 6.4 to 8.8% and the corresponding prob-
σ and on the decision whether to use Friedman’s or Gates’s
ability of winning ranged from 55 to 87%, depending on the sce-
formula.
nario and the value of σ. To compare, the neuro-fuzzy model
For bidding against competitors 55 and 134, Skitmore and
developed by Christodoulou (2004b) suggested an optimum
Pemberton (1994) suggested an optimum markup of 7.7%, while
markup of 7% for the same data, which is within the range of op-
Yuan (2011) suggested an optimum markup of 3.29%. The pro-
timum markup resulting from the proposed model. Being within the
posed model suggests an optimum markup ranging from 1.67 to
2.12%, with a winning probability between 56.4 and 62.4%, given
the assumption of the first scenario. For the second scenario, the
Table 4. Optimum Markup Values Obtained by Skitmore and Pemberton
proposed model suggested optimum markup ranging from 2.16
(1994) and Yuan (2011), Case Study 2
to 2.57% with a winning probability between 53.6 and 62.4%. The
Competing Skitmore and Yuan (2011) values of optimum markups and the winning probabilities within
bidders Pemberton (1994) (%) (%) each range also depend on the value of σ and on the decision
1 þ 55 þ 134 13.47 2.79 whether to use Friedman’s or Gates’s formula.
1 þ 55 10.98 3.69 Generally in the second case study, the optimum markup values
1 þ 134 12.06 3.74 suggested by Yuan (2011) are much lower than those suggested by
55 þ 134 7.70 3.29 Skitmore and Pemberton (1994). Although both of their statistical
55 þ 221 6.62 —
models employ correlation analysis of historical bids, the differences
of two factors. First, both models have totally different method- obtained through the innovative combination of decision theory
ologies. Second, the proposed model takes the dynamic behavior and Bayesian statistics.
of competitors into consideration, so it is more dependent on The proposed model was compared to three bidding models
recent observations. In the case study, the most recent observa- from the literature that utilized two historic case studies. Each case
study had its own set of data. Since the data available did not have
tions had low bid ratios. The authors believe that the proposed
all of the required information, reasonable assumptions were made
model produces accurate results because it takes the dynamic
for the missing information. The purposes of the case studies were
behavior of competitors into consideration. The model’s accu-
to demonstrate the use of the model and to illustrate the effect of
racy increases when the user is knowledgeable about competi-
different parameters on the resulting optimum markup. The model
tors. If such knowledge is available, the assumptions will be
showed that the more recent bidding strategies of competitors play
minimal.
a significant role in predicting the future ones. Also, as the contrac-
The proposed model requires some additional information about
tor becomes more certain about its competitor’s behavior, both its
historical bids other than just bid prices of competitors. Because
probability of winning and optimum bidding markup increase. In
such additional information was not available in the data provided
the first case study, the results of the proposed model were close to
in the literature, the authors simulated different scenarios with dif-
those of Christodoulou (2004a, b). In the second case study, the
ferent likelihood approaches and different values of σ. The output
proposed model suggested a markup that is less than that of Skit-
was a set of different values of optimum markups and probabilities
more and Pemberton (1994) and Yuan (2011). In both case studies,
of winning. However, in reality, the assumptions will be minimal
the probability of winning decreased when the variability of cost
and there will be only one value for markup and one for probability estimates between competitors increased. This highlights the im-
of winning. Also, a firm that opts to use the proposed model can do portance of high accuracy in cost estimating. The authors believe
its own sensitivity analysis and scenarios. It might add a stochastic that the proposed model produces statistically accurate results,
term in the σ parameter itself, where σ itself would follow a certain especially when good quality data are available. This belief is sup-
distribution. ported by the widely credible Bayesian approach and the multi-
In both case studies, as the variability, or the belief of variability, staged approach that accurately simulates the competitors’
between cost estimates (represented by σ) decreased, the probabil- dynamic behavior. One important assumption is that the number
ity of winning increased. This means that if a firm has high of competitors competing in the given bid is known. Most of
certainty that its cost estimate is within a small range of its com- the models in the literature make such an assumption as well. This
petitors’ cost estimates, it can bid with a higher value of markup research should be beneficial for the construction stakeholders to
and at the same time with a higher probability of winning. Accord- better understand decision making in bidding processes and con-
ingly, the accuracy of cost estimation is an important factor in sequently to help create a healthy contracting environment.
deciding the allocated markup, which is in alignment with the dis- For future work, the authors recommend testing the model on
cussion of Capen et al. (1971). A high certainty of the cost estimate further case studies and automating the process using a user-
is always desired. On the contrary, there is no agreement between friendly software tool to run the model. It is recommended to test
the case studies on the general effect of σ on the optimum markup. the implementation of a hybrid model that utilizes both the multi-
In other words, there is a relationship between σ and the optimum staged Bayesian approach and a multivariate analysis approach
markup, but this relationship is different for each project and each under the umbrella of decision theory. The authors intend to further
set of competitors. In cases, σ and the optimum markup might have extend the research to include hybrid game theory concepts that
a positive correlation and in other cases they might have a negative would add the ability to predict the winner’s curse and to grasp
correlation. the effect of learning in bidding. Such an interdisciplinary frame-
Although different values of σ result in different optimum mark- work will provide a more holistic and comprehensive understand-
ups and winning probabilities, such differences are not significant. ing of construction bidding that will enable better decision
This means that the optimum markup is not very sensitive to σ. So making.
the firm does not have to put a lot of effort into estimating the σik of
the likelihood. However, it should do so in estimating the σij of the
historical data. Obtaining credible values of σij should not be dif- Acknowledgments
ficult throughout some statistical analysis of the historical bids. To
this end, a high probability of winning does not guarantee winning. The authors would like to sincerely thank the anonymous reviewers
Nothing in life is guaranteed. This is why all bidding models are whose comments and suggestions helped improve and clarify this
stochastic, not deterministic. paper.
Boughton, P. D. (1987). “The competitive bidding process: Beyond prob- Design of a module-oriented modeling approach based on system dy-
ability models.” Ind. Marketing Manage., 16(2), 87–94. namics and its prototypical implementation in research and education.”
Capen, E. C., Clapp, R. V., and Campbell, W. M. (1971). “Competitive Ph.D. dissertation, Univ. of Duisburg-Essen, North Rhine-Westphalia,
bidding in high-risk situations.” J. Pet. Technol., 23(06), 641–653. Germany.
Carlin, B. P. (1996). “Hierarchical longitudinal modelling.” Markov chain Kelly, D., Youngblood, R., and Vedros, K. (2010). “Minimally informative
Monte Carlo in practice, Chapman & Hall, London, 303–319. prior distributions for PSA.” Proc., Int. Probabilistic Safety Assessment
Carr, R. I. (1982). “General bidding model.” J. Constr. Div., 108(4), and Management, International Association for Probabilistic Safety
639–650. Assessment and Management, CA.
Cheng, M. Y., Hsiang, C. C., Tsai, H. C., and Do, H. L. (2011). “Bidding Kooperberg, C., and Stone, C. J. (1991). “A study of logspline density
decision making for construction company using a multi-criteria pros- estimation.” Comput. Stat. Data Anal., 12(3), 327–347.
pect model.” J. Civ. Eng. Manage., 17(3), 424–436. Lingard, H., Hughes, W., and Chinyio, E. (1998). “The impact of contractor
Christodoulou, S. (2004a). “Optimum bid markup calculation using neuro- selection method on transaction costs: A review.” J. Constr. Procure-
fuzzy systems and multidimensional risk analysis algorithm.” J. Comput. ment, 4(2), 89–102.
Civ. Eng., 10.1061/(ASCE)0887-3801(2004)18:4(322), 322–330. Liu, M., and Ling, Y. (2005). “Modeling a contractor’s markup estimation.”
Christodoulou, S. (2004b). “Optimum bid markup calculation using neuro- J. Constr. Eng. Manage., 10.1061/(ASCE)0733-9364(2005)131:4(391),
fuzzy systems and multidimensional risk analysis algorithm.” J. Comput. 391–399.
Civ. Eng., 10.1061/(ASCE)0887-3801(2004)18:4(322), 322–330. Lo, H. P., and Lam, M. L. (2001a). “A bidding strategy using multivariate
Cooper, D. F. (2005). Project risk management guidelines: Managing risk distribution.” J. Financial Manage. Prop. Constr., 6(3), 155–165.
in large projects and complex procurements, Wiley, Chichester. Lo, H. P., and Lam, M. L. (2001b). “Decision analysis of competitive bid-
Crowley, L. (2000). “Friedman and gates: Another look.” J. Constr. Eng. ding in construction.” Proc., First International Structural Engineering
Manage., 10.1061/(ASCE)0733-9364(2000)126:4(306), 306–312. and Construction Conference, International Structural Engineering and
Cullen, A. C., and Frey, H. C. (1999). Probabilistic techniques in exposure Construction Society (ISEC), ND, 263–268.
assessment: A handbook for dealing with variability and uncertainty in Marsaglia, G., Tsang, W., and Wang, J. (2003). “Evaluating Kolmogorov’s
models and inputs, Plenum, New York. distribution.” J. Stat. Software, 8(18), 1–4.
Dikmen, I., Birgonul, M. T., and Han, S. (2007). “Using fuzzy risk assess- Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., and Teller, E.
ment to rate cost overrun risk in international construction projects.” (1953). “Equations of state calculations by fast computing machines.”
Int. J. Project Manage., 25(5), 494–505. J. Chem. Phys., 21(6), 1087–1092.
Dixie, J. M. (1974). “Bidding models: The final resolution of a controversy.” Nuzzo, R. (2014). “Scientific method: Statistical errors.” Nature, 506(7487),
J. Constr. Div., 100(3), 265–271. 150–152.
Dozzi, S., AbouRizk, S., and Schroeder, S. (1996). “Utility-theory model Pouillot, R., and Delignette-Muller, M. L. (2010). “Evaluating variability
for bid markup decisions.” J. Constr. Eng. Manage., 10.1061/(ASCE) and uncertainty separately in microbial quantitative risk assessment
0733-9364(1996)122:2(119), 119–124. using two R packages.” Int. J. Food Microbiol., 142(3), 330–340.
Drew, D., and Skitmore, M. (2006). “Testing Vickery’s revenue equivalence Press, S. J., and Press, J. S. (1989). Bayesian statistics: Principles, models,
theory in construction auctions.” J. Constr. Eng. Manage., 10.1061/ and applications, Wiley, New York, 57–58.
(ASCE)0733-9364(2006)132:4(425), 425–428. R-studio, version 0.99.473 [Computer software]. RStudio, Boston.
Fayek, A. (1998). “Competitive bidding strategy model and software sys- Ranasinghe, M. (2000). “Impact of correlation and induced correlation on
tem for bid preparation.” J. Constr. Eng. Manage., 10.1061/(ASCE) the estimation of project cost of buildings.” Constr. Manage. Econ.,
0733-9364(1998)124:1(1), 1–10. 18(4), 395–406.
Friedman, L. (1956). “A competitive-bidding strategy.” Oper. Res., 4(1), Robert, C., and Casella, G. (2009). Introducing Monte Carlo methods with R,
104–112. Springer-Verlag, New York.
Gates, M. (1967). “Bidding strategies and probabilities.” J. Constr. Eng. Robert, C., and Casella, G. (2010). “A history of Markov chain Monte
Div., 93(1), 75–110. Carlo: Subjective recollections from incomplete data.” Handbook of
Gilboa, I. (2009). Theory of decision under uncertainty, Cambridge Markov chain Monte Carlo, Chapman and Hall, New York, 49–66.
University Press, Cambridge, U.K. Robert, C. P. (2015). The Metropolis-Hastings algorithm, Wiley, 1–15.
Gilks, W. R. (2005). Markov chain Monte Carlo, Wiley, NJ. Roberts, G. O., Gelman, A., and Gilks, W. R. (1997). “Weak convergence
Hanssmann, F., and Rivett, B. H. P. (1959). “Competitive bidding.” and optimal scaling of random walk Metropolis algorithms.” Ann. Appl.
Oper. Res., 10(1), 49–55. Probab., 7(1), 110–120.
Hastings, W. (1970). “Monte Carlo sampling methods using Markov chains Rosenshine, M. (1972). “Bidding models: Resolution of a controversy.”
and their application.” Biometrika, 57(1), 97–109. J. Constr. Div., 98(1), 143–148.
Hazewinkel, M. (2001). Encyclopedia of mathematics, Kluwer Academic Rothkopf, M. H. (2007). “Decision analysis: The right tool for auctions.”
Publishers, Dordrecht, Netherlands. Decis. Anal., 4(3), 167–172.
Hegazy, T. M. (1993). “Integrated bid preparation with emphases on risk assess- Runeson, G., and Skitmore, M. (1999). “Tendering theory revisited.”
ment using neural networks.” Ph.D. dissertation, Concordia Univ., Quebec. Constr. Manage. Econ., 17(3), 285–296.
construction industry.” Int. J. Constr. Manage., 8(1), 29–35. bidding model.” Constr. Manage. Econ., 30(6), 477–491.