Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

Transport Policy 19 (2012) 1–7

Contents lists available at ScienceDirect

Transport Policy
journal homepage: www.elsevier.com/locate/tranpol

How suitable is CBA for the ex-ante evaluation of transport projects


and policies? A discussion from the perspective of ethics
Bert van Wee n
Delft University of Technology, Section Transport and Logistics, P.O. Box 5015, 2600 GA Delft, The Netherlands

a r t i c l e i n f o abstract

Available online 5 August 2011 Nowadays in most western countries CBA is the standard method to ex-ante evaluate transport policy
Keywords: options. Despite its popularity CBA has often been criticized for several reasons, most of them related to
CBA the utilitarian perspective and related ethical considerations. This paper gives an overview of ethically
Ethics relevant critics on CBA. Rather than rejecting CBA as the method to be preferred the paper concludes
Critics that researchers should be aware of its limitations and gives guidance on how to deal with the
Utilitarianism weaknesses of CBA from an ethical point of view.
& 2011 Elsevier Ltd. All rights reserved.

1. Introduction of my knowledge no comprehensive overview of critics of CBA for


transport policy options is available in the academic literature. This
Transport policy implies making choices, in case of infrastruc- paper aims to present such an overview of critics from an ethical
ture related policies examples being budget allocations for infra- perspective. It is based on an extensive literature review, mainly
structure in general, and choices between alternatives for a new focusing on literature in the area of ethics, but also on literature
road or railway line. Also non infrastructure related policies from disciplines such as economics and geography (Van Wee, 2011).
implies making choices, such as pricing policies, setting (new) In addition to ethics related critics, a few other critics will briefly be
standards for emissions levels of vehicle categories or safety discussed to give a more or less complete overview of dominant
regulations for vehicles. Because of all the choices to be made, critics on CBA.
there is a huge need for ex-ante evaluations of choice options. An Section 2 presents and discusses the ethics related critics
important question therefore is: how to evaluate potential followed by Section 3 which reflects on multi-criteria analysis
options for future transport projects and policies? (MCA) as an alternative for CBA, as well as on combining MCA and
(Social) cost-benefit analysis (CBA) nowadays is a very popular CBA. Section 4 discusses the implications of the critics on CBA.
ex-ante evaluation method in many countries (Hayashi and Section 5 finally tries to answer the question: How useful is CBA
Morisugi, 2000; Bristow and Nellthorp, 2000; Grant-Muller et al., for the ex-ante evaluation of transport policy options?
2001). Basically a CBA is an overview of all the pros (benefits) and
cons (costs) of a project or policy option. These costs and benefits
are as much as possible quantified and expressed in monetary 2. An overview and discussion of critic
terms. Costs and benefits that occur in different years are discounted
and presented as so called net present values. Final results are Utilitarianism is the most popular theory of a family of ethical
often presented in summarizing indicators, such as the difference theories called consequentialism. Utilitarianism is a theory within
between costs and benefits, the return on investment, and the the wider family of consequentialism. Consequentialism is ‘the
benefit-cost ratio. Research into the use of ex-ante evaluation view that normative properties depend only on consequences’
frameworks shows that CBA is used at least in some stage of the (Stanford Encyclopedia of Philosophy). Utilitarianism, more spe-
evaluation (Thomopoulos et al., 2009; Odgaard et al., 2005). cifically: act consequentialism, is ‘the claim that an act is morally
Despite its popularity, CBA has often been criticized for several right if, and only if, that act maximizes the good, that is if, and
reasons (Thomopoulus et al., 2009; Grant-Muller et al., 2001; Sagoff, only if, the total amount of good for all, minus the total amount of
1988; Gardiner, 2006), most of them related to the utilitarian bad for all, is greater than this net amount for any incompatible
perspective and related ethical considerations. However, to the best act available to the agent on that occasion’ (Stanford Encyclopedia
of Philosophy). Utilitarianism provides an ethical foundation of
CBA: a CBA compares policy options from the perspective of
n
Tel.: þ31 15 2781144; fax: þ31 15 2782719. utility (mainly based on the Willingness To Pay of consumers).
E-mail address: g.p.vanwee@tudelft.nl Utilitarianism is an extremely powerful ethical view, particularly

0967-070X/$ - see front matter & 2011 Elsevier Ltd. All rights reserved.
doi:10.1016/j.tranpol.2011.07.001
2 B. van Wee / Transport Policy 19 (2012) 1–7

when one is concerned with issues of public policy because it indicator. Influential philosophers like Rawls and Sen have pro-
makes ethical questions in principle matters of straightforward posed alternatives, such ‘primary social goods’, capabilities, or the
calculation (Hausman and McPherson, 2006). welfare or well being of the least advantaged. See Ralws (1971),
Nevertheless, several reasons to challenge it exist. This paper Sen (2009). According to Rawls (1971, 1982), primary social goods
discusses next (categories of) critics: include

1. Utilitarianism could be useful for some evaluative purposes  basis liberties, including freedom of association, liberty, and so on,
but not for all. In other words, the area of application is  freedom of movement and choice of occupation,
limited.  powers and prerogatives of offices and positions of responsibility,
2. It is not without dispute to select the indicator to be max-  income and wealth,
imized. This could be welfare but other alternatives exist.  the social bases of self-respect.
3. Distribution effects are ignored.
4. Some effects are difficult to monetize. Rawls discussed the use of the optimization of primary social
5. There is more than utilitarianism. Other – in some cases: goods as an alternative for optimizing welfare.
competitive – theories exist. Sen (2009) disagrees with Rawls. He argues that it is the
6. There is more to be evaluated than welfare. Other values may provision of certain kind of ‘primary social goods’ that should be
also be relevant. equalized (nor welfare), but what he calls ‘capabilities’, which lies
7. Not only humans matter. between goods and welfare. Sen argues that the fit between a
8. Poor people count less than rich people. person’s holding of primary goods and the substantive freedoms
9. Choices of people are not always based on reason. that the person can in fact enjoy, can be very imperfect because of
10. CBA evaluates changes in welfare and ignores absolute levels. the actual capabilities of people. It is beyond the scope of this
11. Not only the outcomes of choice options matter but also the paper to further discuss indicators—this is more a general
process of selecting/defining/designing options. discussion than specifically related to transport. The main mes-
sage is that there is more than welfare to be optimized and
Below these critics will be discussed. evaluated.
Relevant for transport is that in case of primary social goods it
is important to decide, which trips or activities will be considered
2.1. Ad 1: the limited area of application as primary social goods. It is beyond the ambitions of this paper to
come to a ‘final’ proposal, but I think that a certain level of access
Utilitarianism might be a useful theory to evaluate some to schools, jobs, shops, family or friends, and health care facilities
choice options but not all. For example, for question such as could be considered as more likely to be included in a list of
how to think about euthanasia, slavery or abortion utilitarianism primary social goods, than access to luxury holiday destinations
is probably not the most helpful theory—in the area of applied or helicopter access to business parks for captains of industry.
ethics philosophers generally use other theories to discuss such Of course a huge element of subjectivity might show up, as does
subjects. In case of ex-ante evaluations of transport policy options the concept of paternalism. I do not want to suggest that certain
it is questionable if such moral dimensions should be put into the categories of activities and related access to them should not
equation. I think that if the ex-ante evaluation considers choice count. I only want to state that the option exist to label some
options for road or rail extensions the critic is of limited categories of activities and related access to them as primary
relevance. But if policy options included policies to reduce social social goods. I think doing so strongly relates to the concepts of
exclusion it might become relevant. In case of social exclusion a access and accessibility, and exploring ways to include these
major problem is that the willingness-to-pay (WTP) of some concepts in ex ante evaluations of transport policy options could
categories of citizens is very low. One can think of children in be of interest.
remote areas going to school or very low income people that In case of capabilities as proposed by Sen it also could be an
simply cannot afford to own (and use) a car. If policy makers want option to include levels of accessibility in the evaluation because
to avoid that such people can hardly participate in society by accessibility strongly relates to the capabilities of performing
introducing social exclusion related policies, utilitarianism might activities at certain locations. A major question then becomes:
be cumbersome. Another category of ex-ante evaluations for whose accessibility? Who to compare? Again I do not aim to come
which utilitarianism can be problematic is if budget allocations to a ‘final’ proposal, but it might be worth exploring accessibility
play a major role, as a result of which quite ‘incomparable’ of groups like disabled persons (in several categories), low income
allocations of a Ministry of Transport should be compared. One groups, or people that do not have a car available.
can think of competition between budgets for high speed rail A third option could be to focus on the least advantaged. This
extensions versus subsidies on local busses. This category of could be done by evaluating their welfare in the traditional way,
ex-ante evaluations is very scarce—to the best of my knowledge this is done in CBA. Alternatives could relate to accessibility levels
in practice CBA is not or hardly used for such comparisons. So the (and related indicators) of the least advantaged as described
limitations of CBA for such ex-ante evaluations probably are more above, or to apply income dependent weight factors for utility
theoretically interesting than in practice, even though the choice (see below).
of budget allocations is highly relevant from an ethical point A fourth option could be to focus on quality of life related
of view. indicators, happiness often being used in research (Easterlin,
1973, 1974; Veenhoven, 1991), but hardly in the area of transport,
2.2. Ad 2: the indicator to be maximized exceptions being the study of Spinney et al. (2009) that studies
quality of life of the elderly Canadians using contextually-derived
CBA assumes what welfare should be maximized (or opti- time budgets that measure daily exposure to psychological,
mized in one way or another, e.g. by maximizing benefits minus exercise, and community benefits of transport mobility, Ettema
costs, of optimizing the benefit-cost ratio). Several authors et al. (2010) who studied well-being related to activity participa-
have stated that it is questionable if all ex-ante evaluations tion and travel, and Bergstad et al. (2011) studying subjective
should focus on maximizing an indicator at all, and if so: which well-being related to travel satisfaction.
B. van Wee / Transport Policy 19 (2012) 1–7 3

2.3. Ad 3: distribution effects and equity are ignored accepted methods exist to monetize effects, there still is debate
on if this is acceptable, an example being pricing human lives, or
CBA is often criticized for ignoring distribution effects. Indeed, at least pricing changes in risks (leading to the indicator the Value
many applications of CBA do so (Thomopoulos et al., 2009; of a Statistical Life—VOSL).
Rietveld et al., 2007). However, it is important to realize that
CBA does not exclude reporting distribution effects, e.g. over 2.5. Ad 5: other theories
income classes or regions. So the critic mainly relates to the use
of CBA in practice. In addition to utilitarianism several other ethical theories can
From a utilitarian perspective the value of each benefit for be used as a point of departure to evaluate (in our case) transport
each person counts equally. But for decision making it may be of options. Below I discuss two dominant theories: deontology and
importance who benefits to what extent, and who loses to what rule based ethics.
extent. Based on a literature review Thomopoulos et al. (2009) Deontology—the concept of duties. The concept of duties as
give an overview of equity categories that could matter in ex-ante proposed by deontologists could be relevant for the evaluation of
evaluations of transport policies, projects and plans, and con- potential transport policy options. For example, one could argue
siderations from an equity point of view—see Table 1. Note that that society has the duty to provide a certain level of access to
such considerations and the way to use them are political choices. activity destinations to most – if not: all – members of society.
Probably the two most important distinctions that are made The consequence could be that ex-ante evaluations should
from a distribution or equity perspective are distinctions between include at least some kind of evaluation of accessibility levels.
income classes and regions. Especially if low income categories or The options as described above could be helpful. In addition, the
poor regions ‘lose’ and high income categories or regions ‘win’ government might have made promises in the past, for example
this may be ethically and politically relevant. to a specific region or city. If so, an explicit evaluation if the
promises are kept, could be included in an ex-ante evaluation.
2.4. Ad 4: some effects are difficult to monetize Deontology—rule based ethics. Rule based ethics holds that the
primary task of ethics is to provide the right rules of action. One of
CBA aims to express (preferably) all effects in monetary terms. the oldest rule views is based on the Ten Commandments of God.
However, some effects, such as construction costs, or travel time The eighteenth-century philosopher Immanuel Kant developed the
savings, are easier to express in monetary terms than others, such principle of the Categorical Imperative. Several formulations of the
as nature, esthetics, or social cohesion and even if generally Categorical Imperative exist. A relatively easy to understand for-
mulation is: act in such a way that you always treat humanity,
Table 1 whether in your own person or in the person of any other, never simply
Equity types and principles found in literature. as a means, but always at the same time as an end (Audi, 2007). This
Source: Thomopoulos et al. (2009). implies that we always treat persons not merely as means, but also
as ends in themselves. This applies to oneself as well as to others.
Equity types Features
Everyone matters and matters equally.
Horizontal equity Comparable individuals, groups or Here I limit the discussion to Kantianism. The idea that people
regions should be treated in a comparable should never be used as a means could be interpreted that it is
way immoral that people lose to make others win. This interpretation
Vertical equity Disadvantaged individuals, groups or
regions deserve protection. People should
links Kantianism to the Pareto optimum. Probably the most often
be burdened according to their ability to cited optimum for welfare is the Pareto optimum, which says that
contribute, and this may lead to schemes the optimum is reached if nobody can increase his welfare unless
where taxes may be progressive someone else’s welfare decreases. A big problem occurs in many
Territorial equity Results from the notion of individual
practices including in transport projects or plans: it is almost
equity when it is projected on relatively
homogeneous regions need to get similar impossible to do anything in the transport system without having
funds for (public) transport losers. Let us assume the example of building a ring road around a
Territorial cohesion Refers to balanced development of town, to reduce noise nuisance and air pollution and to increase
human activities across the EU safety levels. Very likely there will be people living in the
Level playing field Transport sectors should be treated in
similar ways according to taxation,
outskirts of town that will face increasing noise levels due to
payment for the use of infrastructure, etc. the new ring road. Would a Pareto optimum then imply that the
Transport users should pay This concept is usually interpreted in new ring road should not be build? This is questionable because
their way terms of average costs implying that the due to increased car ownership and car use levels, people living
collective of all transport users exactly
along the current roads will be losers. So, there will be losers
pays for the aggregate costs
Individuals that are negatively This principle has its starting point in the anyway. Or assume regulations to further decrease emissions
affected by policies need to status-quo situation and implies that levels of cars. The persons that will buy new cars, very likely will
be compensated winners have to compensate losers lose if the new cars are even 1 euro more expensive due to the
Egalitarianism All individuals are treated equally, technical changes as a result of the new emissions regulations. Or
making the same contribution,
disregarding their financial (or other)
consider any policy that costs money: there is always the tax
ability payer that loses. So I would argue, as many others (Hausman and
Spatial equity It refers to the geographical location of an McPherson, 2006; Rietveld et al., 2007), that in real world
individual, group or region affected by a transport cases, the Pareto principle is of limited use, and that
transport infrastructure project
deontology is very difficult to apply. ‘Solutions’ to this problem
Social equity It refers to the impacts on personal,
economic or social characteristics of an include the use of the well-known Hicks Kaldor (Hicks, 1939;
individual, group or region Kaldor, 1939) principle This principle says that a project has net
Solidarity It is anticipated that an increased focus positive welfare effects if the benefits are large enough that the
on solidarity issues will be facilitated by winners compensate the losers. This implies hypothetical com-
setting the EU transport policy in the
context of the wider EU cohesion policy
pensation. In theory, such a compensation would indeed make
everybody better off, but implementation can easily lead to a
4 B. van Wee / Transport Policy 19 (2012) 1–7

wide range of problems involving high transaction costs and ceteris paribus – per person have more influence on the outcomes of
asymmetric information. a CBA than poor people. One of the reasons in case of the evaluation
of possible transport infrastructure extensions is that the value of
2.6. Ad 6: values matter time (VOT—see above) of higher income groups is higher than of
low income groups. It is an ethically relevant issue to use different
A utilitarian approach could be too limited if specific values could VOTS for different income categories (Grant-Muller et al., 2001). As a
matter as well, freedom probably being one of the most important result higher income groups score better in CBA than lower income
value. Hausman and McPherson (2006) reflect on the issue of groups (Mackie et al., 2003). As a reaction the so-called ‘‘equity
freedom of choice. They argue that from a libertarian point of view value of time’’ was introduced in virtually all cost-benefit analysis
not only the outcomes matter but also the process. In other words, used in the US and abroad. The equity value of time is based on an
‘‘one does not respect freedom by forcing people to do what they would average income level (Morisugi and Hayashi, 2000; cited in Martens,
have chosen to do, and one does not respect rights by forcing on people 2006). Another ethical problem with respect to WPT for travel time
risks that they would voluntarily have chosen to impose upon them- savings is that it implicitly holds that the life of a high income
selves’’ (Hausman and McPherson, 2006). To give an example: person (with a high WTP for travel time savings) is worth more than
a person could decide to accept a job offered at a distance of one the life of a low income person. The same problem occurs with
hour from her home. It could really make a difference if this is the job respect to the WTP for lower risks: high income people then are
she voluntarily has chosen, compared to a situation where this job worth more than low-income people.
accepted is the only job available for her. In the latter case there is In addition, another problem occurs with straightforward
not an element of freedom of choice. The same applies to many other summing up WTP over individuals, which is that the marginal
choices for activities and related destinations. The concept of freedom utility of one monetary unit decreases with wealth. In common
in ex-ante evaluations could be included by evaluating policy options language: for a person with a minimum wage, an increase of – for
via accessibility indicators (Geurs and Van Wee, 2004) such as the example – 100 euro per month adds more to this persons utility
accessibility of activity destinations of several kinds of activities (and probably well being) than for a person earning one million
within certain time limits, or weighted by travel time or generalized euro per year. Hausman and McPherson (2006) cite Bradford
transport costs for the trips to be made, or via person based DeLong who explains that a policy of maximizing net benefits
indicators. Another option is to use output of discrete choice models, coincides with a utilitarian policy if and only if each individual’s
such as generalized costs functions or logsum based accessibility utility is weighted inversely proportionally to each individual’s
indicators (see for the logsum based approach De Jong et al. (2007)), marginal utility of wealth.
or indicators derived from activity-based models (Shiftan, 2008).
In addition, more values exist. Audi (2007) presents what he 2.9. Ad 9: choices and reason
calls ‘basic values’, these are at least: hedonic values, moral
values, intellectual values, esthetic values, spiritual and religious People not only base their choices and behavior on reason but
values, social values, emotional values, and athletic values. ‘Basic’ also on passion and impulse. People may for example over-eat
means that it is not reducible to any other value or to combina- and over-drink. Sen (2009) speaks about the ‘weakness of will’. If
tions of others, nor that its realization cannot be combined with this is the case, then it can be questionable if behavior always is
that of others. If we would take the values of Audi (2007) as a useful to express utility, welfare, or well-being. Sen argues that
point of departure, an ex-ante evaluation could explicitly check if these departures from rational choice do not, in themselves,
other values are at stake. Social values probably are most relevant suggest that the idea of rationality should be modified. In
in case of transport and are to some extent probably strongly addition, it is questionable if this subject is relevant for ex-ante
related to accessibility. But social values can include more, such evaluations of potential future transport policies. In the 1980s the
as forced relocations due to new infrastructure, cultural diversity, Dutch professor of psychology Michon has argued that car use to
and safety impacts. For an overview of social effects and impacts some extent could be considered as behavior subject to addiction.
of transport and the way they can be assessed and are assessed in The same could apply to travel behavior in general. But to the best
the UK and the Netherlands, we refer to Geurs et al. (2009). of my knowledge such ideas have not been widely discussed in
academic literature, so the scientific basis for this point of view
2.7. Ad 7: not only humans matter probably is (still) weak. Therefore I consider them as maybe a
subject of academic research but currently not a reason to
CBA takes human beings as a departure. Impacts on other species criticize current CBA practice in the area of transportation.
and nature are included from a humans perspective. E.g. the will- In addition, according to Sen who refers to Adam Smith, people
ingness to pay for nature conservation can and sometimes is do not decide only based on their self-interest but also on
included in CBAs. But one can debate if this is all that matters. sympathy, generosity and public spirit. And doing so is very
Several philosophers have argued that there is an ethical dimension productive for society. This very likely is true. And probably
that could be relevant, in addition to the human dimension—see, for related behavior may be properly included to some extent in a
example, Jamieson (2003). One could argue that even if human CBA via the willingness to pay and demand curves.
beings would become extinct it matters if the planet is in its current
state compared to a state of much pollution, complete deforestation 2.10. Ad 10: absolute levels are ignored
and huge levels of erosion.
It is important to realize that a CBA evaluates the changes due
2.8. Ad 8: rich people versus poor people to policy options not the absolute levels that result from policy
options. This contradicts with the use of welfare indicators that
This point is related to point 3 on distribution effects, but adds need absolute levels of indicators. E.g. if one is interested in the
to that by discussing elements of weighting between categories of number of people with an income below a certain level, or with
groups of people. access to opportunities below a certain level the changes do not
Taking changes in utility as the main indicator for evaluations (only) matter. Of course it is possible to report the number of
CBA is an undemocratic evaluation method, in the sense that the people below such levels, addition to a CBA. Then the combina-
principle of ‘one man one vote’ does not apply. Rich persons – tion of a CBA and MCA might result.
B. van Wee / Transport Policy 19 (2012) 1–7 5

2.11. Ad 11. the process matters McPherson (2006) who conclude that a CBA might provide a
reasonable basis for decision making in cases where the winners
In line with ideas of Sen (2009) I think it is not a good idea to and losers are more or less equal in their ability to pay (or at least
substitute public deliberation for CBA. A CBA is helpful, but also when it is clear who the winners and losers are, and to what
deliberation, or more generally: the process, matters. This firstly extent they win and lose), where uncertainty about dominant
because preferences can be influenced by arguments and delibera- consequences is limited, and where the kinds of reasons recom-
tion. Deliberation, for example, may people be aware of the value mending different policies are widely understood. This implies
of, for example, providing access to remote areas or specific groups that the usefulness of CBA is higher if the alternatives to be
of people, or to effects on nature or the landscape. Secondly people evaluated are more or less comparable, e.g. alternatives for road
may value their role in decision making, regardless the outcomes. or rail extensions. Applying CBA for comparisons of, for example,
Therefore Sen argues that not only the result of choice matters, but investments in road versus on demand bus or taxi transport for
also the process of choice. Sen refers to what he calls the social isolated regions can be more risky, and at least need a check on
realizations. Social realizations are much more inclusive than only the ethical dimensions.
outcomes, and can include a broad view of the realizations, includ- A second conclusion is that proponents of CBA do not claim
ing the nature of the agencies involved, the processes used, and that the outcomes of a CBA should be the only basis for decision
the relationships of people (Sen, 2009). In other words, people may making and thus that the ‘best’ option should be chosen. This is
value being involved in the process, regardless the outcomes. And first of all because political preferences may occur, as a result of
this involvement may make the final decision more acceptable. which some may value certain outcomes higher than assumed by
As a result, utilitarian ethics is restrictive. An example of literature the price tags. E.g. a green party may value changes in CO2
explicitly discussing ethics in decision making in the area of transport emissions higher than as assumed in the CBA. In addition
is McKay (2000) who discusses incorporating the ethical principles of politicians may include in their decision many other aspects –
differing values, equal consideration, equitable participation, distri- see Section 2 – such as some forms of equity or distribution
butive justice, and emphasis on non-quantifiable factors into the effects (e.g. by region), or inequality of income, or absolute levels
decision process. She examines these five principles through the of accessibility. Secondly, specific groups in society could be
evaluation of the decision to build the Red Hill Creek Expressway in linked to political parties, and winners and losers might be
the region of Hamilton-Wentworth in Ontario, Canada. She concludes unequally distributed amongst those groups. As a result demo-
the process failed to consider these fundamental principles in the cratic decision making does not have to lead to choose the ‘best’
decision-making process. Without these principles the decision will option according to the outcomes of a CBA. Thirdly, and this is
inevitably become mired in the responses of competing stakeholders. more a methodological issue: CBA can generate more than one
outcome. Suppose the case of two choice options for a new rail
line, A and B. A is more expensive and has more benefits than B.
3. MCA as an alternative, or combining CBA and MCA A has a bigger absolute difference in benefits minus costs,
whereas B has a higher return on investment or benefits to cost
If transport policy options need to be evaluated that have ratio. What then to do? Choices like these are also influenced by
important (ethically or non-ethically relevant) effects, that are general concerns of government budgets and deficits, or oppor-
difficult to monetize (e.g. nature effects, esthetics, specific social tunity costs of other policies (projects and others) that could have
effects, distribution effects) MCA may be an alternative. MCA also been financed by the money that is not spend in case of choosing
meets problems with variables that are difficult to value. Weights B over A. To support such choices techniques exist for comparing
are used to solve the problem. An alternative could be a hybrid projects on the basis of an optimization of the use of a given
methodology combining CBA and MCA (Grant-Muller et al., 2001; budget (Pearce and Nash, 1981).
Beuthe, 2002; Macharis et al., 2010). Monetary values could be used Thirdly, a very fundamental conclusion is that it is not only the
for some (quantitative) variables that are relatively easy to monetize outcomes of the CBA that matter but also many process related
in a generally accepted way. For other variables weighting is needed issues. Process matters in itself regardless its impact on the
according to MCA practice and maybe even for combining both outcomes. And in addition the process could have an impact on
categories of variables. See for example Shiftan et al. (2002). Not the outcomes, e.g. because of the selection of policy options, or
surprisingly, MCA has especially been used to assess project impacts their specifications.
if environmental or social effects are important (Lahdelma et al., If a CBA is to be used at all, this paper has shown that several
2000), or if explicit attention needs to be paid to the perspectives of challenges exist for improvements from an ethical perspective.
distinguished stakeholders (Thomopoulos et al., 2009; Macharis The most important I think are next.
et al., 2010). Note that MCA is often criticized as well, mainly Firstly, it is advised to consider reporting distributive effects.
because of the subjectivity of weights to be used, possibilities for Who are the winners and – probably more important – the losers?
manipulations, and lack of robustness (Eijgenraam et al., 2000; Reporting this is relevant in itself. In addition, in case of discussions
Thomopoulos et al., 2009). Although manipulations in MCA might about distributive issues, one can apply distributive weights, either
occur more easily than in CBA also in CBA manipulations are based on income dependent decrease marginal utility, or on political
possible, e.g. by prescribing or selecting unit values (such as for preferences. The researcher can vary quantitative weights and check
the value of time or the Value of a Statistical Life), by providing the impact on the outcomes of the CBA.
manipulated cost estimates (Flyvbjerg et al., 2003), or by strategi- Secondly, several of the insights of ethical theories can be
cally selecting scenario assumptions or (transport) models. It is interpreted as a plea for the inclusion of specific accessibility
beyond the scope of this paper to further discuss MCA. indicators, e.g. for specific groups of population. An important
question then becomes: how to evaluate the score on such
criteria? and: should they then be expressed in monetary terms
4. Implications of ethically based critics for CBA and included in CBA? At least two answers could be given. One is
that accessibility can be expressed elegantly in monetary terms
What then to do with the ethically relevant critics on CBA? using the so called logsum of utility based discrete choice
First of all it is important to discuss if in a particular choice transport models—see, for example, De Jong et al. (2007). But
context a CBA is useful at all. I agree with Hausman and then, several of the critics underlying the plea for the inclusion of
6 B. van Wee / Transport Policy 19 (2012) 1–7

these indicators are ignored—see above. The other answer could (important) pros and cons is presented in both methods anyway).
be that the scores on the accessibility indicators should be In some cases this may be true. But in many other cases this is at
presented separately. I think the latter option is the best one. least risky, mainly because all pros and cons are probably not
This is not a plea against the utility based accessibility indicators. equally important, neither from the decision makers point of
These indicators are a very elegant way to express accessibility in view, nor for relevant actors in the field, and nor from a broad
monetary terms, in a way consistent with the valuation of other welfare perspective. Then some form of analysis becomes useful,
indicators as generally included in a CBA framework. I would two main methods being CBA and MCA. The choice between the
argue that these indicators are of great use as far as the valuation two methods should, I think, be based on the pros and cons of the
of accessibility from a utilitarian perspective is needed. However, options in a specific case. The main pro of an MCA is that it allows
their value is much less – if not absent – in case of specific for the actor preferences in weighting relevant outcomes of
evaluations based on the ethical theories as described above, interest. This also is its main weakness: setting the weights is
including the evaluation of social exclusion policy options. highly subjective and can easily (at least: more easily than in case
Thirdly, an explicit check on values that are at stake in case of of a CBA) lead to manipulations. The dominant pros and cons of
a specific ex-ante evaluation of transport policy options is CBA are opposite to those of an MCA: in gives less room for
recommended. Such a check could at least include ‘‘freedom’’. specific preferences, but because of its weighing on (mainly)
Fourth, it is advised to (at least consider to) add indicators for consumer preferences (expressed in monetary terms) is more
evaluation related to the utility, welfare or well being of the least neutral. I think that if choice options are more or less comparable,
advantaged, or other specific groups. the balance of pros and cons of MCA versus CBA support the use
Fifth, a check on insights from other theories than utilitarian- of CBA. But even then I recommend an explicit check on ethical
ism could be made, as explained above. aspects, as explained above. In case of less comparable choice
Sixth, and related to the lack of democratic level of a CBA, one options, or if important ethical aspects are at stake, a hybrid
could check what the outcomes of the evaluation of policy options methodology of CBA and MCA might be preferred, or an MCA.
could be in case of a democracy, according to the ‘one man one vote’ Another general recommendation is that if ethical issues could be
principle. This seems straightforward but it is not. Firstly data on of importance for the ex-ante evaluation of transport projects and
individual persons (how many, would they win or lose?) are often policies, it is recommended to at least add sensitivity analyses to a
not available. Secondly, it is overly simplistic to assume that people standard CBA addressing question like: how would policy options
would only vote based on their own direct interests. E.g. a person be evaluated using other (additional or alternative) assumptions
that does not benefit from policies herself – say, a bus service – on the indicator(s) to be considered other than utility, what
might value living in a society that provides the options for others. would be the impact of adding different assumptions on valuing
Thirdly, there is the problem of who to include. Let us assume a distribution effects, what if the value of CO2 would increase
project of regional importance. A democratic evaluation including all according to the discount rate, what if one would use an equity
inhabitants of a country would almost certainly lead to a negative based value of time, what if the value of a statistical life would be
decision, because a lot of tax payers loose a small amount of money, income independent?, etc.
whereas a small minority, i.e. the people who live in the region Would it be an option to not try to ex-ante evaluate the pros and
under consideration, or regular visitors, benefit. So, including only cons of alternative choice options at all? I think the answer is ‘no’.
the choice for the regional project would be cumbersome. It may be We need such an evaluation because of reasons of quality of
better to include in general the preference for regional projects: all decision making. Not having a systematic assessment of the
regions could benefit from a certain amount of money to be spent dominant pros and cons of a project has – at least in the Netherlands
on regional projects. But this is too general to be of use for specific – lead to decision making that caused a lot of frustration among
projects. The conclusion is that some check on the level of politicians, partly because of major inconsistencies in partial evalua-
democracy could be of interest but could be difficult to make. tions and highly debatable assumptions made in the related
research (De Jong and Van Wee, 2007; Annema et al., 2007).
A final remark: this paper is about CBA and transport but a lot
5. Discussion: how useful is CBA for the ex-ante evaluation of of discussions also could apply to the use of CBA for ex-ante
transport policy options? evaluations in other areas.

Considering the critics above the major question is: how useful
is CBA for the ex-ante evaluation of transport policy projects and Acknowledgment
policies? This paper could easily give the impression that from an
ethical perspective I think CBA is not or hardly of any use for such The author thanks two reviewers and Yoram Shiftan (board
purposes. But I think we should be careful being too skeptical. member of Transport Policy) for their useful suggestions.
If one takes the perspective (as I do) that for the quality of public
decision making it is important that decision makers are well-
informed, one can assume that the quality of decision making is References
higher if the decision makers make the choice they would have
made (1) if they would have all (from their perspective) poten- Annema, J.A., Koopmans, C., Van Wee, B., 2007. Evaluating transport infrastructure
tially relevant choice options available, (2) if they were fully investments: the Dutch experience with a standardized approach. Transport
Reviews 27 (2), 125–150.
informed and (3) if they were able to evaluate different choice Audi, R., 2007. Moral Value and Human Diversity. Oxford University Press, Oxford
options (weight the pros and cons of choice options). This could and New York.
be a valid rule of thumb under conditions of a high level of Bergstad, C.J., Gamble, A., Gärling, T., Hagman, O., Polk, M., Ettema, D., Friman, M.,
Olsson, L.E., 2011. Subjective well-being related to satisfaction with daily
democracy. Then the question becomes: which methodology for
travel. Transportation 38 (1), 1–15.
ex-ante evaluations of transport projects and policies is ‘best’? Beuthe, M., 2002. Transport evaluation methods: from cost-benefit analysis to
One could argue that it is important to evaluate the pros and cons multicriteria analysis and the decision framework. In: Giorgi, L. (Ed.), Project
of relevant choice options but that an analysis of these pros and and Policy Evaluation in Transport, 2002. Ashgate Publishing Ltd., Burlington,
UK, pp. 209–241.
cons is not needed. Then a simple score care could do the job. Bristow, A., Nellthorp, J., 2000. Transport project appraisal in the European Union.
(Note that a major advantage of CBA and MCA is that a list of Transport Policy 7 (1), 51–60.
B. van Wee / Transport Policy 19 (2012) 1–7 7

De Jong, G., Daly, A., Pieters, M., Van der Hoorn, T., 2007. The logsum as an Lahdelma, R., Salkminen, P., Hokkanen, J., 2000. Using multicriteria methods in
evaluation measure: review of the literature and new results. Transportation environmental planning and management. Environmental Management 26
Research Part A 41 (9), 874–889. (6), 595–605.
De Jong, W.M., Van Wee, G.P., 2007. A new guideline for ex-ante evaluation of Macharis, C., Van Hoeck, E., Perkin., E., Van Lier, T., 2010. A decision analysis
large infrastructure projects in the Netherlands. In: Haezendonck, E. (Ed.), framework for intermodal transport: comparing fuel price increases and the
Transport Project Evaluation. Edward Elgar, Cheltenham, UK. internalisation of external costs. Transportation Research part A 44 (7),
Easterlin, R.A., 1973. Does money buy happiness? Public Interest 30 (30), 3–10. 550–561.
Easterlin, R.A., 1974. Does economic growth improve the human lot?. In: David, Mackie, P.J., Wardman, M., Fowkes, A.S., Whelan, G.A., Nellthorp, J., Bates, J.J., 2003.
P.A., Melvin, W.E. (Eds.), Nations and Households in Economic Growth. Value of Travel Time Savings in the UK. Prepared for the Department for
Stanford University Press, Palo Alto, California, pp. 98–125. Transport. Institute for Transport Studies, University of Leeds, Leeds/John
Eijgenraam, C.J.J., Koopmans, C.C., Tang, P.J.G., Verster, A.C.P., 2000. Evaluation of Bastes Services.
Infrastructural Projects; Guide for cost-benefit analysis, Sections I and II, CPB, Martens, K., 2006. Basing transport planning on principles of social justice.
The Hague, NEI (Changed Name to ECORYS), Rotterdam. Berkeley Planning Journal 19 /www-dcrp.ced.berkeley.edu/bpjS.
Ettema, D., Gärling, T., Olsson, L.E., Friman, M., 2010. Out-of-home activities, daily McKay, R., 2000. Applying ethical principles to the decision to build the Red Hill
travel, and subjective well-being. Transportation Research Part A 44 (9), Creek Expressway. International Journal of Public Sector Management 13 (1),
723–732. 58–67.
Flyvbjerg, B., Bruzelius, N., Rothengatter, W., 2003. Megaprojects and Risk: Odgaard, T., Kelly, C., Laird, J., 2005. Current Practice in Project Appraisal in Europe,
HEATCO Research Project (Harmonised European Approaches for Transport
An Anatomy of Ambition. Cambridge University Press, Cambridge.
Costing and Project Assessment).
Gardiner, S.M., 2006. Protecting future generations: intergenerational buck-pas-
Pearce, D.W., Nash, C.A., 1981. The Social Appraisal of Projects–a Text in Cost
sing, theoretical eptitude and a brief for a global core precautionary principle.
Benefit Analysis. Macmillan, London.
In: Tremmel, J.C. (Ed.), Handbook of Intergenerational Justice. Edward Elgar,
Rawls, J., 1971. A Theory of Justice. Harvard University Press, Boston MA.
Chelterham, UK/Northhampton, USA.
Rawls, H., 1982. Social unity and primary goods. In: Sen, A., Williams, B. (Eds.),
Geurs, K.T., Van Wee, B., 2004. Accessibility evaluation of land-use and transport
Utilitarianism and Beyond. Cambridge University Press, Cambridge Massachusetts.
strategies: review and research directions. Transport Geography 12 (2004),
Rietveld, P., Rouwendal, J., Vlist, A.J. van der, 2007. Equity issues in the evaluation
127–140.
of transport policies and transport infrastructure projects. In: Geenhuizen, M.,
Geurs, K.T., Boon, W., van Wee, B., 2009. Social impacts of transport: literature
van, A., Reggiani, Rietveld, P. (Eds.), Policy Analysis of Transport Networks.
review and the state of the practice of transport appraisal in the Netherlands Ashgate, Aldershot, pp. 19–36.
and the United Kingdom. Transport Reviews 29 (1), 69–90. Sagoff, M., 1988. The Economy of the Earth. Cambridge University Press, New York.
Grant-Muller, S.M., MacKie, P., Nellthorp, J., Pearman, A., 2001. Economic appraisal Sen, A., 2009. The Idea of Justice. Allen Lane, London.
of European transport projects: the state-of-the-art revisited. Transport Shiftan, Y., 2008. The use of activity-based modeling to analyze the effect of land-
Reviews 21 (2), 237–261. use policies on travel behavior. Annals of the Regional Science 42, 79–97.
Hausman, D.M., McPherson, M.S., 2006. Economic Analysis, Moral Philosophy, and Shiftan, Y., Ben-Akiva, M., De Jong, G., Hakkert, S., Simmonds, D., 2002. Evaluation
Public Policy 2nd ed. Cambridge University Press, Cambridge. of externalities in transport projects. European Journal of Transport and
Hayashi, Y., Morisugi, H., 2000. International comparison of background concept Infrastructure Research 2 (3–4), 285–304.
and methodology of transportation project appraisal. Transport Policy 7, Spinney, J.E.L., Scott, D.M., Newbold, K.B., 2009. Transport mobility benefits and
73–88. quality of life: A time-use perspective of elderly Canadians. Transport Policy
Hicks, J., 1939. The foundations of welfare economics. Economic Journal 49, 16, 1–11.
696–712. Thomopoulos, N., Grant-Muller, S., Tight, M.R., 2009. Incorporating equity
Jamieson, D., 2003. Values in nature. In: Frey, R.G., Heath Wellman, G. (Eds.), considerations in transport infrastructure evaluation: current practice and a
A Companion to Applied Ethics. Blackwell Publishing Ltd., Malden MA, Oxford, proposed methodology. Evaluation and Program Planning 32 (4), 351–359.
Carlton, Victoria. Van Wee, B., 2011. Transport and Ethics. Ethics and the Evaluation of Transport
Kaldor, N., 1939. Welfare propositions in economics and interpersonal compar- Policies and Projects. Edward Elgar, Cheltenham, UK, Northamption, MA, USA.
isons of utility. Economic Journal 49, 549–552. Veenhoven, R., 1991. Is happiness relative? Social Indicators Research 24 (1), 1–34.

You might also like