Professional Documents
Culture Documents
Opre 1080 0611
Opre 1080 0611
Operations Research
Publication details, including instructions for authors and subscription information:
http://pubsonline.informs.org
This article may be used only for the purposes of research, teaching, and/or private study. Commercial use
or systematic downloading (by robots or other automatic processes) is prohibited without explicit Publisher
approval, unless otherwise noted. For more information, contact permissions@informs.org.
The Publisher does not warrant or guarantee the article’s accuracy, completeness, merchantability, fitness
for a particular purpose, or non-infringement. Descriptions of, or references to, products or publications, or
inclusion of an advertisement in this article, neither constitutes nor implies a guarantee, endorsement, or
support of claims made of that product, publication, or service.
With 12,500 members from nearly 90 countries, INFORMS is the largest international association of operations research (O.R.)
and analytics professionals and students. INFORMS provides unique networking and learning opportunities for individual
professionals, and organizations of all types and sizes, to better understand and use O.R. and analytics tools and methods to
transform strategic visions and achieve better outcomes.
For more information on INFORMS, its publications, membership, or meetings visit http://www.informs.org
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
Canan Ulu
McCombs School of Business, University of Texas at Austin, Austin, Texas 78712,
canan.ulu@mccombs.utexas.edu
James E. Smith
Fuqua School of Business, Duke University, Durham, North Carolina 27708, jes9@duke.edu
Consumers or firms contemplating purchasing a new product or adopting a new technology are often plagued by uncertainty:
Will the benefits outweigh the costs? Should we buy now or wait and gather more information? In this paper, we study
a dynamic programming model of this technology adoption problem. In each period, the consumer decides whether to
adopt the technology, reject it, or wait and gather additional information by observing a signal about the technology’s
benefit. The technology’s actual benefit may be constant or changing stochastically over time. The dynamic programming
state variable is a probability distribution that describes the consumer’s beliefs about the benefits of the technology. We
allow general probability distributions on benefits and general signal processes and assume that the consumer updates her
beliefs over time using Bayes’ rule. We are interested in structural properties of this model. We show that improving the
technology’s benefit need not make the consumer better off and that first-order stochastic dominance improvements in the
consumer’s distribution on benefits need not increase the consumer’s value function. Nevertheless, the model possesses
a great deal of structure. For example, we obtain monotonic value functions and policies if we order distributions using
likelihood-ratio dominance rather than first-order stochastic dominance. We also examine convexity properties and provide
many comparative statics results.
Subject classifications: dynamic programming; decision analysis: sequential.
Area of review: Decision Analysis.
History: Received January 2007; revision received August 2007; accepted December 2007. Published online in Articles
in Advance March 11, 2009.
Figure 1. Policy regions in McCardle’s (1985) model. some examples. In §3, we study monotonicity properties of
this model and show that if the signal-generating process
satisfies a monotone likelihood ratio assumption and we
use likelihood-ratio (LR) dominance to order distributions,
Adopt we get natural monotonicity results: A LR improvement in
the consumer’s distribution on benefits leads to an increase
Expected benefit
as their certainty equivalent is positive without considering for example, a numeric score or categorical rating (e.g.,
the possibility of gathering additional information to reduce four out of five stars). Having observed signal x, the con-
the uncertainty about the benefit. More recently, Kornish sumer then updates her prior using Bayes’ rule and finds
and Keeney (2008) study the problem of “adopting” a flu a posterior x given by
vaccine when there is uncertainty about the strain of the
virus and thus uncertainty about the effectiveness of the Lx
x =
vaccine. f x
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
Bernoulli process with a probability p∗ of a positive sig- Figure 2. FOSD and LR improvements on a uniform
nal and 1 − p∗ of a negative signal. After observing a 0 1 distribution.
positive signal, the consumer’s posterior distribution for p∗
(a) FOSD improvement (b) LR improvement
becomes Beta( + 1, ) with mean + 1/ + + 1.
After observing a negative signal, the posterior becomes
Beta(, + 1) with mean / + + 1. With either sig-
nal, the posterior precision is equal to + + 1. Thus, in
this model, if we know the prior and and the num-
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
0 1 0 1
ber of periods that have passed, we can fully determine π1 π2
the then-current distribution from its mean p̄; this allows
the model to be formulated as a univariate dynamic pro-
gram taking p̄ as a state variable.1 The beta-binomial model For our purposes, there are three key properties of the LR
generalizes the beta-Bernoulli model to consider n (rather order. The first key property is that LR dominance implies
than one) independent positive or negative reports in each FOSD dominance. Recall the definition of the FOSD order:
period. After seeing s successes in n trials, the posterior 2 FOSD 1 if and only if for all increasing functions
distribution becomes Beta( + s, + n − s). If the num- ", "2 d "1 d. Whitt (1979)
ber of reports at each stage is fixed, the mean of the beta showed that LR dominance implies FOSD dominance and,
distribution can serve as a univariate state variable. even stronger, that LR dominance is equivalent to requiring
McCardle (1985) also describes a normal-normal model, FOSD dominance for all conditional distributions of the
which is the focus of Lippman and McCardle (1987) and form ∈ A where A ⊆ ; that is, 2 LR 1 holds
Chatterjee and Eliashberg (1990). In this model, the prior if and only if 2 ∈ A FOSD 1 ∈ A for all A
on is assumed to be normally distributed with mean m with positive probability under both 1 and 2 .
and precision s (or variance 1/s), and the signals are drawn Although LR dominance implies FOSD dominance, the
from a normal distribution with mean and precision t. converse is not true. Figures 2(a) and 2(b) show two FOSD
The posterior distribution after seeing signal x is then given improvements of a uniform distribution 1 on 0 1. In Fig-
by a normal distribution with mean sm + tx/s + t, and ure 2(a), we form 2 by shifting mass from one interval to
the precision s + t is independent of the signal, as in the another higher interval. In this case, 2 /1 is non-
beta-binomial model. This allows the model to be formu- monotonic and 2 does not LR dominate 1 . In Figure 2(b),
lated as a univariate dynamic program with the then-current we form 2 by shifting mass from a left-tail interval to a
mean as a state variable. right-tail interval. In this case, 2 /1 is monotoni-
cally increasing and 2 LR 1 . Thus, LR improvements,
3. Monotonicity Properties like FOSD improvements, can be constructed by transfer-
In this section, we study the impact of changes in the con- ring mass from lower to higher values of . However, LR
sumer’s prior distribution on the value function and opti- improvements require the transfer of mass from a left-tail
mal policies. Our first task is to identify a stochastic order interval to a right-tail interval to ensure that 2 /1 is
that captures the notion of a “more optimistic” prior that increasing.
allows us to obtain natural monotonicity results. As dis- The second key property of the LR order is that it sur-
cussed in the introduction, an FOSD improvement in the vives Bayesian updating: If two priors are LR ordered, the
prior is not sufficient to ensure an increase in the value corresponding posterior distributions are also LR ordered.
function. We must instead use the LR order and assume that This result is stated formally in the next proposition.
the likelihood functions for signals satisfy the monotone-
likelihood-ratio (MLR) property. Our interest in the LR Proposition 3.2. Given any signal x, the posteriors are
order and the MLR property was motivated by their use LR ordered if and only if the priors are LR ordered# 2 LR
in economics in the study of agency models and auctions; 1 ⇔ 2 x LR 1 x for all x ∈ X.
see, e.g., Milgrom (1981). We begin by introducing the LR Proof. From Definition 3.1, 2 x 1 x
LR
order and MLR assumption. We then show that, with the requires that for all 2 1 ,
MLR assumption, the value function and policies satisfy
natural monotonicity properties in terms of the LR order. 2 2 x 1 2 x
2 1 x 1 1 x
3.1. The Likelihood-Ratio Order
We will first introduce the LR order and then discuss the Writing out the posteriors using Bayes’ rule and can-
properties of this order that we will use in our analysis. celing common terms, we see that this is equivalent to
2 LR 1 .
Definition 3.1. 2 LR dominates 1 (2 LR 1 ) if for
all 2 1 , This survival property is important for the recursive
2 2 2 1 dynamic programming structure because we will need LR
dominance at one stage to imply LR dominance in the next
1 2 1 1
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
stage. FOSD dominance is not preserved in this way: It u is LR decreasing if −u is LR increasing. A key step
is not difficult to construct examples where the priors are in proving that the value function is LR increasing is to
FOSD ordered and the posteriors are not ordered for some show that Bayesian updating preserves the LR-increasing
signals. property; we show this in a lemma and then state the mono-
The final important property of the LR order is that, tonicity result.
when we have totally ordered signals (e.g., four-star ratings Lemma 3.5. Suppose that the signal process satisfies the
are more favorable than three-star ratings) and “monotonic” MLR property and 2 LR 1 ; let x̃2 and x̃1 denote the
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
likelihood functions, we get natural monotonic relation- random signals corresponding to 2 and 1 . Then, for any
ships among priors, signals, and posteriors. We formalize LR-increasing function u,
this monotonicity assumption as follows.
Eu 2 x̃2 Eu 1 x̃1
Definition 3.3. The signal process has the MLR property
if the signal space X is totally ordered and Lx 2 LR Proof. First, recall that Proposition 3.4 implies that the
Lx 1 for all 2 1 . In other words, signal distributions f 2 and f 1 satisfy f 2 LR
f 1 . Then,
Lx2 2 Lx1 2
for all x2 x1 and 2 1
Lx2 1 Lx1 1 Eu 2 x̃2 = u 2 xf x 2 dx
x
The requirement that the signals be totally ordered is nat-
u 1 xf x 2 dx
ural but does rule out some cases that are potentially of x
interest. For example, if we had a beta-binomial model with
uncertainty about the number of reports observed, we may u 1 xf x 1 dx
x
not be able to order all signals: Observing four out of five = Eu 1 x̃1
reports to be positive is not necessarily more favorable than
observing seven out of ten reports to be positive. Although The first inequality follows because u is LR increasing
the monotonicity results of §§3.2 and 8 require this MLR and, for each signal x, 2 LR 1 implies 2 x LR
assumption, most of the other results in the paper do not. 1 x by Proposition 3.2. The second inequality follows
If the signal process satisfies the MLR property, then LR because the LR order on the signal distributions implies
improvements in the prior lead to LR improvements in the FOSD dominance and u 1 x is an increasing func-
signal distribution and more favorable signals lead to LR tion of x; the fact that u 1 x is an increasing func-
improvements in the posterior. tion of x follows from Proposition 3.4(ii) because u is LR
increasing.
Proposition 3.4. If the signal process satisfies the MLR
property, then Proposition 3.6. If the signal process satisfies the MLR
(i) 2 LR 1 ⇒ f 2 LR f 1 , property, then, for all k, the value function vk∗ is LR
(ii) for any prior , x2 x1 ⇔ x2 LR x1 . increasing. In other words, 2 LR 1 implies vk∗ 2
vk∗ 1 .
Proof. These results are well known (see, e.g., Karlin 1968
and Whitt 1979, Theorem 4), but simple direct proofs are Proof. We show this by induction. The terminal value
provided in Online Appendix A.1. function, v0∗ = 0, is trivially LR increasing. Now sup-
∗
pose that vk−1 is LR increasing. By the previous lemma,
The LR ordering is quite natural in both the beta- the value if the consumer waits, −c + Evk−1 ∗
x̃,
binomial and normal-normal examples introduced in §2.2. is LR increasing. The rewards if the consumer adopts
In both models, an improvement in the expected benefit ( d − K) or rejects (0) are also LR increasing.
of the technology (p̄ or m) in any period leads to an LR Then vk∗ , as the maximum of three LR increasing func-
improvement in the underlying distribution and both signal tions, is also LR increasing.
processes satisfy the MLR assumption.
We next consider how the optimal policy responds to
changes in the consumer’s distribution of benefits. First,
3.2. Monotonicity of the Value Function
recall that, in the univariate setting, McCardle (1985)
and Policies
showed that the policy in each period can be character-
We now show that if the signal process satisfies the MLR ized by adoption and rejection thresholds. Intuitively, if LR
property, the optimal value function and optimal policies dominance correctly captures the notion of a “more opti-
are both monotonic in that LR improvements in the prior mistic” distribution of benefits, we might expect optimal
distribution lead to higher values and move policies away policies to have analogous structures in the more general
from rejection and toward adoption. setting. We will show that this is indeed the case. We
To formalize the effect of changes in the prior on the state and prove this threshold result after first establishing
value function, we say a function u defined on distributions a lemma that places a bound on the rate of increase of the
on is LR increasing if 2 LR 1 implies u2 u1 ; value function.
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
Lemma 3.7. Suppose that the signal process satisfies the the MLR property, by Proposition 3.4(ii), more favorable
MLR property. Then, vk∗ − d is LR decreas- signals lead to LR-improved posteriors. Combining this
ing. result with Proposition 3.8, this implies that in each period
there exist threshold signals xka and xkr (with xka xkr ) such
Proof. Note that with Bayesian updating the expected
that it is optimal to adopt in the next period if the observed
posterior
mean is equal to the prior mean d =
signal is greater than xka , optimal to reject if the observed
E x̃ d. Using this, we can write gk =
vk∗ − d as a dynamic programming recursion; signal is less than xkr , and optimal to gather additional infor-
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
g0 = − d, and, for k > 0, mation if the signal lies between these two thresholds. Note
that these signal thresholds, like the posterior distributions,
are “path dependent” in that they will depend on the orig-
gk = max − d −K inal prior distribution and the entire history of signals
observed. Because increasing any early signal leads to an
− c − 1 − d + Egk−1 x̃ LR improvement in the posterior distribution, an increase in
any observed signal will lead all subsequent signal thresh-
We can then show that gk is LR decreasing using olds to decrease (weakly).
the same recursive argument as in the proof of Propo- Given the monotonic relationship between signals and
sition 3.6 above: The terminal value function, g0 , is posterior means (this follows from Proposition 3.4(ii)), we
LR decreasing. Now suppose that gk−1 is LR decreas- can also describe these adoption and rejection thresholds in
ing. Lemma 3.5 implies that the continuation value, terms of posterior means: At each stage, there exist thresh-
Egk−1 x̃, is LR decreasing. Thus, the functions olds ka and kr (ka kr ) such that it is optimal to adopt
associated with each choice in gk are all LR decreas- in the next period if the posterior mean is greater than ka ,
ing. Then, gk , as the maximum of three LR decreasing optimal to reject if the posterior mean is less than kr , and
functions, is LR decreasing. optimal to gather additional information if the posterior
mean lies between these two thresholds. These thresholds
Because d − K is the expected value of adopt-
must also bracket the cost of adoption K (ak K kr )
ing the technology, we can interpret this lemma as saying
because rejection would be preferred to adoption if the pos-
that, if we improve the underlying distribution, the value of
terior mean were less than K; similarly, adoption would
adopting increases at least as much as the value of waiting
be preferred to rejection if the posterior mean were greater
or rejecting. This result is critical to establishing mono-
than K. Thus, the policy regions are analogous to those
tonicity of the optimal policies.
in McCardle’s univariate model, as illustrated in Figure 1.
Proposition 3.8. Suppose that the signal process satisfies However, here, unlike the univariate model, the posterior-
the MLR property and 2 LR 1 # mean thresholds may depend on the original prior distribu-
(i) If it is optimal to adopt with prior 1 , then it is also tion and the entire history of signals observed.
optimal to adopt with 2 . An LR improvement in the consumer’s prior distribu-
(ii) Similarly, if it is optimal to reject with 2 , then it is tion on benefits not only makes the consumer better off
also optimal to reject with 1 . (according to her own expectations), it also makes the pro-
Proof. Assume that 2 LR 1 . (i) Let gk = vk∗ − ducer better off: Even if we hold the set of observed sig-
nals constant, by Proposition 3.2(i), an LR improvement
d −K be the difference between the value func-
tion and the value given by immediate adoption; this differs in the prior leads to an LR improvement in the posteri-
by a constant from the function studied in the previous ors and thus moves the consumer closer to the adoption
lemma. If it is optimal to adopt the technology given dis- region. Thus, actions that lead to consumers having an LR-
tribution 1 , then gk 1 = 0. The previous lemma implies improved prior will increase the probability of adoption and
that g is LR decreasing. Thus, gk 2 0, which implies lead to earlier adoptions. More favorable signals are also
that it is optimal to adopt given 2 . good for both consumer and producer because they lead to
(ii) If it is optimal to reject the technology given distri- increased values and earlier adoption.
bution 2 , then vk∗ 2 = 0. vk∗ is LR increasing (by Propo-
sition 3.6), and thus vk∗ 1 0. Therefore, it is optimal to 4. Convergence and Decisiveness
reject given 1 . The finite-horizon version of the model assumes that the
Thus we have established the monotonic structure of the consumer has a limited number of periods to make the deci-
optimal policy and a general version of the two-threshold sion to adopt or reject the technology. Increasing the num-
result: Along any chain of LR-improving distributions, the ber of periods remaining allows the consumer to gather
optimal action moves from rejection toward adoption, per- additional information, if desired, and thus makes wait-
haps passing through the information-gathering region. ing weakly more attractive and the consumer weakly better
One natural way to construct a chain of LR-improving off. Formally, it is easy to show that vk∗ is nondecreas-
distributions is by considering the observed signals: Given ing in k and, if it is optimal to wait given prior and
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
k periods remaining, it is also optimal to wait with prior varies with the true benefit of the technology. This char-
and k + 1 periods remaining. acterization will give us some insight into why FOSD
However, there is a limit to the benefits of gathering more improvements and increases in uncertainty in the distribu-
information: As the number of signals observed increases, tion on benefits do not necessarily lead to increases in the
the consumer’s estimate of the benefit of the technology will value function.
almost certainly converge and additional information will An adoption/rejection policy for a consumer can be
have diminishing value.2 If information or delay is costly defined by identifying the sets of signals that lead to adop-
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
(i.e., c > 0 or < 1), the cost of gathering information will tion, rejection, or continuation in each period; these sets
eventually outweigh its benefit and it will be optimal to stop will generally depend on earlier signals. For any such policy
gathering information. Of course, if information is free and P (not necessarily an optimal policy), let vk P denote
delay costless (c = 0 and = 1), the consumer might as well the value given by following this policy. Clearly, vk∗ =
gather information forever; however, even in this scenario, vk P if P is an optimal policy for prior . As discussed
additional information has diminishing value and the finite- in §3.2, if the signal process satisfies the MLR property,
horizon value functions will converge to an infinite-horizon the optimal signal policies are monotonic in that they can
limit. We summarize these convergence results as follows. be characterized in terms of adoption and rejection signal
Proposition 4.1. (i) If information gathering is costly thresholds that are decreasing (weakly) in all observed sig-
c > 0, then the consumer will almost certainly stop gath- nals. The following proposition shows that vk P can
ering information at some point. be represented as the expected value of a derived benefit
(ii) If delay is costly < 1, information is free c = 0, function bk that describes the net benefit realized by the
and it is truly optimal to adopt i.e., the limiting expected consumer for a technology with true benefit .
value E is greater than the adoption cost K, then the Proposition 5.1. For any k and policy P , there exists a
consumer will almost certainly adopt the technology. derived benefit function bk such that
(iii) If the cost of information gathering is nonnegative
c 0, then the finite-horizon value functions converge for
all # limk→ vk∗ = v∗ . vk P = bk d
Figure 3. An example derived benefit function bk . distribution, the policy that was optimal for the original dis-
tribution may no longer be optimal. However, in this case
0.20 and others, we can generate numerical examples that con-
sider optimal policies and are such that 2 FOSD 1 and yet
0.15 vk∗ 2 < vk∗ 1 . In contrast, as discussed in §3.1, an LR
(θ –K)pk(θ) improvement in the prior shifts mass from a left-tail region
bk(θ) to a right-tail region. In this case, we can be sure that we
are transferring mass from “bad” to “good” values of and
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
0.10
understanding the role of uncertainty in the model and will Proof. We will prove that the adoption region is convex;
be important for characterizing the effects of “better infor- the proof for the rejection region is similar. If it is optimal
mation” in the next section. We do not need to assume the to adopt with both 1 and 2 , then the value of adopting
MLR property to prove these results. We establish convex- at is
ity of the value function using the same proof strategy that
we used to establish monotonicity in Proposition 3.6; we vk adopt = d − K
first show that Bayesian updating preserves convexity in
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
Proof. See Online Appendix A.4. Thus, if it is optimal to adopt (or reject) at both 1
and 2 , uncertainty about which distribution prevails does
Proposition 6.2. For all k, the value function vk∗ not affect the optimal strategy. However, the waiting region
is convex in # For any distributions 1 and 2 and need not be convex: Although it may be cost effective
0 1, we have to gather additional information at both 1 and 2 , with
uncertainty about which distribution prevails, it may be too
vk∗ vk∗ 1 + 1 − vk∗ 2 expensive to resolve this additional uncertainty, and the
consumer may be better off adopting or rejecting based on
where = 1 + 1 − 2 . the current information.
Proof. We show this by induction. The terminal value
function, v0∗ = 0, is trivially convex. Now suppose that 7. Comparative Statics
∗
vk−1 is convex. By the previous lemma, the value if We now consider the effects of changing various parame-
∗
the consumer waits, −c + Evk−1 x̃, is convex. ters in the model. What happens if we reduce the cost of
The rewards if the consumer adopts ( d − K) or gathering information? Or make the information “better”?
rejects (0) are also convex. Then, vk∗ , as the maximum Or reduce the cost of adoption? Or use a different discount
of three convex functions, is also convex. rate? We examine how these changes affect the consumer’s
Convexity of the value function can be interpreted as an value function, the policy regions, and the timing of adop-
aversion toward uncertainty about the prior . For exam- tion/rejection decisions.
ple, in the iPhone example, the consumer may be uncertain
about the kind of battery used in the device, and this may 7.1. Cheaper Information
affect her beliefs about the iPhone’s benefit. Specifically, she We first consider the impact of reducing the cost of infor-
may have probabilities versus (1 − ) chance of having mation gathering.
prior 1 with battery 1 or 2 with battery 2. A convex value
Proposition 7.1. Decreasing the cost of information
function means that the consumer would prefer to resolve
gathering c increases the value function, expands the
this uncertainty before beginning the information-gathering
information-gathering region, and delays the adoption or
process (for an expected value of vk∗ 1 + 1 − vk∗ 2 )
rejection decision.
rather than begin the information-gathering process with
this uncertainty unresolved (for an expected value of Proof. See Online Appendix A.5.
vk∗ ). Uncertainty about the prior is costly because of its
Thus, cheaper information is good for the consumer and
impact on decision making: If the consumer knew whether
leads her to gather more information before she adopts. For
1 or 2 prevailed, she could make better adoption, rejec-
example, in the “old days” before the Internet, we might
tion, and/or information-gathering decisions.
have been willing to make a spontaneous decision to pur-
We next show that the adoption and rejection regions are
chase a new gadget upon first seeing it at a store. Now, how-
convex.
ever, we are very unlikely to buy a gadget that costs more
Proposition 6.3. If it is optimal to adopt reject with both than (say) $100 without first researching it on the Internet.
1 and 2 , then it is also optimal to adopt reject with Although cheaper information delays the adoption or
any = 1 + 1 − 2 , where 0 1. rejection decision, the effect on the probability of adoption
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
or rejection is unclear. With expensive information, it may with prior and signal process Y , then it is also optimal to
be optimal to either adopt or reject. With cheaper but still wait with prior and signal process X whenever X B Y .
costly information, the consumer would invest in informa-
Proof. See Online Appendix A.6.
tion gathering only if it has the possibility of changing
her decision. Thus, if the optimal decision with expensive Thus, better information is clearly good for the con-
information is to reject immediately, cheaper information sumer.3 The effects on the producer are ambiguous. With a
can only increase the probability of adoption. Conversely, fixed prior, better information makes waiting more attrac-
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
if the optimal decision with expensive information is to tive. However, the expected time until adoption or rejection
adopt immediately, reducing the cost of information can and the probability of eventual adoption may increase or
only decrease the probability of adoption. decrease. A consumer who would have otherwise immedi-
ately adopted or rejected may be induced by better infor-
7.2. Better Information mation to delay and gather more information. On the other
What is the effect of better information? Here we define hand, a consumer who acquires better information may form
better information in the sense of Blackwell’s “sufficiency” precise beliefs more quickly and ultimately decide sooner.
condition (Blackwell 1951). Consider two different signal
processes, one producing signal x ∈ X with likelihood func- 7.3. Reduced Adoption Cost
tion Lx x and the other producing signal y ∈ Y with We next consider the effects of reducing the cost of
likelihood function Ly y . These two processes may, adoption.
general, be dependent, and we can write Ly y =
in
L y x Lx x dx where the conditional distribu-
x yx
Proposition 7.4. Decreasing the cost of adoption K in-
tion Lyx y x captures the dependence between sig- creases the value function, expands the adoption region,
nals X and Y . Blackwell’s notion of a signal process X and shrinks the rejection region; the probability of eventual
being more informative than (or, in his terms, sufficient for) adoption increases, and the expected time until adoption
a signal process Y can be defined as follows. decreases.
Definition 7.2. Signal process X is more informative than Proof. See Online Appendix A.7.
signal process Y , or X B Y , if there exists a stochastic
transformation By x such that Ly y = x By x · Clearly, reducing the adoption cost K is good for the
Lx x dx. consumer. The impact on the producer depends on the inter-
pretation of these costs. If we interpret the adoption cost as
Here the stochastic transformation By x must satisfy the price paid by the consumer to the producer to acquire
the usual conditions of a conditional probability distribution the technology, then we cannot say whether the benefits
(for each x, By x defines a probability distribution on Y ). associated with reducing these costs (e.g., by offering a
With such a transformation, we can define a signal Y ∗ with rebate) outweigh the direct reduction in revenue. However,
conditional distribution Ly∗ x y ∗ x = By x that has if we interpret K as a setup cost paid by the consumer
the same likelihood function as y (L∗y y ∗ = Ly y ) but not paid to the producer (e.g., a cost associated with
but is conditionally independent of given x. Such a signal installing the technology), then a reduction in K is unequiv-
Y ∗ is sometimes referred to as a “garbling” of X because it ocally good for the producer because it accelerates adop-
is as if Y ∗ were generated from X using a stochastic mech- tions and increases the probability of eventual adoption.
anism that is independent of . In the beta-binomial model,
a signal X consisting of five positive or negative reports 7.4. Reduced Discounting
is more informative than a signal Y with three reports; we
could view Y ’s three reports as a random selection of X’s Finally, we consider the effect of increasing the consumer’s
five reports. In the normal-normal model, a signal X drawn discount factor.
from a normal distribution with mean and precision t2 is Proposition 7.5. Increasing the consumer’s discount fac-
more informative than a signal Y drawn from a normal dis- tor increases the value function, expands the informa-
tribution with mean and precision t1 , whenever t2 t1 ; tion-gathering region, and delays the adoption or rejection
we could view the less precise signal as equal to the more decision.
precise signal plus additional noise.
We summarize the effects of having better information Proof. The proof is analogous to the proof of Proposi-
in the following proposition. The convexity of the value tion 7.1 in Online Appendix A.5.
function established in Proposition 6.2 plays a central role
Thus, a consumer with a higher discount factor is better
in this proof.
off and more likely to gather information because the delay
Proposition 7.3. Increasing the informativeness of the induced by information gathering is less costly. As with
signal process increases the value function and expands the a decrease in the cost of information, the effect on the
information-gathering region; that is, if it is optimal to wait adoption probability is unclear.
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
8. Evolving Technologies (2 LR 1 ) implies that the next-period priors, signal dis-
In the previous sections, we assumed that the benefit of the tributions, and posteriors are also LR ordered (02 LR
technology, , does not change over time. A more general 01 , f 2 LR f 1 , and 2 x LR 1 x for
model would allow the technology to evolve over time. each x). Lemma 3.5 and Proposition 3.6 then go through as
For example, the producer may come out with new ver- before, and we can conclude that the value function vk∗
sions of the technology. We can also think of the change in is LR increasing. Thus, if the technology transitions and
benefit being driven by the consumer’s need for the tech- the signal process both satisfy the MLR property, LR dom-
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
nology changing in some predictable or unpredictable way. inance remains an appropriate ordering on priors when the
technology is evolving.
For example, a consumer’s desire for an iPhone may be
Although monotonicity of the value function generalizes
related to her travel plans, which may change because of
with only this MLR assumption, we need an additional
a change in job status. Note that the changes need not be
assumption to ensure monotonicity of the optimal policies.
improvements. For example, the benefit of a new coal-fired
We can illustrate the issue by considering a special case of
power plant may decrease with changes in environmental
the general model where the signal perfectly reveals the true
regulations. A sophisticated consumer needs to consider the
benefit and there are two periods remaining. Taking the dis-
potential changes in benefits when making adoption and
count factor = 1 and ignoring the possibility of quitting,
information-gathering decisions.
the choice between adopting and waiting requires a com-
Because we formulated the stationary model to allow
parison between k − K and Ek−1 k − c; equivalently,
general probability distributions and signal processes, it is
the consumer should adopt if c − K Ek−1 − k k and
not difficult to generalize the model to accommodate
wait otherwise. If Ek−1 − k k is decreasing in k
stochastic changes in the technology’s benefits. Let k ∈
and adoption is preferred for one k , then adoption must
denote the benefit of the technology in period k. As before,
also be preferred for all higher values of k . However, if
if the consumer decides to reject the technology, she
Ek−1 − k k is not decreasing in k , then we may find
receives nothing. If she decides to adopt the technology, she
that adoption is preferred for one k but waiting is preferred
pays a fixed adoption cost K and receives a net expected for a higher k . The condition required to establish mono-
benefit of k k k dk − K, where k is her prior
tonicity in this special case is sufficient for the general case.
on k . If the consumer chooses to wait, she pays c, and the
benefit of the technology changes stochastically according Proposition 8.1. Suppose that the signal process and
to the conditional probability distribution gk−1 k . She technology transitions both satisfy the MLR property. If
then observes a signal xk−1 about the new technology with Ek−1 − k k is nonincreasing in k for each k, then
benefit k−1 , with the signal xk−1 drawn from likelihood (i) vk∗ − k k k dk is LR decreasing.
function Lxk−1 k−1 . Note that, in this model, waiting (ii) The optimal policy satisfies the monotonicity prop-
not only allows the consumer to gather additional informa- erties of Proposition 3.8.
tion, but it also allows the possibility of adopting a better Proof. The proof of (i) is analogous to the proof of
technology in the future. Lemma 3.7, taking into account the technology transitions;
The dynamic programming formulation is the same see Online Appendix A.8 for the proof. Given (i), the proof
as the stationary model except the posterior distributions of the monotonicity of policies in (ii) follows exactly as in
and signal distributions now include the evolution of the the proof of Proposition 3.8.
technology. Let 0k−1 be the prior on next period’s
technology benefit: 0k−1 = k gk−1 k k dk . With the exception of the convergence results of §4,
The signal and the other results and intuitions with stationary technologies
posterior distributions are then given by
f xk−1 = k−1 Lxk−1 k−1 0k−1 dk−1 and continue to hold with evolving technologies without any
additional assumptions. Specifically, the existence of the
Lxk−1 k−1 0k−1 derived benefit function of Proposition 5.1 (now a function
k−1 xk−1 = of the period-k benefit k ) does not require any additional
f xk−1
assumptions on the technology transitions except for the
Most of the properties of the earlier model carry over to this last part of this result, which shows that, if the policy is
more general setting. To establish monotonicity properties monotonic, the probability of adoption is increasing in k ;
analogous to those of §3, we need to assume that the tech- this monotonicity result requires the technology transitions
nology transitions, as well as the signal process, satisfy the and signal processes to both satisfy the MLR property. The
MLR property: gk−1 k2 LR gk−1 k1 for all k2 k1 results on the convexity of the value function and policies
and for all k. This assumption means that a truly better in §6 and the comparative statics results of §7 carry over
technology in one period leads to an LR improvement in directly without any additional assumptions on the transi-
the distribution on technology benefits for the next period. tions. The convergence results of §4 would clearly require
If the technology transitions and the signal process both some additional assumptions to hold: If the technology ben-
satisfy the MLR property, we can use the results of §3.1 to efit k is changing over time, there is no reason to expect
show that LR dominance among the priors for one period the estimate of the benefit to converge.
Published in Operations Research on March 11, 2009 as DOI: 10.1287/opre.1080.0611.
This article has not been copyedited or formatted. The final version may differ from this version.
If technologies are potentially changing over time, this Table 1. Summary of key results.
raises another interesting comparative statics question:
Impact on Short-term
When is one technology transition gk−1 k preferred to value function encourages
another? Or what constitutes an improvement in the future
prospects for a technology? Given that we need an LR Better technology +/− Adoption
improvement in the prior to ensure an increase in the value More optimistic prior + Adoption
More favorable signal x + Adoption
function, we want a condition on the transitions that ensures
More uncertainty about +/− —
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.
of §§4–7 carry over directly to this multivariate setting, but what not to expect—in more complex models of technol-
the monotonicity results in §§3 and 8 require the aggregate ogy adoption and the diffusion of innovations.
benefit function to be increasing in each product attribute
and use multivariate extensions of the LR order and the 10. Electronic Companion
MLR property. This extension is discussed in Ulu (2007). An electronic companion to this paper is available as part
A second possible extension would be to give the con- of the online version that can be found at http://or.journal.
sumer a range of different possible information-gathering informs.org/.
Downloaded from informs.org by [129.241.231.184] on 23 July 2022, at 08:50 . For personal use only, all rights reserved.