Professional Documents
Culture Documents
Shishko Et Al - Real Option Valuation
Shishko Et Al - Real Option Valuation
Shishko Et Al - Real Option Valuation
NASA Technology
Assessment Using Real
Options Valuation
Robert Shishko,* Donald H. Ebbeler, and George Fox
Jet Propulsion Laboratory, California Institute of Technology, 4800 Oak Grove Drive, Pasadena, CA 91109
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION
Received February 7, 2003; Accepted July 7, 200, after one or more revisions
DOI 10.1002/sys.10052
ABSTRACT
We examine the use of real options valuation in the context of prioritizing advanced technolo-
gies for NASA funding. Further, we offer a set of computational procedures that quantifies the
option value of each technology. Other researchers have applied a real options framework to
private sector investments. In the case of NASA investments in advanced technologies, the
underlying products, which must be used to justify the investments, are space-related
scientific results and discoveries from completed missions to be shared worldwide. As in the
private sector, uncertainty plays a significant role in the motivation to use real options in NASA.
Uncertainty in NASA technology investments can be classified as development risk and
programmatic risk (whether missions using the technology will actually fly). The latter might
be called the technology’s “market risk.” We carried out the approach on a number of planetary
exploration technologies. We illustrate the detailed calculations using one of them—light-
weight propellant tank technology. © 2003 Wiley Periodicals, Inc. Syst Eng 7: 1–12, 2004
Key words: real options; NASA technology investment; Weiner process; R&D project selection
1. INTRODUCTION
1
2 SHISHKO, EBBELER, AND FOX
ceive scarce NASA funding. Further, we offer a set of NASA investment in advanced technologies, the ulti-
computational procedures that quantifies the option mate products, which must be used to justify the invest-
value of each technology. ments, are space-related scientific results and
Option pricing has already been applied to a variety discoveries from completed missions to be shared
of investment decisions by firms. When option pricing worldwide. A formal options pricing approach for
applications do not involve financial instruments, the NASA technology investments must consider the pub-
term “real options” is used. Early applications of real lic goods aspects of the ultimate products and the prob-
options valuation were for natural resource invest- lem of valuing their benefits to society.1 It must also
ments, where the underlying asset is traded in both spot treat the underlying uncertainties on both the invest-
and futures markets. Later, real options calculation ment (cost) and payoff (benefit) sides.
methods were developed for real estate and electric The calculation of a technology’s real option value
power investments, and for product development in the results in the amount one should be willing to pay right
pharmaceutical and entertainment industries. See, for now for the right to undertake the technology develop-
example, Faulkner [1996], Luehrman [1992], Majd and ment, incurring its uncertain cost and reaping its uncer-
Pindyck [1987], Neely [1998], and Nichols [1994]. tain benefits beginning at some time T in the future. The
More recently, real options modeling and analysis have monetary metric is easily understood and commensura-
been applied to space systems in the context of on-orbit ble across other technology investments. Moreover, the
servicing by Saleh, Lamassoure, and Hastings [2002] timing of both costs and benefits is treated explicitly,
and Lamassoure, Saleh, and Hastings [2002]. unlike some other approaches to R&D project selection.
Advocates of real options valuation have argued that It is not our intention in this paper to provide a tutorial
the general ideas from options pricing theory can be on real options pricing theory; some familiarity with the
applied even when the underlying asset is not traded in basic concepts, in fact, has been assumed. There are a
markets. They maintain that the real options valuation number of books on real options theory that the reader
captures what the project would be worth if it were may consult to understand the underlying concepts and
traded in a market. These arguments are articulated by to gain an appreciation for the difference between real
several authors in Schwartz and Trigeorgis [2001]. The options valuation and such time-honored approaches as
science NASA missions produce is clearly not traded in Net Present Value (NPV) analysis. These books include
any economic market, but market-like behavior is often Trigeorgis [1996] and Schwartz and Trigeorgis [2001].
observed by those who participate in the selection of
missions.
Company research and development (R&D) funding 2. ADVANCED TECHNOLOGY
can be thought of as buying an option to produce new INVESTMENTS IN NASA
products, without incurring the obligation to do so
unless proved economically viable. In option pricing 2.1. Technology Readiness Levels
thinking, technology developments are treated as assets
At NASA, technologies are categorized by their matur-
whose payoffs are uncertain, but that have the charac-
ity, which is defined by a qualitative measure called the
teristic of enabling potentially spectacular returns with
Technology Readiness Level (TRL). The nine-point
limited losses.
TRL scale is described in Table I. In this paper, we will
The motivation for using real options pricing to
concentrate on developing the real options approach for
value technology developments in NASA is the same
those long-range, higher-risk technology investments.
as in the private sector. In the words of Robert C. Merton
These investments generally are designed to move a
in his December 1997 Nobel Lecture: “the future is
technology with a TRL < 6 up to a TRL = 6, at which
uncertain . . . and in an uncertain environment, having
point a funded NASA mission can assume responsibil-
the flexibility to decide what to do after some of that
ity for its full development. Using the formal three-
uncertainty is resolved definitely has value. Option
tiered structure proposed by Hauser [1998], these
pricing theory provides the means for assessing that
value.” [Merton, 1998: 323] 1
A pure “public good” has the characteristic that one person’s
In the private sector, the ultimate products of tech- consumption of these products does not diminish another’s. As a
nology investments (for example, new drugs in the consequence of nonexcludability and other factors, the analysis of
public goods markets differs from that of strictly private goods. While
pharmaceutical industry) have the important charac- the focus is on NASA’s problem, the approach presented should be
teristic that they are private goods that go through applicable with some modifications to investment in advanced tech-
ordinary markets. As such, consumer demand informa- nologies that support the creation of any public good. In particular,
the Department of Defense (DoD) faces a similar problem. In that
tion, sufficient to allow future revenues to be stochasti- case, the public good is “defense,” rather than space-related science
cally modeled, is likely to be available. In the case of products.
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION 3
investments fall into Tier 1 (Basic Research Explora- into account the cost probability density and probability
tions) and Tier 2 (Development Programs to Create of meeting its technical performance.
Core Technological Competence). “Productizing” a Programmatic risk arises because how many mis-
specific technology falls into Tier 3 (Applied Engineer- sions and which missions NASA will choose to fly in
ing Projects), and is accomplished during the develop- the future is not known with certainty. Mission “road-
ment phase of a funded NASA mission that uses the maps” exist, along with strategic plans directed at par-
technology. ticular space science and exploration goals. Missions
(conceptual versions, at least) in the current roadmaps
2.2. Types of Uncertainty have a higher probability of being flown than missions
not currently on such roadmaps. However, missions on
Uncertainty in NASA technology investments can be
classified as development risk (cost, schedule, and tech- the roadmap could conceivably be replaced by new
nical performance) and programmatic risk (whether missions, not currently planned; and new missions
missions using the technology will actually fly). The could be added to the roadmap in future years. One
latter might be called the technology’s “market risk.” reason for this uncertainty is that future NASA budgets
A technology’s option value must ultimately depend and their allocation are not fully predictable.
on its market success as well as its development Whether any particular future mission flies is linked
success. To be credible, any real options valuation to its perceived value (as measured by society’s will-
equation must reflect these types of uncertainty and ingness-to-pay) at some future date. That value could
capture them quantitatively. A brief description of be substantially greater than we now perceive or it
these uncertainties in a typical NASA technology could be much less, because serendipitous science
investment is warranted. discoveries from earlier (flown) missions could alter
Development risk is more easily understood. Each NASA’s selection of future missions altogether.2
early (low TRL) NASA technology investment faces Moreover, the further out one looks, the uncertainty
uncertainty about the cost of bringing it to TRL = 6 by increases about a mission’s value and its science and
a particular date, even if its development team is com- technology content.
pletely successful. There may be several reasonable
paths to achieving TRL = 6, each with its own pace, 2.3. Role of Real Options
resource requirements, and risks. Generally, by increas- The real options framework confers some true advan-
ing the amount of resources, the date can sometimes be tages for NASA in its strategic planning (over other
moved forward and the probability of a successful methods for selecting technology investments such as
development increased. Indeed, one can picture a sur- net present value). The real options framework values
face representing (at each point in time) the feasible
combinations of the probability of development suc-
2
cess, development time, and expected development One example might be the discovery of subterranean life on
Mars, following which additional expeditions (both crewed and
cost. A technology’s real option valuation must explic- robotic) are sent to Mars at the expense of other space science
itly depend on the technology’s delivery date, and take missions.
4 SHISHKO, EBBELER, AND FOX
technology investments by taking into account the sufficient to justify risk-neutral valuation. One unre-
flexibility they can offer in the face of considerable solved issue here concerns whether NASA (as a gov-
uncertainty. NASA, as the holder of these real options, ernment agency) should be risk-neutral altogether
can decide to invest in missions, wait, abandon, or without regard to whether uncertainties can be hedged
change missions in response to better information as (with a traded twin security) or not. We have implicitly
some of these uncertainties are resolved. In simplest argued that the public goods aspect of NASA invest-
terms, the real options framework captures the addi- ments suggests that NASA should be risk-neutral in
tional value inherent in some technologies that cur- valuing its R&D projects, thus validating the use of a
rently goes unrecognized in the NASA budgeting riskless discount rate.
process. Using the real options framework, NASA can The application of Eq. (2) to NASA technology
achieve greater strategic flexibility with its limited tech- evaluation was elaborated in a paper by one of us
nology budget. [Shishko, 1997], in which we needed to explicitly treat
the technology’s development cost and probability of
success. The development cost was treated as a re-
3. THE REAL OPTIONS EQUATION quired payout whose amount was uncertain. The ex-
pected development cost was calculated over all
The value v of a real (non-income producing) option
(proposed) paths leading to TRL = 6, and then dis-
that pays off W(T) at time T is given by the general
counted appropriately. Thus, the first risk-neutral ex-
formula:
pectation, E[ ], in Eq. (2) is taken over technology
v(t, T ) = exp(−r(T − t))E[max(0, W(T ))], (1) development outcomes, while the second is taken
over “states of the world” in which different mission
where t is current time, E denotes the expected value in sets are realized.
a risk-neutral world, and r is the riskless discount rate. From basic principles, one can derive the real op-
A full explanation of Eq. (1) is beyond the scope of this tions valuation equation applicable to NASA technol-
paper. However, the basic idea was very concisely ex- ogy evaluation. This is documented in Shishko and
plained by the following paragraph in Schwartz and Ebbeler [1999].
Trigeorgis [2001: 452–453]:
T
vi(t, T ) = max 0, −E ∑ ci (τ) exp(−r(τ − t))
Consider, for example, an R&D investment or pilot
τ=t
project to the testing and development of an alternative,
lower-cost technological process. Such a strategic in- ∗
vestment opportunity can be viewed as a call option, T
(2)
having as [its] underlying asset the present value of the + pi,T E ∑ max ∑ i,k
0, X (τ) exp(−r(τ − t)) ,
expected cash inflows from the completed and operat- k τ=T
ing follow-on project, VT, with [the] exercise price
being the necessary investment outlay, I. The ability to where
defer investment in the follow-on project under market
demand uncertainty creates valuable flexibility for Xi,k(τ) = V MPi,k(τ) − MCi,k(τ)
management. If, during the later stages, market de-
mand develops favorably, the firm can make the fol- and
low-on investment and obtain the project’s net present
value at that time, NPVT = VT – I [≡ WT]. If, however, vi(t, T) = the option value of technology i at time t
market demand is weak, management can decide not for a technology readiness date of T,
to invest and its value would be truncated to 0. r = the riskless discount rate,
ci(τ) = the development cost of technology i in period
The discount factor, exp(r(T – t)) in Eq. (1), which is τ for a technology readiness date of T,
just a constant, brings the monetary value back to pi,T = the probability that the technology i develop-
current time t. ment program will be successful by the technology
The risk-neutral environment allows the use of the readiness date T,
riskless discount rate (i.e., the risk-free interest rate such Xi,k(τ) = the net marginal value of the technology i
as that on a government-backed security), which obvi- in project/mission k in period τ, given a successful
ates the need to make assumptions about risk aversion technology i development program,
and risk premia in valuing risky projects. In options VMPi,k(τ) = the value of the marginal contribution of
pricing theory, the existence of a traded “twin security,” technology i in project/mission k in period τ, given a
which has the same risk characteristics as the project, is successful technology i development program,
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION 5
MCi,k(τ) = the marginal cost of “productizing” tech- 2. Compute the technology’s payoff for each sam-
nology i in project/mission k in period τ, given a suc- ple path.
cessful technology i development program, 3. Discount and average the simulated payoffs to
T* = the time horizon (T* ≥ T ≥ t). obtain the option value using Eq. (2).
The form of the equation is tied to the earlier discus-
sion about the tradeoff surface among T, pi,T, the ex- By increasing the number of simulated sample paths,
pected cost of reaching TRL = 6, and the achieved level an arbitrary degree of accuracy can be obtained. Today,
of technical performance following development. We the computational intensity of Monte Carlo simulation
essentially chose to hold T and the achieved level of tends to be driven by the complexity of the behavioral
technical performance constant, while allowing the models using the stochastic variables. For NASA tech-
probability of development success and cost to vary nology investments, the behavioral models for the un-
concomitantly. Another approach would be to hold T derlying asset (i.e., mission) value are likely to be much
less complex than in the financial world for the foresee-
constant, set the probability of development success
able future. Computational time is, therefore, unlikely
equal to 1, while allowing the achieved level of techni-
to be a problem.
cal performance and cost to vary concomitantly.
However, we do not wish to minimize the effort
Whether the achieved level of technical performance is
needed to build a credible behavioral model or simula-
treated stochastically or not, Xi,k is conditional on its tion for each technology investment. For many ad-
state at time T. vanced space technologies (in our experience), the
Monte Carlo simulation is the natural tool for ap- payoff is highly dependent on the number of missions
proximating the expected values in Eq. (2). A generic that “fly” the technology, i.e., the flight rate. This flight
procedure for computing a technology’s real option rate is often highly uncertain and poses a modeling and
value using Monte Carlo simulation involves the fol- simulation challenge. In keeping with a commonly used
lowing steps: technique in real options valuation, we modeled the
flight rate as a diffusion process (geometric Brownian
1. Simulate sample paths for the underlying mission motion). The specific procedure used in our demonstra-
value. tion application below is depicted in Figure 1.
Figure 1. Simplified flow chart for NASA technology real options valuation.
6 SHISHKO, EBBELER, AND FOX
TABLE II. Mission Classes for Ultralight Propellant Tank Application of Real Options
Valuation
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION 7
TABLE III. Flight Rate Simulation Parameters by Mission Class (Nominal Case)
Figure 2. Simulation results for the Earth Orbiter Mission Class (nominal case, lightest titanium tank).
8 SHISHKO, EBBELER, AND FOX
Figure 3. Simulation results for the Earth Orbiter Mission Class (+1% flight rate drift, +10% volatility case, lightest titanium
tank).
overall savings. However, the Mars Sample Return (Ti) and aluminum (Al) UPT technologies, the remain-
mission class, shown in Figures 5–7, contributes sig- ing developments costs to TRL = 6 ranged from just
nificantly because of the high value of the mass savings. over $1M to just under $2M. We constructed a decision
The reader should recognize that in the nominal case, tree using the nominal development schedule and
where the volatility is zero, the Monte Carlo simulation budget extracted from the technology development plan
still results in a distribution because of the stochastic supplied by the cognizant technology manager. Prob-
nature of the mass savings and the mass shadow price. ability elicitation of the manager or system engineer
When volatility in the instantaneous flight rate is intro- was used to estimate the risk of failure at each milestone
duced (Figs. 6 and 7), the resultant benefits pdf is or critical test, and the recovery activities and costs were
multimodal . We believe this is a consequence of several included at each failure branch of the tree. Thus, the
factors: the higher probability of both earlier launches decision tree when completed also provided the overall
and later launches, the blackout period for Mars probability of development success needed in the real
launches, and the discounting of the benefits occurring options equation.
in different years. The development of the decision tree here is strongly
related to traditional systems engineering risk manage-
4.4. Development Cost and Probability of ment: Much of the same information is needed to per-
Success form an integrated cost and schedule risk assessment
The expected development cost of a UPT technology is for the technology development project. If the amount
the first expected value term in the real options equa- of cost and schedule risk information available is rela-
tion. Because of the fairly advanced TRL of the titanium tively rich (evidenced by a detailed project WBS and
Figure 4. Simulation results for the Earth Orbiter Mission Class (–1% flight rate drift, +10% volatility case, lightest titanium
tank).
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION 9
Figure 5. Simulation results for the Mars Sample Return Mission Class (nominal case, best titanium tank w/diaphragm).
Figure 6. Simulation results for the Mars Sample Return Mission Class (+1% flight rate drift, +10% volatility case, best titanium
tank w/diaphragm).
Figure 7. Simulation results for the Mars Sample Return Mission Class (–1% flight rate drift, +10% volatility case, best titanium
tank w/diaphragm).
10 SHISHKO, EBBELER, AND FOX
TABLE IV. Simulation Results for Hi-g Applications: Benefits of Mass Savings by Mission Class in $M (mean,
[standard deviation]) Based on 20,000 Trials
TABLE V. Simulation Results for Low-g Applications: Benefits of Mass Savings by Mission Class in
$M (mean, [standard deviation]) Based on 20,000 Trials
NASA TECHNOLOGY ASSESSMENT USING REAL OPTIONS VALUATION 11
TABLE VI. Sensitivity of Real Options Value minus the benefits of its best currently feasible alterna-
(Aluminum Ultralight Tanks) to Drift and Volatility tive technology) to get the unconditional net benefits
Parameters
for that case. Aggregation over all cases and netting out
the (fairly negligible) expected development costs
yields the real option value calculated in Eq. (2). All
future dollar denominated benefits and costs were dis-
counted at a riskless rate, taken here to be 4.5%.
REFERENCES
T.W. Faulkner, Applying “options thinking” to R&D valu-
TABLE VII. Sensitivity of Real Options Value ation, Res Technol Management 39(3) (May–June 1996),
(Titanium Ultralight Tanks) to Drift and Volatility 50–56.
Parameters J.R. Hauser, Research, development, and engineering met-
rics, Management Sci 4(12) (December 1998), 1670–
1689.
3
For example, product improvement technologies for extending
the service life of the International Space Station (ISS). The disposal
date of the ISS would have to be included as an endogenous stochastic
variable in any simulation to calculate those real option values.
12 SHISHKO, EBBELER, AND FOX
E. Lamassoure, J.H. Saleh, and D.E. Hastings, Space systems J.H. Saleh, E. Lamassoure, and D.E. Hastings, Space systems
flexibility provided by on-orbit servicing: Part 2, J Space- flexibility provided by on-orbit servicing: Part 1, J Space-
craft Rockets 39(4) (July–August 2002), 561–570. craft Rockets, 39(4) (July–August 2002), 551–560.
T.A. Luehrman, Arundel partners: The sequel project, Har- R. Shishko, Strategic technology portfolio selection: Devel-
vard Business School Case #9-292-140, Cambridge, MA, oping a systematic approach, unpublished JPL proposal,
1992. Jet Propulsion Laboratory, Pasadena, CA, September
S. Majd and R.S. Pindyck, Time to build, option value, and 1997.
financial decisions, J Fin Econ 18(1) (March 1987), 7–28. R. Shishko and D.H. Ebbeler, Strategic technology portfolio
R.C. Merton, Applications of option-pricing theory: Twenty- selection: An options pricing approach for NASA, JPL
five years later, Amer Econ Rev 88(3) (June 1998), 323– 900-990, JPL Economic Research Series, Jet Propulsion
349. Laboratory, Pasadena, CA, May 1999.
J.E. Neely III, Improving the valuation of R&D: A composite E.S. Schwartz and L. Trigeorgis (Editors), Real options and
framework of real options, decision analysis and benefit investment under uncertainty: Classical readings and re-
valuation frameworks, Ph.D. thesis, MIT International cent contributions, MIT Press, Cambridge, MA, 2001.
Center for the Management of Technology, Cambridge, L. Trigeorgis, Real options: Managerial flexibility and strat-
MA, June 1998. egy in resource allocation, MIT Press, Cambridge, MA,
N.A. Nichols, Scientific management at Merck: An interview 1996.
with CFO Judy Lewent, Harvard Bus Rev 72(1) (January–
February 1994), 89–99.
Robert Shishko is currently a Principal System Engineer and Economist in the Mission and System
Architecture Section of the Jet Propulsion Laboratory (JPL), California Institute of Technology. Dr.
Shishko received two S.B. degrees from MIT (1968), and his M.Phil. (1970) and Ph.D. (1972) in
economics from Yale University. He has been at JPL since 1983, and is currently working to improve the
practice of systems analysis and engineering at JPL and across NASA. He has worked on the International
Space Station and Mars Pathfinder mission, and was one of the “founding fathers” of JPL’s Project Design
Center. Dr. Shishko served as task manager and principal contributor to the NASA Systems Engineering
Handbook, for which he received the NASA Exceptional Achievement Medal in 1996. Prior to coming
to JPL, Dr. Shishko worked at the Rand Corporation (1970–1983) on a variety of defense resource
allocation and management issues. He has been an adjunct Associate Professor of Economics at the
University of Southern California. He has served on the part-time faculty of the International Space
University (Strasbourg, France) and is a visiting lecturer in systems engineering at MIT.
Donald H. Ebbeler is on the technical staff at JPL. He has been involved in the modeling and analysis of
both the engineering reliability and economic aspects of solar energy, war-gaming, cost prediction,
aerospace propulsion, electro-optical, structural, mechanical, chemical, advanced automobile air bag
systems, and optical space interferometer system designs. Before coming to JPL in 1980, he worked as
an aerospace research engineer for General Motors, served as an assistant and associate professor of
economics at Georgia Institute of Technology, Claremont Graduate School and the University of Iowa,
and as an economist at Southern California Edison. He has been on the editorial board of the Journal of
Macroeconomics since its founding in 1979. He graduated from Purdue University in 1970 with an M.S.
and Ph.D. in Economics. In 1964 he earned a B.S. in Electrical Engineering in the R&D option, with
concentrations in physics and mathematics, and in 1965 earned an M.S. in Electrical Engineering,
specializing in statistical communication theory with a concentration in statistics, both from Purdue
University.
George Fox: Engineers used slide rules when George entered Caltech as a freshman in 1965. A Caltech
Ph.D. in Applied Physics and Economics followed in 1979. George joined JPL in 1980 to study the
economic value of solar energy to utilities. Then followed work on military acquisition policy analysis,
war game modeling, and simulation. An original codeveloper of the Space Station Freedom System Design
Tradeoff Model, he also pioneered new systems models and analysis for projects in JPL’s Project Design
Center and new planning and scheduling tools used by NASA’s Deep Space Network. He currently does
reliability modeling of complex systems and dynamic cost risk and technology valuation using real options
models to value portfolios of NASA technology developments and the space mission projects that use the
resulting products.