Professional Documents
Culture Documents
Arbitrage: An Undergraduate Introduction To Financial Mathematics
Arbitrage: An Undergraduate Introduction To Financial Mathematics
_
a
11
a
12
a
1n
a
21
a
22
a
2n
.
.
.
.
.
.
.
.
.
a
m1
a
m2
a
mn
_
_
_
_
x
1
x
2
.
.
.
x
n
_
_
_
_
b
1
b
2
.
.
.
b
m
_
_
= b.
The general form of a linear program will be
Maximize c
T
x subject to the constraints Ax b and
x 0.
J. Robert Buchanan Arbitrage
Feasible Vectors and Cost Functions
Denition
Vector x is feasible if x 0 and Ax b.
Denition
If c is a vector of n components, then we dene
c
T
x = c
1
x
1
+ c
2
x
2
+ + c
n
x
n
to be the cost function.
Denition
Vector x is an optimal solution if x is feasible and maximizes
the cost function.
J. Robert Buchanan Arbitrage
Feasible Vectors and Cost Functions
Denition
Vector x is feasible if x 0 and Ax b.
Denition
If c is a vector of n components, then we dene
c
T
x = c
1
x
1
+ c
2
x
2
+ + c
n
x
n
to be the cost function.
Denition
Vector x is an optimal solution if x is feasible and maximizes
the cost function.
J. Robert Buchanan Arbitrage
Feasible Vectors and Cost Functions
Denition
Vector x is feasible if x 0 and Ax b.
Denition
If c is a vector of n components, then we dene
c
T
x = c
1
x
1
+ c
2
x
2
+ + c
n
x
n
to be the cost function.
Denition
Vector x is an optimal solution if x is feasible and maximizes
the cost function.
J. Robert Buchanan Arbitrage
Example (1 of 2)
Example
Use the notion of the intersection of planes in R
3
to minimize
5x
1
+ 4x
2
+ 8x
3
subject to x
1
+ x
2
+ x
3
= 1 and x is feasible.
J. Robert Buchanan Arbitrage
Example (2 of 2)
0.0
0.5
1.0
x
1
0.0
0.5
1.0
x
2
0.0
0.5
1.0
x
3
Constraint Set
0.0
0.5
1.0
x
1
0.0
0.5
1.0
x
2
0.0
0.5
1.0
x
3
Constraint Set
5x
1
4x
2
8x
3
k
J. Robert Buchanan Arbitrage
Slack Variables
Many optimization problems may include inequality
constraints.
Inequality constraints can be converted to equality constraints
by introducing slack variables. Thus
x
1
+ x
2
+ x
3
1 becomes x
1
+ x
2
+ x
3
+ x
4
= 1,
where x
4
0 and takes up the slack to produce equality.
J. Robert Buchanan Arbitrage
Example (1 of 2)
Example
Use the notion of the intersection of planes in R
3
to minimize
5x
1
+ 4x
2
+ 8x
3
subject to x
1
+ x
2
+ x
3
1 and x is feasible.
J. Robert Buchanan Arbitrage
Example (2 of 2)
If the constraints are x
1
+ x
2
+ x
3
1 and x feasible, then the
set of points where the solution must be found would resemble
a tetrahedron with vertices at (0, 0, 0), (1, 0, 0), (0, 1, 0), and
(0, 0, 1).
Feasible Region
5x
1
4x
2
8x
3
k
0.5
0.0
0.5
1.0
x
1
0.5
0.0
0.5
1.0
x
2
0.5
0.0
0.5
1.0
x
3
J. Robert Buchanan Arbitrage
Matrix Notation for Slack Variables
Suppose A is an mn matrix, x is a vector of n components,
and b is a vector of m components, then by augmenting x with
m slack variables and A with the mm identity matrix the
inequality constraint Ax b is equivalent to
_
_
a
11
a
12
a
1n
1 0 0
a
21
a
22
a
2n
0 1 0
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
a
m1
a
m2
a
mn
0 0 1
_
_
_
_
x
1
x
2
.
.
.
x
n
x
n+1
x
n+2
.
.
.
x
n+m
_
_
=
_
_
b
1
b
2
.
.
.
b
m
_
_
_
A I
m
_
x
x
_
= b.
J. Robert Buchanan Arbitrage
Canonical Linear Form
The general linear problem can now be stated in equivalent
form
maximize c
T
x subject to Ax = b and x 0,
where
A is an m(n + m) matrix consisting of the original
constraint matrix augmented with the identity matrix, and
x is the previous solution vector augmented with the slack
variables.
This new form of the linear problem will be called the canonical
form.
J. Robert Buchanan Arbitrage
Dual Problems
For every linear programming problem of the type discussed
above, there is an associated problem known as its dual.
Henceforth the original problem will be known as the primal.
These paired optimization problems are related in the following
ways.
Primal: Maximize c
T
x subject to Ax b and x 0.
Dual: Minimize b
T
y subject to A
T
y c and y 0.
J. Robert Buchanan Arbitrage
Observations
Primal: Maximize c
T
x subject to Ax b and x 0.
Dual: Minimize b
T
y subject to A
T
y c and y 0.
Note:
1
the process of maximization in the primal is replaced with
the process of minimization in the dual,
2
the unknown of the dual is a vector y with m components,
3
the vector b moves from the constraint of the primal to the
cost function of the dual,
4
the vector c moves from the cost of the primal to the
constraint of the dual,
5
the constraints of the dual are inequalities and there are n
of them.
J. Robert Buchanan Arbitrage
Dual of the Dual
Theorem
The dual of the dual is the primal.
J. Robert Buchanan Arbitrage
Proof
Starting with the dual problem,
Minimize b
T
y subject to A
T
y c and y 0.
We can re-write the dual in general form,
Maximize (b)
T
y subject to (A)
T
y c and y 0.
Now the dual of this problem (i.e., the dual of the dual) is
Minimize (c)
T
x subject to ((A)
T
)
T
x b and x 0.
This problem is logically equivalent to the problem
Maximize c
T
x subject to Ax b and x 0,
which is the primal problem.
J. Robert Buchanan Arbitrage
Weak Duality Theorem
Theorem (Weak Duality Theorem)
If x and y are the feasible solutions of the primal and dual
problems respectively, then c
T
x b
T
y. If c
T
x = b
T
y then
these solutions are optimal for their respective problems.
J. Robert Buchanan Arbitrage
Proof of Weak Duality Theorem
Feasible solutions to the primal and the dual problems must
satisfy the constraints Ax b with x 0 (for the primal
problem) and A
T
y c with y 0 (for the dual). Multiply the
constraint in the dual by x
T
x
T
A
T
y x
T
c c
T
x y
T
Ax.
Multiply the constraint in the primal by y
T
y
T
Ax y
T
b = b
T
y.
Directions of the inequalities are preserved because x 0 and
y 0. Combining these last two inequalities produces
c
T
x y
T
Ax b
T
y.
Therefore we have c
T
x b
T
y. If c
T
x = b
T
y then x and y must
be optimal since no x can make c
T
x larger than b
T
y and no y
can make b
T
y smaller than c
T
x.
J. Robert Buchanan Arbitrage
Example (1 of 2)
Example
Primal: Maximize 4x
1
+ 3x
2
subject to x
1
+ x
2
2 and
x
1
, x
2
0.
Dual: Minimize 2y
1
subject to y
1
3, y
1
4, and y
1
0.
J. Robert Buchanan Arbitrage
Example (2 of 2)
The minimum value of y
1
subject to the constraints must be
y
1
= 4. According to the Weak Duality Theorem then the
minimum of the cost function of the primal must be at least 8.
Applying the level set argument as before, the largest value of k
for which the level set 4x
1
+ 3x
2
= k intersects the set of
feasible points for the primal is k = 8.
Feasible Region
4x
1
3x
2
8
0.0 0.5 1.0 1.5 2.0
0.0
0.5
1.0
1.5
2.0
x
1
x
2
J. Robert Buchanan Arbitrage
More on Duality
Theorem
Optimality in the primal and dual problems requires either
x
j
= 0 or (A
T
y)
j
= c
j
for each j = 1, . . . , n.
J. Robert Buchanan Arbitrage
Proof
When x and y are optimal for their respective problems then
b
T
y = y
T
Ax = c
T
x
(y
T
A c
T
)x = 0
(A
T
y c)
T
x = 0.
Since x 0 and A
T
y c 0 then vector x must be zero in
every component for which vector A
T
y c is positive and vice
versa.
J. Robert Buchanan Arbitrage
Example (1 of 4)
Example
Primal: Maximize c
T
x = 3x
1
+ 2x
2
x
3
+ 3x
4
subject to
x 0 and
_
1 1 1 0
2 0 1 1
_
_
_
x
1
x
2
x
3
x
4
_
_
_
5
3
_
J. Robert Buchanan Arbitrage
Example (2 of 4)
Dual: Minimize b
T
y = 5y
1
+ 3y
2
subject to
_
_
1 2
1 0
1 1
0 1
_
_
_
y
1
y
2
_
_
_
3
2
1
3
_
_
J. Robert Buchanan Arbitrage
Example (3 of 4)
1 2 3 4 5 6
2.0
2.5
3.0
3.5
4.0
4.5
5.0
y
1
y
2
Optimal solution is at (y
1
, y
2
) = (3, 3) and has value 24.
J. Robert Buchanan Arbitrage
Example (4 of 4)
Strict inequality is present in the second and third constraints
since
y
1
= 3 > 2
y
1
+ y
2
= 0 > 1.
Thus the second and third components of x in the primal
problem must be zero. Therefore the primal can be recast as
Primal: Maximize 3x
1
+ 3x
4
subject to x
1
0, x
4
0 and
_
1 1 1 0
2 0 1 1
_
_
_
x
1
0
0
x
4
_
_
=
_
x
1
2x
1
+ x
4
_
_
5
3
_
Thus x
1
= 5 and x
4
= 13, the maximum of the cost function for
the primal is 24 and it occurs at (x
1
, x
2
, x
3
, x
4
) = (5, 0, 0, 13).
J. Robert Buchanan Arbitrage
Duality Theorem
Theorem (Duality Theorem)
If there is an optimal x in the primal, then there is an optimal y
in the dual and the minimum of c
T
x equals the maximum of
y
T
b.
Remark: before proving the Duality Theorem we must state a
lemma which will be used in the proof.
Lemma (Farkas Alternative)
Exactly one of the following two statements is true. Either
1
Ax b has a solution x 0, or
2
A
T
y 0 with b
T
y < 0 has a solution y 0.
J. Robert Buchanan Arbitrage
Duality Theorem
Theorem (Duality Theorem)
If there is an optimal x in the primal, then there is an optimal y
in the dual and the minimum of c
T
x equals the maximum of
y
T
b.
Remark: before proving the Duality Theorem we must state a
lemma which will be used in the proof.
Lemma (Farkas Alternative)
Exactly one of the following two statements is true. Either
1
Ax b has a solution x 0, or
2
A
T
y 0 with b
T
y < 0 has a solution y 0.
J. Robert Buchanan Arbitrage
Proof (1 of 6)
Primal: Maximize c
T
x subject to Ax b and x 0.
Dual: Minimize b
T
y subject to A
T
y c and y 0.
Assuming there are feasible solutions to each problem then we
can re-write the constraint of the dual as (A)
T
y c with
y 0. Thus according to the constraint on the primal, the
re-written constraint on the dual, and the conclusion of the
Weak Duality Theorem the following inequalities hold for
x, y 0.
Ax b
(A)
T
y c
c
T
x b
T
y 0
J. Robert Buchanan Arbitrage
Proof (2 of 6)
These inequalities can be written in the block matrix form
_
_
A 0
0 A
T
c
T
b
T
_
_
_
x
y
_
_
_
b
c
0
_
_
.
According to the Farkas Alternative Lemma either this
inequality has a solution x, y 0 or the alternative
_
A
T
0 c
0 A b
_
_
_
u
v
_
_
0 and
_
b
T
c
T
0
_
_
u
v
_
_
< 0
has a solution u, v, 0.
J. Robert Buchanan Arbitrage
Proof (3 of 6)
We may decompose this block matrix to derive the following
system of inequalities:
A
T
u +c 0, Av b 0, b
T
u c
T
v < 0
with u 0, v 0, and 0. If > 0 then this system of
inequalities is equivalent to the following system.
A
_
1
v
_
b
A
T
_
1
u
_
c
b
T
_
1
u
_
> c
T
_
1
v
_
Since u 0 and v 0 the vectors
1
u 0 and
1
v 0 as well.
J. Robert Buchanan Arbitrage
Proof (4 of 6)
The rst two inequalities form a primal problem and its dual.
Primal: A
_
1
v
_
b
Dual: A
T
_
1
u
_
c
If we apply the Weak Duality Theorem, then it must be the case
that b
T
_
1
u
_
c
T
_
1
v
_
, contradicting the inequality:
b
T
_
1
u
_
> c
T
_
1
v
_
Therefore we know that = 0.
J. Robert Buchanan Arbitrage
Proof (5 of 6)
Thus the Farkas Alternative simplies to the following system:
Av 0, A
T
u 0, and b
T
u < c
T
v
where u 0 and v 0. The last inequality implies that
b
T
u < 0 or c
T
v > 0. If b
T
u < 0 then the primal problem Ax b
has no feasible solution x 0. To see this note that together
the inequalities x 0, Ax b, and b
T
u < 0 imply that
(Ax)
T
b
T
x
T
A
T
b
T
x
T
_
A
T
u
_
b
T
u < 0.
However, x 0 and A
T
u 0 and thus x
T
_
A
T
u
_
0, a
contradiction.
J. Robert Buchanan Arbitrage
Proof (6 of 6)
If c
T
v > 0 then the dual problem A
T
y c has no feasible
solution y 0. To see this note that together the inequalities
y 0, A
T
y c, and c
T
v > 0 imply that
_
A
T
y
_
T
c
T
y
T
A c
T
y
T
(Av) c
T
v > 0
y
T
(Av) < 0
However, y 0 and Av 0 and thus y
T
(Av) 0, a
contradiction.
J. Robert Buchanan Arbitrage
Fundamental Theorem of Finance (1 of 2)
Assumptions and background:
Experiment has m possible outcomes numbered 1 through
m.
We can place n wagers (numbered 1 through n) on the
outcomes.
r
ij
is the return for a unit bet on wager i {1, 2, . . . , n}
when the outcome of the experiment is j {1, 2, . . . , m}.
Vector x = (x
1
, x
2
, . . . , x
n
) is called a betting strategy.
Component x
i
is the amount placed on wager i .
Return from a betting strategy is
n
i =1
x
i
r
ij
.
J. Robert Buchanan Arbitrage
Fundamental Theorem of Finance (2 of 2)
Theorem (Arbitrage Theorem)
Exactly one of the following is true: either
1
there is a vector of probabilities y = y
1
, y
2
, . . . , y
m
for
which
m
j =1
y
j
r
ij
= 0, for each i = 1, 2, . . . , n, or
2
there is a betting strategy x = x
1
, x
2
, . . . , x
n
for which
n
i =1
x
i
r
ij
> 0, for each j = 1, 2, . . . , m.
J. Robert Buchanan Arbitrage
Proof (1 of 4)
Let the n-tuple (x
1
, x
2
, . . . , x
n
) be the betting strategy.
Vector x = x
1
, x
2
, . . . , x
n
, x
n+1
where the (n + 1)st
element is the payoff for the betting strategy.
We would like to maximize x
n+1
under the constraint that
n
i =1
x
i
r
ji
x
n+1
for j = 1, 2, . . . , m. This is equivalent to
n
i =1
x
i
(r
ji
) + x
n+1
0 for j = 1, 2, . . . , m.
c = 0, . . . , 0
. .
n components
, 1 and b = 0, . . . , 0
. .
m components
_
r
11
r
12
r
1n
1
r
21
r
22
r
2n
1
.
.
.
.
.
.
.
.
.
.
.
.
r
m1
r
m2
r
mn
1
_
_
_
_
x
1
x
2
.
.
.
x
n
x
n+1
_
_
0
0
.
.
.
0
_
_
.
The dual of this primal problem can be stated as Minimize
b
T
y = 0 subject to A
T
y c and y 0. The unknown y is a
vector of m components. Since b = 0 the cost function is
minimized at 0.
J. Robert Buchanan Arbitrage
Proof (3 of 4)
The dual problem is that of minimizing 0 subject to y 0 and
_
_
r
11
r
21
r
m1
r
12
r
22
r
m2
.
.
.
.
.
.
.
.
.
r
1n
r
2n
r
mn
1 1 1
_
_
_
_
y
1
y
2
.
.
.
y
m1
y
m
_
_
=
_
_
0
0
.
.
.
0
1
_
_
.
This is equivalent to the system of equations,
m
j =1
y
j
r
ji
= 0 for
i = 1, 2, . . . , n;
m
j =1
y
j
= 1, and y
j
0 for j = 1, 2, . . . , m. The
dual problem is feasible with a minimum value of zero if and
only if y is a probability vector for which all bets have an
expected return of zero.
J. Robert Buchanan Arbitrage
Proof (4 of 4)
Suppose the dual problem is feasible, the primal problem is
also feasible since x
i
= 0 for i = 1, 2, . . . , n + 1 satises the
inequality constraints of the dual. According to the Duality
Theorem then the maximum of the primal problem is zero
which means no guaranteed prot is possible. In other words if
(1) is true then (2) is false.
Now suppose the dual problem is not feasible. According to the
Duality Theorem the primal problem has no optimal solution.
Therefore zero is not the maximum payoff, thus there is a
betting strategy which produces a positive payoff. Thus we see
that if (1) is false then (2) is true.
J. Robert Buchanan Arbitrage