Professional Documents
Culture Documents
The University of Edinburgh Probability Notes
The University of Edinburgh Probability Notes
d2 y dy
P (t) 2
+ Q(t) + R(t)y = G(t);
dt dt
provided that P (t) 6= 0 it may be expressed as
d2 y dy
2
+ p(t) + q(t)y = g(t).
dt dt
• Two functions y1 and y2 are linearly dependent on an interval I if there exists two con-
stants C1 and C2 , not both zero, such that
C1 y1 (t) + C2 y2 (t) = 0
for all t ∈ I.
The functions are linearly independent on I if they are not linearly dependent.
Proof:
91
(i) Suppose W (y1 , y2 )(t0 ) 6= 0 at some point t0 ∈ I. Also suppose there exist constants
C1 , C2 such that C1 y1 (t) + C2 y2 (t) = 0 for all t ∈ I. Then we also have C1 y1′ (t) +
C2 y2′ (t) = 0 for all t ∈ I. In other words
y1 (t0 ) y2 (t0 ) C1 0
= .
y1′ (t0 ) y2′ (t0 ) C2 0
−1
C1 y1 (t0 ) y2 (t0 ) 0
Thus =
C2 y1′ (t0 ) y2′ (t0 ) 0
′
1 y2 (t0 ) −y2 (t0 ) 0
= ′ (t )
W (y1 , y2 )(t0 ) −y 1 0 y (t
1 0 ) 0
0
= .
0
As both C1 , C2 are zero, y1 , y2 are linearly independent on I.
(ii) Contrapositive of (i).
• Abel’s Theorem: Suppose that y1 , y2 are two solns to the homogeneous ODE
y ′′ + p(t)y ′ + q(t)y = 0
where p, q are continuous on an open interval I. Then the Wronskian
Z
W (y1 , y2 ) = C exp − p(t) dt
where the constant C depends on y1 , y2 but not t. Furthermore, there are only two
possibilities: )
W (y1 , y2 ) = 0 ∀t ∈ I
.
W (y1 , y2 ) 6= 0 ∀t ∈ I
Since the exponential function is never zero, we have that W (t) 6= 0 unless W (t0 ) = 0 in
which case W (t) = 0 for all t.
92
• Suppose that y1 , y2 are two solns to the homogeneous ODE
y ′′ + p(t)y ′ + q(t)y = 0
where p, q are continuous on an open interval I. Then:
(i) y1 , y2 are linearly dependent on I iff W (y1 , y2 )(t) = 0 for all t ∈ I
(ii) y1 , y2 are linearly independent on I iff W (y1 , y2 )(t) 6= 0 for all t ∈ I.
Proof: As (i) and (ii) are equivalent we need only prove (i). Furthermore we proved earlier
that:
linear dependence of y1 , y2 =⇒ W (y1 , y2 )(t) = 0 for all t ∈ I.
So all that remains to be proved is that:
W (y1 , y2 )(t) = 0 for all t ∈ I =⇒ linear dependence of y1 , y2 .
Suppose W (y1 , y2 )(t) = 0 for all t ∈ I. Then, there exist constants C1 , C2 , not both zero,
such that
y1 (t0 ) y2 (t0 ) C1 0
=
y1′ (t0 ) y2′ (t0 ) C2 0
for any point t0 ∈ I (see Introduction to Linear Algebra course).3 Let φ(t) = C1 y1 (t) +
C2 y2 (t). Clearly φ(t) is a soln to the homogeneous ODE y ′′ + p(t)y ′ + q(t)y = 0 and it also
satisfies the initial conditions
φ(t0 ) = 0, φ′ (t0 ) = 0.
Therefore, by Ex. 83, we have φ(t) = 0 for all t ∈ I. That is, C1 y1 (t) + C2 y2 (t) = 0 for all
t ∈ I with C1 , C2 not both zero. Hence y1 , y2 are linearly dependent on I.
• Suppose that y1 , y2 are 2 linearly independent solns to the homogeneous ODE
y ′′ + p(t)y ′ + q(t)y = 0
where p, q are continuous. Then every soln to the ODE has the form
y = C1 y1 (t) + C2 y2 (t)
where C1 , C2 are constants.
Proof: Let φ(t) be an arbitrary soln to the homogeneous ODE. Consider φ evaluated at
an arbitrary point t0 : let φ(t0 ) = a and φ′ (t0 ) = b. That is, φ(t) satisfies the IVP
y ′′ + p(t)y ′ + q(t)y = 0, y(t0 ) = a, y ′ (t0 ) = b.
Now suppose y1 , y2 are 2 linearly independent solns to the homogeneous ODE. Since
they are linearly independent, we know that W (y1 , y2 )(t0 ) 6= 0. Thus we may introduce
introduce constants C1 , C2 such that
y1 (t0 ) y2 (t0 ) C1 a
′ ′ =
y1 (t0 ) y2 (t0 ) C2 b
−1
C1 y1 (t0 ) y2 (t0 ) a
i.e., = ′ ′
C2 y1 (t0 ) y2 (t0 ) b
′
1 y2 (t0 ) −y2 (t0 ) a
= .
W (y1 , y2 )(t0 ) −y1′ (t0 ) y1 (t0 ) b
3
Let M be a 2×2 matrix. Then:
x 0 x 0
det M = 0 ⇐⇒ ∃ 6= such that M = .
y 0 y 0
93
Since the constants C1 , C2 are such that
the function C1 y1 (t) + C2 y2 (t) satisfies the initial conditions C1 y1 (t0 ) + C2 y2 (t0 ) = a and
C1 y1′ (t0 ) + C2 y2′ (t0 ) = b. But, by Existence and Uniqueness Thm, φ(t) is the only soln that
satisfies these initial conditions; hence
• The functions y1 and y2 in the general soln y = C1 y1 +C2 y2 are said to form a fundamental
set of solutions.
• If we know one soln, say y1 (t), to a linear homogeneous ODE, another linearly inde-
pendent soln may be found by substituting y = v(t)y1 (t) into the ODE. This leads to a
1st-order separable ODE for v ′ (t) from which v(t) may be found.
This is called the Method of Reduction of Order.
y ′′ + 4y ′ + 4y = 0
so y1 (t) is clearly a soln. To find a second linearly independent soln we try y2 = v(t)e−2t .
Then
i.e., y2 = y1 v is a soln provided that v ′′ = 0. This ODE for v has the general soln
v = C1 + C2 t. Thus, the general soln to the ODE in the question is
which is never zero. Hence, e−2t and te−2t are indeed linearly independent.]
94
7.2 Linear homogeneous ODEs with constant coefficients
ay ′′ + by ′ + cy = 0 (22)
• Let us seek solns of the form y(t) = ert . Substituting this trial soln into (22) we get
ar2 + br + c ert = 0.
Thus, since y = ert is never zero, y(t) = ert is a soln to (22), provided that r is a root of
the auxiliary equation
ar2 + br + c = 0.
• Case I: If the auxiliary eqn has real-valued and distinct roots, i.e., b2 − 4ac > 0, then the
general soln to the ODE (22) is
which is never zero provided that r1 6= r2 . Hence, er1 t and er2 t are indeed linearly inde-
pendent.]
b
• Case II: If the auxiliary eqn has equal roots, i.e., b2 − 4ac = 0, then r = − and one soln
2a
to the ODE (22) is
b
y1 (t) = exp − t .
2a
To find another linearly independent soln consider the trial soln y2 (t) = v(t)y1 (t). Then
b −bt b
y2′ = − e 2a v + e− 2a t v ′ ,
2a
b2 − b t b b b
y2′′ = 2
e 2a v − e− 2a t v ′ + e− 2a t v ′′
4a a
95
which when substituted into the ODE (22) yields
2
b2
′′ ′ b
− 2a t b ′ ′′ ′
0 = ay2 + by2 + cy2 = e v − bv + av − v + bv + cv
4a 2a
b
= e− 2a t av ′′ since b2 − 4ac = 0
i.e., y2 = y1 v is a soln provided that v ′′ = 0. This ODE for v has the general soln
v = Cα + Cβ t. Thus, the general soln to the ODE (22) is
y = C1 ert + C2 tert .
which is never zero. Hence, ert and tert are indeed linearly independent.]
• Example 86 Solve the ODE
d2 y dy
4 2
+ 12 + 9y = 0.
dt dt
Soln: The auxiliary eqn 4r2 + 12r + 9 = (2r + 3)2 = 0 has the sole root r = −3/2. Hence
the general soln to the ODE is
3 3
y(t) = C1 exp − t + C2 t exp − t .
2 2
• Case III If the auxiliary eqn has complex-valued roots, i.e., b2 − 4ac < 0, then the roots
must be the complex-conjugate pair
r1 = α + iβ, r2 = α − iβ
√
where α, β ∈ R and i = −1; the general soln to the ODE (22) is
r1 t r2 t
y(t) = C1 e + C2 e
(α+iβ)t
= C1 e + C2 e(α−iβ)t
= eαt C1 eiβt + C2 e−iβt
= eαt [C1 (cos βt + i sin βt) + C2 (cos βt − i sin βt)] (using Euler’s formula)
αt
= e [(C1 + C2 ) cos βt + i (C1 − C2 ) sin βt]
or by relabelling the constants
y(t) = eαt (Cm cos βt + Cn sin βt) .
= βe2αt
which is never zero (as β 6= 0 here). Hence, eαt cos βt and eαt sin βt are indeed linearly
independent.]
Note:
96
(i) C2 = C1∗ =⇒ Cm , Cn ∈ R =⇒ y(t) ∈ R.
(ii) Sometimes it is helpful to express the term
as
C cos (βt + φ) , (C, φ constants) .
Since C cos (βt + φ) = C (cos βt cos φ − sin βt sin φ), we have
Cn
Cm = C cos φ, Cn = −C sin φ; i.e., C 2 = Cm
2
+ Cn2 , tan φ = − .
Cm
• If appropriate initial conditions are specified then particular solns can be found.
d2 y
+y =0 y(0) = 2, y ′ (0) = 3.
dt2
Soln: The auxiliary eqn r2 + 1 = 0 has roots r = ±i so the general soln to the ODE is
y(0) = CM = 2, y ′ (0) = CN = 3.
• Particular solns can also be found if appropriate boundary conditions are specified. A
boundary-value problem (BVP) comprises the ODE along with boundary conditions of the
form
y(x1 ) = y1 , y(x2 ) = y2 .
97
• Example 89 Solve the BVP
d2 y dy
2
+2 + y = 0, y(0) = 1, y(1) = 3.
dx dx
Soln: The auxiliary eqn r2 + 2r + 1 = (r + 1)2 = 0 has only one root r = −1, so the
general soln to the ODE is
y(x) = C1 e−x + C2 xe−x .
To satisfy the boundary conditions we require
Substituting C1 = 1 into the second eqn we find C2 = 3e − 1. Thus, the particular soln is
ay ′′ + by ′ + cy = g(t) (23)
• If Y1 and Y2 are any two solns of the nonhomogeneous ODE (23) then their difference
Y1 − Y2 is a soln of the corresponding complementary eqn (22); i.e.,
where C1 , C2 are certain constants and y1 , y2 are a fundamental set of solns of the
corresponding complementary eqn (22).
Proof: We have
Hence result.
• In this result, if we let Y1 be an arbitrary soln y(t) of the nonhomogeneous ODE (23) and
let Y2 be a particular soln yp (t) of the nonhomogeneous ODE (23), then we see that the
general soln of the nonhomogeneous ODE (23) may be expressed as
where yc (t) = C1 y1 (t) + C2 y2 (t) is the general soln of the corresponding complementary
eqn (22).
yc (t) is called the complementary function.
98
• In other words, to find the general soln of the nonhomogeneous ODE (23):
– Find the general soln yc of the corresponding homogeneous ODE (22), using the
techniques of §7.2;
– find any particular soln yp to the nonhomogeneous ODE (23);
– then add yc and yp together.
• There are two main methods of finding a particular soln yp to the nonhomogeneous ODE
(23) :
• Note: If the constant coefficients a, b, c in the nonhomogeneous ODE (23) were replaced
by functions a(t), b(t), c(t) then the general soln can still be expressed as
with yc (t) being the general soln of the corresponding homogeneous ODE and yp (t) being
any particular soln of the nonhomogeneous one.
Soln: The complementary eqns for both ODEs have the auxiliary eqn r2 − r − 12 =
(r − 4) (r + 3) = 0 which has roots r1 = 4, r2 = −3. So the complementary function for
both ODEs is
yc (t) = C1 e4t + C2 e−3t .
(a) -5 is not a root of the auxiliary eqn so we try yp (t) = Ce−5t . Substituting into the
nonhomogeneous ODE gives
99
(b) -3 is a root of the auxiliary eqn so we try yp (t) = Cte−3t . We have
yp′ = C e−3t − 3te−3t , yp′′ = C −6e−3t + 9te−3t ,
Thus yp is a particular soln provided that C = −3. Therefore the general soln is
Soln: The complementary eqn has the auxiliary eqn r2 + 6r + 9 = (r + 3)2 = 0 which has
the repeated root r = −3. So the complementary function is
-3 is a repeated root of the auxiliary eqn so we try yp (t) = Ct2 e−3t . We have
yp′′ + 6yp′ + 9yp = C 9t2 − 12t + 2 − 18t2 + 12t + 9t2 e−3t = 2Ce−3t = e−3t .
Thus yp is a particular soln provided that C = 1/2. Therefore the general soln is
1
y(t) = (C1 t + C2 ) e−3t + t2 e−3t .
2
Differentiating the general soln gives
3
y ′ (t) = C1 e−3t − 3 (C1 t + C2 ) e−3t + te−3t − t2 e−3t .
2
To satisfy the initial conditions we require
– If ±ik are not roots of the auxiliary eqn, try yp (t) = C cos kt + D sin kt;
– if ±ik are roots of the auxiliary eqn, try yp (t) = t (C cos kt + D sin kt) .
(a) 2y ′′ − y ′ − 6y = 21 sin 3t
(b) y ′′ + 9y = 12 cos 3t − 6 sin 3t
100
Soln:
(a) The complementary eqn has the auxiliary eqn 2r2 − r − 6 = (2r + 3) (r − 2) = 0
which has roots r1 = −3/2, r2 = 2. So the complementary function is
3
yc (t) = C1 e− 2 t + C2 e2t .
±3i are not roots of the auxiliary eqn so we try yp (t) = C cos 3t + D sin 3t. We have
yp′ = −3C sin 3t + 3D cos 3t, yp′′ = −9C cos 3t − 9D sin 3t,
This pair of linear eqns has the soln C = 7/65, D = −56/65. Hence the general soln
of the ODE is
3 1
y(t) = C1 e− 2 t + C2 e2t + (7 cos 3t − 56 sin 3t) .
65
(b) The complementary eqn has the auxiliary eqn r2 + 9 = 0 which has roots r1 = 3i,
r2 = −3i. So the complementary function is
±3i are roots of the auxiliary eqn so we try yp (t) = t (C cos 3t + D sin 3t). We have
Thus yp is a particular soln provided that C = 1 and D = 2. Hence the general soln
of the ODE is
y(t) = C1 cos 3t + C2 sin 3t + t (cos 3t + 2 sin 3t) .
(a) y ′′ + y ′ − 2y = t2
(b) y ′′ + y ′ = t + 1
Soln:
101
(a) The complementary eqn has the auxiliary eqn r2 + r − 2 = (r − 1) (r + 2) = 0 which
has roots r1 = 1, r2 = −2. So the complementary function is
yc (t) = C1 et + C2 e−2t .
Polynomials are equal when their coefficients are equal. Thus yp is a particular soln
provided that
−2C = 1, 2C − 2D = 0, 2C + D − 2E = 0;
which yields the solns C = −1/2, D = −1/2, E = −3/4. Hence the general soln of
the ODE is
1 1 3
y(t) = C1 et + C2 e−2t − t2 − t − .
2 2 4
(b) The complementary eqn has the auxiliary eqn r2 + r = 0 which has roots r1 = 0,
r2 = −1. So the complementary function is
yc (t) = C1 + C2 e−t .
2C + 2Ct + D = t + 1.
1
2C = 1, 2C + D = 1, i.e., C= , D = 0.
2
Hence the general soln of the ODE is
1
y(t) = C1 + C2 e−t + t2 .
2
• If g(t) is a product of functions of the types covered in Cases (i), (ii), (iii), then for our trial
particular soln yp we take a corresponding product of functions.
102
Neither 1 nor ±2i is a root of the auxiliary eqn so we try yp (t) = Cet cos 2t + Det sin 2t. We
have
which yields the solns C = 10/13, D = 2/13. Hence the general soln of the ODE is
et
y(t) = C1 e4t + C2 e−t + (10 cos 2t + 2 sin 2t) .
13
where s is the smallest of the integers 0, 1, 2 that ensures that no term of yp is a soln of
the corresponding complementary eqn.
• If yp1 (t) and yp2 (t) are particular solns of the nonhomogeneous ODEs
ay ′′ + by ′ + cy = g1 (t), ay ′′ + by ′ + cy = g2 (t)
respectively, then yp1 (t) + yp2 (t) is a particular soln of the nonhomogeneous ODE
ay ′′ + by ′ + cy = g1 (t) + g2 (t).
Proof: We have
′′ ′ ′′ ′
ayp1 + byp1 + cyp1 = g1 (t), ayp2 + byp2 + cyp2 = g2 (t).
as required.
103
• Example 95 Find the general soln of the nonhomogeneous ODE
Soln: The complementary eqn has the auxiliary eqn r2 − 4 = 0 which has roots r1 = 2,
r2 = −2. So the complementary function is
−3C = 1 and 2C − 3D = 0,
−4C cos 2t − 4D sin 2t − 4(C cos 2t + D sin 2t) = −8C cos 2t − 8D sin 2t = cos 2t.
1
yp2 (t) = − cos 2t.
8
104
7.3.2 Method of variation of parameters
• Here we turn to the case where g(t) for the nonhomogeneous ODE (23) is a general
function:
yp′ (t) = u′1 (t)y1 (t) + u1 (t)y1′ (t) + u′2 (t)y2 (t) + u2 (t)y2′ (t)
– Note: Since 2 unknown functions u1 (t), u2 (t) have been introduced, we need to
impose 2 conditions, namely (24) and (25), in order to determine u1 (t), u2 (t).
– Then we have
yp′′ (t) = u′1 (t)y1′ (t) + u1 (t)y1′′ (t) + u′2 (t)y2′ (t) + u2 (t)y2′′ (t)
and substituting yp , yp′ , yp′′ into the nonhomogeneous ODE (23) yields
u1 ay1′′ + by1′ + cy1 + u2 ay2′′ + by2′ + cy2 + a u′1 y1′ + u′2 y2′ = g;
since y1 and y2 are solns to the corresponding homogeneous ODE (22), the first two
bracketed terms vanish, i.e.,
g(t)
u′1 (t)y1′ (t) + u′2 (t)y2′ (t) = . (26)
a
– The pair of linear algebraic eqns (25), (26) can be solved for u′1 , u′2 per
y2 (t)g(t) y2 (t)g(t)
u′1 (t) = − =−
a [y1 (t)y2′ (t) − y2 (t)y1′ (t)] aW (y1 , y2 )
y1 (t)g(t) y1 (t)g(t)
u′2 (t) = ′ ′ = .
a [y1 (t)y2 (t) − y2 (t)y1 (t)] aW (y1 , y2 )
105
• Example 96 Find the general soln of the nonhomogeneous ODE
π
y ′′ + y = tan t, 0<t< .
2
Soln: The complementary eqn has the auxiliary eqn r2 + 1 = 0 which has roots r = ±i.
So the complementary function is
with u1 , u2 satisfying
sin t tan t cos t tan t
u′1 (t) = − = − sin t tan t, u′2 (t) = = sin t,
W (cos t, sin t) W (cos t, sin t)
sin2 t
Z Z
u1 (t) = − dt = − (sec t − cos t) dt = − ln |sec t + tan t| + sin t
cos t
Z
u2 (t) = sin t dt = − cos t.
yp (t) = [− ln (sec t + tan t) + sin t] cos t − cos t sin t = − cos t ln (sec t + tan t)
Note:
• The Method of Variation of Parameters works in same way if the constant coefficients a, b,
c of the nonhomogeneous ODE (23) were replaced by functions a(t), b(t), c(t). However
it may then be tricky to find the fundamental set of solns y1 (t), y2 (t) for the corresponding
homogeneous ODE; the techniques of §8.3 may be needed.
106