Professional Documents
Culture Documents
Numerical Methods
Numerical Methods
1
Recap
• Transformations/maps
• Determinant
• Induced norms
• Condition number
2
Recap
• Matrices:
y = Ax
0 1
-2 1 0
A = @ 1 -2 1 A
0 1 -2
3
Recap
• Matrices:
y = Ax
0 1
-2 1 0 1
A = @ 1 -2 1 1 A
0 1 -2 1
4
Recap
• Matrices:
y = Ax
0 1
-2 1 0
B 1 -2 1 C
A=B
@ 0
C
1 -2 A
1 1 1
5
Recap
• Matrices:
y = Ax
ssT
A=I-
ksk22
6
Existence and Uniqueness
• Example:
phosphate (P)
5 dirt (D)
phosphate (P) water (W)
dirt (D)
water (W) 6
dryer
1 3 phosphate (P)
washer dirt (D)
phosphate (P) water (W)
phosphate (P)
dirt (D)
dirt (D)
water (W) 4 water (W)
phosphate (P)
dirt (D) 9
water (W)
2 8
mixer decanter
phosphate (P) phosphate (P)
dirt (D) dirt (D)
water (W) water (W) phosphate (P)
7
dirt (D)
water (W)
02S
• has an additive inverse:
x 2 S ) (-x) 2 S : x + (-x) = 0
8
Vector Spaces
9
Vector Spaces
10
Vector Spaces
• A “subspace” is a subset of a vector space
• 2
For example, R is a subspace of R 3
• Is this a subspace?
{y : y = A((3, 0) + (0, 1)); A1 , A2 2 R}
• The linear combination of a set of vectors:
y=
M
X
Ai x i
i=1
12
Linear Dependence
• Example: are the columns of I linearly dependent?
0 1 0 1 0 1 0 1
1 0 0 1
@ 0 A 1+
@ 1 A 2+
@ 0 A 3 =@ 2
A=0
0 0 1 3
13
Linear Dependence
• Uniqueness of solutions to: Ax = b
• Proof:
• Let x = x H P
+ x , and Ax H P
= 0 while Ax = b
• If x H
6= 0 , x = cxH + xP is another solution.
• Therefore, x cannot be unique.
• 1 2
(A c
A c
. . . A c
M )x H
= 0 H
only if x = 0
15
Linear Dependence
• The dimension of a subspace is the minimum number of
linearly independent vectors required to describe the
span:
S = span{(1, 0, 0), (0, 1, 0), (0, 0, 1)}, dim S = 3
S = span{(1, 0, 0), (0, 1, 0), (0, 0, 1), (0, 0, 2)}, dim S = 3
16
Four Fundamental Subspaces
N ⇥M
A2R
• Null space:
M
N (A) = {x 2 R : Ax = 0}
• Row space:
R(AT ) = span{Ar1 , Ar2 , . . . , ArN }
• Left null space:
T N T
N (A ) = {x 2 R : A x = 0}
17
Column Space
A2R N ⇥M R(A) = span{A1c , A2c , . . . , AcM }
• Existence of solutions:
• Consider: Ax = b
M
X
c
xi Ai =b
i=1
• Converse: if b 2
/ R(A), then x cannot exist
18
Existence of Solutions
A2R N ⇥M R(A) = span{A1c , A2c , . . . , AcM }
• Example: 0
1 0 0
1
• Example: 0
1 0 0
1
• Is b 2 R(A) ?
21
Null Space
A 2 RN ⇥M
• The set of all vectors that are transformed into the
null vector by A is called the null space of A
N (A) = {x 2 RM : Ax = 0}
• The null space is a subset of RM
Null Space
C
Consider the reaction network:
• For a matrix A 2 C N ⇥ N , tr(A) = l1 + l2 + . . . l N .
k1 k2 k4
An example A ! B ! C ! D.
•
k3 k5
Consider the reaction network: An example
Example: 42 10.34: numerical methods, lecture notes
Consider
If thek1reaction the reaction in anetwork:
k2 takes k4 place well mixed, batch vessel, then the rate of
A ! B ! C ! D.
• A series of chemical
change of concentration
•
change Conservation
of concentration ofequation:
0 1 0
d B
Ifeach
the
B
singular.
dt @mass
change of
[ B] C
species
Breaction
[C ]
Cis
relates
Physically,
takes
concentration
A
B place
@ 0 of1
this must
B k1 in ka2well mixed,
C = B individual
each
0
k2 species
species
k
k3be the
1 rateis
k4 k5
case
batch Csince
0 vessel, B Bconservatio
C B [ then
C B They
equations.
A @ [C ]
] C Cthe rat
. no
C are
A
[ A] k1 0 independent. 0 0 [ A] 3
B C B [0D] 1 00 C 0B k4
C k5 1 [0D] 1
d B [ B] C B k1 k2 To[ Athe k]3 eigenvalue 0 kC 0[ B] C
B zero,
1 of there 0 is a corresponding
0 [ A]eigenv
B C=B B [kB] C C B
Bk k A @ [kC ] A k C . C B [ B] C
dt @ [C ] A @ When 0 k2ddescribes
the reaction
B 3 C kthe
reaches
4 B its steady-state
chemical engineer’s intuition: C
5 1 2 (d3 / dt[ ⇤ ] 0
= 0), the
at rate equa
Bsteady Cstat
B C=B C B C .
[D] 0 is simply:
tion 0dtas@it [is Ck]4depleted
A @ k5by 0 only k[2Dforward
] k3 reactions, k4 k5 Awhile @ [C[B], ] A [C
[ Dnon-zero
] 0 00 kequilibrium k5 of0 [D ] 1
•
0
When the reaction reaches its ksteady-state obtain values set
1
(d0/dt[⇤] = 00), the rate by the 41 the reaction
Steady state: 1 0 [ A]equa- [ A]
tion is simply: BWhen these species. This eigenvector C B [ Bis] aCset of non-zero B theconcentraC eq
B 1 k the reaction
k 2 k reaches
3 0its steady-state
CB C (d / dt[ ⇤ ] = 0),
B [ B]rate C
B belongs to the null space C of
B the reaction
C = 0 rate matrix.
B C, s
This
0 @tion0is simply:
1k0 2 k 1 k k A0 @ [ C ]1 A @ [ C ] A
k1 0 0 0 determined [ A] 3 by assuming
4 5
A
[D] = 1 and performing back subs
[ ]
B k 0 0 C 0B k
C 4 k 5 B 1 [0 D ]C 1 [0D] 1
B 1 k2 k3 0 determine
kC 1 B 0[ B ] C 0
the concentrations 0 B [ Bof ] C A] other components.
[the [ AThe
]
B C B C = 0 or 0 B C ,
@ 0 k2 k4 B
k3 There k5 knon-zero
Bmust 1A be@ a [kC vectors
A
non-trivial
2 ] k 3 satisfying
solution 0 @ C[CB
steady-state
for
C Bthe
] A [ B C
steady
] C condition is
concentrations
B [ B] C
B – an C
B CB C = 0 or 0 B C
0 0 k4 eigenvector
@ k5 0 corresponding
k[2D ] k3 to 0k4an eigenvalue
k51 A [ D@]0 [C of] zero.
A The eigenvalues 1@ [C ] of A
•
@ 0 k2 k3 k4 l k5 A
What B is kthis subspace
k 1 l 0 where 0 geometrically?
0
c0is an arbitrary 0
0 scalar kthat is determined
C 4 k5 l by1a total
B 1 k2 l ance onk3the kh1 steady-state.
l 00 CBecause 0 the stoichiometric0 i 24rela
0 = det B B 2 C (2.52) C
dimension of its column space:
N ⇥M
R N (A) = r
A 2dim M.
• Rank ofrank
If the a matrix is the
of a matrix dimension
equals the number of its column
of columns in the space
matrix,
r = M, the dimension of the null space is zero. Such a matrix is said
r = dim R(A)
to be full rank. The rank of a matrix can be determined by reducing it
to row-echelon form: A ! U . This is done by following the Gaussian
• Finding the procedure
elimination rank: transform
will have the structure:
with pivoting. toThe
upper triangular
row-echelon formU ,
form matrix,
A!U 0 1
U11 U12 . . . U1r U1(r+1) . . . U1M
B 0
B U22 . . . U2r U2(r+1) . . . U2M C C
B .
B . .. .. .. .. .. .. CC
B . . . . . . . C
B C
U =B 0 0 . . . U rr Ur(r+1) . . . U rM
C. (2.47)
B C
B 0
B 0 ... 0 0 ... 0 C C
B C
@ 0 0 ... 0 0 ... 0 A
0 0 ... 0 0 ... 0
• For any b in Ax = b
• Uniqueness:
26
MIT OpenCourseWare
httpV://ocw.mit.edu
For information about citing these materials or our Terms of Use, visit: httpV://ocw.mit.edu/terms.