Professional Documents
Culture Documents
Linear Systems
Linear Systems
Linear Systems
1: Linear Systems
Outline
Intersections: R2
Intersections: R2
Intersections: R2
The intersection of the two lines is the set of points (x, y ) that are
solutions to this system of linear equations:
a1 x + a2 y = a3
b1 x + b2 y = b3
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Intersections: R2
The intersection of the two lines is the set of points (x, y ) that are
solutions to this system of linear equations:
a1 x + a2 y = a3
b1 x + b2 y = b3
a1 a2
If the intersection is a point, what can we say about det ?
b1 b2
A. zero B. nonzero C. positive D. negative
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Intersections: R2
The intersection of the two lines is the set of points (x, y ) that are
solutions to this system of linear equations:
a1 x + a2 y = a3
b1 x + b2 y = b3
a1 a2
If the intersection is a point, what can we say about det ?
b1 b2
A. zero B. nonzero C. positive D. negative
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
Intersections: R3
a1 x + a2 y + a3 z = a4
b1 x + b2 y + b3 z = b4
c1 x + c2 y + c3 z = c4
Possible solutions:
∅
x=q
x = q + sa
x = q + sa + tb
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Intersections: R3
a1 x + a2 y + a3 z = a4
b1 x + b2 y + b3 z = b4
c1 x + c2 y + c3 z = c4
Intersections: R3
a1 x + a2 y + a3 z = a4
b1 x + b2 y + b3 z = b4
c1 x + c2 y + c3 z = c4
Intersections: R3
a1 x + a2 y + a3 z = a4
b1 x + b2 y + b3 z = b4
c1 x + c2 y + c3 z = c4
Linear (In)dependence
Definition we want:
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if none is a linear combination of the others.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Linear (In)dependence
Definition we want:
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if none is a linear combination of the others.
Definition: Linear Independence
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if the only solution to the equation
s1 a1 + s2 a2 + · · · + sn an = 0
is
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Linear (In)dependence
Definition we want:
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if none is a linear combination of the others.
Definition: Linear Independence
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if the only solution to the equation
s1 a1 + s2 a2 + · · · + sn an = 0
is s1 = s1 = · · · = sn = 0.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Linear (In)dependence
Definition we want:
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if none is a linear combination of the others.
Definition: Linear Independence
If a1 , a2 , . . ., an are a collection of vectors, we call them linearly
independent if the only solution to the equation
s1 a1 + s2 a2 + · · · + sn an = 0
is s1 = s1 = · · · = sn = 0.
So, the vectors are linearly dependent if there exist scalars
s1 , s2 , . . . , sn , at least one of which is nonzero, such that
s1 a1 + s2 a2 + · · · + sn an = 0.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i
(1) 1 + 2 = 3
1 2 3
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
(1) 2 [ 10 ] + 7 [ 22 ] = [ 16
14 ]
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
(1) 2 [ 10 ] + 7 [ 22 ] = [ 16 1 2 16 0
14 ] (2) Equivalently, 2 [ 0 ] + 7 [ 2 ] − [ 14 ] = [ 0 ]
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
(1) 2 [ 10 ] + 7 [ 22 ] = [ 16 1 2 16 0
14 ] (2) Equivalently, 2 [ 0 ] + 7 [ 2 ] − [ 14 ] = [ 0 ]
nh 1 i h 0 i h 0 io
Example: 0 , 1 , 0 are linearly independent.
0 0 7
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
(1) 2 [ 10 ] + 7 [ 22 ] = [ 16 1 2 16 0
14 ] (2) Equivalently, 2 [ 0 ] + 7 [ 2 ] − [ 14 ] = [ 0 ]
nh 1 i h 0 i h 0 io
Example: 0 , 1 , 0 are linearly independent.
0 0 7
nh 1 i h 1 i h 2 io
Example: 1 , 2 , 3 are linearly dependent.
1 2 3
h1i h1i h2i h1i h1i h2i h0i
(1) 1 + 2 = 3 (2) Equivalently, 1 + 2 − 3 = 0
1 2 3 1 2 3 0
Example: {[ 10 ] , [ 22 ] , [ 16
14 ]} are linearly dependent
(1) 2 [ 10 ] + 7 [ 22 ] = [ 16 1 2 16 0
14 ] (2) Equivalently, 2 [ 0 ] + 7 [ 2 ] − [ 14 ] = [ 0 ]
nh 1 i h 0 i h 0 io
Example: 0 , 1 , 0 are linearly independent.
0 0 7
Basis
Definition: Basis
In Rn , a collection of n linearly independent vectors is called a
basis.
Any x in Rn can be written as a linear combination of basis vectors.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Basis
Definition: Basis
In Rn , a collection of n linearly independent vectors is called a
basis.
Any x in Rn can be written as a linear combination of basis vectors.
1 2
Verify that and form a basis.
1 1
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Basis
Definition: Basis
In Rn , a collection of n linearly independent vectors is called a
basis.
Any x in Rn can be written as a linear combination of basis vectors.
1 2
Verify that and form a basis.
1 1
7 1 2
Write as a linear combination of and .
−2 1 1
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Basis
Definition: Basis
In Rn , a collection of n linearly independent vectors is called a
basis.
Any x in Rn can be written as a linear combination of basis vectors.
1 2
Verify that and form a basis.
1 1
7 1 2
Write as a linear combination of and .
−2 1 1
7 1 2
= −11 +9
−2 1 1
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Bases
Bases
1 0 0
0 , 1 , 0 = {i, j, k}
0 0 1
“Standard basis”
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
0
0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Suppose:
x a1 b
=s +t 1
y a2 b2
and also
x a1 b
=p +q 1 ,
y a2 b2
where s 6= p.
a1 b
Is , 1 a basis of R2 ?
a2 b2
Suppose:
x a1 b
=s +t 1
y a2 b2
and also
x a1 b
=p +q 1 ,
y a2 b2
where s 6= p.
a1 b
Is , 1 a basis of R2 ?
a2 b2
Suppose:
x a1 b
=s +t 1
y a2 b2
and also
x a1 b
=p +q 1 ,
y a2 b2
where s 6= p.
a1 b
Is , 1 a basis of R2 ?
a2 b2
a1 b
Find a scalar constant c so that =c 1 .
a2 b2
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Suppose:
x a1 b
=s +t 1
y a2 b2
and also
x a1 b
=p +q 1 ,
y a2 b2
where s 6= p.
a1 b
Is , 1 a basis of R2 ?
a2 b2
a1 b q−t
Find a scalar constant c so that =c 1 . c=
a2 b2 s −p
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Substitution
2
Give 24 as a linear combination of the vectors in the basis
49
below.
2 0 1
1 , 9 , 1
5 8 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Substitution
2
Give 24 as a linear combination of the vectors in the basis
49
below.
2 0 1
1 , 9 , 1
5 8 0
2 2 0 1
24 = 5 1 + 3 9 − 8 1
49 5 8 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Substitution
Find A, B, and C .
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Substitution
Find A, B, and C .
A = 2, B = −5, C = 3
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
General Form
Upper Triangular
Diagonal
Equivalent Equations
Notice:
6x + 10y + 14z = 20
and
3x + 5y + 7z = 10
have the same solutions.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Notice:
6x + 10y + 14z = 20
and
3x + 5y + 7z = 10
have the same solutions.
Caution:
0x + 0y + 0z = 0
has more solutions.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Notice:
3x + 5y + 7z = 10
and
3x + 5y + 7z + C = 10 + C
have the same solutions.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Notice:
3x + 5y + 7z = 10
and
3x + 5y + 7z + C = 10 + C
have the same solutions.
By the same logic,
(
3x + 5y + 7z = 10
x +y +z = 15
and (
3x + 5y + 7z = 10
x + y + z + 10 = 15 + 10
have the same solutions.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Notice:
3x + 5y + 7z = 10
and
3x + 5y + 7z + C = 10 + C
have the same solutions.
By the same logic,
(
3x + 5y + 7z = 10
x +y +z = 15
and (
3x + 5y + 7z = 10
x + y + z + 3x + 5y + 7z = 15 + 10
have the same solutions.
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Useful: (
3x + 5y + 7z = 10
−3x − 5y + z = 15
has the same solutions as
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Useful: (
3x + 5y + 7z = 10
−3x − 5y + z = 15
has the same solutions as
(
3x + 5y + 7z = 10
8z = 25
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
Equivalent Equations
and also
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Equivalent Equations
and also (
3x + 9y − 6z =7
3y =4
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
3x − 9y + 6z = 30
−x + 3y + 5z = 4
x + y + z = −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
3x − 9y + 6z = 30
−x + 3y + 5z = 4
x + y + z = −6
1x − 3y + 2z = 10
−x + 3y + 5z = 4
x + y + z = −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
x − 3y + 2z = 10
−x + 3y + 5z = 4
x + y + z = −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
x − 3y + 2z = 10
−x + 3y + 5z = 4
x + y + z = −6
0x − 0y + 7z = 14 (Row1+Row2)
−x + 3y + 5z = 4
x + y + z = −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
7z = 14
−x + 3y + 5z = 4
x + y + z = −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
7z = 14
−x + 3y + 5z = 4
x + y + z = −6
−x + 3y + 5z = 4
x + y + z = −6
7z = 14
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
x − 3y + 2z = 10
−x + 3y + 5z = 4
x + y + z = −6
1 −3 2 10
−1 3 5 4
1 1 1 −6
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Augmented Matrices
1 0 0 0 1
0 1 0 0 5
0 0 1 0 −3
0 0 0 1 2
Solution:
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Augmented Matrices
1 0 0 0 1
0 1 0 0 5
0 0 1 0 −3
0 0 0 1 2
Solution: x1 = 1 x2 = 5 x3 = −3 x4 = 2
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Augmented Matrices
1 0 0 0 1
0 1 0 0 5
0 0 1 0 −3
0 0 0 1 2
Solution: x1 = 1 x2 = 5 x3 = −3 x4 = 2
1 2 3 5
0 1 2 −3
0 0 1 2
Solution:
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
Augmented Matrices
1 0 0 0 1
0 1 0 0 5
0 0 1 0 −3
0 0 0 1 2
Solution: x1 = 1 x2 = 5 x3 = −3 x4 = 2
1 2 3 5
0 1 2 −3
0 0 1 2
Solution: x3 = 2 y = −7 x = 13
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3
1 1 1 7
0 0 −3 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3
1 1 1 7
0 0 −3 0 R3 → − 13 R3
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4
1 1 1 7
0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4
1 1 1 7 R2 → R2 − R1
0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4 0 1 0 −4
1 1 1 7 R2 → R2 − R1 1 0 1 11
0 0 1 0 0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4 0 1 0 −4
1 1 1 7 R2 → R2 − R1 1 0 1 11 R2 → R2 − R3
0 0 1 0 0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4 0 1 0 −4
1 1 1 7 R2 → R2 − R1 1 0 1 11 R2 → R2 − R3
0 0 1 0 0 0 1 0
0 1 0 −4
1 0 0 11
0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4 0 1 0 −4
1 1 1 7 R2 → R2 − R1 1 0 1 11 R2 → R2 − R3
0 0 1 0 0 0 1 0
0 1 0 −4 R1 ↔ R2 1 0 0 11
1 0 0 11 0 1 0 −4
0 0 1 0 0 0 1 0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
1 2 1 3 1 2 1 3 R1 → R 1 − R2
1 1 1 7 1 1 1 7
0 0 −3 0 R3 → − 13 R3 0 0 1 0
0 1 0 −4 0 1 0 −4
1 1 1 7 R2 → R2 − R1 1 0 1 11 R2 → R2 − R3
0 0 1 0 0 0 1 0
0 1 0 −4 R1 ↔ R2 1 0 0 11 x = 11
1 0 0 11 0 1 0 −4 y = −4
0 0 1 0 0 0 1 0 z =0
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems
2x + y + z
=8
x − y − 3z = −5
−x − 2y + z =2
Course Notes 2.6: Introduction to Linear Systems 3.1: Linear Systems