1.

7 Linear
Independence

Linear
Independence

1.7 Linear Independence

Department of Mathematics and Natural Sciences

AURAK

Spring 2017
 1.7 Linear
Independence
Table of contents
Linear
Independence

1 Linear Independence
 1.7 Linear
Independence
Linear Independence
Linear
Independence

Definition: An indexed set of vectors {v1 , v2 , ..., vp } in Rn , is said to be linearly

independent if the vector equation:

x1 v1 + x2 v2 + ... + xp vp = 0

has only the trivial solution.

 1.7 Linear
Independence
Linear Dependence
Linear
Independence

Definition: An indexed set is linearly dependent if and only if it is not linearly

independent.
 1.7 Linear
Independence
Linear Dependence
Linear
Independence

Remark: A set {v1 , v2 , ..., vp } is linearly dependent if there exist weights c1 , ..., cp ,
not all zero, such that:

c1 v1 + c2 v2 + ... + cp vp = 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Example 1:     
1 4 2
Let v1 =  2 , v2 =  5 , v3 =  1 .
3 6 0
1 Determine if the set {v1 , v2 , v3 } is linearly independent.
2 If possible, find a linear dependence relation among v1 , v2 , and v3 .
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution: We need to determine if there is a nontrivial solution of the following

equation:

x1 v1 + x2 v2 + x3 v3 = 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:
       
1 4 2 0
x1 2 + x2 5 + x3 1 = 0 
      
3 6 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution: This is equivalent to the matrix equation Ax = 0, where

   
1 4 2 x1
A= 2 5 1  and x =  x2  .
3 6 0 x3
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution: Row reduce the augmented matrix of the system to reduced echelon
form:  
1 4 2 0
 2 5 1 0 
3 6 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:    
1 4 2 0 1 4 2 0
R2 −2R1 →R2
 2 5 1 0  ∼  0 −3 −3 0 
3 6 0 0 3 6 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:
   
1 4 2 0 1 4 2 0
R3 −3R1 →R3
 0 −3 −3 0  ∼  0 −3 −3 0 
3 6 0 0 0 −6 −6 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:
   
1 4 2 0 1 4 2 0
R3 −2R2 →R3
 0 −3 −3 0  ∼  0 −3 −3 0 
0 −6 −6 0 0 0 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:    
1 4 2 0 − 13 R2 →R2
1 4 2 0
 0 −3 −3 0  ∼  0 1 1 0 
0 0 0 0 0 0 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:    
1 4 2 0 1 0 −2 0
R1 −4R2 →R1
 0 1 1 0  ∼  0 1 1 0 
0 0 0 0 0 0 0 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution:
The matrix  
1 0 −2 0
 0 1 1 0 
0 0 0 0
is in reduced echelon form.
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution: The corresponding system is:

x1 − 2x3 = 0
x2 + x3 = 0
 1.7 Linear
Independence
Linear Dependence and Independence
Linear
Independence

Solution: Solve for the basic variables x1 and x2 to obtain:

x1 = 2x3
x2 = −x3
x3 = free variable
 1.7 Linear
Independence
Solutions of Nonhomogeneous Linear Systems
Linear
Independence

Solution:
• Each nonzero value of x3 determines a nontrivial solution of the equation.
 1.7 Linear
Independence
Solutions of Nonhomogeneous Linear Systems
Linear
Independence

Solution:
• Each nonzero value of x3 determines a nontrivial solution of the equation.
• Hence, v1 , v2 , v3 are linearly dependent.
 1.7 Linear
Independence
Solutions of Nonhomogeneous Linear Systems
Linear
Independence

Solution:
• Choose any nonzero value of x3 , say x3 = 1, we get x1 = 2 and x2 = −1.
 1.7 Linear
Independence
Solutions of Nonhomogeneous Linear Systems
Linear
Independence

Solution:
• Substitute these values into the equation x1 v1 + x2 v2 + x3 v3 = 0, we obtain
linear dependence relations among v1 , v2 , and v3 :

2v1 − v2 + v3 = 0.
 1.7 Linear
Independence
Linear Dependence and Independence of Matrix
Linear
Independence
Columns

Let A be an m × n matrix with columns a1 , a2 , ..., an .

• The matrix equation Ax = 0 can be written as:

x1 a1 + x2 a2 + ... + xn an = 0.
 1.7 Linear
Independence
Linear Dependence and Independence of Matrix
Linear
Independence
Columns

• The columns of the matrix A are linearly independent if and only if the
equation Ax = 0 has only the trivial solution.
 1.7 Linear
Independence
Set of One Vector
Linear
Independence

• A set containing only one vector v is linearly independent if and only if v is not
the zero vector.
 1.7 Linear
Independence
Set of One Vector
Linear
Independence

• Assume that v 6= 0.
 1.7 Linear
Independence
Set of One Vector
Linear
Independence

• Assume that v 6= 0.
• If cv = 0 and c 6= 0, then
 1.7 Linear
Independence
Set of One Vector
Linear
Independence

• Assume that v 6= 0.
• If cv = 0 and c 6= 0, then
• c1 (cv) = c1 0 = 0
 1.7 Linear
Independence
Set of One Vector
Linear
Independence

• Assume that v 6= 0.
• If cv = 0 and c 6= 0, then
• c1 (cv) = c1 0 = 0
• v = 0, a contradiction.
 1.7 Linear
Independence
Zero Vector
Linear
Independence

• The zero vector is linearly dependent because the equation

x1 0 = 0

has many nontrivial solutions.

 1.7 Linear
Independence
Zero Vector
Linear
Independence

• The zero vector is linearly dependent because the equation

x1 0 = 0

has many nontrivial solutions.

• For example, we have (1)0 = 0.
 1.7 Linear
Independence
Set of Two Vectors
Linear
Independence

• A set of two vectors {v1 , v2 } is linearly dependent if one of the vectors is a

multiple of the other.
 1.7 Linear
Independence
Set of Two Vectors
Linear
Independence

• Assume that there exists two weights c1 and c2 not both equal to zero such
that
c1 v1 + c2 v2 = 0
 1.7 Linear
Independence
Set of Two Vectors
Linear
Independence

• Assume that there exists two weights c1 and c2 not both equal to zero such
that
c1 v1 + c2 v2 = 0
• If c1 6= 0, we have
c2
v2 = − v1
c1
 1.7 Linear
Independence
Set of Two Vectors
Linear
Independence

• Assume that there exists two weights c1 and c2 not both equal to zero such
that
c1 v1 + c2 v2 = 0
• If c1 6= 0, we have
c2
v2 = − v1
c1
• If c2 6= 0, we have
c1
v1 = − v2
c2
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Theorem: An indexed set S = {v1 , ..., vp } of p vectors is linearly dependent if and

only if at least one of the vectors in S is a linear combination of the others.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Example2:   
3 1
Let u =  1 , v =  6 .
0 0
1 Show that the set {u, v} is linearly independent.
2 Describe the set spanned by u and v.
3 Show that a vector w is in Span{u, v} if and only if {u, v, w} is linearly
dependent.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
1. Let us show for example that u is not a multiple of v i.e. that the following
equation:
u = tv
has no solution.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: Assume that we have:

u = tv
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:    
3 1
 1 =t 6 
0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:    
3 t
 1  =  6t 
0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: We obtain 
t=3
6t = 1
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: This leads to 

t=3
6(3) = 1
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: 
t=3
⇔
18 = 1
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: Since the second equation is not true, there is no solution to the
equation u = tv.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution: Hence the two vectors are linearly independent.

 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. Since the vectors u and v are linearly independent, they span a plane in R3 .
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. Let’s show that Span{u, v} is the x1 x2 -plane (with equation x3 = 0) in R3 .
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. First notice that every vector w in Span{u, v} is such that w = tu + sv.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. If w = tu + sv, then    
3 1
w = t  1  + s  6 .
0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2.    
3t s
⇒ w =  t  +  6s  .
0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2.  
3t + s
⇒ w =  t + 6s  .
0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. Since the third entry of w is equal to 0, the vector w belongs to the x1 x2 -plane.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:  
x1
2. Now let w =  x2  be an arbitrary vector in the x1 x2 -plane.
0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. To show that w is in Span{u, v}, we need to show that we have for some real
numbers t, s:
w = tu + sv
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. If w = tu + sv, then
     
x1 3 1
 x2  = t  1  + s  6 
0 0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2.    
x1 3t + s
⇒  x2  =  t + 6s  .
0 0
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. 
x1 = 3t + s
⇒
x2 = t + 6s
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2.
6x1 −x2

t= 17
⇒ 3x2 −x1
s= 17
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. Hence we have
6x1 − x2 3x2 − x1
w= u+ v
17 17
which means that w belongs to Span{u, v}.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
2. Conclusion: Span{u, v} is the x1 x2 -plane.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. If w is a linear combination of u and v, then

w = tu + sv

for some real numbers t and s.

 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3.
⇒ tu + sv − w = 0.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. Hence {u, v, w} is linearly dependent.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. Conversely assume that {u, v, w} is linearly dependent.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. Then we have for some x1 , x2 , x3 not all zeros

x1 u + x2 v + x3 w = 0.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. If x3 = 0, then
x1 u + x2 v = 0.
which contradicts the fact that {u, v} is a linearly independent set.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. Therefore x3 6= 0.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. Then we have:
x3 w = −x1 u − x2 v.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3.
x1 x2
⇒w=− u − v.
x3 x3
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Solution:
3. This means that w is a linear combination of the vectors u and v.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Theorem: If a set contains more vectors than there are entries in each vector, then
the set is linearly dependent.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

That is, any set {v1 , ..., vp } in Rn is linearly dependent if p > n.

 1.7 Linear
Independence
Matrix Version
Linear
Independence
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Example 3: Let
       
3 2 3 5
v1 =  1  , v2 =  −3  , v3 =  −2  , v4 =  2  .
−1 4 7 7
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

• The set {v1 , v2 , v3 , v4 } is linearly dependent in R3 since p = 4 > 3 = n.

 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

Theorem: If a set {v1 , ..., vp } in Rn contains the zero vector, then the set is
linearly dependent.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

For example if p = 2, then by renumbering the vectors, we may assume that

v1 = 0.
Then we have:
1v1 + 0v2 = 0.
 1.7 Linear
Independence
Set of Two or More Vectors
Linear
Independence

For p > 2, by renumbering the vectors, we may assume that v1 = 0.

Then we have:
1v1 + 0v2 + ... + 0vp = 0.