Linear Algebra and Applications

EEF281E

Week #5

Linear Algebra and Applications 1

Vector spaces:
Inside 𝑅𝑛 means, any operation (add
A space composed by a set of vectors, multiply with scalar) stays
column vectors with 𝑛 components in 𝑅𝑛 .
is called a 𝑅𝑛 vector space. Considering the conditions above,
we can define special vector spaces
If 𝒗 and 𝝎 are vectors in a vector
other than 𝑅𝑛 , 𝐶 𝑛 as follows:
space 𝑆, any combination c𝒗 + d𝝎
Should be in 𝑆.
𝑍: Zero vector space : Consists only 𝟎.
𝑅1 → space is a line. 𝐹: Vector space of all real functions.

𝑅2 → space is a plane. 𝑀: Vector space of all real 2 × 2

⋮ matrices.

A plane inside 𝑅𝑛 is called a Definition :

subspace. If 𝒗 and 𝝎 are vectors in the
subspace and c is any scalar, the two
A line 𝒍 inside 𝑅2 plane is a requirements below are satisfied.
subspaceof that 𝑅2 plane.

Linear Algebra and Applications 2

 𝒄𝒗 = (−2, −3) is not in the
𝑖) 𝒗 +𝝎 is in this subspace
quarter plane. 𝑖𝑖) is violated.
𝑖𝑖) 𝑐𝒗 or (𝑐𝝎) is in this subspace
The quarter plane is not a
subspace.
EXAMPLE:
Extend the example by considering
Consider a vector 𝑥, 𝑦 whose two quarter planes.
components are positive or zero
for a quarter plane.
Quarter plane

𝒗 = (2,3) can be included.

𝝎 = (−3, −2) can be included.
𝒗 = (2,3) is in the
quarter plane. 𝒗 + 𝝎 = (−1,1) is outside two quarter planes.
𝑖) is violated
Linear Algebra and Applications 3
Two quarter planes do not make Add any two 𝑈 matrices ;
a subspace. result is 𝑈.

Therefore a subspace containing 𝑈 is a subspace of 𝑀.

𝒗 and 𝝎 must contain all linear
combinations c𝒗 + 𝑑𝝎. 𝐷 is a subspace of 𝑀.

𝐷 is also a subspace of 𝑈.
EXAMPLE:

Consider 𝑀 vector space of all 2 × 2

matrices and consider

𝑎 𝑏 𝑎 0
𝑈= ,𝐷 =
0 𝑑 0 𝑑
𝑈𝑝𝑝𝑒𝑟 𝐷𝑖𝑎𝑔𝑜𝑛𝑎𝑙
𝑡𝑟𝑖𝑎𝑛𝑔𝑢𝑙𝑎𝑟 𝑚𝑎𝑡𝑟𝑖𝑐𝑒𝑠

Linear Algebra and Applications 4

Column space of A:
Note: Column space consists all
We try to solve. linear combinations of the columns.
2 4 −2 𝑥 𝑏1 They fill the column space 𝐶 𝐴 .
𝐴𝒙 = 𝒃; 4 9 −3 𝑦 = 𝑏2
−2 −3 7 𝑧 𝑏3
𝐴𝒙 = 𝒃 is solvable
If one produce different 𝑏1 , 𝑏2 , 𝑏3 ⇔ 𝒃 is in the column space of 𝐴.
values corresponding to different
Suppose 𝐴 is 𝑚 × 𝑛 matrix.
𝑥, 𝑦, 𝑧;
This means that 𝐴 has 𝑛 columns
then one obtains the column space And these columns have 𝑚
of 𝐴, 𝐶 𝐴 . components.
We also write ;
Therefore, 𝐶 𝐴 is a subspace of 𝑅𝑚 .
2 4 −2 𝑏1
𝑥 4 + 𝑦 9 + 𝑧 −3 = 𝑏2
−2 −3 7 𝑏3
Linear Algebra and Applications 5
EXAMPLE:

𝐶 𝐴 is a spanned by a set of
1 0 𝑥 1 0 1 0
1
𝐴𝒙 = 4 3 𝑥 = 𝑥1 4 + 𝑥2 3 vectors 4 , 3 .
2
2 3 2 3 2 3

All combinations constitute a

plane in 𝑅 3 . Columns of 𝐴 span the column
space 𝐶 𝐴 .

Linear Algebra and Applications 6

EXAMPLE:
Next,

Describe the column spaces for 1 2 𝑥1 1 2

𝐴𝒙 = = 𝑥 + 𝑥
1 0 1 2 2 4 𝑥2 1
2 2
4
𝐼= and 𝐴 = .
0 1 2 4
Second column is a multiplier of the first
𝑥1 column.
1 0
𝑥1 + 𝑥2 = 𝑥
0 1 2 1 1 1
𝑥1 + 2𝑥2 = (𝑥1 + 2𝑥2 )
2 2 2
𝑐
The column space of 𝐼 is the 𝑐
whole 𝑅2 . Therefore the column space 𝐶 𝐴 contains
2𝑐
.
Every vector is a combination of This is a line.
the columns of 𝐼.
Therefore 𝐴𝒙 = 𝒃 is solvable ⇔ 𝒃 is on that line.

Linear Algebra and Applications 7

 −3𝑅1 +𝑅2 1 2
Nullspace of A: 𝐴 , 𝐴𝒙 = 0
0 0
(Solving 𝐴𝒙 = 0, 𝑅𝒙 = 0)
1 2 𝑥1 0 We have only one
=
Nullspace 𝑁(𝐴) consists of all 0 0 𝑥2 0 equation.
solutions to 𝐴𝒙 = 0.
𝑥1 + 2𝑥2 = 0 𝑥1 = −2𝑥2
These vectors 𝒙 with 𝑛 components
are in 𝑅𝑛 .
−2𝑥2 −2𝑥
𝒙= ≡ Take 𝑥=1,
𝑵(𝑨) is a subspace of 𝑹𝒏 . 𝑥2 𝑥

EXAMPLE: −2
𝒙= (Special solution)
1
1 2
Describe the nullspace of 𝐴 =
3 6 The Nullspace of 𝐴 consists of all
combinations of the special solutions to
Note that this is a singular matrix. 𝐴𝒙 = 0.
EXAMPLE: NOTE: The free components
1 2 correspond to columns with no pivots.
Describe the nullspace of 𝐴 =
3 8
EXAMPLE:
−3𝑅1 +𝑅2 1 2 Describe the nullspace of
𝐴
0 2
𝑥1 + 2𝑥2 = 0 No special
2𝑥2 = 0 solutions.

Only solution is 𝑥1 = 𝑥2 = 0
So the Nullspace is Z.

Linear Algebra and Applications 9

 EXAMPLE: Consider again,

𝑥1 𝑥1 −2𝑥3 −2 0
1 0 2 0 𝑥2 0 𝑥2 −2𝑥4 = 𝑥 0 + 𝑥 −2
𝑥 = =
0 1 0 2 3 0 𝑥3 𝑥3 3 1 4 0
𝑥4
𝑥4 𝑥4 0 1
𝑥1 + 2𝑥3 = 0
𝑥2 + 2𝑥4 = 0
Linear combinations
𝑥1 = −2𝑥3 with 𝑥3 and 𝑥4 fill the
𝑥2 = −2𝑥4 nullspace of C.

Linear Algebra and Applications 11