Professional Documents
Culture Documents
Week 3-4, 5-8cahpter I. Linear Algebrasolving Systems of Linear Equations Linear Algebra 1
Week 3-4, 5-8cahpter I. Linear Algebrasolving Systems of Linear Equations Linear Algebra 1
Week 3-4, 5-8cahpter I. Linear Algebrasolving Systems of Linear Equations Linear Algebra 1
OPERATION ON MATRICES
Lesson 1.1 Sum and Difference of Matrices
Lesson Objectives: At the end of the lesson the students should be able to;
Classify the types of Matrices
Calculate some simple operations such as addition, and subtraction of Two Matrices
Reading:
Meaning of Matrices
A matrix is a rectangular arrangement of numbers, objects, variables or parameters carefully placed
within the matrix. The objects in a matrix are called elements which can be arranged into rows and/
columns
a11 a12 a 13
[
A¿ a 21 a22 a 23
a31 a32 a 33 ]
The matrix above is a 3 by 3 matrix, the elements are as shown in rows and columns in the matrix above.
Types of Matrices
Row matrix
is a matrix consisting of one row with dimensions 1 x n
A = [ a11 a 12 a13 ]
A Column matrix
is a matrix consisting of one column with dimensions m x 1
a11
Zero matrix
[]
A = a21
a31
0 0 0
[ ]
A= 0 0 0
0 0 0
Diagonal matrix
a matrix that has element zero everywhere except in the leading or principal diagonal
2 0 0
[ ]
A= 0 3 0
0 0 4
Identity matrix
1 0 0
[ ]
A= 0 1 0
0 0 1
Example:
add the following matrices:
1. A= [ 09 1 2
8 7
, B=]6 5 4
3 4 5 [ ]
I need to add the pairs of entries, and then simplify for the final answer:
A +B= [ 09 18 27] + [ 63 54 45 ]
0+6 1+5 2+ 4
=[
9+3 8+ 4 7+5 ]
So the answer is:
= [ 126 6 6
12 12 ]
4 −3 1 −1 2 3
2. Add the matrices: A = ⌈ 0 5 −2 ⌉ and B= ⌈ 6 −7 9 ⌉
5 −6 0 0 −4 8
4 −3 1 −1 2 3
solution: A+ B = ⌈ 0 5 −2 ⌉ + ⌈ 6 −7 9 ⌉
5 −6 0 0 −4 8
3 −1 4
= ⌈ 6 −2 7 ⌉ answer
5 −10 8
−4 −5 ⌉ −4 2⌉
3. Find the sum of A and B given: A = ⌈ and B = ⌈
1 −3 −3 4
Solution:
−4 −5 −4 2
A + B =⌈ ⌉+ ⌈ ⌉
1 −3 −3 4
−4 +(−4) −5+2
= ⌈ ⌉
1+(−3) −3+( 4)
[
A= 14 12 10
4 −2 2 ] and
[
B = 0 −12 −4
−5 2 −2 ]
2 −10 −2 6 10 −2
Solution: A+ B =
[ 14 12 10
4 −2 2 ] [
+ 0 −12 −4
−5 2 −2 ]
2+ 6 −10+10 −2+(−2)
=
[ 14 +0 12+(−12) 10+(−4)
4+(−5) −2+2 2+(−2) ]
8 0 −4
=
[ 14 0 6
−1 0 0 ]
SUBTRACTING MATRIX A AND MATRIX B
4 −3 1 −1 2 3
5. Subtract the matrices: A = 0 5 −2 and B= 6 −7 9 ⌉
⌈ ⌉ ⌈
5 −6 0 0 −4 8
4 −3 1 −1 2 3
solution: A −¿B = ⌈ 0 5 −2 ⌉ −⌈ 6 −7 9 ⌉
5 −6 0 0 −4 8
5 −5 −2
= ⌈ −6 12 −11 ⌉ answer
5 −2 −8
−4 −5 ⌉ −4 2⌉
6. Find the difference of A and B given: A = ⌈ and B = ⌈
1 −3 −3 4
Solution:
−4 −5 −4 2
A −¿ B =⌈ ⌉ −¿ ⌈ ⌉
1 −3 −3 4
[
A= 14 12 10
4 −2 2 ] and B = 0 −12 −4
−5 2 −2 [ ]
2 −10 −2 6 10 −2
Solution: A −¿ B =
[ 14 12 10
4 −2 2 ] [
−¿
]
0
−5
−12
2
−4
−2
References:
Sterling, M.J. (2009)., Linear Algebra for Dummies, 111 River St, Wiley Publishing
Hefferon, J., Elementary Linear Algebra with applications, (Fourth Edition)
Strang, G., Linear Algebra and Its Application, (Fourth Edition)
1 2 3
3
1. ⌈ ⌉
4
2. ⌈
a b⌉
7 12 [ ]
3. 2 4 5
3 5 6
0 0 1 1 0 0
[ ]
4. 1 0 0
0 1 0 [ ]
5. 2 4 0
3 5 6
−2 2 0 −1 2
1. If A = [−11 −3 4 ]
and B = [
3 0 1 ]
,then find the sum and difference of A and B
1 0 2 0 −1 0 2 3 1
[ ] [ ] [
2. if A = 0 2 3 , B = −2 0 3 and C = 0 0 −3 find A + B + C.
1 0 0 0 1 2 1 1 −1 ]
LINEAR ALGEBRA Prepared by: SHELA M. RAMOS
1st Semester, S.Y. 2020-2021
Bachelor of Secondary Education
Instructor 2
5 −3 1 0
3. if A ⌈ ⌉ + A=⌈ ⌉ , find the matrix A
2 4 0 1
2 3 ⌉ ⌈ −2 1 ⌉=⌈ 0 4 ⌉
4. if ⌈ + find the value of x.
−5 4 x 3 −3 9
5 4 3 2 3 4
[
5. Let A = 7 8
] [
9 and B = 4 −5 6 find A – B
3 12 −5 0 7 8 ]
OPERATION ON MATRICES
Readings:
−1 2 3 −1 2 3
[
A= 6 −7 9
0 −4 8 ] [
(-1)A= −1 6 −7 9
0 −4 8 ]
1 −2 −3
[
= −6 7 −9
0 4 −8 ]
Matrix product
The method of multiplication of matrices is not as intuitive and may seem strange, although this
method is extremely useful in many mathematical applications.
Matrix multiplication was introduced by an English mathematician named Arthur Cayley
(1821-1895) . We will see shortly how matrix multiplication can be used to solve systems of linear
equations.
15 [ ][ ]
1. 0 2 x 0 2 = NO
15 [ ][
3. 2 π x
31
0 0 1
2 4 3 ]
= Yes
1 0 2
2.
2 1
[ ] [ ]
0 0
x
2x2
3 5
4 2
= yes
2x2
[ ][
4. 3 1 4 x
5 7 2
3x3
0 1
2 7
= No
2x2
]
More examples:
1 6
A=
3 1 −1
[
2 0 3 ] [ ]
B = 3 −5
−2 4
Find AB if it is defined:
1 6
[ 3 1 −1
2 0 3 ][ 3 −5
−2 4 ]
Is Matrix Multiplication Commutative?
Now we will attempt to multiply the matrices in reverse order:
1 6
BA = 3 −5
−2 4 [ [] 32 1 −1
0 3 ]
Now we are multiplying a 3 x 2 matrix by a 2 x 3 matrix. This matrix multiplication is defined but
the result will be a 3 x 3 matrix. Since AB does not equal BA, matrix multiplication is not
commutative.
15 1 17
BA= −1 3 −18
2 −2 14[ ]
Example:
a. Find AB
2 3
4 0 5 [
∧B= −4 0
2 3
] [ ]
b. Find BA
Soluiton:
5 −1
a. AB = [ −1 2 3 x
4 0 5
−4 0
2 3
][ ]
−1 ( 5 )+ 2 (−4 ) +3(2) −1 (−1 ) +2 ( 0 ) +3(3)
= [ 4 ( 5 )+ 0 (−4 )+5 ( 2 ) 4 (−1 )+ 0 ( 0 ) +5(3) ]
1+ 9
= [ −5+ (−8 )+6
20+10 −4+15 ]
LINEAR ALGEBRA Prepared by: SHELA M. RAMOS
1st Semester, S.Y. 2020-2021
Bachelor of Secondary Education
Instructor 2
= [−730 1011 ]
5 −1
b. BA = −4
2
0 x
3 [ ][
−1 2 3
4 0 5 ]
5 (−1 )±1(4 ) 5 ( 2 )±1( 0) 5 ( 3 )±1(5)
=
[ 2 (−1 )+3 (4) 2 ( 2 ) +3(0) 2 ( 3 ) +3(5)]
−4 (−1 )+ 0 ( 4 ) −4 ( 2 )+ 0(0) −4 ( 3 ) +0 (5)
−5+−4 10 15+−5
= 4
[ −8 −12
−2+12 4 6+ 15 ]
−9 10 10
[
= 4 −8 −12
10 4 21 ]
Practical application
Suppose you a business owner and sell clothing. The following represents the number of items sold
and the cost for each item: Use matrix operations to determine the total revenue over the two days:
Monday: 3 T-shirts at Ᵽ10 each, 4 hats at Ᵽ 15 each, and 1 pair of shorts at Ᵽ 20.
Tuesday: 4 T-shirts at Ᵽ 10 each, 2 hats at Ᵽ 15 each, and 3 pairs of shorts at Ᵽ 20.
[]
[ 10 15 20 ] 4 2
13
Then your total revenue for the two days is =[110 130] Price Quantity=Revenue
References:
Sterling, M.J. (2009)., Linear Algebra for Dummies, 111 River St, Wiley Publishing
Hefferon, J., Elementary Linear Algebra with applications, (Fourth Edition)
Strang, G., Linear Algebra and Its Application, (Fourth Edition)
2. -2B 4. -4 C
Solution: Solution:
4 10 2 −3 12
A=
−1 5
[
3 2
,B=
3 6 4
] [
−8 0 12
, C= −2
59
6 ] [ ] [
, D= 9 3 1
0 8 −10 ]
1. AB
2. BC
3. CA
4. BD
5. DC
Chapter III
Determinants of Matrix
Reading
Determinants- The determinant is defined as a scalar value which is associated with the square matrix. If X
is a matrix, then the determinant of a matrix is represented by |X| or det (X).
We obtain this value by multiplying and adding its elements in a special way.
The determinant of a square matrix A is the integer obtained through a range of methods using the elements
of the matrix.
The determinant of a matrix is a special number that can be calculated from a square matrix.
Example:
First of all the matrix must be square (i.e. have the same number of rows as columns). Then it is just basic
arithmetic:
|A| = ad − bc
"The determinant of A equals a times d minus b times c"
Example:
1. B = [ 43 68] 2. A = [ 14 22]
Solution: Solution:
= 32 – 18 = 2-8
= 14 = -6
2 −3 1
|
Example 1. 2 0 −1
1 4 5 |
Applying the formula:
a b c
| |
det d e f = a∙ det
g h i
e f
h i
−b ∙det
d f
| |
g i
+ c ∙det
d e
g h| | | |
2 −3 1
|
Solution: det 2 0 −1 = 2 ∙det
1 4 5
4 5|
0 −1
-(-3)det
2 −1
|
1 5 |
+ 1∙det
2 0
1 4 | | | |
= 2 [ 0−(−4 ) ]+ 3 [ 10−(−1) ]+ 1 [ 8−0 ]
= 2(0+4)+3(10+1)+1(8)
= 2(4)+3(11)+8
= 8+33+8
6 1 1
|
= 49 2. C= 4 −2 5
2 8 7 |
Solution:
|C|= 6 × (−2 × 7 – 5× 8) – 1 × (4 × 7 – 5 × 2) + 1×(4 × 8 – (−2 × 2))
= 6 × (−54) – 1 × (18) + 1 × (36)
2|
3. −3 −1 −3
3 1 |
Solution: = 1 ∙det |13 −31 |-(-3)det|−32 −31 |+ 1∙det|−32 −13 |
= 1 [ −1−(−9) ]- 3 [ −3−(−6) ] + 2 [ −9− (−2 ) ]
= 1(-1+9) -3 (-3+6) + 2(-9+2)
= 1(8)-3(3)+2(-7)
= 8-9-14
= -15
Properties of Determinants
1. Propery 1. Interchanging rows with columns
¿B ¿=¿ A∨¿
a1 a2 a3 a1 b1 c 1
| || |
b 1 b2 b3 = a2 b2 c 2
c1 c 2 c 3 a 3 b3 c 3
2. Proeperty 2: Interchanging any two rows/ columns, the sign of the determinant is changed but its
absolute value is unchanged ¿B ¿=−¿ A∨¿
a1 b 1 c 1
| |
| A|= a2 b 2 c 2
a3 b 3 c 3
consider the determinant ,
a2 b2 c 2
| |
|B|=¿ a1 b1 c 1
a 3 b3 c 3
expand by second row,
|B|= -a 1(b 2 c 3−b 3 c2) +b 1(a 2 c 3−a3 c2)−c 1(a 2 b3 −a3 b2)
¿−¿ ¿(b 2 c 3−b 3 c2) - b 1(a 2 c 3−a3 c2) + c 1(a 2 b3 −a3 b2))
The term in the bracket is same as the equation (2)
a 1 b1 c 1
| |
So |B|=− a 2 b2 c 2 or |B|=¿ −| A|
a 3 b3 c 3
3. Property 3: If every element of a row or column of a determinant is zero, the value of the determinant
is zero. For example:
0 0 0
|
| A|=¿ a2 b2 c 2
a 3 b3 c 3 |
= 0(b 2 c 3−b 3 c2) −¿0(a 2 c 3−a3 c2)+0(a 2 b3 −a3 b3)
| |
| A| = a2 b2 c 2
a 3 b3 c 3
ka1 kb 1 k c 1
|
Consider a determinant , | A| = a2 b2 c 2
a3 b3 c 3 |
|B|=¿ k a 1(b 2 c 3−b 3 c2)−¿ kb 1(a 2 c 3−a3 c2)+ kc1(a 2 b3 −a3 b2)
= k(a 1 ¿ ¿)−¿ b 1(a 2 c 3−a3 c2)+c 1(a 2 b3 −a3 b2))
a1 b 1 c 1
k
| |
So |B| = a2 b 2 c 2
a3 b 3 c 3
Or |B| = K | A|
5. If two rows or columns of a determinant are identical, the value of the determinant is zero.
a1 b1 c 1
| |
| A| = a1 b1 c 1
a 3 b3 c 3
| A| = 0
6. The value of a determinant is not changed if each element of any row or of any column is added to
(or subtracted from) a constant multiple of the corresponding element of another row or column. For
example, if
a1 b1 c 1
| |
| A| = a1 b1 c 1
a 3 b3 c 3
Consider a matrix,
|B|= ¿
= ¿ ¿)−¿ ¿(a 2 c 3−a3 c2)+(c 1+ kc 2)(a 2 b3 −a3 b2)
| |
= a2 b2 c 2 + k(0) because row 1st and 2nd are identical
a 3 b3 c 3
|B| = | A|
7. The determinant of a diagonal matrix is equal to the product of its diagonal elements.
2 0 0
|
| A|= 0 −5 0
0 0 3 |
= 2(-15-0) - (0-0) + 0(0-0)
= 30, which is the product of diagonal elements.
= 2(-5)3 = -30
8. The determinant of a matrix is equal to the determinant of its transpose.
9. The determinant of the product of two square matrices is equal to the product of the determinants of
the given matrices.
Determinants; Cofactor Expansion
Determinants of 2×2 and 3×3 Matrices
2×2 determinant
3 x 3 determinant
Elementary product: a product containing one entry from each row and one entry from each column.
In formula (4) each elementary product is of the form
where the blank contain some permutation of the column indices {1, 2, 3}.
Signed elementary product
The sign can be determined by counting the minimum number of interchanges in the permutation of the
column indices required to put those indices into their natural order: the sign is + if the number is even and –
if it is odd.
Determinants of Matrices with Rows or Columns That Have All Zeros
Theorem 4.1.2. If A is a square matrix with a row or a column of zeros, then det(A) = 0
Example:
Cramer’s Rule
Adjoint of A matrix
If A is and n x n matrix and Cij is the factor of aij, then the matrix
[
C = C 21 C 22 … … . C2 n
Cn 1 C n 2 … …. C nn ]
Is called the matrix of cofactors from A. the transpose of this matrix is called the adjoint (or sometimes the
adjugate) of A and its denoted by adj(A)
Theorem 4.3.1. if the entries in any row (column) of a square matrix are multiplied by the cofactors of the
corresponding entries in a different row(column), then the sum of the product is zer0.
a11 a12 a 13
[
A¿ a 21 a22 a 23
a31 a32 a 33 ]
If we multiply the entries in the first row by the corresponding cofactors from the third row, then the sum is
a 11 C 31+a 12 C32+a 13 C33
Let’s consider a matrix A’ that results when the third row of A is replaced by a duplicate of the first row
Cramer’s Rule
Not all systems have a definite solution. If the determinant of the coefficient matrix is zero, a
solution cannot be found using Cramer’s Rule because of division by zero.
When the solution cannot be determined, one of two conditions exists:
The planes graphed by each equation are parallel and there are no solutions.
The three planes share one line (like three pages of a book share the same spine) or represent
the same plane, in which case there are infinite solutions
Evaluating a 3x3 Determinant
Expanding by Minors (little 2x2 determinants)
a1 b1 c1
b c2 a c2 a b2
|a 2 b2 c 2 |=a1| 2 |−b1| 2 |+c 1| 2 |
b3 c3 a3 c3 a3 b3
a3 b3 c3
1 3 −2
0 3 2 3 2 0
|2 0 3 |=( 1 )| |−( 3 )| |+(−2 )| |
2 3 1 3 1 2
1 2 3
=( 1 )(−6 ) −( 3 )( 3 ) +( −2 )( 4 )
=−6 −9 −8 = −23
Using Cramer’s Rule
to Solve a System of Three Equations
2 x1 4 x2 5 x3 36
3 x1 5 x2 7 x3 7
5 x1 3 x2 8 x3 31
A x B
where
2 4 5
A
3 5 7
5 3 8
2 36 5
D2 3 7 7 1008
5 31 8
2 4 36
D3 3 5 7 1344
5 3 31
D1 672
x1 2
D 336
D2 1008
x2 3
D 336
D3 1344
x3 4
D 336
Example 1
9 2 1
5 2 2
2 1 4 23
x 1
3 2 1 23
1 2 2
1 1 4
3 9 1
1 5 2
1 2 4 69
y 3
3 2 1 23
1 2 2
1 1 4
2. Expand across along the first row:
References:
Sterling, M.J. (2009)., Linear Algebra for Dummies, 111 River St, Wiley Publishing
Hefferon, J., Elementary Linear Algebra with applications, (Fourth Edition)
Strang, G., Linear Algebra and Its Application, (Fourth Edition)
http://www.authorstream.com/Presentation/joshsmith1110-162211-determinants-math-ppt-shella-
paglinawan-education-powerpoint/
2 −6 4 1 −3 2
2.
|1 6 3 | |
3 5 −2 = 2 3 5 −2
1 6 3 |
Answer: ______________________________________________
1 3 −4 1 3 −4
3.
| ||
2 0 −3 = 0 −6 5
5 −4 7 5 −4 7 |
Answer: ______________________________________________
1 2 3 1 2 3
4.
| ||
0 5 −4 = 0 5 −4
3 7 4 0 1 −5 |
Answer: ______________________________________________
1 5 −3
2.
| |
3 −3 3 = __________________________________________________________
2 13 −7
2 3 0
3.
| |
1 3 4 = __________________________________________________________
1 2 1
5 0 −1
4.
|
1 −3 −2
0 5 3 | = __________________________________________________________
1 −2 3
|
1. 6
|
7 −1 = __________________________________________________________
−3 1 4
−4 1 3
|
2. 3
|
0 −3 = __________________________________________________________
2 −2 3
1 1 4
| |
3. 0 −1 2 = __________________________________________________________
2 3 0
Chapter IV
Real Vector Spaces
Lesson Objectives: at the end of the lesson the students must be able to;
Determine if the given vector u is in the span of the vectors in W
Identify linear independence of vectors
Compute ithe components of the vector v with respect to the given orthonormal basis
Find the expressions using Inner Product Space (IPS)
Readings:
Vector Spaces
A space in which the elements are sets of numbers themselves
Is a collection , V, of vectors and two operations, ±, such that the following hold for u, v,w∈ V and
c, d ∈ R
Many concepts concerning vectors in Rn can be extended to other mathematical systems.
We can think of a vector space in general, as a collection of objects that behave as vectors do in Rn . The
objects of such a set are calle vectors.
A vector space is a nonempty set V of objects, called vectors, on which are defined two operations,
called addition and multiplication by scalars (real numbers), subject to the ten axioms below. The
axioms must hold for all u, v and w in V and for all scalars c and d
1. u + v is in V. closure under addition
2. u + v = v + u. commutative
3. (u + v) + w = u + (v +w) associative
4. there is a vector (called the zero vector) 0 in V such that u + 0 = u.(o exists in V, ie u+0 = u
Additive inverse
5. For each u in V, there is vector – u in V satisfying u + (-u) = 0
Inverse
6. c u is in V. closure under scalar multiplication
7. c (u+v) = cu +cv distributive
8. (c +d)u = cu +du distributive
9. (cd) u = c(du)
Example
a b
Let M 2× 2 = : a , b , c , d are real
c d
In this context, note that the 0 vector is
.
Example
Let n ≥ 0 be an integer and let
p ( t )= a 0 + a 1 t + a 2 t 2 + ··· + an t n
Rn has been based on the two basic vector operations, namely, vector addition and scalar
multiplication. For instance, the notion of a linear combination of vectors,
We will just verify 3 out of the 10 axioms here.
uses these two operations. And so do all of the definitions involving linear combinations, such as
span, linear independence, basis, and coordinate vector. Even the idea of a linear function
is based on these two operations:
here are sets besides Rn that also have naturally defined addition and scalar multiplication. For example, the
set M2x3 of 2 × 3 matrices:
Both Rn and M2×3 are “vector spaces.” A vector space is a set having an addition and a scalar multiplication
that satisfy some properties. In this section, we study vector spaces in general. This allows for efficiency in
that we can apply anything we learn about a general vector space to any particular vector space that we
encounter.
Vectors in Rn
u
w
Geometric representation:
x In:
Geometric representation:
2x
Some Operations:
Vector addition:
x+y
y
x
x
Vector Norm:
The length or the norm of the vector is the positive real number given
Definition of subspace:
W is called a subspace of a real vector space V if
1. W is a subset of the vector space V.
2. W is a vector space with respect to the operations in V.
Important Result:
W is a subspace of a real vector space V
1. If u and v are any vectors in W, then u v W .
Example:
a
0 , a R
0 ,
together with standard addition and scalar multiplication. Is W1 a subspace of R ?
3
We need to check if the conditions (1) and (2) are satisfied. Let
a1 a 2
u 0 , v 0 , c R
0 0
.
Then,
(1):
a1 a 2 a1 a 2
u v 0 0 0 W1
0 0 0
.
(2):
ca1
cu 0 W1
0
.
Example:
Let the real vector space V be the set consisting of all n n matrices together with the standard addition and
scalar multiplication. Let
W2 the subset of V consisting of all n n diagonal matrices.
Is W2 a subspace of V?
Let
a11 0 0 b11 0 0
0 a22 0 0 b22 0
u W2 v W2
0 0 a nn
, 0 0 bnn
, and c R .
(1):
a11 b11 0 0
0 a 22 b22 0
uv W2
0 0 a nn bnn
since u v is still a diagonal matrix.
(2):
ca11 0 0
0 ca 22 0
cu W2
0 0 ca nn
since cu is still a diagonal matrix.
W2 is a subspace of V.
Example:.
Pn
the set consisting of all polynomials of degree n or less with the form together with standard
polynomial addition and scalar multiplication. Pn is a vector space. P the set consisting of all
polynomials with the form together with standard polynomial addition and scalar multiplication. Then, P is
also a vector space. Then, Pn is a subspace of P .
Example:
V4 the set consisting of all real-valued continuous functions defined on the entire real line together with
Example:
W3 3
the subset of R consisting of all vectors of the form,
a
a 2 , a, b R
b ,
together with standard addition and scalar multiplication. Is W3 a subspace of R ?
3
Let
a1 a2
u a12 , v a22 , c R
b1 b2
.
Then,
(1):
a1 a2 a1 a2 a1 a2
u v a12 a22 a12 a22 a1 a2 W3
2
b1 b2 b1 b2 b1 b2
.
Therefore,
u v W3 .
W3 is not a subspace of R 3 .
Example:
V3
the set consisting of all polynomials of degree 2 or less with the form together with standard
polynomial addition and scalar multiplication. V3 is a vector space. Let
W4 the subset of V3 consisting of all polynomials of the form
ax 2 bx c, a b c 2 .
Is W4 a subspace of V3 ?
Let
Linear Independence
S v1 , v2 , , vk span ( S ) W
Let and . Is it possible to find a smaller (or even smallest) set,
for example,
S
v1 , v2 , , vk 1 , such that
span ( S ) W span ( S ) ?
To answer this question, we need to introduce the concept of linear independence and linear
dependence.
c v c v c v 0
1. Form equation 1 1 2 2 k k , which lead to a homogeneous system.
2. If the homogeneous system has only the trivial solution, then the given vectors are linearly
independent; if it has a nontrivial solution, then the vectors are linearly dependent.
Example:
[solution:]
1 0 0 1 0 0 c1
c1e1 c 2 e2 c3 e3 c1 0 c 2 1 c3 0 0 1 0 c 2 0
0 0 1 0 0 1 c3
c1 0
c 2
0
c
3
0 .
Therefore, e1 , e 2 and e3 are linearly independent.
Example:
1 2 8
v1 2, v2 1 , v3 6 .
3 1 10
. Are v1 , v 2 and v3 linearly independent?
[solution:]
1 2 8 1 2 8 c1
c1v1 c 2 v2 c3 v3 c1 2 c 2 1 c3 6 2 1 6 c 2 0
3 1 10 3 1 10 c3
c1 4
c2 t 2 , t R
c3
1
.
Therefore, v1 , v 2 and v3 are linearly dependent.
Example:
Determine whether the following set of vectors in the vector space consisting of all 2 2 matrices is linearly
independent or linearly dependent.
2 1 3 0 1 0
S v1 , v 2 , v3 , 2 1 , 2 0
0 1 .
[solution:]
Example:
Determine whether the following set of vectors in the vector space consisting of all polynomials of degree
n is linearly independent or linearly dependent.
S v1 , v2 , v3 x 2 x 2, 2 x 2 x, 3x 2 2 x 2 .
[solution:]
c1v1 c2 v2 c3 v3 c1 x 2 x 2 c2 2 x 2 x c3 3x 2 2 x 2 0 .
Thus,
c1 2c 2 3c3 0 1 2 3 0
c1 c 2 2c3 0 c1 1 c 2 1 c3 2 0
2c1 2c3 0 2 0 2 0
.
The associated homogeneous system is
1 2 3 c1 0
1 1 2 c 2 0
2 0 2 c 3 0
.
Note:
1 2 8
v1 2, v2 1 , v3 6 ,
3 1 10
In the examples with or with
2 2 2
S v1 , v2 , v3 x x 2, 2 x x, 3x 2 x 2 , v1 , v 2 and v3 are linearly dependent. Observe
that v3 in both examples are linear combinations of v1 , v 2 ,
8 1 2
v3 6 4 2 2 1 4v3 2v 2
10 3 1
and
v3 3x 2 2 x 2 x 2 x 2 2 x 2 x v1 v 2 .
As a matter of fact, we have the following general result.
Important result:
Note:
v , v , , vk are k vectors in
Every set of vectors containing the zero vector is linearly dependent. That is, 1 2
vi v , v , , vk are linearly dependent.
any vector space and is the zero vector, then 1 2
Characterizations of a Basis
Let S={v 1 , v 2 , … , v k } be a set of vectors in a vector space V. The
following statements are equivalent.
1) S is a basis for V.
2 ¿ S is a minimal spanning set for V.
3) S is a maximal linearly independent subset of V.
Example 1. The vectors e 1=( 1, 0) end e 2=(0 ,1) form a basis for R2, because
a). if a=(a1 ,a 2) is any vector from R2 , then a=( a 1 , a2 ) =a1 ( 1, 0 ) + a2 ( 0 , 1 )=a1 e1 +a2 e 2 . That means that
any vector from R2is linear combination of the vectors e 1 and e 2.
The vectors e 1=( 1, 0,0) , e 2=(0 ,1,0) , e 3=( 0 , 0,1 ) form a basis for R3 .
In general
e 1=( 1 , 0,0 , …0 ) ,
e 2=( 0 , 1,0 , … 0 )
Each of these sets of vectors is called the natural basis or standard basis for R2 , R3 , Rn respectively.
Example 2. LetV =P n be the set of all polynomials of degree ≤ n together with zero polynomial.
The set of vectors {1 , t , t 2 , … , t n } forms a basis for the vector space Pn called the natural basis for Pn .
Example 3. Show that the set S={v 1 , v 2 , v 3 } where v1 =( 1,0,1 ) , v 2 =( 0,1,0 ) , v 1=( 1,2,0 ) is a basis for R3 .
x 1 + x 3=a 1
{ x2 +2 x 3=a2
x 1=a3
b). Let y 1 v 1 + y 2 v 2+ y3 v3 =0= ( 0 ,0,0 ). Then we obtain the linear system of equations
y 1+ y 3 =0
{ y 2+ 2 y 3=0 .
y1 =0
Theorem 1. If S={v 1 , v 2 , … , v n } is basis for vector space V , then every vector in V can be written in
one and only one way as a linear combination of vectors in S .
Theorem 2. If S={v 1 , v 2 , … , v n } and T ={w1 , w2 , … , wk } is basis for vector space V , then m=n.
Definition (Dimension)
2. dim R3=3, because the three unit vectors { (1 , 0,0) , (0 , 1,0) , ( 0 , 0,1 ) } form a basis for R3.
Example 5. The dimension of P2 is 3, because vectors {1 , t , t 2 } form a basis for P2. dim P3 = 4, because
vectors {1 , t , t 2 , t 3 } form a basis for P3, in general
Example 6. The dimension of M 23 , the vector space of all 2× 3 size matrices, is 6 because its elements
1 0 0 0 1 0 0 0 1 0 0 0 0 0 0 0 0 0
v1 = (
0 0 0 )
, v 2=
0 0 0( , v3 = )
0 0 0 (
, v 4=
1 0 0 ) (
, v5 = )
0 1 0 (, v 6= )
0 0 1 (
form a )
basis for this vector space. Indeed this system of elements is linear independent: If
c 1 v 1+ c 2 v 2+ c3 v3 + c 4 v 4 +c 5 v 5 +c 6 v 6 =0 then
c 1 c 2 c3
(
c 1 v 1+ c 2 v 2+ c3 v3 + c 4 v 4 +c 5 v 5 +c 6 v 6 =
c 4 c 5 c6).
a1 a2 a3
Every element A= ( a4 a5 a6 )
of M 23 is a linear combination of the system:
a1 a2 a3
( a4 a5 a6 )
=a1 v 1 +a2 v 2 +a 3 v3 + a4 v 4 +a5 v 5 +a 6 v 6.
If S=( v ¿ ¿1 , v 2 , … , v n )¿ is an ordered basis for the n dimensional vector space V , then every vector u
in V can be uniquely expressed in the form
u=c 1 v 1+ c2 v 2 +…+ c n v n
c1
[]
We will refer to [ u ] S = c 2⋮ as the coordinate vector of u with respect to the ordered basis S . The entries of
cn
[ u ] S are called the coordinates of u with respect to S . Now the equality
u=c 1 v 1+ c2 v 2 +…+ c n v n
c1
the product of matrix S=( v ¿ ¿1 , v 2 , … , v n )¿ with the matrix [ u ] S = c 2⋮ .
[]
cn
c 1=1
{ c 1+ c 2=2
1
[]
Thus [ u ] S = .
1
where ū , v̄ ∈W
Show that W is IPS
answer : let ū , v̄ , w̄ ∈W
¿ ū , v̄≥¿ 2u1v1 + u2v2 + 3u3v3
= 2 v1u1 + v2u2+ 3v3u3
¿< v̄ , ū> ¿(simetry)
Example :
< u – 2v, 3u + 4v >
= < u, 3u + 4v > - < 2v, 3u + 4v = < u, 3u > + <
= < u, 3u > + < u, 4v > - < 2v, 3u > - < 2v, 4v >
= 3 < u, u > + 4 < u, v > - 6 < v, u > - 8 < v, v >
= 3 ||u||2 + 4 < u, v > - 6 < u, v > - 8 ||v||2
= 3 ||u||2 - 2 < u, v > - 8 ||v||2
Orthonormal Set
A Set in the inner product space is called orthogonal set
IF every couple of vectors on the set is orthogonal.
Orthonormal set orthogonal set which each vector has norm equal to one.
Let, T ={ c̄ 1 , c̄ 2 , ... , c̄ n }in the IPS
2. B=
¿1
¿ 0{( ) ( ¿¿ -10 )}in the Euclidean IPS, A is not orthogonal set
,
Let S= { v̄ 1 , v̄ 2 ,... , v̄ n }
Is a orthogonal basis for a IPS V
v̄ 1 v̄ v̄ v̄ v̄ v̄
If ū is a vector inV, then ū=¿ ū , > 1 +¿ ū , 2 > 2 +...+¿ ū , n > n
‖v̄ 1‖ ‖v̄ 1‖ ‖v̄ 2‖ ‖v̄ 2‖ ‖v̄ n‖ ‖v̄ n‖
ū=¿ ū , v̄ 1> ¿ 2 v̄ 1+ ¿ ū , v̄ 2> ¿ 2 v̄ 2+...+¿ ū , v̄ n > ¿ 2 v̄ n ¿ ¿ ¿
‖v̄ 1‖ ‖v̄ 2‖ ‖v̄ n‖
ORTHOGONAL PROJECTION
Definition
A set of vectors in an inner product space is called an orthogonal set if all pairs of distinct vectors in the set
are orthogonal. An orthogonal in which each vectors has norm 1 is called orthonormal set.
Let W be a subspace of an inner product space V, if {s1,s2,…,sr } is orthonormal basis for W and a
any vectors in V, then pro j W ā= pro j s̄ ā+ pro j s̄ ā+…+ pro j s̄ ā
1 2 n
Example
Let R2 have the Euclidean inner product and W be the subspace has orthonormal basis:
Solution
Gramm-Schmidt Process
B= { w̄1 , w̄2 ,... , w̄ n }orthonormal basis of The following squence of steps as Gramm Schmidt
Process
c̄ 1
1. w̄1=
‖c̄ 1‖
2. c̄ 2 w̄ 2
q1 c2
w2 c2 , w1 w1
p1 proyw1 c2 2
c2 , w1 w1
w1
q1 c2 p1
w1 p1 q1 c2 c2 , w1 w1
ci projW i 1ci
3. c3 w3 wi
ci projW i 1ci
c3
Wi-1 : subspace spanned by W1,…,Wi-1
q2
w3 p2 W it
q2 c3 p2 1
w 2 w
p 2 proyW c 3 c 3 , w1 w1 c 3 , w2 w2
q2 c3 ( c3 , w1 w1 c3 , w2 w2 )
Unit vector which
c3 ( c3 , w1 w1 c3 , w2 w2 )
w3 orthogonal with W
c3 ( c3 , w1 w1 c3 , w2 w2 )
Example :
1 0 0
Let : B= ū
{ ( ) ( ) ( )}
1 = 1
1
, ū 2 = 1
1
, ū 3 = 0
1
()
√3
ū1 (1,1,1 ) 1
Step 1. v̄1 = ¿ ¿
‖ū1‖ √3 √3
1
√3
2 1 1 1 −2 1 1
¿ ( 0,1,1 )− (
, ,
√ 3 √3 √ 3 √3
¿ , ,
3 3 3 )( )
4 1 1 √6
Hence, ‖ū 2−pro y v̄ ū2‖= 1
√ + + =
9 9 9 3
−2
()
√6
1
Such : v̄ 2=
√6
1
√6
ū3− pro y W ū 3
Step 3 . v̄3 =
‖ū3− pro y W ū 3‖
1 1 1 1 1 −2 1 1 1 1
Then ū3− pro y W ū3=ū3 −⟨ ū 3 , v̄1 ⟩ v̄ 1− ⟨ ū3 , v̄ 2 ⟩ v̄ 2¿ ( 0,0,1 )− ( , , ) (
− , ,
√ 3 √3 √ 3 √3 √ 6 √ 6 √ 6 √ 6
¿ 0 ,− ,
2 2 )( )
0
−1
We get : v̄3 = √ 2
1
√2
()
1 −2
{( ) ( ) ( )}
0
√ 3 √ 6 −1
1 1
So, { v̄ 1 , v̄ 2 , v̄ 3 }= , , √2
√ 3 √6 1
1 1
√2
√ 3 √6
1 0
Let plane shape which spanned by
{( ) ( )}
0 , 1
1 1
is subspace of Euclidean IPS in R3
1 0
v̄ =
1
,
() ()
Let 1 0 2 1 be basis of Subspace of IPS Because { v̄ 1 , v̄ 2 } is linear independent
v̄ =
1
v̄1 ( 1 , 0 ,1 ) (1 , 0 , 1 ) 1 1
w̄ 1= ¿ 2 2
‖v̄1‖ √( 1 ) + ( 0 ) + ( 1 ) 2
¿
√2
¿ ( ,0,
√ 2 √2 )
( √12 , 0 , √12 )>¿¿ 0+0+ √12 ¿ √12
So, ⟨ v̄ 2 , w̄1 ⟩ =¿ ( 0 , 1 ,1 )
1 1 1 1 1 1 1
⟨ v̄ , w̄ ⟩ w̄ = ( , 0 , )
2 1 1 v̄ −⟨ v̄ , w̄ ⟩ w̄ =( 0 , 1 ,1 ) −( , 0 , )¿ ( ,0 , )
2 2 1
2 1
2 2 2
√ 2 √ 2 √2
−1 1
¿( ,1 , )
2 2
−1 2 2
1
We obtained : ‖v̄ 2−⟨ v̄ 2 , w̄1 ⟩ w̄1‖=
√( 2 )
+ ( 1 ) 2+
2 ()
1 1 6
¿
√ 4
+1+ =
4 4 √
1
¿ √6
2
v̄2 −⟨ v̄ 2 , w̄1 ⟩ w̄1
We get w̄ 2= The Orthonormal Basis :
‖v̄2 −⟨ v̄ 2 , w̄1 ⟩ w̄1‖
−1
{( ) ( )}
1
(¿ −12 , 1 , 12 ) √2 2
√6
−1 2 1
1
√6
0 ,
1 √ 6
¿
√ 6(,
√ 6
,
√6 )
2 1
√2
√6
1
Orthogonal Projection of Vector ū= 1 On W is :
1 ()
Pr o y W ū=⟨ ū , w̄1 ⟩ w̄1 + ⟨ ū , w̄2 ⟩ w̄2
−1
()
3
1
1 ()
=0 +
2
3
1
3
()
3
2
¿
3
4
3
1 −2 0
3.
[ ][ ][ ]
4 , 5 , 0
−7 3 0
C. Compute the components of the vector v with respect to the given orthonormal basis.
3 4 −4 3
1. v = (1,8) ; a = ,
5 5
b=( ) 5 5
, ( )
2. v = (8,2,3) ; a = ( 13 , 23 , 23 ), b = ( 23 , 13 ,− 23 ), c = ( −23 , 23 ,− 13 )
1 1 −1
() ( )
1 and 0 Find a orthogonal projection 1 on
0 −1 2 ()
Inner Product Space (IPS)
d.Find the expressions : If < u,v > = 2, < v,w > = -3, < u,w > = 5
||u|| = 1, ||v|| = 2, and ||w|| = 7