Professional Documents
Culture Documents
Inner Product
Inner Product
Inner Product
Hoang Hai Ha
HCMUT-OISP
Email: hoanghaiha@hcmut.edu.vn
3 Orthogonality
4 MatLab
→
− −
W = F .→
s = F .s. cos α
Example 2.1
On Rn , dot product is standard inner product
n
xi yi = x.y T
P
(x, y ) 7−→ ⟨x, y ⟩ =
i=1
where x = (x1 , x2 , . . . , xn ), y = (y1 , y2 , . . . , yn ).
⟨y , x⟩ = y1 x1 + 2y2 x2 + y1 x2 + y2 x1 = ⟨x, y ⟩.
⟨y , x⟩ = y1 x1 + 2y2 x2 + y1 x2 + y2 x1 = ⟨x, y ⟩.
For z = (z1 , z2 ), we see that ⟨x + y , z⟩ = ⟨x, z⟩ + ⟨y , z⟩.
⟨y , x⟩ = y1 x1 + 2y2 x2 + y1 x2 + y2 x1 = ⟨x, y ⟩.
For z = (z1 , z2 ), we see that ⟨x + y , z⟩ = ⟨x, z⟩ + ⟨y , z⟩.
⟨αx, y ⟩ = α⟨x, y ⟩.
⟨y , x⟩ = y1 x1 + 2y2 x2 + y1 x2 + y2 x1 = ⟨x, y ⟩.
For z = (z1 , z2 ), we see that ⟨x + y , z⟩ = ⟨x, z⟩ + ⟨y , z⟩.
⟨αx, y ⟩ = α⟨x, y ⟩.
⟨x, x⟩ = x12 + 2x22 + 2x1 x2 = (x1 + x2 )2 + x22 ≥ 0 and
⟨x, x⟩ = 0 ⇔ x = (x1 , x2 ) = (0, 0).
Definition 2.1
If V is a real inner product space, then the length of a vector x ∈ V
is denoted by ||x|| and is defined by
p
||x|| = ⟨x, x⟩ . (1)
Definition 2.1
If V is a real inner product space, then the length of a vector x ∈ V
is denoted by ||x|| and is defined by
p
||x|| = ⟨x, x⟩ . (1)
Definition 2.2
If V is a real inner product space, then the distance between two
vectors u, v ∈ V is denoted by d(u, v ) and is defined by
p
d(u, v ) = ||u − v || = ⟨u − v , u − v ⟩ (2)
Example 2.3
In R2 the inner product is given
⟨x, y ⟩ = 3x1 y1 + x1 y2 + x2 y1 + x2 y2
Example 2.3
In R2 the inner product is given
⟨x, y ⟩ = 3x1 y1 + x1 y2 + x2 y1 + x2 y2
⟨x, y ⟩ = xAy T
Solution.
T
Rewrite the using the matrix form: ⟨x, y ⟩ = xAy ,
formula by
1 2 0
where A = 2 5 0.
0 0 3
Solution.
Rewrite the using the matrix form: ⟨x, y ⟩=
formula by xAy T ,
1 2 0 1
where A = 2 5 0 . Then ⟨u, v ⟩ = 1 1 1 A 0
0 0 3 1
Find ⟨u, v ⟩, ⟨u, ⟨v , v ⟩ by multiplying
u⟩,
1 1
1 1 1 ⟨u, u⟩ ⟨u, v ⟩ 13 6
A 1 0 =
= .
1 0 1 ⟨v , u⟩ ⟨v , v ⟩ 6 4
1 1
Hoang Hai Ha (HCMUT) Inner product 9 / 29
Orthogonality
Definition 3.1
1 Two vectors x, y ∈ V in an inner product space V is called
orthogonal ⇔ ⟨x, y ⟩ = 0. We denote it by x ⊥ y .
Definition 3.1
1 Two vectors x, y ∈ V in an inner product space V is called
orthogonal ⇔ ⟨x, y ⟩ = 0. We denote it by x ⊥ y .
2 Vector x is orthogonal to the set M ⊂ V if x is orthogonal to
every vector in M. We denote it by x ⊥ M.
⟨x, y ⟩ = 2x1 y1 − x1 y2 − x2 y1 + x2 y2
where x = (x1 , x2 ), y = (y1 , y2 ), and let u = (1, −1), v = (2, m). Find
m such that u ⊥ v .
⟨x, y ⟩ = 2x1 y1 − x1 y2 − x2 y1 + x2 y2
where x = (x1 , x2 ), y = (y1 , y2 ), and let u = (1, −1), v = (2, m). Find
m such that u ⊥ v .
Ans: m = 3
Example 3.2
On R3 given the standard inner product and the subspace
x1 + 2x2 − x3 = 0
F = x = (x1 , x2 , x3 ) ∈ R3
2x1 + 3x2 + x3 = 0
Example 3.2
On R3 given the standard inner product and the subspace
x1 + 2x2 − x3 = 0
F = x = (x1 , x2 , x3 ) ∈ R3
2x1 + 3x2 + x3 = 0
Example 3.2
On R3 given the standard inner product and the subspace
x1 + 2x2 − x3 = 0
F = x = (x1 , x2 , x3 ) ∈ R3
2x1 + 3x2 + x3 = 0
Example 3.3
On Rn
2 the standard inner
o product is given. Then the set
M = (1, −2), (2, 1) is orthogonal set.
Example 3.3
On Rn
2 the standard inner
o product is given. Then the set
M = (1, −2), (2, 1) is orthogonal set.
1 2 2 1
N= √ , −√ , √ , √ is the orthonormal set.
5 5 5 5
Definition 3.3
If F is a subspace of a real inner product space V , then the set F ⊥ of
all vectors in V that are orthogonal to F is called the orthogonal
complement of F .
Definition 3.3
If F is a subspace of a real inner product space V , then the set F ⊥ of
all vectors in V that are orthogonal to F is called the orthogonal
complement of F .
Theorem 3.2
Let F be a subspace of a real inner product space V , then F ⊥ is a
subspace of V , and:
and the subspace F = span {(1, 2, 1), (2, −1, 4), (1, −3, 3), (5, 0, 9)}.
Find the dim of F ⊥ and one its basis.
Solution.
A basis of F is E = {e1 = (1, 2, 1), e2 = (2, −1, 4)}.
Similarly to the previous
example,
we find
4 0 0
1 2 1
B= 0 5 −1, then F ⊥ ≡ null(B).
2 −1 4
0 −1 4
x = y + z,
where y ∈ F , z ∈ F ⊥ .
x = y + z,
where y ∈ F , z ∈ F ⊥ .
Definition 3.4
Vector y is called the orthogonal projection of x on F . We denote it
by y = prF x.
x = λ1 e1 + λ2 e2 + ... + λm em + z
x = λ1 e1 + λ2 e2 + ... + λm em + z
⟨x, e1 ⟩ = ⟨e1 , e1 ⟩λ1 + ⟨e2 , e1 ⟩λ2 + ... + ⟨em , e1 ⟩λm
⟨x, e2 ⟩ = ⟨e1 , e2 ⟩λ1 + ⟨e2 , e2 ⟩λ2 + ... + ⟨em , e2 ⟩λm
⇔ .
..
⟨x, e ⟩ = ⟨e , e ⟩λ + ⟨e , e ⟩λ + ... + ⟨e , e ⟩λ .
m 1 m 1 2 m 2 m m m
1 f1 , f2 ,
. . . , fm: basis of F . A = [f1 ; f2 ; . . . ; fm ]
f1
f2 ⊥ ′ ′
A= . . . ⇒ Basis of F : null(A, r )
fm
2 If F is the solution subspace of homogeneous system AX = 0
then the basis of F ⊥ consists of all row vectors of matrix B
B = rref (A)