Linear Algebra and Random Variables (LARV) HS10109 Unit I

Unit I
Vector Spaces

Introduction: In this topic you will learn how matrices, mainly the concept of rank help us in
analyzing the system of linear equations and finding its solution. The most important application of
system of linear equations “Analysis of Electrical circuit” is discussed in detail.
We are familiar with the concept of vectors in 2-D and 3-D. You will learn the power of abstraction
when we study vector spaces.

Matrices:

Matrix: A matrix is a rectangular array of numbers. The numbers in the array are called the
elements of the matrix.
The size of the matrix is described in terms of the number of rows (Horizontal lines) and number of
columns (Vertical lines). The matrix having m-rows and n-columns is denoted by
Am  n  aij  , where aij is the element present in the ith row and jth column of the matrix A.
mn

Types of Matrices:

Row Matrix or Row vector: Matrix having single row.

Column Matrix or Column vector: Matrix having single column.

Square Matrix: Matrix having same number of rows and columns.

  0, if i  j
Upper triangular matrix: Am  m   aij  mm , where aij  
 0, if i  j .

  0, if i  j
Lower triangular matrix: Am  m   aij  mm , where aij   .
 0, if i  j
  0, if i  j
Diagonal Matrix: Am  m   aij  mm , where aij   .
 0, otherwise

 k  0, if i  j
Scalar Matrix: Am  m   aij  mm , where aij   .
0, otherwise

1
 Unit I Linear Algebra and Random Variables (LARV) HS10109

 1, if i  j
Unit Matrix: Am  m   aij  , where aij   .
mm
0, otherwise
Null Matrix: A matrix having all elements zero.

Matrix Algebra:

1. Equality of Matrices: Matrix A and B are said to be equal if and only if

i) A and B are of same order and
ii) Corresponding elements of A and B are equal.
2. Addition of Matrices: The matrices A and B are said to be compatible for addition if and only if
they are same order. The sum of A and B denoted by A+B is obtained by adding corresponding
elements.
If Am  m   aij  , and Bmn  bij  , then Cmn  A  B   aij  bij 
mm mm mm

i.e. A  B is the matrix obtained by adding the entries of B to the corresponding entries of A.
3. Scalar Multiplication: If A is any matrix and c is any scalar, then the product cA is the matrix
obtained by multiplying each element of matrix A by c.

Properties of Addition and Scalar multiplication:

1. A  B  B  A (Commutative)
2. A  ( B  C )  ( A  B)  C (Associative)
3. A  0  0  A  A (0  Null matrix  Additive Identity)
4. A  B  A  C  B  C (Cancellation Law)
5.  ( A  B)   A   B (distributive Law)

4. Multiplication: The matrices A and B are said to be compatible for multiplication A  B , if

number columns of A is equals to number of rows of B.
 p 
If A   aij  and B  bkj  , then A  B   aik bkj 
m p p n
 k i  mn

Properties Matrix multiplication:

1. AB  BA (Non  Commutative)
2. A( BC )  ( AB)C (Associative)
3. AI  AI  A (I Identity matrix  Multiplicative Identity)
4. AB  AC  B  C (Cancellation not hold Law)

2
Linear Algebra and Random Variables (LARV) HS10109 Unit I

5. A( B  C )  AB  AC (Distributive Law)
6. AB  0 doe not imply that A = 0 or B = 0.

7. A2  A, then A is called as idempotent matrix.

Note That : Cancellation does not hold for general matrices, but it holds with non-singular
matrix.
 Matrix Product as a Linear combination

 a11 a12   a1n   x1 

a    x 
 21 a22 a2 n   2
If A       and X     then
   
      
 am1 am 2   amn  mn  xn 

 a11   a12   a1n 

a  a  a 
 21   22   2n 
AX  x1     x2     ...  xn   
     
      
 am1   am 2   amn 

 Transpose of a Matrix: If A is any m  n matrix, then transpose of A, denoted by

AT or A , is n  m matrix obtained from interchanging rows and columns of A.

i.e. if A= aij  , then AT  a ji 

mn nm

 Properties of Transpose of a Matrix:

1. A 
T T
 A.

2. ( A  B)T  AT  BT

3. ( A  B)T  BT  AT
 Trace of a Matrix: Let A be a square matrix, then Trace of A, denoted by tr (A) is sum of
the entries in the main diagonal of A.
 Determinant of a Matrix: Let A be a square matrix, then determinant of A, denoted by det
(A) or |A| is the real number assign with A.
 Singular Matrix: Let A be a square matrix, if determinant of A = 0, then A is said to
singular matrix otherwise it is said to be non-singular matrix.
 Minor of an i-jth element of the Matrix: The determinant obtained by deleting the ith row
and jth column of a matrix.

3
 Unit I Linear Algebra and Random Variables (LARV) HS10109

 Cofactor of an i-jth element of the Matrix:

Ci j  (1)i  j M i j , M i j  is the i - j th element of thematrix

 Cofactor Matrix: The Matrix obtained by replacing each element of A by its cofactor and
taking transpose of the resultant matrix.
Inverse of a Matrix: Let A be non-singular matrix, B is said to be inverse of A

if and only if AB  BA  I .
 Properties of Inverse of a Matrix:
If A is invertible then

1. A 
1 1
 A.

2. ( A  B)1  B1  A1

A  A 
1 T T 1
3.

1 1
 kA
1
4. For any non-zero scalar k ,  A
k

5. An is invertible and ( An )1   A1 

n

adj ( A)
6. A1 
det( A)
Symmetric Matrix: A square matrix A is said to be symmetric if and only if

AT  A. i.e. If A  aij  , then aij  a ji .
nn

 Skew Symmetric Matrix: A square matrix A is said to be skew symmetric if and only if
AT   A. i.e. If A  aij  , then aij  a ji for i  j and aii  0.
nn

 Every square matrix can be expressed as sum of symmetric and skew symmetric matrices.
1
A  ( A  AT )  (A AT )  , where ( A  AT )T  ( A  AT ) and ( A  AT ) T  ( A  AT ) .
2
 Rank of a Matrix : Let Am  n be any matrix, ' r  0' is said to a rank of the matrix A

denoted as ( A) if the matrix has

1. at least 1 non-zero minor of order ' r '

2. all the minors of order ' r  1' are zero.

OR
The order of highest order non-vanishing minor is the rank of the matrix.

4
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Elementary Transformations:
1. Interchange of any two rows or columns
Ri j or ( Ri  R j ) , Ci j or (Ci  C j ) .

2. Multiplying any row or column by a non-zero constant  ,  Ri ,  C j ,   0

th
3. Adding in i th row a scalar multiple of corresponding elements of j row (similarly

for column) Ri   R j , Ci   C j

# Theorem 1.1: Elementary transformations do not alter the rank of the matrix.

 Echelon Form (Row reduced form)

(To reduce a matrix into an Echelon form, only row transformations are permitted.)
1. All the non-zero rows are above any rows of zeros.
2. Each leading entry of a row is in a column of the right of the leading entry of the row
above it.
3. All entries in a column below the leading entry all zeros.

Leading entry – First non-zero element in a row.

e.g.

Pivot elements are the elements whose position should

not be altered by application of row transformations.

Equivalent Matrices : - B is said to be an equivalent matrix of A, shown as B A iff B is obtained

by applying elementary transformations on A.
For a matrix A m  n

1. Rank of A, ( A)  min(m, n)
2. Number of pivot elements in an Echelon form is the rank of the matrix.
3. If A is a nonsingular matrix of order n, then ( A)  n.

5
 Unit I Linear Algebra and Random Variables (LARV) HS10109

4. If A is a nonsingular matrix of order n, then A I n , where I n is an identity matrix

of order n.
Elementary Matrix:- A matrix obtained by applying a single elementary row transformations on
identity matrix is called Elementary Matrix.
Note That: Every Elementary Matrix is invertible, and is also an elementary matrix

Illustrative Examples:
Q 1) Find the rank of the matrix by reducing it to an Echelon form.
 0 3 6 4 9 
 1 2 1 3 1 
A 
 2 3 0 3 1
 
 1 4 5 9 7 
Soln. R1 : R1  R4 

 1 1 1 5 2 
 1 2 1 3 1 
A  
 2 3 0 3 1
 
 1 4 5 9 7 
R2  R1 , R3  2R1 , R4  R1 

1 1 1 5 2
0 3 2 2 3 

0 1 2 7 3 
 
0 3 6 4 5

R23 

1 1 1 5 2
0 1 2 7 3 

0 3 2 2 3 
 
0 3 6 4 5

 R2 

1 1 1 5 2 1 1 1 5
2
0 1 2 7 3 0 1 2 7 3
 R3  3R2 , R4  3R1  
0 3 2 2 3  0 0 8 23 12 
   
0 3 6 4 5 0 0 0 25 4 

 ( A)  4

6
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Q 2) Find the rank of the matrix by reducing it to an Echelon form.

3 2 5 7 12 
n
Sol . A  1 1 2 3 5 
3 3 6 9 15

R1  R2 
1 1 2 3 5 
A 3 2 5 7 12 
3 3 6 9 15 
R2  3R1 , R3  3R1 
1 1 2 3 5 
A 0 1 1 1 3
0 0 0 0 0 
 ( A)  2

7
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Exercise 1.1

[A] Determine the rank of the following matrices by reducing it to an Echelon form.

 3 2 0 1 7  5 6 7 8
0 2 2 1 5  6 7 8 9
Q 1) A  A 
1 2 3 2 1  Q 2) 11 12 13 14 
   
0 1 2 1 6  16 17 18 19 

1 2 1 0 
3 2 1 2   2 3 1 1
  1 1 2 4 
Q 3) A  1 3 1 3 Q 4) A
  3 1 3 2 
 2 1 2 5  
7 

 5 6 3 2  6 3 0

2 3  1  1  5 6 7 8
1  1  2  4  6 7 8 9
Q 5)   Q 6)  
3 1 3  2 11 12 13 14
   
6 3 0  7 16 17 18 19

6 1 3 8
 2 1  3  6 4
3  3 1 2 6 1
Q 7)
 2  Q 8) 
10 3 9 7
1 1 1 2   
16 4 12 15 

8
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

System of Linear Equations

Consider a system of m equations and n unknowns.
a11 x1  a12 x2   a1n xn  b1
a21 x1  a22 x2   a2 n xn  b2

am1 x1  am 2 x2   amn xn  bm

The above system of equation can be written in the matrix form as

AX  B

A  [ai j ] m  n  coefficient matrix

 x1   b1 
x  b 
X  2
 Matrix of unknowns and B   2   Matrix of constants
   
   
 xn  bm 

(I) If b1  b2   bm  0 , then it is said to be Homogeneous System of Linear equations.

(II) If atleast one of b1 , b2 , , bm is non-zero, then it is said to be Non-homogeneous System of

Linear equations.

 Results
1. Homogeneous system of Linear equations is always consistent because one of the solutions is
x1  x2   xn  0 called as „Trivial Solution‟.

# Augmented Matrix denoted as [ A : B] is the matrix obtained by attaching additional column B

to matrix A.

 A : B  [ai j : bi ] m  ( n1)
2. If rank of augmented matrix is equal to rank of coefficient matrix, i.e.
[ A : B]  [ A]  r (say) Then, the system of linear equations is consistent.

Note: 1) If r  n (number of unknowns), then the system has a unique solution.

2) In case of homogeneous system, unique solution is a Trivial solution.

9
 Unit I Linear Algebra and Random Variables (LARV) HS10109

3) If r  n , then the system has infinite number of solutions.

4) If r  n , then ' n  r ' variables are “free variables.”
5) Non-pivot variable is considered as a free variable.

Illustrative Examples
Check the consistency of following systems. If consistent, find the solution.
Q 1) 3x1  6 x2  x3  x4  0
x1  2 x2  5 x3  3x4  0
2 x1  4 x2  3x3  x4  0
Soln. the system is homogeneous, it is consistent.
 3 6 1 1
AX  0 , where A  1 2 5 3
 
 2 4 3 1

R1  R3 
1 2 4 0 
1 2 5 3
 
 2 4 3 1
R2  R1 & R3  2 R1 
1 2 4 0 
0 0 9 3
 
0 0 11 1

11
R3 
R2 
9
1 2 4 0 
0 0 9 3
 
 8
0 0 0 3 
 
 ( A)  3  4 , system has a non-trivial solution.
Equivalent system is
x1  2 x2  4 x3  0 ---------- (i)

9 x3  3x4  0 ---------- (ii)

8
x4  0 ---------- (iii)
3
From (iii), x4  0 ---------- (iv)

10
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

From (ii) & (iv), x3  0

Here x2 is a free variable (as x2 is a non-pivot element)

Let x2  k  x1  2k

 x1   2k   2
x   k  1 
 Solution vector X   2      k  
 x3   0  0
     
 x4   0  0
Q 2) Investigate the values of a and b so that the equations
2 x  3 y  5z  9 7 x  3 y  2z  8 2 x  3 y  az  b
have (i) no solution (ii) unique solution (iii) infinite solutions.
2 3 5 : 9
[ A : B]  7 3 2 : 8 
n
Sol .
 2 3 a : b 

R2  3R1 
2 3 5 : 9 
1 6 17 : 19 
 
 2 3 a : b 

R12 
1 6 17 : 19 
2 3 5 : 9 

 2 3 a : b 

R2  2 R1 , R3  2 R1 
1 6 17 : 19 
0 15 39 : 47 

0 15 a  34 : b  38

R3  R2 
1 6 17 : 19 
0 15 39 : 47 
 
0 0 a  5 : b  9 

i) For no solution, [ A]  [ A : B] i.e. if a  5  0 & b  9  0

then [ A]  2, [ A : B]  3

ii) For unique solution, [ A]  [ A : B]  number of unknowns. i.e. if a  5  0 then

[ A] [ A : B]  3  number of unknowns.

11
 Unit I Linear Algebra and Random Variables (LARV) HS10109

iii) For infinite solutions, [ A]  [ A : B]  number of unknowns. i.e. if a  5  0 &

b  9  0 then [ A] [ A : B]  2, 2  3 (number of unknowns)

Exercise 1.2

Q 1) Investigate for what values of  and  the simultaneous equations

x  y  z  6, x  2 y  3z  10, x  2 y  z  
have i) No solution ii) A unique solution iii) An infinite number of

For what values of k the equations x  y  z  1, 2 x  y  4 z  k and 4 x  y  10 z  k have

2
Q 2)
a solution and solve them completely in each case.

Q 3) Determine for real values of a so that the system of equations have non-trivial solution
x  2 y  3z  ax, 3x  y  2 z  ay and 2x  3 y  z  az .

Q 4) Show that the system of equations ax  by  cz  0, bx  cy  az  0 and cx  ay  bz  0

have a non-trivial solution if (i) a  b  c  0 (ii) a  b  c and solve them completely.

Q 5) Solve 2 x  y  z  w  2; 3x  y  z  w  2; x  2 y  z  w  1, 6x  2 y  z  w  5 .

Q 6) Solve x  y  z  w  4; x  z  2w  2; y  z  3w  1, x  2 y  z  w  3.

Q 7) Solve – x1  2 x2  x3  2 x4  0; 2 x1  2 x2  x3  4 x4  0 ;
3x1  2 x2  2 x3  5x4  0; 3x1  8x2  5x3  17 x4  0 .

Q 8) For what values of a the system of equations have

x  2 y  3z  4; 3x  y  5z  2; 4 x  y  (a 2  1) z  a  2
i) No solutions ii) Unique solutions iii) infinitely many solutions.
[Ans.: No solution for a  4, uniquesolution for a  4
andinfinitely manysolutions for a  4]

Q 9) For what values of a the system of equations have

x  y  z  1; x  3 y  az  2; 2x  ay  3z  3
i) No solutions ii) Unique solutions iii) infinitely many solutions.
[Ans.: No solution for a   3 , unique solution for a  2 and a   3
and infinitely many solutions for a  2 .]

Q 10) Investigate for consistency of the following equations and if possible find solutions:
i) x  y  z  6; x  y  3z  1 : 15x  3 y  9 z  21
ii) 2 x  3 y  7 z  5; 3 x  y  3z  13 : 2 x  19 y  47 z  32
iii) w  x  3 y  3z  3;  5w  2 x  5 y  4 z  4;  3w  4 x  7 y  2 z  7
2w  3x  y  11z  1
[Ans.: Inconsistent]
iv) w  x  3 y  3z  3;  5w  2 x  5 y  4 z  5;  3w  4 x  7 y  2 z  7
2w  3x  y  11z  1
[Ans.: consistent, Infinite no of solutions]

12
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

v) 3w  6 x  y  z  0; w  2 x  5 y  3z  0; 2w  4 x  3 y  z  3
vi) 2 x1  x2  2 x3  x4  6 ; 6 x1  6 x2  6 x3  12 x4  36 ; 4 x1  3x2  3x3  3x4  1 ;
2 x1  2 x2  x3  x4  10 .
[Ans.: x1  2; x2  1; x3  1; x4  3]
Q 11) Solve completely the system of equations.
i) x  y  2z  3w  0; x  2 y  z  w  0; 4x  y  5z  8w  0; 5x  7 y  2z  w  0.
ii) 3x  4 y  z  6w  0; 2 x  3 y  2 z  3w  0; 2 x  y 14z  9w  0;
x  3 y  13z  3w  0.

Q 12) Find the values of  for which the equations

(2   ) x  2 y  3  0; 2 x  (4   ) y  7  0; 2 x  5 y  (6   )  0 have a solution and find
them completely.

Q 13) Determine the values of k for which the following system of equations has a non-trivial
solutions and find them:
(k  1) x  (4k  2) y  (k  3) z  0; (k  1) x  (3k  1) y  2kz  0;
2 x  (3k  1) y  3(k  1) z  0.

Q 14) For different values of k, discuss the nature of solution of the following equations
x  2 y  z  0; 3x  (k  7) y  3z  0; 2 x  4 y  (k  3) z  0
[Ans.: If k 2  1  0 then unique solution and if k 2  1  0 then infinite no of solutions.]

13
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Analysis of electrical Network

In this section basic laws of electrical circuit are discussed. You will learn how these laws can be
used to obtain the system of linear equations whose solution yields the currents in the system. There
are three basic quantities associated with electrical circuit. Electrical potential (E-Volts), resistance
(R-ohms), and current (I-ampere). Electrical potential (called as voltage drops between two points)
is associated with two points in electrical circuits and is measured by connecting those points to a
device called a voltmeter. The flow of current in electrical circuits is governed by three basic laws.
1. Ohms law: The voltage drop across a resistor is the product of current passing through it and its
resistance V  IR .
2. Kirchhoff’s current law: The sum of currents flowing into any point equals the sum of the
currents flowing out from the point.
3. Kirchhoff’s voltage law: Around any closed loop, the algebraic sum of voltage drops is zero.
Note: A current passing through the resistor produces a positive voltage drop if it flows in the
positive direction of the loop and negative voltage drop if it flows in the negative direction of the
loop.
Illustrative Example
Find the unknown currents I1 , I 2 , and I3 in the circuit shown in the figure.

Applying Kirchhoff‟s current law to the points b and e yields

I1  I 2  I 3 (Point b)
I 2  I 3  I1 (Point a)

 I1  I 2  I3  0 ---------- (1)
Applying Kirchhoff‟s voltage law and Ohms law to loop 1 in the figure yields
R1I1  R3 I3  V1 ---------- (2)
Now applying to loop (2), we get
R2 I 2  R3 I 3  V2 ---------- (3)
Expressing equations (1), (2), and (3) in matrix notations as follows

14
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

1 1 1   I1   0 
R 0 R3   I 2   V1 
 1
 0 R2  R3   I 3  V2 

Solving the linear systems yields the solution

In particular if we set
V1  30 V, V2  50 V, R1  7 , R2  11, and R3  3 
570 590 20
we get I1  A, I 2  A, and I 3   A.
131 131 131

Vector Space
Definition: Let V be non-empty set. Define two operations namely „addition‟ and „scalar
multiplication‟ on V. V is said to be a vector space if for every u, v, w in V and any real, complex
number  , following axioms hold.
1. u  v V (closed under addition)
2. u  v  v  u (addition is commutative)
3. u  (v  w)  (u  v)  w (addition is associative)
4. There exists 0 V such that u  0  0  u  u . (Existence of zero element for
addition known as additive identity)
5. There exists u V  u  u  u  (u)  0 . (Existence of additive inverse)

6.  u V {closed under scalar multiplication}

7. (  )u   u   u
Scalar multiplication is distributive}
8.  (u  v)   u   v

9. ( u)  () u {Scalar multiplication is associative}

10. There exists 1 such that 1 u  u .

Elements / members of V are called as „vectors‟.
Theorem1.2: For a vector space V
i) Zero vectors are unique.
ii) u V is unique such that u  (u)  0.
Theorem1.3: Let V be a vector space and let x, y be vectors in V, then
i) x  y  x  y  0.
ii) 0  x  0.
iii) k  0  0 for any k  .
iv)  x is unique and  x  (1) x
v) If k x  0, then k  0 or x  0.
15
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Examples of Vector Spaces

1) V  {0} (Set consisting of zero vectors)

2) n
 {( x1 , x2 , , xn ) / x1 , x2 , x3 , , xn  } (Set of all ordered n-tuple of
real or complex numbers) is a vector space under component wise addition and
scalar multiplication, i. e.,
( x1 , x2 , , xn )  ( y1, y2 , , yn )  ( x1  y1, x2  y2 , , xn  yn )

 ( x1, x2 , , xn )  ( x1,  x2 , ,  xn ) .
3) Pn ( x)  Set of all polynomials in x up-to degree „n‟

 {a0 xn  a1 xn1   an / a0 , a1 , , an  }
is a vector space under usual addition and scalar multiplication of polynomials,
i.e.
n n1 n n1 n n1
( a0 x  a1x   an )  (b0 x  b1x   bn )  (a0  b0 ) x  (a1  b1 ) x   (an  bn )

 (a0 x n  a1x n1   an )  ( a0 ) x  ( a1 ) x

n n1
  ( an ) .

4) M m  n ( )  {[ai j ] m  n / ai j  , i  1, 2, , m ; j  1, 2, , n} is a vector space

with usual addition and scalar multiplication of matrices, i. e.,

[ai j ]  [bi j ]  [ai j  bi j ] and [ai j ]  [ ai j ] .

5) E  {f :  } set of all real valued functions is a vector space under addition

and scalar multiplication of functions, i.e.,
( f  g )( x)  f ( x)  g ( x) and ( f )( x)    f ( x) .
Examples of a set which are not a vector space
1. P2  Set of polynomials of exactly degree 2 is not closed with respect to vector addition.
For Example: Let p( x)   x 2  2 x  5, q( x)  x 2  3
.
 p( x)  q( x)  2 x  8  P2 as 2 x  8 is not a polynomial of degeree 2.
2. The set of integers is not a vector space. Because the set is not closed with respect to scalar
multiplication.
1 2
For example (2)   is not an integer.
3 3

3. Let V  ( x, y, z) : x, y, z  R , with standard operation of addition and nonstandard

operation scaler multiplication defined as c ( x, y, z)  (cx, 0, 0)

[Ans.: 1 x, y, z    x, 0, 0    x, y, z  ]

16
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

4. Let V  ( x, y) : x, y  R , with standard operation of addition and nonstandard

operation scaler multiplication defined as c ( x, y, z)  (cx, y) show that V is not a vector

space.
[Ans.: In this example all the axioms are satisfied except axiom number 10.

0  1, 1, 1 =  0 1, 1  (0, 1)  0 V is not a vector space. ]

# Subspace: - Let V be a vector space and V  0, U  V , U is said to be a subspace of V if U itself

is a vector space under the same „addition‟ and „scalar multiplication‟ operations as defined on V.
Theorem1.4: - A non-empty subset U of vector space V is a subspace of V if and only if
1) U is closed under addition, i. e., u1  u2 U for all u1 , u2 U

2) U is closed under scalar multiplication, i. e.,  u U for every  

and u  U .

Note: If 0 V is not a member of U V then U is not a subspace of V .

Illustrative Examples:
Q 1) Let A be m  n matrix, then V   X  n
: AX  0 , is a subspace of n
.

Soln : Let x, y V  Ax  0, and Ay  0 `

Consider, A( x  y )  Ax  Ay  0,  x  y V
and Let   , then A( x)   A( x)  0,   x V
V is closed with respect to addtion and scalar multilication
V is a subsapce of n
.

Q 2) List all the subspaces of

2
 {( x, y) | x, y  }
Soln. 1) {(0, 0)}

2) Set of all lines passing through origin {( x, y) | y  mx, m  }

2
3) itself.

Q 3) List all the subspaces of

3
 {( x, y) | x, y, z  }
Soln. 1) {(0, 0, 0)}
2) Any plane passing through origin.
3) Any line passing through origin.
3
4) itself.

17
 Unit I Linear Algebra and Random Variables (LARV) HS10109

2 3
Q 4) Is a subspace of ?
Soln. No, because 2
is not even a subset of 3
( 2
has ordered pairs while 3
has ordered
triples)
Q 5) Let U and W aresubspaces of a vector space V .Sumof U and W is defined as

U  W  u  w V : u U and v V  Show that U  W isa subspaceof V .

Soln. Let x, y U  W  x  u1  w1 and y  u2  w2 where u1 , u2  U and w1 , w2  W .

i) x  y   u1  w1    u2  w2 
  u1  u2    w1  w2  (by associativity and commutativity of V)
but  u1  u2  U and  w1  w2  W (as U and W are subspaces of V )
 x  y U  W .
ii) Let  be any real number,
 x    u1  w1    u1   w1 (Distributive property of V )

but  u1 U and  w1 W (as U and W aresubspaces of V )

  x U  W
 U  W is a subspace of V .
Examples of sets which are not subspaces
Q 1) Is M the set of all singular matrices of order 2  2 a subspace of M 2  2 ( ) ?

Soln. M is not a subspace because it is not closed under addition.

1 1  0 0  1 1 
0 0  1 2  1 2  M . Since addition matrix is non-singular
     
Is {( x, y) | y  mx, m  } a subspace of
2
Q 2) ?

Soln. ( x1 , y1 ), ( x2 , y2 )  y1  m1 x1 , y2  m2 x2 , y1  y2  m1 x1  m2 x2  m( x1  x2 )

2
Hence it is not closed under addition. It is not a subspace of .
Q 3) Is H  {( x, y) | y  mx, m is fixed real number} a subspace of 2
?
Soln. Yes, because fixed real number  a single line passing through origin.
Let ( x1 , y1 ),( x2 , y2 ) H  y1  mx1 , y2  mx2 .

18
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Consider,  x1  x2 , y1  y2    x1  x2 , mx1  mx2    x1  x2 , m( x1  x2 )   H and

  x1 , y1    x1 ,  (mx1 )    x1 , m ( x1 )   H as m,  both are real numbers.

Q 4) Is H1  {( x, y) | x 2  y 2  1} a subspace of 2
?

Soln. H1 is not a subspace because (0,0)  H1 .

Q 5) Is H 2  {( x, y) | x 2  y 2  1} a subspace of 2
?

Soln. H 2 is not a subspace because H 2 is not closed under addition. e.g. (1,0),(0,1)  H 2 but

(1,0)  (0,1)  (1,1)  H 2 .

# Linear Combination (L.C.) of Vectors

Let H  {v1 , v2 , v3 , , vn } be a subset of a vector space V, then the sum c1v1  c2v2   cnvn ,

where c1 , c2 , , cn  is defined as a linear combination of v1 , v2 , , vn .

# Span of a Set
Let H  {v1 , v2 , v3 , , vn } be a subset of vector space V.

span H  {c1v1  c2v2   cnvn | c1 , c2 , , cn  } = Set of all possible linear combination of

members of H
Theorem1.5: Let H  {v1 , v2 , v3 , , vn } be a subset of vector space V. Show that span H is a
subspace of V containing H.
Proof. i) Let h1 , h2  span H 
n

h1   ai vi 
i 1 
n  ai , bi  /
h2   bi vi 
i 1


n n
h1  h2   (ai  bi ) vi   ci vi , ci  / . Therefore h1  h2  span H
i 1 i 1

ii) Let  
n n
 h1   ( ai ) vi   di vi , di  / . Therefore  h1  span H
i 1 i 1

 Span H is a subspace of a vector space V.

Note That : Span H is a smallest subspace of V containing H.

19
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Illustrative Examples
Q 1) Show that the set M of all symmetric matrices of order 2  2 is a subspace of M 2  2 ( ) .

Soln. Consider any symmetric matrix A M . Then

a c  1 0  0 0 0 1 
A   a  b c  , where a, b, c  .
 c b 0 0  0 1  1 0 
1 0   0 0  0 1
Here A is a linear combination of   ,  and   of M 2  2 .
0 0 0 1  1 0 
 Set of symmetric matrices of order 2 is a subspace of M 2  2 ( ) .

 a  b  c  
 
  2a  b  
Q 2) Show that H    is a subspace of
4
.
  a  b  5c  
  2a  c  

 a bc  1   1 1

 2a  b   2  1  
Soln.    a b c 0 
 a  b  5c  1   1  5
       
 2a  c  2 0  1
 1   1  1  
      
 2 1 0 
 H  span   ,   ,     v1 , v2 , v3 
 1   1  5  
 2   0   1  
where v1 , v2 , v3  4 .

 H is subspace of 4
.
 a  b  c  
 
 5   a subspace of
Q 3) Is H    4
?
  a  b  5c  
  2a  c  

0
0
Soln. Since   is not a member of H, it is not a subspace of 4
.
0
 
0

20
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Exercise 1.3
  a 0 
Q 1) Determine if the the set H=    : a , b, c   is a subspace of M 22 .
b c  

Q 2) Let F be a fixed 4  3 matrix. H =  A  M 35 : FA  0, 0 matrix in M 45 .

Determine if H is a subsapce of M 35.

Q 3) Determine whether W is a subspace of vector space V and justify.

i) W  ( x, y : x  2 y , V  R 2
ii) W  ( x, y) : x  y  1 , V  R 2

iii) W  ( x, y, z ) : x 2  y 2  z 2  0 , V  R3 
Q 4) Mark true or false. Justify your answer.
i) All polynomials of the form p(t )  a  t , where a  R is a subspace of P2 .
2

ii) The additive inverse of a vector is not unique.

iii) A subspace is also a vector space.
iv) The additive inverse of a vector is not unique.
 x  
v) W     : xy  0 is a subspace of 2
 y  
 s  3t 
 s t 
Q 5) Let W be a the set of all vectors of the form   , show that W is a subspace of 4
.
2s  t 
 
 4t 

Q 6) Let A be an n  n square matrix, and let  be a scalar. Prove that the set
S   X : AX   X  is a subspace of n .

  2t  
 
Q 7) Let W    t  : t   , find a vector v in
3
such that W  span {v}. Why does this shows
  3t  
  
3
that W is a subspace of .

3
Q 8) Which of the following sets are subsapces of ? Justfy.
i) H  ( x, y, z )  3
: x y z  0
ii) H  (3t ,  2t , t )  3
: t 
iii) H  ( x, y, z ) ÎR3 : x 2 - y 2  z 2  0
iv) H  x  3
: xT u  xT v  0, where u and v are fixed vectors in 3


21
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Q 9) Let U and W aresubspaces of a vector space V .

i) Is U  V a subsapce of V ?
ii) Is U  V a subsapce of V ?

Q 10) Let V  C( ) be the vector space of all continuous functions on . Which of the following
are suspaces of V? Justfy.
i) H is a set all differentiable functions on .
ii) H is a set all bounded continuous functions on .
iii) H is a set all continuous even functions on
iv) H is a set all polynomials with integer coefficient on .

3
Q 11) Which of the following are subspaces of ? Justfy.
i) W  ( x, y, z ) : xyz  0
ii) W   3t ,  2t , t  : t  
iii) W  x  3
: xT u  xT v  0 , where u, v are any fixed vectors in 3
.

22
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

# Spanning Set
Let H  {v1 , v2 , , vn } be a subset of vector space V.
H is said to be a spanning set of V if every element of V is expressible as linear combination of
elements of H, i.e., v  span {H } for all v V , i.e.,

v  c1v1  c2v2   cnvn for some c1 , c2 , , cn is a consistent system of linear equations.

Illustrative Examples
Q 1) Let H  {e1  (1, 0), e2  (0, 1)} . Is H spanning set of 2
?

Let ( x, y)  . ( x, y)  xe1  ye2 is always consistent.

2
Soln.

 H spans 2
.

Is H  {1, x, x } spans P2 ?
2
Q 2)

Soln. Let p( x)  P2 then

p( x)  a0 x2  a1 x  a2 ; a0 , a1 , a2  .  H spans P2 .

Q 3) i) For what value of h, will y be in the subspace of 3

spanned by v1 , v2 , v3 where

1 5  3  4 

v1   1 , v2   4  , v3   1  and y   3 
     
 2  7   0   h 

ii) Is v1 , v2 , v3 span 3
?

Soln. i) Let y  span {v1 , v2 , v3} .

Therefore y  c1v1  c2v2  c3v3 .

 4 1 5  3

i.e.  3   c1  1  c2  4   c3  1 
       
 h   2  7   0 

 c1  5c2  3c3  4
c1  4c2  c3  3
2c1  7c2  0c3  h

1 5 3 : 4 
Consider the augmented matrix [ A : y ]  1 4 1 : 3 

 
 2 7 0 : h 

R2  R1 , R3  2 R1  R3  3R2 
1 5 3 4  1 5 3 4 
~ 0 1 2 1  0 1 2 1  .
 
0 3 6 h  8 0 0 0 h  5

23
 Unit I Linear Algebra and Random Variables (LARV) HS10109

For h  5, [ A]  [ A : y]
 The system of equations is consistent.
Hence, y  span {v1 , v2 , v3} iff h  5 .

ii) {v1 , v2 , v3} does not span 3

because the system of equations v  c1v1  c2v2  c3v3 is

not consistent for every v  .

1  2 4  3
Q 3) Let v1  0 , v2  1 , v3  2 , w  1 
     
       
 1  3 6   2

i) Is w belong to the set {v1 , v2 , v3} ?

ii) How many vectors are in the set {v1 , v2 , v3} ?

iii) How many vectors are in span{v1 , v2 , v3 } ?

iv) Is w  span {v1 , v2 , v3} ? Why?

v) Is span {v1 , v2 , v3}  3

?

Soln. i) No. w is not a member of the set {v1 , v2 , v3} because w  v1  v2  v3 .

ii) Total number of vectors in the set {v1 , v2 , v3} are 3.

iii) There are infinite numbers of vectors in span{v1 , v2 , v3 } .

iv) w  span {v1 , v2 , v3}

Consider, w  c1v1  c2v2  c3v3

3 1  2  4
1   c  0   c 1   c  2
  1  2  3 
 2  1  3  6 

c1  2c2  c3  3
0c1  c2  2c3  1
c1  3c2  6c3  2

 1 2 4 3
Consider the augmented matrix, [ A : B]   0 1 2 1 
 
 1 3 6 2 

 1 2 4 3 1 2 4 3 
R3  R1 R3  5R2
0 1 2 1  0 1 2 1 
      
0 5 10 5 0 0 0 0 

ρ[ A : B]  ρ[ A]  The system of equations is consistent.

24
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

v) Consider v  c1v1  c2v2  c3v3

v  AC, as [ A]  2  [ A, v] for every v  3

..

 This system is not consistent for every v  3

.

 Span {v1 , v2 , v3}  3

.

Exercise 1.4
Q 1) Find the value of k, for which v  (3, 0, k ) be in the subspace spanned by u1 , u2 , u3
where u1  1,  1, 2 , u2   2, 4,  2  , u3  (1, 2,  4).

Q 2) Determine if y is in the subspace of 4 spanned by v1 , v2 , v3 , where

6 5  5  9 
7 8 8  6 
y   , v    , v1    , v  
 1  2  5  9  1  3 
       
 4 3  2  7 

# Linearly Dependent / Independent Set

Let H  {v1 , v2 , v3 , , vn } be a subset of a vector space V . H is said to be linearly dependent if

there exist scalars (real numbers) c1 , c2 , , cn not all zero such that

c1v1  c2v2  c3v3   cnvn  0 .

H is said to be linearly independent if c1v1  c2v2  c3v3   cnvn  0 implies

c1  c2   cn  0 .

Note: i) H is linearly independent if and only if the system c1v1  c2v2  c3v3   cnvn  0 has
trivial solution only, i.e. otherwise the set is linearly dependent.
ii) A set containing zero vector is linearly dependent.
iii) Set consists of single non – zero vector is linearly independent.

Theorem1.6: - If the set of vectors are linearly dependent then one of the vectors is expressible as a
linear combination of the remaining.
Proof:- The set is linearly dependent, c1v1  c2v2  c3v3   cnvn  0 has a non-trivial

solution.  Atleast one of c1 , c2 , , cn is non-zero.

1
Let us assume that c2  0 . Then v2  (c1v1  c3v3   cn vn ) .
c2

25
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Method of checking Linearly Dependent / Independent Set

Step 1: Consider, c1v1  c2 v2  c3v3   cn vn  0
 c1 
c 
AC  0 where A   v1 v2 v3 ... v n  , C   2  .
 ... 
 
cn 
Step 2: Find rank of A.
Let ρ( A)  r
Step 3: i) If ( A)  r  n (Number of unknowns), then set is linearly independent .
ii) If ( A)  r  n (Number of unknowns), then set is linearly dependent .
Step 3 : If dependent find relation between the vectors.

Illustrative Examples
Q 1) Determine whether S  {1  t , 2t  3t 2 , t 2  2t 3 , 2  t 3} is linearly dependent or
independent. If dependent, find the relation between them.
Soln. Let v1  1  t , v2  2t  3t 2 , v3  t 2  2t 3 , v4  2  t 3 .

Consider, c1v1  c2v2  c3v3  c4v4  0 .

c1 (1  t )  c2 (2t  3t 2 )  c3 (t 2  2t 3 )  c4 (2  t 3 )  0  0 t  0 t 2  0 t 3
This is ideally zero for every „t‟ iff
c1  2c4  0
c1  2c2  0
3c2  c3  0
2c3  c4  0

1 0 2
0  c1 
 1 2 0 0  c 
i.e.   2  0
0 3 1 0  c3 
   
0 0 2 1  c4 
1 0 2
0 1 0 2
0 1 1 0 02
 1 2 0 0   2 0 2  R2 0 1 0 1 
R2  R1 0
Let A     
2
0 3 1 0 0 3 1 0 0 3 1 0
     
0 0 2 1  0 0 2 1  0 0 2 1 

1 0 0 2 1 0 0 2
0 1 0 1  0 1 0 1 
R3  3R2 R4  2 R3
     
0 0 1 3 0 0 1 3
   
0 0 2 1 0 0 0 5

26
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

[ A]  4  number of unknowns.
 The system has a trivial solution only.
 Set of vectors are linearly independent.
 1 0  2 1   3 4  3 3 
Q 2) Determine whether the set of vectors H    ,  ,  ,    is
  2 3  1 0  2 3  1 3  
linearly dependent or independent? If dependent, find the relation.
1 0   2 1  3 4  3 3
Soln.: Let v1    , v2    , v3    , v4   .
 2 3  1 0  2 3 1 3
Consider c1v1  c2v2  c3v3  c4v4  0 . ---------- (i)

1 0   2 1  3 4  3 3
c1    c2  1 0  c3 2 3  c4  1 3 0
 2 3      
c1  2c2  3c3  3c4  0
c2  4c3  3c4  0
2c1  c2  2c3  c4  0
3c1  3c3  3c4  0

1 2 3 3 1 2 3 3
 0 1 4 3 0 1 3
R3  2 R1 , R4  3R1 4
A   
 2 1 2 1  0 0 16 16 
   
3 0 3 3  0 0 30 30 

1 1 1 2 3 3 1 2 3 3
R3 , R4 0 1 4 3  4 3
(16) R4  R3 0 1
 
30
  
0 0 1 1 0 0 1 1
   
0 0 1 1 0 0 0 0

[ A]  3  number of unknowns  4
 The system has a non-trivial solution.
 Vectors are linearly dependent.
Equivalent system is
c1  2c2  3c3  3c4  0
c2  4c3  3c4  0
c3  c4  0

Let c4  k , k  0  c3  k

c2  4k  3k  0, c2  k , c1  2k  3k  3k  0, c1  2k

Put values of c1 , c2 , c3 , c4 in (i), 2kv1  kv2  kv3  kv4  0 .

27
 Unit I Linear Algebra and Random Variables (LARV) HS10109

2kv1  kv2  kv3  kv4  0 , i. e., 2v1  v2  v3  v4  0

Q 3) Let H  {v1 , v2 , , vk } spans V. Show that if H is linearly dependent then

H1  {v1 , v2 , , vk 1} also spans V.

Soln. Let v V then as H spans V, v  d1v1  d2v2   dk vk .

If H is linearly dependent, then any vector in H is expressible as the linear combination of
others. Therefore let vk  c1v1  c2v2   ck 1vk 1 . Substituting this in v

v  (d1  dk c1 )v1  (d2  dk c2 )v2   (d k 1  d k ck 1 )vk

Thus v is expressible as linear combination of vectors in H1 . Hence H1 spans V.

Q 4) Determine by inspection if the given set is linearly independent
1 4 1 3 0  1  2 
a)  1 ,  7 ,
 
 1 ,
 
1 
  b) 0  ,  5  , 3
   
 6   2   2   4  0   7  1 
 2   5 
1 2  4  4  10 
c) 1 , 3 ,
 
 6 
  d)   ,  
6  15
1  4   8    
10   25 
Soln. a) Set is linearly dependent, because it contains 4-vectors in 3
.
b) Set is linearly dependent, because it contain zero vector.
2  4 
  1  
c) Set is linearly dependent, because  3    6 .
2
 4   8
d) Set is linearly independent as there is no relation between them.

Exercise 1.5

Q 1) Are the following vectors linearly dependent? if so find the relation between them.
i) (2,  1, 3, 2), (1, 3, 4, 2) and (3,  5, 3, 2)
ii) [3 0 2 4 5], [7 2 6 1 0], [1 2 2  7  10].
iii) [9 0 9] , [0 6 6], [3 3 0].
iv) (1, 2,  1, 0), (1, 3, 1, 2), (4, 2, 1, 0), (6, 1, 0, 1).

Q 2) Determine the given functions are linearly dependent or independent if dependent find
the relation between them.
i) p1 ( x)  1  3x  3x 2 , p2 ( x)  1  2 x  x 2 , p3 ( x)  2  5 x, p4 ( x)  3  8 x  2 x 2 .

28
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

 1 0   0 1  1 0 1 3 
Q 3) Determine whether the set of vectors H    ,  ,  ,    is linearly
  2 1  1 0  2 0 1 3 
dependent or independent? If dependent, find the relation.

Q 4) Let f ( x)  x and g ( x)  x , determine wheather f ( x) and g ( x) areindependent in

C  1, 1 or in C 0, 1.

Basis of a Vector Space

A subset B  {v1 , v2 , , vn } of a vector space V is a basis for V if
1) B is linearly independent.
2) V  span {B} , i.e. B spans V.
Note That : i) A given vector space may have more than one bases.
e.g. B1  {e1  (1, 0) , e2  (0, 1)} , B2  {v1  (1, 1), v2  (1, 1)}
2
Both B1 & B2 are bases of .
ii) A set having maximum number of linearly independent vectors is the basis.
iii) Minimum number of vectors which spans the set is the basis.
iv) If B  {v1 , v2 , , vn } is basis for vector space V, then every vector in V can
be written in one and only one as a linear combination of vectors in B.
v) If a vector space V has one basis with n vectors, then every basis for V has n
vectors.
Dimension of a vector space
Number of elements in a basis is known as the dimension of the vector space.
If basis of vector space V contains finite number of vectors, the vector space is finite dimensional.
Otherwise it is said to be infinite dimensional.
# If basis of a vector space V has n-vectors then dimension of V  dim(V )  n & dim{0}  0 .
Note That: 1) In an n-dimensional vector space V, “ n  1 ” vectors are linearly dependent.
2) In an n-dimensional vector space V, “ n  1 ” vectors do not span vector space V.
 Standard Bases
1) V 
n

B  {e1 , e2 , , en }

where, e1  (1, 0, , 0), e2  (0, 1, , 0) , , en  (0, 0, , 0, 1) .  dim( n

)n.

 1 0   0 1   0 0   0 0  
2) V  M 2  2 ( ) . B    ,  ,  ,     dim(M 2  2 ( ))  4 .
  0 0   0 0  1 0   0 1  

29
 Unit I Linear Algebra and Random Variables (LARV) HS10109

(Note: If V  M m  n ( ) then dim(M m  n ( ))  mn )

3) V  Pn ( x) : space of polynomials in x at most degree n . Basis of Pn ( x) is

B  {1, x, x2 , , xn }  dim( Pn ( x))  n  1 .

Illustrative Examples
1   1
Q 1) Is B  {v1 , v2 } a basis of 3
, where v1  2 , v2   2  ?
 
   
1   1 

Soln. No. Because dim( 3

)  3.

1   1
Q 2) Is B  {v1 , v2 } a basis of 2
, where v1  2 , v2   2  ?
 
   
1   1 

Soln. No. Because v1 & v2 are not even the members of 2

.

Q 3) What is the span {B} in the above example?

Soln. It is a plane through origin. Since 3 non-collinear points viz origin, point corresponding to
vector v1 and point corresponding to vector v2 forms a plane.
n
Note That: If Basis of subsapce V of contains

i) 1  vector, then geometricallyit is a straight line in n

through origin.
ii) 2  vectors, then geometricallyit is a plain in n
through origin.
Illustrative Examples
Q 1) Determine whether the set is a basis for M 2  2 ( ) ?

 1 0  1 0  2 1  1 1 
S   ,  ,  ,  
 0 1   1 1  1 0 0 1 
Soln. Since dim(M 2  2 ( ))  4 and S contains 4 vectors, therefore S is a basis for M 2  2 ( ) if

and only if given set of vectors are linearly independent.

1 0   1 0 2 1 1 1
Let v1    , v2   1 1 , v3  1 0  , v4  0 1
0 1       
1 1 2 1
0 0 1 1 
Consider c1v1  c2v2  c3v3  c4v4  0 . i.e. AC  0 where A   .
0 1 1 0
 
1 1 0 1

30
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

1 1 2 1 1 1 2 1
0 0 1 1  0 1 1 0 
R4  R1  R2  R3 
   
0 1 1 0 0 0 1 1
   
0 2 2 0 0 2 2 0

1 1 2 1 1 1 2 1
0 1 1 0  0 1 1 0 
R4 2 R2  R4 4 R3 
   
0 0 1 1 0 0 1 1
   
0 0 4 0 0 0 0 4

 ( A)  4  number of unknowns. Hence given set of vectors are linearly independent.

Hence S is a basis for M 2  2 ( ).

Q 2) Determine whether the set S  (1, t , 1  t 2 ) a basis for P2 ?

Soln. dim(P2 (x ))  3 and S has exactly 3 elements, it forms a basis for P2 ( x) iff set of vectors
are linearly independent.
Let v1  1, v2  t , v3  1  t 2

Consider c1v1  c2v2  c3v3  0 ,

1 0 1 
where A  0 1 0   ( A)  3  number of unknowns
 
0 0 1 

Hence given set of vectors are linearly independent.

 S forms a basis for P2 .
Note That: If W is a subspace of an n-dimensional vector space, then dimension of W is less than
or Equal to n.
Method of determining the dimension of a subspace: dimension of a subspace can be
determined by finding a set of linearly independent vectors that spans the subspace. This set is a
basis for the subspace and the number of vectors in it is the dimension of the space.

Illustrative Examples
4
Q 1) Determine the dimension of each subspace of .
a) S   a, a  b, b, a  c  : a, b , c  
b) S   3a, a, b, 0  : a, b 
Soln. a)  a, a  b, b, a  c   a(1, 1, 0, 1)  b(0, 1, 1, 0)  c(0, 0, 0, 1)
we can see that S is spanned by (1, 1, 0, 1), (0, 1, 1, 0) and (0, 0, 0,  1)
and can easily be shown that the set of vectors are linearly independent.

31
 Unit I Linear Algebra and Random Variables (LARV) HS10109

 B  (1, 1, 0, 1), (0, 1, 1, 0), (0, 0, 0,  1) is a basis for S.

 dim( S )  3.
b)  3a, a, b, 0  =a(3, 1, 0, 0)+b(0, 0, 1, 0)
we can see that S is spanned by (3, 1, 0, 0), (0, 0, 1, 0)
and can easily be shown that the set of vectors are linearly independent.
 B  (3, 1, 0, 0), (0, 0, 1, 0) is a basis for S.
 dim( S )  2.

a b 
Q 2) If W     : a, b, c   is a subspace of M 22 . what is a dimension of W?
 0 c  
a b 1 0 0 1  0 0
Soln.  0 c   a 0 0  b 0 0  c 0 1 
       
 1 0   0 1   0 0  
So, theset B     , 0 0 , 0 1   is a basis for W .
  0 0     
 dim(W )  3.

  a  3b  2c  
  
 b  4c  3d  
Q 3) Find the dimension of the subsapce W    : a, b, c, d  
  a  3c  2 d  
   
  2a  5b  2c  d  
 a  3b  2c  1   3 2 0
 b  4c  3d  0 1  4  
Soln.    a    b    c    d  3
 a  3c  2d  1  0  3  2
         
 2a  5b  2c  5d  2 5  2  5
1   3 2 0
0 1  4  3
i.e. W is spanned by   ,  ,  ,  
1  0  3  2
       
2 5  2 5
These vectors is a basis for W if vectors are linearly independent

1 3 2 0  1 3 2 0 
0 1 4 3  R3  R1 , R4 2 R1 0 1 4 3 
 consider A    
1 0 3 2  0 3 5 2 
   
2 5 2 5  0 11 6 5 

1 3 2 0  1 3 2 0 
0 1 4 3  R4  387 R3 0 1 4 3 
R3 3 R2 , R4 11R2
     
0 0 7 7  0 0 7 7 
   
0 0 38 38  0 0 0 0 

32
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

( A)  3

basis for subspace W of 4

pivote columns of A .

 1   3 2
  1  4 
 0   
basis for subspace W  B     ,  ,
 1  0  3 
  2  
5
 
 2 
 dim(W)  3.

Exercise 1.6

Q 1) Determine the dimension of set of all symmetric matrices of order 3.

1   2 6 5 0

0  1  1  3 3
Q 2) Find a basis for the space spanned by   ,  ,  ,  ,  .
0   1 2 3  1
         
1  1  1  4 1

Q 3) W   x, y, z  : x  y  z  0, prove that W is a subspace of 3

.
Determine the dimension of W.

Q 4) Let U   x, y, z  : 2 x  3 y  z  0 and V   x, y, z  : x  2 y  z  0 be the subspaces

3
of .
i) Find a basis for U V . ii) Determine the dimension of U  V .
iii) Describe U , V , U V and U  V geometrically.
1  0  0 
Q 5) Let v1  0 , v2  1  , v3  1  and let W  ( x, y, y)T : x, y 
   
.
1  1  0
Every vector in W is expressed as
 x 1  0 0
 y   x 0  ( x  y ) 1   y 1  for any x and y.
       
 z  1  1  0
Is v1 , v2 , v3  a basis for W ?

Q 6) Find a basis and dimension of the solution space of the homogeneous system of equations.
i) x1  2 x2  5 x3  11x4  3x5  0
2 x1  4 x2  5 x3  15 x4  2 x5  0
x1  2 x2  4 x4  5 x5  0
3x1  6 x2  5 x3  19 x4  2 x5  0

33
 Unit I Linear Algebra and Random Variables (LARV) HS10109

ii) x1  4 x2  2 x4  x5  0
3x1  12 x2  x3  5 x4  5 x5  0
2 x1  8 x2  x3  3x4  2 x5  0
5 x1  20 x2  2 x3  8 x4  8 x5  0
Column space, Row space and Null space of a Matrix
# Column Space of a Matrix
Let A be m  n matrix. Column space of matrix A is the set of all possible linear combinations of

columns of A, denoted as col( A) .

i. e. If A  v1 v2  vn  , then col( A)  span v1 v2  vn 

Note That : 1) Number of columns of A  n

2) Number of vectors in col ( A)  infinite.
m
3) col ( A) is a subspace of .

4) y  col ( A) means the system of linear equations y  AX for some

X n
is consistent.
i. e. col ( A)   y  m
: y  AX for some X  n

5) Elementary row operation on a matrix does not affect the linear dependence relation
among the columns of the matrix.
6) The Pivot columns of matrix A form a basis for Col(A).

# Row Space of a Matrix

Let A be m  n matrix. Row space of matrix A is the set of all possible linear combinations of rows

of A, denoted as row ( A) .
Note That : 1) number of rows of A  m
2) number of vectors in row ( A)  infinite
n
3) row ( A) is a subspace of

4) y  row ( A) means this system of linear equations y  A T X for some X  m

is consistent.

# Null Space of a Matrix

Let A be m  n matrix. Null space of A is the set of all those vectors in n
which get map on to

zero by A , denoted as Null( A) , i. e. , Null( A)  {x  n

| AX  0} .
n
Note That : 1) Null ( A) is a subspace of .

34
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

0  Null ( A) . Let x1 , x2  Null ( A) , then

A x1  0, A x2  0  A ( x1  x2 )  A x1  A x2  0  x1  x2  Null( A)

 ( A x1 )   A x1  0   A  Null ( A)
n
Null (A) is the subspace of (solution space of the homogeneous system
AX  0 .)
2) If  ( A)  r , then dim(Null A)  n  r  Nullity of A.

3) dim(col A)  dim(row A)  r .

Theorem1.7: For any matrix A m  n , dim(Null A)  dim(col A)  number of columns of A.

Illustrative Examples
Q 1) Determine the basis for Null ( A), col ( A) and row ( A) and hence determine their
dimensions. Assume that A is row equivalent to B.
 1 3 4 1 9  1 3 0 57 
 2 6 6 11 10   2 3 8 
A  , B  0 0
 3 9 6 6 3  0 0 0 0 5
   
 3 9 4 9 0  0 0 0 0 0

Soln.: Given: A B.
Each non-pivot columns of B is a linear combination of pivot columns.
In this example it is to observe that
3 3
b2  3b1 and b4  5b1  b3 a2  3a1 and a4  5a1  a3
2 2
by spanning set theorem we may discard a2 and a4 , to get Basis for column space of
A, is the set containing pivot columns of A.
 1  4  9 
   6  10 
 2  
Basis for col ( A)     ,  , 
  3  6  3  
  3   
4
 
 0  
dim(col A)  3
Basis for row space of A, is the set containing pivot rows of B.
Therefore Basis for
row ( A)  1 3 0 5 7 , 0 0 2 3 8 , 0 0 0 0 5

dim(row A)  3

35
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Basis for Null ( A)  is the solution space of AX  0 .

x1  3x2  5 x4  7 x5  0
Equivalent system is 2 x3  3x4  8 x5  0
5 x5  0

 x5  0

Let x4  k1 & x2  k2 , x1  3k2  5k1 .

 x1  3k2  5k1   5  3

x   k  0 1 
 2  2     
 Solution vector X   x3    3k1   k1  3   k2 0
       
 x4   k1  1 0
 x5   0   0  0

  5  3 
  1  
  0    
Basis for Null ( A)    3  , 0   . dim Null ( A)  2
 1   
  0 
  0  0  

Q 2) Find k such that

k
i) Null space of A is subsapce of and
k
ii) column space of A is subsapce of .
1 2 1 5 
3 1 1 1 

where A  7 6 5 2
 
1 2 3 1 
 2 0 1 3 

Soln.: i) Here A is 5  4 matrix and we know that Null space is a subspaceof 4

,  k  4.

ii) Here A is 5  4 matrix and we know that column space is a subspace of 5

,  k  5.

 8 2 9 2
Q 3) Let A   6 4 8  and w   1  .
 4 0 4   2

i) Determine if w is in column space of A.

ii) Is w in null space of A?
iii) Is w in row space of A?

Soln.: i) w will be in column space of A, if there exists some vector x  3

such that Ax  w is consistant.

36
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

 8 2 9 2  R  2 0 2 1
let  A, w   6 4 8 1    6 4 8 1 
  R1  2
2

 4 0 4 2   8 2 9 2 

 2 0 2 1 1
 2 0 2 1
 0 4 2 4   0 4 2 4 
R3  R2
R2 3 R1 , R3  4 R1 2
  
0 2 1 2 0 0 0 0 

  A, w    A  2,
 the system of linear equations is consistant.
 w  col ( A)
ii) w is in null ( A) if and only if Aw  0
 8 2 9   2  0 
Aw   6 4 8   1   0 
 4 0 4   2  0 
 w  null ( A).

iii) w will be in row space of A, if there exists some vector x  3

such that AT x  w is consistant

 8 6 4 2   1 2 0 0 
 AT , w   2 4 0 1  R1  R3
  2 4 0 1 
   
 9 8 4 2   9 8 4 2 

1 2 0 0  1 2 0 0 
  0 0 0 1  
R2  2 R1 , R3  9 R1 R2  R3

 0 10 4 2 
 
0 10 4 2  0 0 0 1 
  A, w    A
 w  Row( A).
Q 4) If AX  V and AX  W are both consistant. Is the equation AX  V  W consistant?
Soln.: AX  V is consistant means V  col ( A), and AX  W is consistant means W  col ( A).
But col ( A) is a subspace.
V  W  Col ( A)
 AX  V  W is consistant.

5  1  2
Q 5) Let H  Span v1 , v2  and W  u1 , u2  , where v1  3 , v2   3 , u1 
   1 ,
 
8  4  4 

0 
and u2  0  and K  H W , find the basis for K.
1 

37
 Unit I Linear Algebra and Random Variables (LARV) HS10109

Soln. Geometrically H and W are the planes in 3

.
 H W is a line of intersection of the plains H and W .
 K can be written as c1v1  c2v2 and also as c3u1  c4u4 .
 K is a solution space of c1v1  c2v2  c3u1  c4u4 .
i. e. K is a solution space of c1v1  c2v2  c3u1  c4u4  0
In the matrix notation it can beexpressed as AC  0

5 1 2 0 1 5 4 0
where A  3 3 1 0  
 R1  2 R2
 3
 3 1 0 
8 4 4 1  8 4 4 1 

1 5 4 0 1 5 4 0
R2 3 R1 , R3 8 R1
 0 12 11 0  
3 R3  R2
 0 12 11 0 
 
0 4 36 1  0 0 97 1 
( A)  3

Let c4  k be a free variable

1 11 11
c3  k , c2  k, c4   k
97 1164 1164
 1 
 97 k 
  12 
 11  11  
C  k  1 k
1164  1164  
   1
 11
k
1164 
 12  
 
Basis for K    1   .
  1 
  

38
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Exercise 1.7

Q 1) If f ( x)  cos2 x, g ( x)  sin 2 x, then determine which of the following are in the subspace
spanned by f ( x) and g ( x).
a) 3 b) cos 2 x c) 0 d) 3  x2 e)eix f) sin 2 x

Q 2) Find the bases for the row(A), col(A) and null(A) for each of the following matrices.
 0 1 1 2 1 
1 1 2 3 1 
1 2 1 5  

a) A   2 4 3 0   b) B   2 1 1 8 3
 
1 2 1 1   0 0 2 2 1
 3 5 5 5 10 

4
Q 3) Determine if the columns of the matrix A span .
5 1 2 4 
1 0 2 3
A .
1 1 6 1 
 
1 0 0 4 

1 1 0 0
0 1 3 1 
Q 4) Find the basis for solution spaceof AX  0 where A   .
 1 0 1 1
 
0 2 2 2 

4
Q 5) Find the dimension of the subspace Wof spanned by
U  (1, 2, 5, 0), (3, 0, 1,  2), (5, 4, 9, 2).

Q 6) Let V  ( x1 , x2 , x3 , x4 ) : x1  x2  x3  0
W  ( x1 , x2 , x3 , x4 ) : x2  x3  0, x3  2 x4  be two subspaces of 4
.
Find basis for V , W , V  W and V  W .

Q 7) Determine whether w is in the col ( A), null ( A) or both

7 6 4 1  1
 5 1 0 2  1
A   , w   .
 9 11 7 3  1
   
19 9 7 1   3

Q 8) Determine if the following statements true or falls, and justify your answers.
a) A linearly independent set in a subspace H is a basis for H .
b) The columns of a nonsingular matrix forms a basis for Col ( A).
c) The null space of an m  n matrix A is a subsapce of m
.

39
 Unit I Linear Algebra and Random Variables (LARV) HS10109

d) col ( A)is a set of vectors that can be written as AX for some X .

3 3
e) A plain in is two dimensional subspace of .
f) The dimension of vector space P3 (set of all polynomials at most of degree 3), is 3.
g) If the 6  3 matrix A rank 3, then dimension of Null ( A)  0.
h) If the 4  5 matrix A has 4 pivote columns, then col ( A)  4
.

Q 9) Determine if the following statements true or falls, and justify your answers.
a) If the dim( Null ( A56 ))  5, then dim (Col ( A))  2.
b) If A is 6  8 matrix, then the smallest possible dimension of null ( A) is1.
c) V   Ann : AT  A1 , is a subspace of M nn .
d) If U and W are linearly independet subset of a vector space V , so is theor union U  W .
e) For any m  n matrix A, dim(Col ( AT ))  dim( Null ( AT )  m.
f) Let U be a subspace of V and x and y are vectors in V such that x  y U , then
x  U and y  U .

1 3
Q 10) Let v1   1 , v2   1 . determine if v1 , v2  is a basis for 2
.
 2   5 
Is v1 , v2  is a basis for 3 ?

1 1 2  2

Q 11) Let v1   2 , v2   1  , v3   2 , v4   4 .
     
 5   1  3   9 
Find a basis for the subspace W spanned by v1 , v2 , v3 , v4 .

0 0  0 

 
Q 12) Let v1  1 , v2  0 , and H   t  : t 
   
.
     
0 1   t  
  
0 0 0
Then every vector in H is a linear combination of v1 and v2 because  t   t 1   t 0 .
 t  0 1 
Is v1 , v2  a basis for H .

Q 13) Find the a basis and the dimension of the solution space of the homogeneous system of
equation
i) 2 x1  4 x2  3x3  6 x4  0 ; x1  2 x2  2 x3  5x4  0 ; 3x1  6 x2  5x3  11x4  0 .
ii) x1  3x2  x3  x4  0 ; 2 x1  x2  x3  2 x4  0 ;
x1  4 x2  2 x3  x4  0 ; 5x1  8x2  2 x3  5x4  0 .
iii) 2 x1  2 x2  x3  x5  0;  x1  x2  2 x3  3x4  x5  0;
x1  x2  2 x3  x5  0; x3  x4  x5  0.

40
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

Q 14) i) Prove that the set of all singular 2  2 matrices is not a vector space.
ii) Determine whether a set is a subspace of 4 . W  ( x, x  y, y, y) : x, y  .
Q 15) a) The two matrices A and B are row-equivalent.
 2 4 0 1 7 11  1 2 0 0 3 2 
 1 2 1 1 9 12   
A  , B  0 0 1 0 5 3
 1 2 1 3 5 16  0 0 0 1 1 7 
   
 4 8 1 1 6 2  0 0 0 0 0 0 
i) Find rank of A.
ii) Find a basis for a row space of A.
iii) Find a basis for a column space of A.
iv) Find a basis for a Null space of A.
v) Is the last column of A is in the span of the first three columns?
b) Assume that A is row equivalent to B . Find the basis for Nul ( A) and Col ( A) .
 1 2 5 11 3 1 2 0 4 5
 2 4 5 15 2   0 0 5 7 8 
A , B   
1 2 0 4 5  0 0 0 0 9 
   
 3 6 5 19 2  0 0 0 0 0

Q 16) Determine whether the set of vectors in P2 are linearly independent or dependent
S  1  x  2 x 2 , 2  5x  x 2 , x  x 2 if dependent find the relation between them.

Q 17) Which of the following are subspace of a given vector space V ? Justify?
i) w  ( x, y) / y  ax, where a isinteger , V  R .
2

ii) w  ( x, y) / x 2  y 2  1 , V  R 2 .
iii) w  ( x, y, z ) / x  y  z  0 , V  R .
3

5b  2c 
iv) w be the set of all vectors of the form  b  ; V  R 3 .
 c 
3
 2 4 2 1   2  3

Q 18) Let A   2 5 7 3 , u    , v   1 .
 1
 3 7 8 6     3 
0
i) Determine if u is in Nul  A . Could u be in col  A ?
ii) Determine if v is in col  A . Could v be in Nul  A ?

Q 19) Let A be a n  n square matrix, and let  be a scalar. Prove that the set
S   X : AX   X  is a subspace of n
. Determine the dimension of S if   3 and
3 1 0
A  0 3 0  .
0 0 1 

41
 Unit I Linear Algebra and Random Variables (LARV) HS10109

1  2  4  3
Q 20) Let v1   0  , v2  1  , v3   2 , and w  1  .
     
 1  3  6   2
i) Is w in v1 , v2 , v3 ? How many vectors are in v1 , v2 , v3 ?

ii) How many vectors are in span v1 , v2 , v3 ?

iii) Is w in the subspace spanned by v1 , v2 , v3 ? Why?

Q 21) Determine which of the following are subspaces of stated vector space.
i) S   Ann : AX  0 has only the trivial solution is a subspace of Mnn
ii) S  (a, b, c) : b  a  c  1 is a subspace of R3.
iii) S  a0  a1 x  a2 x 2  a3 x3 : a0  a1  a2  a3  0 is a subspace of P3 .

Q 22) a) If the null space of 5  6 matrix A is 4-dimensional, what is the dimension of column
space of A?
b) A is 6  8, what is the smallest possible dimension of Nul ( A)?
c) If a 6  3 matrix A has rank 3, What is the dimension of Nul ( A), Dim Row( A),
and rank ( AT )?

Q 23) a) Prove that the set of all singular 2  2 matrices is not a vector space.
b) Determine whether a set is a subspace of 4 . ( x, x  y, y, y) : x, y  .
 
c) 2, x  1, x 2 , 1  x  2 x 2 is linearly dependent in P2 , justify.

Q 24) Find the basis for the subspace spanned by v1 , v2 , v3 , v4 and v5 .

1 0  3 1 2
0 1  4  3 1
 ,  ,   ,  ,  
 3 2 1  8  6
         
2  3 6 7 9

Q 25) Let W be the set of vectors of the form

i)  s  3t , s  t , 2s  t , 4t  ii)  s  5t , 3  t , 2s  7t , 4t  t 
T T

4
Which of the above are subspace of .

 4 5 9 2 1 2 6 5
Q 26) If A  6 5 1 12 and B  0 1 5 6  where A
  B Find basis for Col(A),
   
 3 4 8 3 0 0 0 0 

Row(A) and Null(A) and state its dimension.

Verify Rank ( A)  Nullity( A)  Number of columns of A.
Q 27) Mark each statement true or false. Justify each answer.

42
 Linear Algebra and Random Variables (LARV) HS10109 Unit I

a) A set containing zero vector is linearly independent.

b) A basis is a spanning set that is as large as possible
c) A basis is a linearly independent set that is as large as possible.
d) The additive inverse of a vectors is not unique
e) A subspace is also a vector space
 x  
f) W     : xy  0 is a subspace of 2
 y  
g) All polynomials of the form p(t )  a  t 2 , where a  R is a subspace of P2 .
h) If the columns of an m  n matrix A span Rm , then the equation AX  b is consistent
for each b  Rm .
i) Suppose a 4  7 matrix has four pivot columns. Then dim( Null A)  3.
j) A single vector by itself is linearly dependent.

3
Q 28) For what value of h will y be in the subspace of spanned by v1 , v2 , v3 , if
1 5  3  4
v1   1 , v2   4  , v3   1  , and y   3  .
 2   7   0   h 

Q 29) Determine whether a set is a basis for M 2,2 .

 1 0  2 1   3 4  3 3 
S   ,  ,  ,   .
  2 3  1 0  2 3  1 3  
Q 30) i) Ax  b has a solution under what condition on b , for the following A and b ?
1 2 0 3  b1 
A   0 0 0 0  and b  b2 
 
 2 4 0 1  b3 
ii) Find the basis for the null space of A and find its dimension.
iii) Find the solution to Ax  b , when a solution exists.
iv) Find the basis for column space of A and find its dimension.
v) What is the rank of AT .

 
Q 31) Determine whether S  1  t , 2t  3t 2 , t 2  2t 3 , 2  t 3 a basis for is P3 and hence find its
dimension.

32) Find the basis for the columns space of the matrix and find Nullity( A) for
1 3 1 3
0 1 1 0 

A   3 0 6 1 .
 
3 4 2 1 
 2 0 4 2 

43