Problem set 1

————————————————————————————————————————-
1. (Vector space) Show that following sets form a vector space over R or C.
a. the set of solutions of a homogeneous ode.
b. single variable polynomials with degree less than or equal to n.
c. contiuous functions, differentiable functions (real or complex valued).
d. coumn/row span of a matrix.
e. set of all linear maps from a vector space V to itself.

2. (Subspace) Show that a set of differentiable functions forms a subspace of the vector space
of contiuous functions (over R or C). Construct more examples of subspaces.

3. (Linear dependance/independance)
    Check the following sets for linear dependance/independance.
    1 0      
1 0  1   1  1 0 1
a.  1  ,  1 , b.   ,   c.  1  ,  1  ,  2 .
 0   1 
2 1 1 1 2
1 1
4. (Basis) Find at least two set of bases for R3 apart from standard basis vectors.

5. (Matrix representation) Let {v1 , v2 , v3 } be a basis for V. Let A : V → V. Let Av1 =

α1 v1 + α2 v2 + α3 v3 , Av2 = α4 v1 + α5 v2 + α6 v3 and Av3 = α7 v1 + α8 v2 + α9 v3 . Find a matrix
representation for A w.r.t. a basis {v1 , v2 , v3 }. Let w = β1 v1 +β2 v2 +β3 v3 . Find co-ordinates of Aw.

6. (Change of basis) Let V be a vector space. Suppose vectors are represented by row vectors
instead of column vectors. Find a matrix representation of A : V → V w.r.t. standard basis vectors
{eT T T T
1 , . . . , en }. Let {v1 , . . . , vn } be a new basis. Find the matrix representation of A w.r.t. new basis.

7. (Invariant subspaces) Find

 all invariant 
subspaces of the following matrices.
    1 1 0 0
1 0 0 1 0 0  0
 0 1 0 , 0 5 0 , 1 0 0  .
 0 0 2 1 
0 0 2 0 0 2
0 0 0 2
8. (Jordan and Rational canonical form). Let A : V → V and dimension of V = 6. Suppose
A has eigenvalues {1, 2, 3}. Suppose algebraic multiplicities of eigenvalues {1, 2, 3} are 3, 2 and
1 respectively and geometric multiplicities are 2, 1 and 1 respectively. Find Jordan and rational
canonical forms of A. Find all cyclic subspaces of V. Moreover, find the minimal and the charac-
teristic polynomial of A.

9. (Othonormal set/basis) Construct orthonormal set of vectors from exercise problem 3.

10. (Orthogonal subspaces) Show that ker(A) = Im(AT )⊥ .

11. Show that inner products are preserved for unitary/orthogonal operators.

12. Show that eigenvalues of positive definite matrices are positive.

13. Solve the following least squares problem:
   
1 2   1
 1 1  x1 =  1 
x2
0 0 2

14. (Norms and svd) Find 1−norm and 2−norms of vectors from exercise 3 and 2−norms of ma-
trices in exercise 4. Find svd of matrices in exercise 4.
 
1
15 (Quotient spaces) Let V1 =< > be a subspace of R2 . Find a basis for R2 /V1 .
1
16. Let A : V → V. Show that V/ker(A) is isomorphic to Im(A).

17. Find the least norm solution of the following:

 
 x
1 2 5  1 
  
1
x2 = .
1 1 4 2
x3

18. Show that the determinant of orthogonal matrices is ±1.

19. Show that if A is symmetric, then singular values of A are given by modulus of eigenval-
ues of A (Singular values are always greater than or equal to zero for any matrix).

20. Let JA be a Jordan canonical form of A. Find eJA t .