Linear Algebra II
Linear Algebra II
LINEAR MAPPINGS
Let U and V be vector spaces over the same field K . A mapping T :U →V is called a
linear mapping or a linear transformation if;
~~ ~ ~ ~ ~
1. For any u , v ∈U , T ( u + v )=T ( u )+T ( v ).
~ ~ ~
2. For any scalar k ∈ K and u ∈ U , T (k u )=kT ( u ).
transformation.
~ ~
Solution: Let u =( x 1 , y 1 ) and v =( x 2 , y 2 ) in R and scalar k . Then
2
T (~
u +~
v )=T [ ( x1 , y 1 )+( x 2 , y 2 ) ]
=T ( x 1 +x 2 , y 1 + y 2 )
=( x 1 +x 2 + y 1 + y 2 , y 1 + y 2 )
And
T (~
u )+T ( ~
v )=T ( x 1 , y 1 )+T ( x 2 , y 2 )
=( x 1 + y 1 , y 1 )+( x 2 + y 2 , y 2 )
=( x 1 + y 1 + x2 + y 2 , y 1 + y 2 )
=( x 1 + x 2 + y1 + y 2 , y 1 + y 2 )=T ( ~
u +~
v ).
T (k ~
u )=T [ k ( x 1 , y 1 ) ]=T (kx 1 , ky 1 )
=(kx 1 + ky 1 , ky 1 )=k ( x 1 + y 1 , y 1 )
=kT (~
u)
Hence T is linear.
1
~ ~
Solution: Let u =(1 , 0 ) and v =(0 ,1 ) in R , then
2
T (~
u +~
v )=T [ (1 , 0 )+(0 , 1) ]
=T (1 ,1 )=1+1+1=3
But
T (~
u )+T ( ~
v )=T (1 , 0 )+ T ( 0 , 1 )
3 λ+μ=x
( x , y )=λ (3 ,1 )+ μ ( 1, 1) ⇒ λ+μ= y . Solving these simultaneously
x y 3 x
λ= − , μ= y−
for λ and μ gives 2 2 2 2.
Therefore
x y
( ) 3 x
( x , y )= − (3,1)+ y− (1 , 1)
2 2 2 2 (.
)
Now
2
T ( x , y )=T [ ( )
x y
2 2
3
2
x
− (3 ,1 )+ y − (1 , 1)]
2 ( )
( )
x y
2 2
3
2
x
= − T (3 ,1 )+ y− T (1 , 1)
2 ( )
( )
x y 3 x
= − (2 ,−4 )+ y− (0 ,2 )
2 2 2 2 ( )
=( x− y ,−2 x+2 y )+(0 , 3 y−x )=( x− y ,−3 x +5 y )
Exercise:
linear map.
2. Show that the mapping T : R ⟶ R defined by T ( x , y , z )=( x +1 , 2 y , x + y ) is not
2 3
linear.
3. Let T : R ⟶ R be defined by T (1,1,1,1)=(1,0,−1), T (0,1,1,1)=(2,1,1),
4 3
Suppose
{e1 ,e2 ,e 3 ,⋯,en }is a basis for a vector space V over
K and for ~
v ∈ V suppose
~v=a e +a e +a e +⋯+a e
that 1 1 2 2 3 3 n n , then the coordinate vector of ~
v relative to the
basis
{ei }is the column vector
~[v] =¿(a1¿)(a2¿)(a3¿)(⋮¿) ¿
e
¿
3
v=(4 , 3)∈ R and { f 1 =( 1 , 3) , f 2 =( 2 , 5 ) } be a basis of R2. Find the
Example 1: Let ~
2
~
coordinate vector of v relative to the basis
{f i }.
λ+2μ=4
3 λ+5 μ=3 solving these simultaneously gives μ=9 and λ=−14 .
[~v ]f =¿ (−14 ¿ ) ¿ ¿¿
Therefore, ( 4 ,3 )=−14 f 1 + 9 f 2 and ¿ .
to the basis
{e1 ,e2 ,e 3}.
Solution: Set
= λ1 (1 )+ λ2 t−λ 2 +λ 3 t 2 −2 λ3 t+λ 3
4
Exercise: Let V be the vector space of 2×2 matrices over R . Find coordinate vector
(
A= 2 3
4 −7 ) .
of T in the basis
{ei }. That is
( )
a 11 a21 ⋯ an 1
[T ]e = a 12 a22 ⋯ an 2
⋮ ⋮ ⋯ ⋮
a1n a2 n ⋯ a nn
5
Solution: If (a ,b)∈ R , then ( a , b )=ae 1 + be 2 .
2
T ( e1 )=( 0 , 2)=0 e1 + 2 e2
Therefore,
[T ]e = 0 2
2 −1( )
Example 2: Let T : R ⟶ R be a linear mapping defined by T ( x , y )=(4 x−2 y , 2 x+ y ).
2 2
( a , b )=λ 1 ( 1 ,1 )+ λ2 (−1 , 0 )
⇒ λ1 − λ2 =a , ⇒ λ 1= b , λ 2 =b− a , λ1 =b so
Now,
So
(
[T ]e = 3 −2
1 2 )
Example 3: Let V be a vector space of polynomials in t of deg≤3 and let D : V →V be
d
D( f (t ))= (f (t )).
the differential linear mapping defined by dt Compute the matrix of
2 3
D with respect to the basis {1, t , t , t }.
Solution:
D(1)=0=0⋅1+0⋅t+0⋅t 2 +0⋅t 3
D(t )=1=1⋅1+0⋅t +0⋅t2 +0⋅t 3
D(t 2 )=2t=0⋅1+2⋅t +0⋅t 2 +0⋅t 3
6
D(t 2 )=3 t 2 =0⋅1+0⋅t +3⋅t 2 +0⋅t3
So
( )
0 1 0 0
0 0 2 0
0 0 0 3
[D]=
0 0 0 0
Exercise:
2. Let
A= 1 2
3 4 ( ) and T be the linear mapping from
R
3
to
R
3
defined by
T (~ v where ~
v )= A ~ v is written as a column vector. Find the matrix of T in each
of the following basis.
i. { e1 =( 1 , 0 ), e 2=( 0 , 1) }
ii. { e1 =( 1 , 3) , e 2=( 2 ,5 ) }
3. Each of the sets
Theorem: Let
{e1 ,e2 ,e 3 ,⋯,en }be a basis of V and let T be any operator on V. Then
~
for any vector v ∈ V ,
[T ]e [ ~v ]e=[ T (~v )]e .
7
i. Find the matrix of T in the basis { f 1=(1,1,1),f 2=(1,1,0),f 3=(1,0,0)} .
ii. Verify that
[T ]f [ ~
v ]=[ T (~v )]f
Solution:
(a,b,c)=c(1,1,1)+(b−c )(1,1,0)+(a−b)(1,0,0)
=cf 1 +(b−c )f 2 +(a−b) f 3
( )
3 3 3
[T ]f = −6 −6 −2
6 5 −1
( )
c
~
⇒[ v ]f = b−c
a−b also
8
T (~
v )=(2b+c ,a−4 b , 3 a )
( )
3a
~
[ T ( v )]f = −2 a−4 b
−a+6 b+c
Thus
( )( ) ( )
3 3 3 c 3a
[T ]f [ v ]= −6 −6 −2 b−c = −2 a−4 b =[ T ( ~
~ v ) ]f
6 5 −1 a−b −a+6 b+c
Exercise:
CHANGE OF BASIS
Let
{e1 ,e2 ,e 3 ,⋯,en }be a basis of V and let {f 1 , f 2 ,f 3 ,⋯,f n }be another basis. Suppose
f 1=a11 e 1 +a 12 e 2 +a 13 e 3 +⋯+a1n en
f 2=a21 e1 +a22 e2 +a23 e 3 +⋯+a 2n en
f 3 =a31 e1 +a32 e2 +a33 e 3 +⋯+a 3n en
⋮
9
Then the transpose P of the above matrix of coefficients is called the transitional
( )
a 11 a21 ⋯ an 1
P= a12 a22 ⋯ an 2
⋮ ⋮ ⋯ ⋮
a 1n a2 n ⋯ a nn
Since the vectors are linearly independent, the matrix P is invertible. In fact, the the
−1
inverse P is the transitional matrix from the basis
{f i } back to the basis {ei }.
{ f 1 =( 1 , 1) , f 2 =(−1 , 0) } . Then,
f 1=( 1 ,1 )=( 1 , 0 )+( 0 , 1)=e1 + e2
P= (11 −10 )
Recall: If (a ,b)∈ R , ( a , b )=bf 1 +( b−a ) f 2 so,
2
(
Q= 0 1
−1 1 )
Observe that P and Q are inverses
( )(
PQ= 1 −1 0 1 = 1 0 =I
1 0 −1 1 0 1 )( )
10
Theorem: Let P be the transitional matrix from a basis
{ei } to a basis {f i } in a
−1
Thus the effect of P is to transform the coordinate vector in the new basis
{f i }
=bf 1 +( b−a) f 2 , so
v ]f = b
[~
b−a( ) .
Therefore,
[T ]e = 4 −2
2 1 ( ) .
Also
T ( f 1 )=T ( 1 ,1 )=( 2, 3 )=3 f 1 +f 2
So
[T ]f = (31 −22 ) .
Now
11
P−1 [T ]e P= ( 0
)(
1 4 −2 1 −1
−1 1 2 1 1 0 )( )
= ( 2
−2 3 1 0
= )(
1 1 −1 3 −2
1 2
=[T ]f )( )
Example 2: Consider the following basis of R3 ,
Solution:
~v=(a,,b,c)=a(1,0,0)+b(0,1,0)+c(0,0,1)
i.
=ae 1 +be 2 +ce 3
()
a
~
[ v ]= b
Therefore,
c
Also
~v=(a,b,c)=λ (1,1,1)+ λ (1,1,0)+λ (1,0,0)
⇒
1 2 3
λ1+λ+2 λ3=a¿} λ1+λ2 =b ¿}¿¿ ⇒λ1=c,λ2=b−c,λ3=a−b¿¿
So
¿
~v=(a,,b,c)=cf +(b−c)f +(a−b)f
1 2 3
Therefore,
( )
c
~
[ v ]f = b−c
a−b
12
ii.
f 1=(1,1,1)=e1 +e2 +e 3
f 2=(1,1,0)=e 1 +e 2 +0e 3
f 3=(1,0,0)=e1 +0e2 +0e 3
( )
1 1 1
P= 1 1 0
Therefore,
1 0 0
e 1=(1,0,0)=0 f 1 +0 f 2 +f 3
e 2=(0,1,0)=0f 1+f 2−f 3
e 1=(0,0,1)=f 1 −f 2 +0f 3
( )
0 0 1
Q= 0 1 −1
So that
1 −1 0
( )( )( )
1 1 1 0 0 1 1 0 0
PQ= 1 1 0 0 1 −1 = 0 1 0
1 0 0 1 −1 0 0 0 1 and so P−1 =Q .
iii. Since T ( x , y , z )=(2 y +z , x−4 y , 3 x ),
T (e1 )=T (1,0,0)=(0,1,3)=0e 1+e 2+3 e3
T (e 2 )=T(0,1,0)=(2,−4,0)=2e1−4 e 2+0e 3
T (e3 )=T(0 ,0,1)=(1,0,0)=e1+0e2 +0e 3
( )
0 2 1
[T ]e = 1 −4 0
Therefore,
3 0 0
13
( )
3 3 3
[T ]f = 6 −6 −2
Therefore,
6 5 −1
Now,
( )( )( ) ( )
0 0 1 0 2 1 1 1 1 3 3 3
P[ T ]e P= 0 1 −1 1 −4 0 1 1 0 = −6 −6 −2
1 −1 0 3 0 0 1 0 0 6 5 −1
Hence
[T ]f =P−1 [ T ]e P
Exercise:
dim V =n . Furthermore let {e1 ,e2 ,e 3 ,⋯,em } be a basis of U and {f 1 , f 2 ,f 3 ,⋯,f n }be a
14
T (e1 )=a11 f 1 +a 12 f 2 +a13 f 3 +⋯+a 1n f n
T (e 2 )=a21 f 1 +a22 f 2 +a23 f 3 +⋯+a2 n f n
⋮
( )
a11 a21 ⋯ an 1
[ T ]ef = a12 a22 ⋯ an 2
⋮ ⋮ ⋯ ⋮
a1 n a 2n ⋯ ann
That is, .
and R ,
2
{ f 1=(1,1,1),f 2=(1,1,0),f 3=(1,0,0)} and { g =( 1, 3 ), g =( 2 , 5) }.
1 2
15
T ( f 2 )=( 5 ,−4 )=−33 g1 +19 g2
T (f 3 )=(3,1)=−13 g1 +8g 2
And so
(4
[ T ] gf = −7 −33 −13
19 8 )
ii. Let v=( a ,b , c ), then recall:
(a,b,c)=cf 1 +(b−c)f 2 +( a−b)f 3 so that
( )
c
[ v ] f = b−c .
a−b
T (v )=(3 a+2b−4 c , a−5 b+3 c )
So
( 8 a+11b−15 c )
[ T (v ) ]g = −7−20 b+26 c
Now
)( )(
c
g
f (
[ T ] [ v ]f = −7 −33 −13
4 19 8
b−c =
a−b
−7 c−33 b+33 c−13 a+13 b
4 c+19 b−19 c+8 a−8 b )
(
= −13 a−20 b+26 c
8 a+11b−15 c )
Example 2: Let T : R ⟶ R be defined by T ( x , y )=(2 x−3 y , x +4 y ). Find the matrix of
3 2
T ( x , y )=(2 x−3 y , x +4 y ),
T ( e1 )=( 2 ,1 )=−8 f 1 +5 f 2
16
And so
(5
[ T ]ef = −8 23
−13 )
Example 3: Let
Pn denote the vector space of all polynomials in x of deg≤n over
R.
Let
Pn : P2 →P 3 be the linear mapping defined by T ( P( x ))=xP( x−3 ) , that is
T (c 0 +c1 x+c 2 x 2 )=x(c 0 +c2 ( x−3)+c3 ( x−3 )2 ). Find the matrix representation
[ T ] BB '
where B= {1, x ,x 2 } and B'= {1, x ,x 2 , x 3 } .
Solution:
T (1)=x=0⋅1+1⋅x+0⋅x 2 +0⋅x 3
T ( x)=x( x−3 )=x 2−3 x=0⋅1+3⋅x+1⋅x 2 +0⋅x 3
T ( x2 )=x( x−3)2 =x(x 2 −6 x+9)=x 3 −6 x 2 +9 x=0⋅1+9⋅x−6⋅x 2 +1⋅x 3
So
( )
0 0 0
[ T ] BB ' = 1 −3 9
0 1 −6
0 0 1
Solution:
17
⇒¿λ1=13 ¿ } λ1+λ2=14 ¿ }¿ ¿⇒λ1=13, λ2=1, λ3=−10¿
Therefore, T (1+ x+x 2 )=13(1+x+x 2 )+1( x+x 2 )−10(x 2 )
T ( x+x 2 )=2 x +3+(2 x +3)2 =12+14 x +4 x2
=λ1 (1+ x+ x 2 )+ λ 2 ( x+ x2 )+ λ 3 ( x 2 )
( )
13 12 9
[ T ]= 1 2 3
−10 −10 −8
Example 5: : Let
f :R ⟶R
3 2
18
Solution: ( x , y , z)=x (1 , 0 ,0 )+ y (0 , 1 ,0 )+z(0 , 0 ,1 ) and therefore,
=x(2,1)+x(5,−4)+z(−3,7)
( a , b )=λ 1 ( 1 ,3 )+ λ 2 ( 2 ,5 )
Now,
T ( 1, 1 , 1)=( 4 , 4 )=−12 g 1 +8 f 2
T ( 1, 0 , 0 )=( 2 , 1)=−8 g 1 +5 f 2
Therefore,
[ T ] g=B
f =B = (8
' −12 −41 −8
24 5 )
Example 6: Let
( )
1 3 −1
A= 2 0 5
6 −2 4 be the matrix of T : P2 → P 2 with respect to the
B= {v 1 , v 2 , v 3 } v 1=3 x +3 x3
v 2=−1+3 x+2 x2
v 3=3+7 x−2 x 2
basis where , and . Find;
i. [ T (v 1 )]B , [ T (v 2 )] B , [ T (v 1 )]B ,
ii. T (v 1 ), T ( v 2 ) , T (v 3 ),
19
Solution:
() () ()
1 3 −1
[ T (v 1 )]B = 2 , [ T (v 2 )] B= 0 , [ T (v 3 )] B= 5 ,
i.
6 −2 4
ii.
T (v 1 )=1 v 1 +2 v 2 +6 v 3=1 (3 x+3 x 2 )+2 ((−1+3 x+2 x 2 )+6 (3+7 x−2 x 2 )
EXERCISE
1. Find the matrix representation of each of the following linear mappings
relative to the standard basis of Rn ;
T : R ⟶ R defined by T ( x , y )=(3 x− y , 2 x +4 y ,5 x−6 y ).
2 3
i.
T : R ⟶ R defined by T ( x , y , s , t )=(3 x−4 y+2 s−5t , 5 x +7 y−s−2 t ).
4 2
ii.
2. Let T : P2 → P 2 be the linear mapping defined by T [ P( x ) ] =P ( 2 x +1 ) that is
T (c 0 +c1 x +c 2 x 2 )=c 0 +c 1 (2 x +1 )+c 2 (2 x+1 )2 ).
i. Find [ T ] B with respect to the basis B= 1, x ,x { 2
}
2
ii. Compute T (2−3 x+4 x )
3. Let f : R 3 ⟶ R2 be the linear mapping which is represented by the matrix
20
i. [ T (e 1)] g , [ T (e 2) ]g , [ T (e 3) ]g ,
ii. T (e1 ), T ( e 2) , T (e3 ),
4. Let T : R ⟶ R be a linear mapping such that T (1, 0 , 0 , 0 )=(2 , 3 ,6 ),
4 3
3
R : (1,0,0), (0,1,0), (0,0,1)
CONJUGATION OF MATRICES
Suppose A and B are square matrices for which there exists an invertible matrix
P such that B=P−1 AP , then B is said to be similar to A . Note that if B is similar to
A then A is similar to B.
Proof:
Theorem: If A and B are similar, then they have the same determinant.
21
Proof: Since A and B are similar, there exists an invertible matrix P such that
A=P−1 BP so
determinant of T .
So
(
[ T ] B= 1 1
−2 4 ) and det T =1×4−(−2 )( 1 )=6
So
(0 3 )
[ T ] B '= 2 0
and det T =2×3−(0)(0 )=6 .
22
Definition: A linear mapping T is said to be diagonalizable if for some basis
{e1 ,e2 ,e 3 ,⋯,en } it can be represented as a diagonal matrix.
diagonal matrix.
Solution:
a. f 1=( 1 ,1 )=e 1 +e 2
a−b a+2b
λ1 +2 λ2 =a ¿ } ¿¿⇒ λ 2= , λ1 = ¿
3 3
Therefore
(a , b )= ( a+23 b ) f +( a−b3 ) f
1 2
.
Now
1 1
e 1=(1 , 0)= f 1 + f 2
3 3
( )
1 2
3 3
Q=P−1=
2 1 1 1
e 1=(0 , 1)= f 1 − f 2 −
3 3 . So
3 3
23
b. Since T ( x , y )=( x + y ,−2 x+4 y ),
T ( e1 )=T ( 1 , 0)=( 1 ,2 )=e1 +2 e 2
So
(2 3 )
[ T ]e = 1 4
Also
T ( f 1 )=T ( 1 ,1 )=(5 , 5 )=5 f 1 +0 f 2
Therefore
[ T ]f = 5 ( 0
0 −1 ) a diagonal matrix.
( )( ( )(
1 2 1 2
P−1 [ T ] e P= 3
1
−
3
1 )(
1 4 1 2 = 3
2 3 1 −1 1 ) −
1 1 −1 0 −1 )(
3 1 2 = 5 0 = [T ]
f )
Now
3 3 3 3 . Hence T is
diagonalizable.
Exercise
THEORY OF DETERMINANTS
Recall:
a. If
A=
( a11
a21
a 12
a 22 ) , a 2×2 matrix, then its determinant is given by;
24
a a 1 2
|A|=| 11 12|=a 11 a22−a12 a 21 | |=(1×4)−(2×3)=−2
for example 3 4
a21 a22 .
( )
a11 a12 a 13
A= a21 a22 a 23
a31 a32 a 33 3×3
b. If ,a matrix, then its determinant is given by;
a11 a12 a 13
a a a a a a
|A|=|a21 a22 a 23|=a11| 22 23|−a12| 21 23|+a13| 21 22|
a32 a33 a31 a33 a 31 a32
a31 a32 a 33 .
Example:
1 2 3
1 1 2 1 2 1
|2 1 1 |=1| |−2| |+3| |=1(2−1)−2( 4−4)+3(2−4)=1−2(0)+3(−2)=−5
1 2 4 2 4 1
4 1 2
Exercise:
( )
t +3 −1 1
A= 5 t−3 1
Evaluate the determinant of
6 −6 t +4
Properties of Determinants:
25
7. If B is another matrix of the same order as A , then det ( AB )=det A⋅det B .
8. If A is a diagonal or a triangular matrix, then det A is equal to the product of
the entries in the main diagonal.
minor of element
a ij which we denote by
M ij is the determinants of the
(n−1)×(n−1 ) submatrix which is obtained after deleting the i th row and jth
column of A . The number
Aij =(−1)i+ j M ij a.
is called the cofactor of ij
Example:
( )
2 3 −4
A= 0 −4 2
Let
1 −1 5 a
, compute the minors and cofactors of a 11 , a 12 and 13
Solution:
−4 2 0 2 0 −4
M 11=| |=−18, M 12=| |=−2, M 13=| |=4 .
−1 5 1 5 and 1 −1
26
Theorem:(Laplace’s expansion Theorem) The determinant of the matrix
A=aij is
equal to the sum of the products obtained by multiplying elements of a row (or
column) of A by their respective cofactors.
n n
|A|=a i1 Ai1 +ai 2 A i2 +⋯+ain Ain = ∑ aij Aij |A|=a 1 j A 1 j +a2 j A 2 j +⋯+anj A nj =∑ a ij A ij
j=1 and i=1
Note that the trick is to expand along a row or column that has a lot of zeros.
( )
4 0 0 0
7 −1 0 0
A=
2 6 3 0
5 −8 4 3
Solution: Expand along row 1 to get
−1 0 0 −1 0 0
2
|A|=4(−1) | 6 3 0 |−0+0−0=4| 6 3 0 |
−8 4 3 −8 4 3
{
4 (−1)|
3 0
|−0|
6 0
4 3 −8 3 −8 4
|+0|
6 3
}
| =4 {(−1)(9 )−0+0 }=−36
Or
Since A is a triangular matrix, the determinant can be obtained by multiplying
elements in the main diagonal;
|A|=4(−1)(3)(3)=−36
( )
3 −7 8 9 −6
0 2 −5 7 3
A= 0 0 1 5 0
0 0 2 4 −1
0 0 0 −2 0
Solution:
27
Expand along column 1 to get:
2 −5 7 3 2 −5 7 3
0 1 5 0 0 1 5 0
|A|=(−1)2(3)| |=3| |
0 2 4 −1 0 2 4 −1
0 0 −2 0 0 0 −2 0
Next expand the 4×4 submatrix obtained along the first column,
1 5 0 1 5 0
2
|A|=(3)(2)(−1) |2 4 −1 |=6|2 4 −1 |
0 −2 0 0 −2 0
{
6 1|
4 −1
−2 0
|−5|
2 −1
0 0
|+0|
2 4
0 −2 }
| =6 {−2−0+0 } =−12
( )
4 0 −7 3 −5
0 0 2 0 0
A= 7 3 −6 4 −8
5 0 5 2 −3
0 0 9 −1 2
Solution: Expand along column 2 to have;
4 −7 3 −5 4 −7 3 −5
0 2 0 0 0 2 0 0
|A|=(3)(−1)5| |=(−3)| |
5 5 2 −3 5 5 2 −3
0 9 −1 2 0 9 −1 2
Next expand along row 2 to get,
4 3 −5
4
|A|=(−3)(2)(−1) |5 2 −3 |
0 −1 2
{
=(−6) 4|
2 −3
−1 2
|−3|
5 −3
0 2
|−5|
5 2
0 −1
| =−6{4−30+25}=6 }
28
b.Gauss Elimination Method:
In this technique multiples of rows or columns are added to other rows or
columns creating zeros which simplifies subsequent calculations. As we saw
earlier, this operation does not change the value of the determinant.
( )
1 −4 2
A= −2 8 −9
−1 7 0
Solution: The strategy is to reduce A to echelon form and then use the fact that
the determinant of a triangular matrix is the product of the leading diagonal
entries.
1 −4 2 1 −4 2 1 −4 2
|A|=|−2 8 −9 |=|0 0 −5 |=(−1)|0 3 2 |=(−1)(1)(3)(−5)=15
−1 7 0 0 3 2 0 0 −5
Example 2: Compute det A where
( )
2 −8 6 8
3 −9 5 10
A=
−3 0 1 −2
1 −4 0 6
Solution: We first factor 2 from the top row,
1 −4 3 4
3 −9 5 10
|A|=2| |
−3 0 1 −2
1 −4 0 6
Next we perform elementary operations.
1 −4 3 4 1 −4 3 4 1 −4 3 4 1 −4 3 4
3 −9 5 10 0 3 −4 −2 0 3 −4 −2 0 3 −4 −2
|A|=2| |=2| |=2| |=2| |
−3 0 1 −2 0 −12 10 10 0 0 −6 2 0 0 −6 2
1 −4 0 6 0 0 −3 2 0 0 −3 2 0 0 0 1
29
=(2)(1 )(3 )(−6 )(1 )=−36
Sometimes the two methods can be combined;
Example 3: Compute the determinant of
( )
5 4 2 1
2 3 1 −2
A=
−5 −7 −3 9
1 −2 −1 4
Solution: Make use of 1 in the third column to create zeros below and above it:
5 4 2 1 1 −2 0 5
2 3 1 −2 2 3 1 −2
|A|=| |=| |
−5 −7 −3 9 1 2 0 3
1 −2 −1 4 3 1 0 2
Next expand along column 3 to get,
1 −2 5
5
3 1 2
{
1 2 3 2 3 1 }
|A|=(1)(−1) |1 2 3|=−1 1|2 3 |+2|1 3 |+5|1 2| =−1 {(1)(1)+2(−7)+5(−5)} =38
( )
0 1 2 −1
2 5 −7 3
|A|=
0 3 6 2
−2 −5 4 −2
Solution: Make use of 2 in column 1 to create a zero below it
0 1 2 −1 0 1 2 −1
2 5 −7 3 2 5 −7 3
|A|=| |=| |
0 3 6 2 0 3 6 2
−2 −5 4 −2 0 0 −3 1
Next expand along column 1 to obtain,
1 2 −1 1 2 −1
3
|A|=(2)(−1) |3 6 2 |=−2|3 6 2 |
0 −3 1 0 −3 1
30
{
=−2 1|
6 2 3 2 3 6
|−2| |−1|
−3 1 1 0 0 −3 }
| =(−2) {(12)−(2)(3)−(1)(−9) }=−30
( )
3 −2 −5 4
−5 2 8 −5
|A|=
−2 4 7 −3
2 −3 −5 8
Solution: First reduce A to a matrix which has 1 as an entry, such as adding twice
the first row to the second row. Then use this 1 to create zeros below and above it.
3 −2 −5 4 3 −2 −5 4 0 4 1 −5
−5 2 8 −5 1 −2 −2 3 1 −2 −2 3
|A|=| |=| |=| |
−2 4 7 −3 −2 4 7 −3 0 0 3 3
2 −3 −5 8 2 −3 −5 8 0 1 −1 2
Expand along column 1 to get,
4 1 −5 4 1 −5
3
|A|=(1)(−1) |0 3 3 |=(−1)|0 3 3 |
1 −1 2 1 −1 2
{ }
(−1) 4| 3 3 |−1|0 3 −5|0 3 || =−1 {4(9)−1(−3)−5(−3)}=−1{36+3+15}=−54
−1 2 1 2 1 −1
Exercise
Compute the determinant of each of the following Matrices;
( )
1 0 0 3
0 1 −2 0
( )
A= 3 1 −2 1
−2 3 −2 3
0 −3 3 3 1 1 −3 2
1. C=
2 0 2 3
3 3 1 −3
( )
2 5 −3 −1 3.
3 0 1 −3
B=
−6 0 −4 9
2.
4 10 −4 −1
31
( )
2 5 −3 −2
−2 −3 2 −5
D=
1 3 −2 2
( )
2 5 4 1
−1 −6 4 3
4. 4 7 6 2
G=
6 −2 −4 0
7.
1 3 1 0
( )
2 1 3 2
3 0 1 −2
( )
E= 1 −1 1 −1
1 −1 4 3
2 2 −1 1 1 −1 3 2
5. H=
4 2 1 3
0 1 3 0
( )
2 2 −2 0 8.
−4 2 0 1
F=
0 4 −1 −4
6.
3 1 3 −1
BLOCK MATRICES
Using a system of vertical and horizontal lines, we can partition a matrix A into
smaller matrices called blocks (or cells). The matrix A is then called a block matrix.
Clearly a given matrix can be divided into blocks in different ways as below;
( )( )( )
1 −2 0 1 3 1 −2 0 1 3 1 −2 0 1 3
A= 2 3 5 7 −2 = 2 3 5 7 −2 = 2 3 5 7 −2
3 1 4 5 9 3 1 4 5 9 3 1 4 5 9
32
The convenience of the partition into blocks is that the result of operations on block
matrices can be obtained by carrying out the computation with blocks just as if they
were the actual elements of the matrix.
Determinant of the block matrices:
( )
A1 B ⋮ C
0 A2 ⋮ D
M=
⋮ ⋮ ⋱ ⋮
0 0 ⋯ Am
Then
|M|=|A1||A 2|⋯|Am|.
Example: Find the determinant of the matrices
( )
2 5 0 0 0
( )
2 1 0 0 0 2 0 0 0
0 2 0 0 B= 0 0 4 2 0
A=
0 0 1 1 0 0 3 5 0
0 0 −2 4 0 0 0 0 7
Solution:
Since A is a triangular block matrix,
2 1 0 0
0 2 0 0 2 1 1 1
|A|=| |=| || |=4×(4+2)=24
0 0 1 1 0 2 2 4
0 0 −2 4
33
2 5 0 0 0
0 2 0 0 0
|B|=|0 2 5 4 2 ||7|=4×(20−6)×7=392
0 4 2 0 |=| ||
0 2 3 5
0 0 3 5 0
0 0 0 0 7
Exercise:
Find the determinants of the following matrices:
( )(
2 8 0 0 0 0 0
0 2 0 0 0 0 0
)
0 0 4 2 0 0 0 3 1 0 0 0
( )
A= 0 0 1 3 0 0 0 0 3 0 0 0 2 1 0 0
0 0 0 0 0 3 0 B= 0 0 3 1 0 0 2 0 0
C=
0 0 0 0 0 1 0 0 0 0 3 1 0 0 2 0
0 0 0 0 0 0 0 0 0 0 0 3 0 0 0 5
34
In particular, we say that A is a zero or the root of the polynomial f (t ) if f ( A )=0 , a
zero matrix of the same order as A.
Example:
Let
A= (13 24 ) , f (t )=2t −3t+7
2
and g(t )=t2 −5t−2. Find f ( A ) and g( A ).
Solution:
( ) ( ) ( ) ( )( )( )
2
=2 1 2 −3 1 2 +7 1 0 =2 7 10 − 3 6 + 7 0
3 4 3 4 0 1 15 22 9 12 0 7
( )( )( )(
= 14 20 − 3 6 + 7 0 = 18 14
30 44 9 12 0 7 21 39 )
g( A )= A2 −5 A−2I
( ) ( ) ( )( )( )( )( )
2
= 1 2 −5 1 2 −2 1 0 = 7 10 − 5 10 − 2 0 = 0 0
3 4 3 4 0 1 15 22 15 20 0 2 0 0
Exercise:
1. Find f ( A ) where
(A= 1 −2
4 5 ) and f (t )=t 2−3t +7.
A=(
2 3)
1 4
2. Show that is a zero of f (t )=t 2−4t−5.
35
Suppose T : V →V is a linear operator on a vector space V over a field K. If
f (t )=a n t n +a n−1 t n−1 +an−2 tn−2 +⋯+a 1 t+a0 , we define f ( T ) in the same way as we did
T (k ~
v )=kT ( ~
v )=k ( λ ~
v )=λ (k ~
v)
The set of all such vectors is a subspace of V called the eigen space of λ . The terms
Characteristic value and Characteristic vector or proper value and proper vector are
frequently used instead of eigen value and eigen vector.
~ ~ ~ ~
Example1: Let I : V →V be the identity mapping. Then for every v ∈ V , I ( v )= v =1 v .
Hence 1 is the eigen value of I, and every vector in V is an eigen vector belonging to
I.
36
If A is an n×n matrix over a field K, then λ ∈ K is an eigen value of A if for some non-
~ ~ ~ ~
zero vector v ∈ K then A v=λ v . In this case v is an eigen vector of A belonging to
the eigen value λ .
We also have that is the eigen space of λ if and only if the above relations hold,
~
hence v is the kernel of λI −T .
Example 1: Let
( )
A= 1 4 .
2 3 Find the eigenvalues of A and a basis of each eigen
space.
Solution:
To obtain the eigen space of λ=5 , we substitute λ=5 into the equation
( λI − A )~
v =0 to get (−24 2 )
−4 ¿ ( x ¿ ) ¿ ¿
¿ or
4x−4y=0¿} ¿¿ or x−y=0.¿ This system has 1
independent solution hence the dimension of the eigen space of λ=5 is 1. A basis
for this eigen space is {(1,1)}
~
The eigen space of λ=−1 , substitute λ=−1 in the equation ( λI − A ) v =0 to get
(
−2 −4 )
−2 −4 ( x ¿ ) ¿
¿
¿
¿
or
−2x−4 y=0¿} ¿ ¿ or x+2y=0.¿ This system has one independent
37
solution, hence the dimension of this eigen space is 1. A basis for this eigen space is
{(2 ,−1 )} .
Example 2: Find the eigen values and the basis for each of the eigen space of
T : R → R defined by T ( x , y , z )=(2 x + y , y −z , 2 y+ 4 z ).
3 3
Solution: First find the matrix of T, say to the usual basis of R3;
( )
2 1 0
[ T ] =A= 0 1 −1
0 2 4
( )( )
λ 0 0 2 1 0
|λI − A|= 0 λ 0 − 0 1 −1 =¿ ( 0 ¿ ) ( 0 ¿ ) ¿ ¿ ¿
¿
0 0 λ 0 2 4
38
( )
0 −1 0 − y =0
( λI− A )~v = 0 1 1 ¿ ( x ¿ ) ( y ¿ ) ¿ ¿ ⇔ y + z=0 y=0
¿
0 −2 −2 −2 y−2 z=0 or y+z=0
These equations have one independent solution, say (1,0,0) so the basis of this
eigen space is {(1,0,0)}.
( )
1 −1 0 x − y=0
( λI− A ) v = 0 2 1 ¿ ( x ¿ ) ( y ¿ ) ¿ ¿
~ ⇔ 2 y + z=0 x− y=0
¿ −2 y−z =0 2 y+z=0
0 −2 −1 or
The number of independent solutions in the above system is 1. So eigen values of
λ=3 has 1 dimension and its basis is {(1 ,1 ,−2)}.
Exercise:
1. For each Matrix below, find all the eigenvalues and a basis for each
eigenspace,
( )
−3 1 −1
C= −7 5 −1
i.
(
A= 3 −1
1 1 ii.
) 1 4(
B= 2 −1 ) iii.
−6 6 −2
2. Find the eigenvalues and a basis of each eigenspace of the operator of
T : R → R defined by T ( x , y , z )=( x + y + z ,2 y + z ,2 y +3 z ).
3 3
−1
eigenvalue of T .
Diagonalization of Matrices
39
( )
λ1 0 0 ⋯ 0
0 λ2 0 ⋯ 0
0 0 λ3 ⋯ 0
⋮ ⋮ ⋮ ⋱ ⋮
0 0 0 ⋯ λn
if and only if there exists a basis
{~v 1 ,~v 2 , ~v 3 ,⋯,~v n } of V for which
T (~
v 1 )= λ1 ~
v1
T (~
v 2 )= λ 2 ~
v2
T (~
v 3 )= λ3 ~v 3
⋮
T (~
v n )= λn ~
vn
~v , ~v ,~v ,⋯, ~v
That is , the vectors 1 2 3 n are eigenvectors of T belonging to eigenvalues
λ 1 , λ2 , λ3 ,⋯, λ n .
Example 1: Diagonalize
( )
A= 1 2
3 2
40
Solution:
|λI−A|=0 if λ is an eigenvalue of A.
λ−1 −2
|λI− A|=| |=( λ−1)( λ−2 )−6=0 ⇒ λ2 −3 λ−4=0 ⇒( λ−4 )( λ+1 )=0
−3 λ−2
⇒ λ=4 , λ=−1
(−3
3 −2
2 )
¿ ( x ¿) ¿ ¿
¿ or 3 x−2 y=0
Eigenspace of λ=−1 ,
(−2
−3 −3 ¿)
−2 ¿ ( x ¿ ) ¿ ¿
or x + y=0
( )
1 1
P−1 =
(
1 −1 −1
= 5
) 5
Therefore
(
P= 2 1
3 −1 ) and
−5 −3 2 3
5
−
2
5
Now,
( ) ( )
1 1 4 4
P−1 AP=
5
3
−
( )(
5 1 2 2 1
2 3 2 3 −1
=
−
5
3 ) 5
2 (23 1
−1
= )(
4 0
0 −1 )
5 5 5 5 , a diagonal matrix.
Example 2: For each matrix find all the eigenvalues and a basis for each
eigenspace. Which matrix can be diagonalized and why?
( ) ( )
1 −3 3 −3 1 −1
A= 3 −5 3 B= −7 5 −1
a.
6 −6 4 b.
−6 6 −2
41
Solution:
a.
λ−1 3 −3
λ+5 −3 −3 −3 −3 λ+5
|λI− A|=| −3 λ+5 −3 |=( λ−1)| |−3| |−3| |=0
6 λ−4 −6 λ−4 −6 6
−6 6 λ−4
⇒ λ3 −12 λ−16=0
¿ − 8 λ 16 ¿ − 8 λ 16 ¿ 0 ¿
λ 2−2 λ−8=( λ+2)( λ−4) ⇒ λ3 −12 λ−16=( λ+2)2 ( λ−4)=0
⇒ λ=−2,−2 or λ=4
Eigenspace of λ=−2 ;
( )
−3 3 −3
−3 3 −3 ¿ ( x ¿ ) ( y ¿ ) ¿ ¿
¿
−6 6 −6 or x− y + z=0
{ (1 , 1 , 0),(0 , 1 ,1 )}
42
Eigenspace of λ=4 ,
( )
3 3 −3 x+ y−z=0
−3 9 −3 ¿ ( x ¿ ) ( y ¿ ) ¿ ¿ x−3 y+z=0
¿
−6 6 0 or x− y=0
x+ y−z=0
Or 2 y−z=0 .
( ) ( )
1 0 1 −2 0 0
−1
P= 1 1 1 D=P AP= 0 −2 0
0 1 2 and
0 0 4
b.
λ+3 −1 1
|λI−B|=| 7 λ−5 1 |=0 ⇒( λ+3)|λ−5 1 |+1|7 1 |+1|7 λ−5 |=0
−6 λ+2 6 λ+2 6 −6
6 −6 λ+2
⇒( λ+3 ) [ ( λ−5)( λ +2)+6 ] +1 [ 7( λ+2)−6 ] +1 [ −42−6( λ−5) ] =0
Eigenspace of λ=−2 ,
( )
1 −1 1
7 −7 1 ¿ ( x ¿) ( y ¿ ) ¿ ¿ ¿
¿
6 −6 0
¿
There is only one independent solution. A basis for this eigenspace is { (1 , 1 , 0) } .
Eigenspace of λ=4 ,
43
( )
7 −1 1
7 −1 1 ¿ ( x ¿) ( y ¿ ) ¿ ¿
¿
6 −6 6
Exercise:
1. Show that
P= 1 1
0 1 ( )
is not diagonalizable.
2. For each matrix find all the eigenvalues and a basis for each eigenspace.
( ) ( ) ( )
3 1 1 1 2 2 1 1 0
A= 2 4 2 B= 1 2 −1 C= 0 1 0
i.
1 1 3 ii.
−1 1 4 iii.
0 0 1
P −1 BP 2 P −1 CP3
2 and 3 are diagonal.
D( x)=|xI−A| is called a
Let A be a square matrix, the determinant
( )
1 3 0
A= −2 2 −1
4 0 −2
Solution:
44
x−1 −3 0
x−2 −1 2 1
D( x)=|xI− A|=| 2 x−2 1 |=( x−1)| |+2| |
0 x+2 −4 x+2
−4 0 x+2
=x 3 −x 2 +2 x+ 28
CAYLEY-HAMILTON THEOREM
Every matrix is a zero of its characteristic polynomial.
A= (13 22 )
Solution:
x−1 −2
|xI− A|=| |=(x−1)( x−2)−6=x2 −3 x−4
−3 x−2
( ) ( ) ( )
2
f ( A )=A 2 −3 A−4 I= 1 2 −3 1 2 −4 1 0
3 2 3 2 0 1
45
( )( )( )( )
=7 6 −3 6 −4 0 =0 0
9 10 9 6 0 4 0 0 Thus A is a zero of its characteristic
polynomial.
Proof: Let A and B be similar matrices. Then there exists an invertible matrix P such
−1
that B=P AP . So
=|xI−A|
Suppose
M=
( A1
0
B
A2 )
where A1 and A2 are square matrices. The characteristic
polynomial of M is the product of the characteristic polynomial of A1 and A2 .
( )
2 1 0 0
0 2 0 0
A=
0 0 1 1
0 0 −2 4
Solution:
46
x−2 −1 0 0
0 x−2 0 0 x−2 −1 x−1 −1
D( x)=|xI− A|=| |=| || |
0 0 x−1 −1 0 x−2 2 x−4
0 0 2 x−4
( x−2 )2 [ ( x−1)( x−4 )+2 ]=(x−2)2 ( x 2 −5 x+6)
( x−2 )3 ( x−3 )
The eigenvalues of A are λ=2 , 2, 2 and λ=3 . We can extend the above theorem to
triangular block matrices. If
( )
A1 B ⋯ C
M= 0 A2 ⋯ D
⋮ ⋮ ⋱ ⋮
0 0 0 An
where
Ai are square matrices, then the characteristic polynomial of M is the product
( )
2 5 0 0 0
0 2 0 0 0
A= 0 0 4 2 0
0 0 3 5 0
0 0 0 0 7
Solution:
x−2 −5 0 0 0
0 x−2 0 0 0
|xI− A|=| 0 x−2 −5 || x−4 −2 |( x−7)
0 x−4 −2 0 |=|
0 x−2 −3 x−5
0 0 −3 x−5 0
0 0 0 0 x−7
47
=( x−2)2 [ ( x−4 )( x−5 )−6 ] (x−7)
( )
3 1 0 0 0
1 4 0 0 0
( ) ( )
3 −5 5 1 1 0 C= 0 0 3 1 0
A= 5 −7 5 B= 0 2 0 0 0 1 3 0
5 −5 3 0 0 1 0 0 0 0 1
MINIMAL POLYNOMIAL
Definition: Let
f (a )=a n x n +a n−1 x n−1 +an−2 x n−2 +⋯+a2 x 2 +a 1 x+a0 be a polynomial of
degree n . Then
a n is called the leading coefficient and f ( x ) is monic if a n=1.
48
If D( x)=( x−1)2 ( x−2)( x+3)
( )
3 −5 5
A= 5 −7 5
5 −5 3
Solution:
x−5 5 −5
|xI− A|=| −5 x+7 −5 |=( x−3)|x+7 −5 |−5|−5 −5 |−5|−5 x+7 |
5 x−3 −5 x−3 −5 5
−5 5 x−3
=( x−3 ) [ ( x +7 )( x−3 )+ 25 ] −5 [ −5( x−3 )−25 ] −5 [−25+5( x+ 7) ]
=( x−3)(x+2)2
2
M 2 ( x )=( x−3 )( x+2)
( )( )( )
0 −5 5 5 −5 5 0 0 0
M 1 ( A )=( A−3 I )( A+2 I )= 5 −10 5 5 −5 5 = 0 0 0 =0
5 −5 0 5 −5 5 0 0 0
M 2 ( A )=0 by Cayley-Hamilton theorem. ⇒ M 1 ( x )=( x −3)( x +2) is the minimal
polynomial.
Example 2: Find the characteristic polynomial, minimal polynomial and the
eigenvalues of
49
( )
2 1 0 0
0 2 0 0
A=
0 0 2 0
0 0 0 5
Solution:
x−2 −1 0 0
0 x−2 0 0 x−2 −1 x−2 0
|xI− A|=| |=| || |
0 0 x−2 0 0 x−2 0 x−5
0 0 0 x−5
=( x−2)2 ( x−2)( x−5)=( x−2)3 ( x−5)
( )( )( )
0 1 0 0 −3 1 0 0 0 −3 0 0
0 0 0 0 0 −3 0 0 0 0 0 0
M 1 ( A )=( A−2 I )( A−5 I )= = ≠0
0 0 0 0 0 0 −3 0 0 0 0 0
0 0 0 3 0 0 0 0 0 0 0 0
( )( ) ( )( )
0 1 0 0 2 −3 1 0 0 0 0 0 0 −3 1 0 0
0 0 0 0 0 −3 0 0 0 0 0 0 0 −3 0 0
M 2 ( A )=( A−2 I )2 ( A−5 I )= =
0 0 0 0 0 0 −3 0 0 0 0 0 0 0 −3 0
0 0 0 3 0 0 0 0 0 0 0 9 0 0 0 0
50
( )
0 0 0 0
0 0 0 0
= =0
0 0 0 0
0 0 0 0
Exercise:
1. For each of the following matrix find the polynomial having the matrix as a
root,
( )
1 4 −3
C= 0 3 1
i.
(
A= 2 5
1 −3 ) ii.
(
B= 2 −3
7 −4
iii.
) 0 2 −1
2. Find the characteristic polynomial, minimal polynomial and eigenvalues of
each matrix below;
( )
2 1 0 0
( ) ( )
1 1 0 0 2 0 0 1 2 2
B=
A= 0 2 0 0 0 1 1 C= 1 2 −1
i.
0 0 1 ii.
0 0 −2 4 iii.
−1 1 4
51
Theorem: Let M ( x ) be the minimal polynomial of an n-square matrix A. Then the
characteristic polynomial of A divides M ( x ) .
TRACE
A=( a ij )
The trace of a square matrix written tr ( A ) is defined to be the sum of its
Thus the trace of a linear operator T is the trace of any one of its matrix
representations i.e tr ( T )=tr ( [ T ] e ) .
{ ( ) ( ) ( ) ( )}
E1 =
1
0
0
0
, E2 =
0 1
0 0
, E3 =
0 0
1 0
, E 4=
0 0
0 1 , then
( )( ) ( )
T ( E1 )= 1 2 1 0 = 1 0 =1 E 1 +0 E2 +3 E 3 +0 E 4
3 4 0 0 3 0
52
( )( ) ( )
T ( E3 )= 1 2 0 0 = 2 0 =2 E 1 +0 E2 +4 E 3 +0 E 4
3 4 1 0 4 0
T ( E )=(
3 4 )(0 4 ) (0 4 )
1 2 0 0 0 2
4 = =0 E +2 E +0 E +4 E
1 2 3 4
Hence
( )
1 0 2 0
[ T ] E= 0 1 0 2
3 0 4 0
0 3 0 4 and tr ( T )=1+1+4 +4=10
53