An Introduction To Eigenvalues and Eigenvectors: Bachelor of Science
An Introduction To Eigenvalues and Eigenvectors: Bachelor of Science
BACHELOR OF SCIENCE
In Mathematics
By
To the
DEPARTMENT OF MATHEMATICS
JULY, 2021
CONTENTS
1.DECLARATION
2.CERTIFICATION
3.ACKNOWLEDGEMENT
4. INTRODUCTION:.............................................................................................................................. 1
6. APPLICATIONS: …………………………………………………………………………………………………………………………… 13
7.CONCLUSION: ………………………………………………………………………………………………………………………………
1. DECLARATION
Place: -
Date: -
Date: -
Place: -
Determinants give a transition from 𝐴𝑥 = 𝜆 to 𝐴𝑥 = 𝜆𝑥. In both the cases the determinant
leads to a formal solution to Cramer’s rule for 𝑥 = 𝐴−1 𝜆 and the polynomial det (𝐴 − 𝜆𝐼),
whose roots will be the eigen values. The determinant can actually be used if 𝑛 = 2 𝑜𝑟 3. For
large n, computing b is more difficult than solving 𝐴𝑥 = 𝑏.
The first step is to understand how eigenvalues can be useful. One of their application is to
ordinary differential equations. We shall not assume that the reader is an expert on
differential equation. If we can differentiate 𝑥 𝑛 , sin 𝑥 𝑎𝑛𝑑 𝑒 𝑥 , we know enough.
As a specific example, consider the coupled pair of equations
𝑑𝑣
= 4𝑣 − 5𝑤, 𝑣 = 8 𝑎𝑡 𝑡 = 0
𝑑𝑡
𝑑𝑤
= 2𝑣 − 3𝑤, 𝑤 = 5 𝑎𝑡 𝑡 = 0 __________ (1)
𝑑𝑡
This is an initial value problem. The unknown is specified at time 𝑡 = 0 by the given initial
values 8 and 5. The problem is to find 𝑣(𝑡) and 𝑤(𝑡) for later times 𝑡 > 0.
It is easy to write the system in matrix form. Let the unknown vector be 𝑢(𝑡) with initial
value 𝑢(0). The co-efficient matrix is A.
𝑣(𝑡) 8
Vector unknown 𝑢(𝑡) = ( ), 𝑢(0) = ( )
𝑤(𝑡) 5
4 −5
𝐴=( )
2 −3
The two coupled equations become the vector equations we want
𝑑𝑢
𝑑𝑡
= 𝐴𝑢 with 𝑢 = 𝑢(0) at 𝑡 = 0. _________ (2)
This is the basic statement of the problem. Note that it is a first order equation, no higher
derivatives and it is linear in the unknowns. It also has constant co-efficient the matrix A
which is independent of time.
How do we find (𝑡) ? If there were only one unknown instead of two, that equation would
have been easy to answer. We would have had a scalar instead of a vector equation.
𝑑𝑢
= 𝑎𝑢 𝑤𝑖𝑡ℎ 𝑢 = 𝑢(0) 𝑎𝑡 𝑡 = 0 ________ (3)
𝑑𝑡
The solution to this equation is the one thing you need to know.
1
At the initial time 𝑡 = 0 u equals to 𝑢(0) because 𝑒 0 = 1. The derivatives of 𝑒 𝑎𝑡 has the
𝑑𝑢
required factor a, so that = 𝑎𝑢. Thus the initial condition and the equation are both
𝑑𝑡
satisfied. Notice the behaviour of u for large times. The equation is unstable if 𝑎 > 0,
neutrally stable if 𝑎 = 0 or stable if 𝑎 < 0. The factor 𝑒 𝑎𝑡 approaches infinitely, remains
bounded or goes to zero. If 𝑎 were a complex part it would have produced oscillations.
𝑣(𝑡) = 𝑒 𝜆𝑡 𝑦
Or in vector notation
𝜆𝑒 𝜆𝑡 𝑦 = 4𝑒 𝜆𝑡 𝑦 − 5𝑒 𝜆𝑡 𝑧
𝜆𝑒 𝜆𝑡 𝑧 = 2𝑒 𝜆𝑡 𝑦 − 3𝑒 𝜆𝑡 𝑧
The factor 𝑒 𝜆𝑡 is common to every term, and can be removed. This cancellation is the reason
for assuming the same exponent 𝜆 for both unknowns. It leaves eigenvalue problem
4𝑦 − 5𝑧 = 𝜆𝑦
2𝑦 − 3𝑧 = 𝜆𝑧 _________ (7)
That is the eigenvalue equation. In matrix form it is 𝐴𝑥 = 𝑏𝑥. We can see it again if we use
𝑢 = 𝑒 𝜆𝑡 𝑥 – a number 𝑒 𝜆𝑡 that growth or decay time around a fixed vector 𝑥. Substituting it
𝑑𝑢
into = 𝐴𝑢 gives
𝑑𝑡
𝜆𝑒 𝜆𝑡 𝑥 = 𝐴𝑒 𝜆𝑡 𝑥
𝐴𝑥 = 𝜆𝑥
2
CHAPTER 2
2. EIGENVALUES AND EIGENVECTORS:
Let 𝐴 be a square matrix of order 𝑛, then the values of 𝜆 for which the equation 𝐴𝑥 = 𝜆𝑥 has
non-trivial solution, are called the eigen values of 𝐴. If 𝜆 is an eigen value then the non-zero
vectors 𝑥 for which the equation 𝐴𝑥 = 𝜆𝑥 holds are called the eigen vectors of 𝐴.
Eigen values are also called characteristic values or proper values. Eigen vectors are also
called characteristic vectors or proper vectors.
Let 𝐴 be a square matrix of order 𝑛. Let 𝜆 be an eigen value of 𝐴. Then the polynomial
𝑑𝑒𝑡(𝐴 − 𝜆𝐼) is called the characteristic polynomial of the matrix 𝐴. The algebraic equation
𝑑𝑒𝑡(𝐴 − 𝜆𝐼) = 0 is called the characteristic equation of the matrix 𝐴.
Example:
Determine the eigenvalues and the corresponding eigenspaces for the following matrix.
3 1
𝐴=( )
6 2
Solution-
The characteristic equation of the matrix 𝐴 is
𝑑𝑒𝑡(𝐴 − 𝜆𝐼) = 0
3 1 1 0
⟹ 𝑑𝑒𝑡 {( )−𝜆( )} = 0
6 2 0 1
3 1 𝜆 0
⟹ 𝑑𝑒𝑡 {( )−( )} = 0
6 2 0 𝜆
3−𝜆 1
⟹ 𝑑𝑒𝑡 ( )=0
6 2−𝜆
⟹ (3 − 𝜆)(2 − 𝜆) − 6 = 0
⟹ 6 − 5𝜆 + 𝜆2 − 6 = 0
⟹ 𝜆2 − 5𝜆 = 0
⟹ 𝜆(𝜆 − 5) = 0
⟹ 𝜆 = 5 𝑜𝑟 𝜆 = 0
For 𝜆1 = 0
𝐴𝑥 = 𝜆1 𝑥
3 1 𝑥1 𝑥1
⟹( ) (𝑥 ) = 0 (𝑥 )
6 2 2 2
3
3𝑥 + 𝑥2 0
⟹( 1 )=( )
6𝑥1 + 2𝑥2 0
⟹ 3𝑥1 + 𝑥2 = 0, 6𝑥1 + 2𝑥2 = 0
⟹ 3𝑥1 + 𝑥2 = 0
⟹ 𝑥2 = −3𝑥1
The eigenvectors corresponding to eigenvalue 0 are of the form (𝑥1 , −3𝑥1 ) when 𝑥1 ≠ 0. The
eigenspace corresponding to the eigenvalue is given by
⃗}
𝜖(0) = [(1, −3)]\{0
For 𝜆2 = 5
𝐴𝑥 = 𝜆2 𝑥
3 1 𝑥1 𝑥1
⟹( ) (𝑥 ) = 5 (𝑥 )
6 2 2 2
3𝑥 + 𝑥2 5𝑥
⟹( 1 ) = ( 1)
6𝑥1 + 2𝑥2 5𝑥2
⟹ 2𝑥1 − 𝑥2 = 0
⟹ 𝑥2 = 2𝑥1
The eigenvectors corresponding to eigenvalue 5 are of the form (𝑥1 , 2𝑥1 ) when 𝑥1 ≠ 0. The
eigenspace corresponding to the eigenvalue is given by
⃗}
𝜖(5) = [(1,2)]\{0
𝐴𝑢 = 𝜆𝑢 _______ (1)
Taking complex conjugates of both sides of (1), we obtain
𝐴∗ 𝑢∗ = 𝜆∗ 𝑢∗
4
Now we pre-multiply (1) with (𝑢∗ )𝑇 to obtain
= (𝐴𝑇 𝑢∗ )𝑇 𝑢 ; since 𝐴𝑇 = 𝐴
Thus (𝜆 − 𝜆∗ )(𝑢∗ )𝑇 𝑢 = 0
(𝑢∗ )𝑇 𝑢 = ∑ 𝑢𝑖 ∗ 𝑢𝑖 > 0
𝑖=1
Since at least one of the components of 𝑢 is non-zero and for any complex number 𝑧 = 𝑎 +
𝑖𝑏, we have 𝑧 ∗ 𝑧 = 𝑎2 + 𝑏 2 ≥ 0
Let 𝐴 be a real symmetric matrix. Let 𝐴𝑢1 = 𝜆𝑢1 and 𝐴𝑢2 = 𝜆𝑢2 with 𝑢1 and 𝑢2 non-zero
vectors in 𝑅 𝑛 and 𝜆1 , 𝜆2 ∈ 𝑅. Pre-multiplying both sides of the first equation above with 𝑢2 𝑇 ,
we get
𝜆1 𝑢2 𝑇 𝑢1 = 𝑢2 𝑇 (𝐴𝑢1 )
= (𝑢2 𝑇 𝐴)𝑢1
= (𝐴𝑇 𝑢2 )𝑇 𝑢1
= (𝐴𝑢2 )𝑇 𝑢1
= 𝜆2 𝑢2 𝑇 𝑢1
Therefore, 𝜆1 ≠ 𝜆2 ⟹ 𝑢2 𝑇 𝑢1 = 0 as required.
If an eigenvalue 𝜆 has multiplicity 𝑚(𝑠𝑎𝑦) then we can always find a set of 𝑚 orthogonal
eigenvectors for 𝜆. We conclude that by normalizing the eigenvectors of 𝐴, we get an
orthogonal set of vetors 𝑢1 , 𝑢2 , … , 𝑢𝑛 .
Example:
3⁄
To find the eigenvalues of the matrix 𝐴 = (2 2)
2 0
Solution-
The characteristic equation of the given matrix is
5
𝑑𝑒𝑡(𝐴 − 𝜆𝐼) = 0
3⁄
⟹ det {(2 2) − 𝜆 (1 0
)} = 0
2 0 0 1
2−𝜆 3⁄
⟹ det ( 2) = 0
2 −𝜆
⟹ −𝜆(2 − 𝜆) − 3 = 0
⟹ 𝜆2 − 2𝜆 − 3 = 0
⟹ 𝜆2 − 3𝜆 + 2𝜆 − 3 = 0
⟹ 𝜆(𝜆 − 3) + 1(𝜆 − 3) = 0
⟹ (𝜆 − 3)(𝜆 + 1) = 0
⟹ 𝜆 = 3 𝑜𝑟 − 1
Therefore, eigenvalues are 3 or -1, which are real.
For 𝜆1 = 3,
𝐴𝑥 = 𝜆1 𝑥
3⁄ 𝑥 𝑥
⟹(2 2) ( 1 ) = 3 ( 1 )
𝑥2 𝑥2
2 0
2𝑥 + 3⁄2 𝑥2 3𝑥
⟹( 1 ) = ( 1)
2𝑥1 + 0𝑥2 3𝑥2
⟹𝑥1 = 3⁄2 𝑥2
For 𝜆1 = −1,
𝐴𝑥 = 𝜆2 𝑥
3⁄ 𝑥 𝑥
⟹(2 2) ( 1 ) = −1 ( 1 )
𝑥 𝑥
2 0 2 2
6
2𝑥 + 3⁄2 𝑥2 −𝑥1
⟹( 1 ) = (−𝑥 )
2𝑥1 + 0𝑥2 2
⟹𝑥1 + 1⁄2 𝑥2 = 0
⟹𝑥2 = −2𝑥1
Proof:
𝜆𝑣 = 𝐴𝑣
⟹𝜆=𝐴
Now 𝜆𝑣 = 𝐴𝑣
= 𝐴𝐴𝑣
= 𝜆𝜆𝑣
= 𝜆2 𝑣
Since 𝑣 ≠ 0, we find
𝜆 − 𝜆2 = 0
⟹ 𝜆(1 − 𝜆) = 0
⟹𝜆 = 0 𝑜𝑟 𝜆 = 1
Example:
7
1 0
𝐴=( )
0 1
1 0 1 0 1 0
𝐴2 = 𝐴𝐴 = ( )( )=( )
0 1 0 1 0 1
⟹𝐴 is an idempotent matrix
Eigenvalues of a skew symmetric matrix 𝐵 with real entries are purely imaginary.
𝐵𝑥 = 𝜆𝑥
⟹(𝐵𝑥)∗ = (𝜆𝑥)∗
⟹𝐵 ∗ 𝑥 ∗ = 𝜆∗ 𝑥 ∗
⟹𝐵𝑥 ∗ = 𝜆∗ 𝑥 ∗ since 𝐵 is real
⟹(𝐵𝑥 ∗ )𝑇 = 𝜆∗ (𝑥 ∗ )𝑇
(𝐵𝑥 ∗ )𝑇 𝑥 = 𝜆∗ (𝑥 ∗ )𝑇 𝑥
⟹(𝑥 ∗ )𝑇 𝐵 𝑇 𝑥 = 𝜆∗ (𝑥 ∗ )𝑇 𝑥
⟹−(𝑥 ∗ )𝑇 𝜆𝑥 = 𝜆∗ (𝑥 ∗ )𝑇 𝑥
⟹−𝜆(𝑥 ∗ )𝑇 𝑥 = 𝜆∗ (𝑥 ∗ )𝑇 𝑥
⟹−𝜆 = 𝜆∗
Therefore 𝜆 is purely imaginary. The only real eigenvalue that a skew symmetric matrix
might have is the zero eigenvalue.
Example:
0 1
Find the eigenvalues of the skew symmetric matrix 𝐴 = ( )
−1 0
Solution-
0 1
𝐴=( )
−1 0
The characteristic equation of the given matrix is,
8
det(𝐴 − 𝜆𝐼) = 0
0 1 1 0
⟹det {( )−𝜆( )} = 0
−1 0 0 1
0 1 𝜆 0
⟹det {( )−( )} = 0
−1 0 0 𝜆
−𝜆 1
⟹det ( )=0
−1 −𝜆
⟹𝜆2 + 1 = 0
⟹𝜆2 = −1
⟹𝜆 = ±√−1
⟹𝜆 = +𝑖, −𝑖
Let 𝑀(𝑛, 𝑛) be the set of all 𝑛 × 𝑛 matrices over a commutative ring with identity. Then the
Cayley-Hamilton theorem states,
Theorem 2.4.1:
Let 𝐴 ∈ 𝑀(𝑛 × 𝑛) with characteristic polynomial
det(𝐼 − 𝑡𝐴) = 𝑐0 𝑡 𝑛 + 𝑐1 𝑡 𝑛−1 + 𝑐2 𝑡 𝑛−2 + ⋯ + 𝑐𝑛
Proof:
First observe that
1
det(𝐼 − 𝑡𝐴) = 𝑡 𝑛 det ( 𝐼 − 𝐴) = 𝑐0 + 𝑐1 𝑡 + 𝑐2 𝑡 2 + ⋯ + 𝑐𝑛 𝑡 𝑛
𝑡
Now Laplace formula for calculating the determinant gives the standard equation
So, (∑∞ 𝑖 𝑖 2 𝑛
𝑖=0 𝐴 𝑡 )(𝑐0 + 𝑐1 𝑡 + 𝑐2 𝑡 + ⋯ + 𝑐𝑛 𝑡 )𝐼 = 𝑎𝑑𝑗 (𝐼 − 𝑡𝐴)
Writing 𝑎𝑑𝑗 (𝐼 − 𝑡𝐴) as a formal power series in 𝑡 with coefficients in 𝑀(𝑛 × 𝑛) gives
9
∞ ∞
2 𝑛)
(𝑐0 + 𝑐1 𝑡 + 𝑐2 𝑡 + ⋯ + 𝑐𝑛 𝑡 (∑ 𝐴 𝑡 ) = ∑ 𝐵𝑖 𝑡 𝑖
𝑖 𝑖
𝑖=0 𝑖=0
Observe that the entries in 𝑎𝑑𝑗 (𝐼 − 𝑡𝐴) are polynomials in 𝑡 of degree at most 𝑛 − 1. So 𝐵𝑖
is the zero matrix for 𝑖 ≥ 𝑛. Equating the coefficients of 𝑡 𝑛 on both sides gives
𝑐0 𝐴𝑛 + 𝑐1 𝐴𝑛−1 + 𝑐2 𝐴𝑛−2 + ⋯ + 𝑐𝑛 𝐼 = 0
Example-1:
1 4
Verify Cayley-Hamilton theorem for 𝐴 = ( ). Also find 𝐴−1 .
2 3
Solution-
We know that
det(𝐴 − 𝜆𝐼) = 0
1 4 1 0
⟹det {( )−𝜆( )} = 0
2 3 0 1
1−𝜆 4
⟹| |=0
2 3−𝜆
⟹(1 − 𝜆)(3 − 𝜆) − 8 = 0
⟹3 − 𝜆 − 3𝜆 + 𝜆2 − 8 = 0
⟹𝜆2 − 4𝜆 − 5 = 0
10
Hence the equation is satisfied.
⟹𝐴 − 4𝐼 − 5𝐴−1 = 0
⟹5𝐴−1 = 𝐴 − 4𝐼
1
⟹𝐴−1 = 5 (𝐴 − 4𝐼) _______ (2)
1 1 4 1 0
Now 𝐴−1 = 5 {( ) − 4( )}
2 3 0 1
1 1−4 4−0
= 5( )
2−0 3−4
1 −3 4
= 5( )
2 −1
Example-2:
1 2 −1
−1
Find 𝐴 𝑎𝑛𝑑 𝑎𝑑𝑗 𝐴 if 𝐴 = (0 1 1 ) by using Cayley-Hamilton theorem.
3 −1 1
Solution-
1 2 −1
𝐴 = (0 1 1)
3 −1 1
𝑝(𝜆) = 𝜆2 − 3𝜆2 + 5𝜆 + 3 = 0
0 −1 −1
1
𝐴−1 = − 3 (−3 4 1)
−3 7 1
1
Since 𝐴−1 = |𝐴| 𝑎𝑑𝑗 𝐴
11
6 −2
𝐴=( )
6 −1
We know that |𝐴 − 𝜆𝐼| = 0
6 −2 1 0
⟹|( )−𝜆( )| = 0
6 −1 0 1
6−𝜆 −2
⟹| |=0
6 −1 − 𝜆
⟹(6 − 𝜆)(−1 − 𝜆) + 12 = 0
⟹−6 − 6𝜆 + 𝜆 + 𝜆2 + 12 = 0
⟹𝜆2 − 5𝜆 + 6 = 0
𝑝(𝜆) = 𝜆2 − 5𝜆 + 6 = 0
Replacing 𝜆 with 𝐴
𝑝(𝐴) = 𝐴2 − 5𝐴 + 6𝐼 = 0
Solving for 𝐴2 ,
𝐴2 = 5𝐴 − 6𝐼
𝐴3 = 5𝐴2 − 6𝐴
= 5(5𝐴 − 6𝐼) − 6𝐴
𝐴4 = 19𝐴2 − 30𝐴
𝐴5 = 65𝐴2 − 114𝐴
𝐴6 = 221𝐴2 − 390𝐴
12
=221(5A-6I)-390A
=665A-1266I
6 −2 1 0
=665( ) - 1266 ( )
6 −1 0 1
2724 −1330
A6=( )
3990 1931
8.CONCLUSION-