Modul 7_Eigenvalues and Eigenvectors
Modul 7_Eigenvalues and Eigenvectors
Eigenvalues and
Eigenvectors
Learning Objectives
2
Scope
Eigenspace
Diagonalization
Orthogonal Diagonalization
3
Pre-test modul
Pre-test
5
Answers to pre-test
2 0 5 1 0
A= u= v= w=
4 1 4 4 4
2 0 5 10
Au = =
4 24 ku untuk semua k R u and Au are NOT parallel
4 1
2 0 1 2 1
Av = =
= 2 . 4 = 2v v and Av are parallel
4 1 4 8
2 0 0 0
Aw = =
= 1 w w and Aw are parallel
4 1 4 4
6
Eigenvalues and Eigenvectors
Eigenspaces
Diagonalization
Orthogonal Diagonalization
2 0 5 10 5 2 0 1 1 2 0 0 0
4 1 4 = 24 k 4 4 1 4 = 2 4 4 1 4 = 1 4
Au ≠ ku Av = 2v Aw = 1w
10
y Au = y 2 y
4 Av =
8
1
v=
5 4 0
u= w = Aw =
4 4
x x x
8
Vector and Matrix Multiplication
A x = λx
Ax
x
Ax
9
Definition: eigenvalue and eigenvector
Av
v
v v
v Av
Av Av
(1) λ ≥ 1 (2) 0 ≤ λ ≤ 1 (3) -1 ≤ λ ≤ 0 (4) λ ≤ - 1
10
Exercise 1: zero vector and the zero
eigenvalue
a. Why is an eigenvector never a zero vector?
Answer:
Suppose vector v = 0, then every matrix Anxn, and scalar λ will satisfy
the equation Ax = λx, such that the equation would not give any
meaningful information.
11
Exercise 2: Homogeneous SLE Anxnx = 0
1. A is a square matrix and SLE Ax = 0 only has the trivial solution. What
is your conclusion about A?
Answer:
a. A has an inverse.
b. det(A) ≠ 0
12
The Eigenvector Problem
A x parallel to x
A x = λ x
13
The Eigenvalue Problem
A x = λ x
x is a nonzero vector
14
Equivalent Statements
1. is an eigenvalue of A
15
Characteristic Equation
If it is expanded, det(A - λI) is an n degree polynomial in terms of λ,
p( ) = n + cn−1 n−1 + cn−2n−2 + + c1 + c0 characteristic polynomial
A - λI = A-λI
= + cn−1 + cn−2 + + c1 + c0 = 0
n n−1 n−2
det A-λI
16
Exercise 3: finding eigenvalues
2 0
Find all eigenvalues of A =
4 1
Answer:
First, find the characteristic equation det(A- λ I) = 0
2 − 0
det = 0
4 1 −
18
Exercise 4: finding eigenvalues
1 1 1
Find all eigenvalues of matrix A = 0 3 3
−2 1 1
Answer:
1. Find the characteristic equation det(A - λI) = 0
1 − 1 1
det( A − I ) = det 0 3− 3 = (1 − )2 (3 − ) − 6 + 2(3 − ) − 3(1 − )
−2 1 1 −
2. Modify the characteristic equation into an equivalent equation that is easier to solve
(1 − )2 (3 − ) − 6 + 2(3 − ) − 3(1 − ) = 0
3. Solve the equation to obtain eigenvalues
(1 − )2 (3 − ) − (3 − ) = 0 Eigenvalues of A:
1 = 0
( − 2)(3 − ) = 0
2 = 2
3 = 3
19
Eigenvalues of diagonal matrices
2 0 0 0
0 5 0 0
Given a diagonal matrix A=
0 0 6 0
0 0 0 1
2 − 0 0 0
0 5 − 0 0
A − I =
0 0 6− 0
0 0 0 1 −
Characteristic equation: det( A − I ) = (2 − )(5 − )(6 − )(1 − ) = 0
The eigenvalues of a diagonal matrix are its entries in the main diagonal.
20
Exercise 5 : finding eigenvalues
1. Given an upper triangular matrix below. Find its eigenvalues.
1 1 3 0
0 5 2 0
A=
0 0 6 7
0 0 0 7
2. Find all eigenvalues of the following lower triangular matrix.
a11 0 0
a21 a22 0
A=
a an2 ann
n1
21
Solution
1 1 3 0
1. Eigenvalues of matrix 0 5 2 0
are 1, 5, 6, 7
A=
0 0 6 7
0 0 0 7
a11 0 0
a21 a22 0
2. Eigenvalues of matrix A = are a11, a22,…ann
a an2 ann
n1
22
Is λ an eigenvalue of A?
2 − 2 2 0
( )
det A − 2I = det 0 4 −2 0 =0 2 is an eigenvalue of A
0 1 0 − 2
2 − 4 2 0
det( A − 4I ) = det 0 4−4 0 =0 4 is an eigenvalue of A
0 1 0 − 4
2 − 8 2 0
det( A − 0I ) = det 0 4−8 0 = −192 8 is not an eigenvalue of A
0 1 0 − 8
23
Exercise 6 : finding eigenvectors
1 1 1 0 − 4 − 2 0 2
A = 0 3 3 , u = − 2 , x = − 6 , y = 1 z = 0 , w = 1
−2 1 1 2 2 1 0 0
• Find and draw vectors u, x, y, z and Au, Ax, Ay, Az
24
Exercise 7
25
Eigenvalues of Power of a Matrix
Theorem 7.1:
If n is a positive integer, λ is an eigenvalue of A, then λn is an eigenvalue of An
26
Eigenvalues of Power of a Matrix
1 1 1
• Eigenvalues of A are 0, 2, and 3. A = 0 3 3
−2 1 1
−1 5 5
Find eigenvalues of A2 = − 6 12 12 , A13 , A20
− 4 2 2
Eigenvalues of A2 are: 0, 4, and 9
Eigenvalues of A13 are: 0, 213, and 313
27
Eigenvalue of Singular Matrix
• Suppose = 0 is an eigenvalue of A.
Then 0 is a solution to the characteristic equation:
By substituting with 0, we have c0 = 0.
Because det(A- I) = 0, where = 0, then det(A) = c0 = 0.
And because det(A) = 0 then A does not have inverse.
Theorem 7.2:
0 is an eigenvalue of A if and only if A does not have an inverse.
28
Eigenvalues of Transpose of Matrix
det(B) = det(BT)
(A- I)T = (AT- I)
Theorem 7.3:
A and AT have the same eigenvalue.
29
Exercise 8
Determine if the following statements are TRUE or FALSE!
1. If Ax – ax = 0 for a nonzero scalar a, then x is an eigenvector.
2. If a is not an eigenvalue of A, then SLE (aI –A)x = 0 has exactly one solution.
3. Every identity matrix has one eigenvalue, that is 1
4. A matrix that only has 1 as its eigenvalue is the identity matrix.
5. If the following is the characteristic polynomial of A
p( ) = ( − 1 )2 ( − 2)3 ( − 3), then A is a 5x5 matrix
6. If the following is the characteristic polynomial of matrix A
p( ) = ( − 1 )2 ( − 2)3 ( − 3) , then A2 does not have an inverse.
30
Solution to Exercise 8
Solution:
1. FALSE, if x is a zero vector, x is not an eigenvector
2. TRUE
3. TRUE
4. FALSE
5. FALSE
6. FALSE
31
Eigenvalues and Eigenvectors
Eigenspace
Diagonalization
Orthogonal Diagonalization
7.2 Eigenspace
32
Scalar Multiple of Eigenvectors
• Given A, suppose x is an eigenvector of A corresponding to 2. Find if 1/2x, 10x, 5x are
also eigenvectors of A
1 1 1 − 4 − 2 − 40 − 20
1
A = 0 3 3 x = − 6 x = − 3 10x = − 60 5x = − 30
−2 1 1 2 2 1 20 10
1 1 1 − 4 − 8 1 1 1 − 40 − 80
Ax = 0 3 3 − 6 = − 12 = 2x A(10 x ) = 0 3 3 − 60 = − 120 = 2(10 x )
− 2 1 1 2 4 − 2 1 1 20 40
Ax = 2 x A(10x) = 2 (10x)
A x = λ x
A (10) x = λ (10) x
33
Scalar Multiple of Eigenvectors (cont)
1 1 1 − 4 − 2
1
A = 0 3 3 x = − 6 x = − 3
−2 1 1 2 2 1
1 1 1 − 4 − 8 1 1 1 − 2 − 4
1 1
Ax = 0 3 3 − 6 = − 12 = 2x A x = 0 3 3 − 3 = − 6 = 2 x
2 1 2 2
− 2 1 1 2 4 − 2 1 1
1 1
Ax = 2x A x = 2 x
2 2
A x = λ x A (1/2) x = λ (1/2) x
34
Finding Eigenvectors of Eλ
• Given a matrix A and one of its eigenvalues, λ. Find all eigenvectors
corresponding to λ.
Null(A - λ I)-{0}
35
Eigenspace
• The eigenspace of A corresponding to λ consists of all eigenvectors
corresponding to λ and the zero vector
0
Eigenspace
Eλ
Null(A - λ I) = Eλ
36
Procedure to find eigenspace
2. Solve the SLE, you will obtain the subspace: Null(A - λI)
E λ= Null(A – λI)
37
Example 1: Finding eigenspace Eλ
Given matrix A and one of its eigenvalue λ = 3. Find all eigenvectors corresponding
to λ = 3.
1 1 1 1 − 3 1 1
A = 0 3 3 A − I = 0 3−3 3
−2 1 1 −2 1 1 − 3
Given SLE ( A − 3I ) x = 0
1 − 3 1 1 x1 0 − 2 x1 + x2 + x 3 = 0
( A − 3I )x = 0 3 − 3 3 x2 = 0 3 x3 = 0
−2 1 1 − 3 x3 0 − 2 x1 + x2 − 2 x 3 = 0
x1 = a 1
General solution : x2 = 2a Solution set: a 2 , a R
x3 = 0 0
1
The set of eigenvectors of A corresponding to = 3: a 2 , a 0, a R
0
38
Exercise 9: Finding the eigenspace
Answer:
1. Eλ = Null(A - λ I)
2. NO, there is one element, i.e. 0 that is not an eigenvector.
The zero vector is not an eigenvector for any matrix.
3. [Hint: find basis of Null(A - λI)]
39
Eigenvalues and Eigenvectors
Eigenspace
Diagonalization
Orthogonal Diagonalization
7.3 Diagonalization
Diagonalization
Example 2:
5 − 6 2 1 1 −1
A = P = −1
P =
3 − 4 1 1 − 1 2 Diagonal
matrix
1 − 1 5 − 6 2 1 2 0
=
− 1 2 3 − 4 1 1 0 − 1
P-1 A P D
A is diagonalizable
41
When is matrix A diagonalizable?
Theorem 7.3.
If A is a nxn matrix, then the following sentences are equivalent:
1. A is diagonalizable
2. A has n linearly independent eigenvectors
a11 a12 a1 n
Proof (1) → (2)
a21 a22 a2n
A=
Given A
a an2 ann
n1
1 0 0
0 2 0
Such that P-1 AP = D is a diagonal D=
matrix
0
0 n
42
When is matrix A diagonalizable? (cont)
43
Procedure to Diagonalize a Matrix
Procedure
1. Find n linearly independent eigenvectors of A, e.g. p1, p2, p3, …, pn
44
Example 3: diagonalizing matrix
Given matrix Anxn find P such that P-1AP = D.
5 − 6
A =
3 − 4
Procedure
1. Find 2 linearly independent eigenvectors A. First, find its eigenvalues, i.e. λ1= 2 and λ2= -1
(was previously obtained/calculated). Find eigenvectors corresponding to its eigenvalues,
by solving SLE (A - λ I)x =0 we have
2 1
p 1 = p 2 =
1 1
2. Define matrix P where its columns are the eigenvectors above.
2 1 1 −1
P = P −1 =
1 1 − 1 2
3. Matrix D = P-1A P is a diagonal matrix where the entries of its main diagonal are λ1, λ2
consecutively
1 − 1 5 − 6 2 1 2 0
D = =
− 1 2 3 − 4 1 1 0 − 1
45
The Diagonalization Problem and The
Eigenvector Problem
• The Eigenvector Problem
Given matrix Anxn, is there a basis of Rn that consists of eigenvectors of A?
Theorem 7.4:
Anxn is diagonalizable if and only if there are n linearly independent eigenvectors.
46
The Diagonalization Problem (cont)
Theorem 7.5:
If v1, v2, …,vk are eigenvectors of A corresponding to distinct eigenvalues λ1, λ2, …
λk, then { v1, v2, …,vk } is a linearly independent set.
Theorem 7.6.:
If matrix Anxn has n distinct eigenvalues, then A is diagonalizable.
47
Example : diagonalizable matrix
a. Matrix 0 1 0
A = 0 0 1
4 − 17 8
Has 3 distinct eigenvalues, i.e. λ = 4, λ = 2+3, λ = 2 - 3. Thus, A is
diagonalizable.
Definition 7.3.:
• If λ0 is an eigenvalue of a square matrix A, then dimension of the
eigenspace corresponding to λ0 is called the geometric multiplicity of λ0.
• The number of times λ – λ0 appears as a factor in the characteristic
polynomial of A is called the algebraic multiplicity of A.
Suppose A is a 6x6 matrix that has the characteristic equation λ2 (λ-1) (λ-2)3 = 0.
Algebraic multiplicity of each eigenvalues 0, 1, and 2 are 2, 1, dan 3.
49
Geometric and Algebraic Multiplicity
Theorem 7.4:
If A is a square matrix, then:
1. For every eigenvalue of A, its geometric multiplicity is less than or equal to its
algebraic multiplicity.
2. A is diagonalizable if and only if the geometric multiplicity is equal to its
algebraic multiplicity for each of the eigenvalue of A.
50
Exercise 10: information from the characteristic
equation
Answer:
51
Geometric and Algebraic Multiplicity
1 2 1
P = 1 3 3
1 3 4
52
Diagonalization
Diagonalization can be used to simplify the following expression:
1. If A is a square matrix and P is an invertible matrix, then:
(P-1AP)2 = P-1APP-1AP = P-1AIAP = P-1A2P
53
Exercise 12: diagonalization
Given matrix A
0 0 0
A = 0 0 0
3 0 1
• Determine if A is diagonalizable.
54
Answer to Exercise 12
1 0 0 0 0 0
Then
P = 0 1 0 and P −1 AP = 0 0 0 = D
− 3 0 1 0 0 1
55
Eigenvalues and Eigenvectors
Eigenspace
Diagonalization
Orthogonal Diagonalization
7.4 Orthogonal
Diagonalization
56
Orthogonal Diagonalization
Theorem 7.7:
If A is a square matrix, then the following sentences are equivalent:
a. A is orthogonally diagonalizable
b. A has an orthonormal set that consists of n eigenvectors
c. A is symmetric
57
Example 6: Orthogonal Diagonalization
Characteristic equation of A:
− 4 − 2 −2
det(I − A) = det − 2 − 4 − 2 = ( − 2)2 ( − 8) = 0
− 2 − 2 − 4
− 1 − 1
Vectors u1 = and u2 = form a basis of Eλ = 2.
1 0
0 1
58
Orthogonal Diagonalization (cont)
1
The eigenspace of λ = 8 has basis B = { u3 }= 1
1 1
3
1
Apply normalization to {u3} such that it produces: B = {v3 }=
1 3
3
59
Orthogonal Diagonalization Procedure
60
Reflection
Make a diagram that explains the relation between concepts you have
learned, i.e. Vectors in 2-space and 3-space, vector and matrix
multiplication, homogeneous SLE, determinant, polynomial equation,
eigenvalue, eigenvector, eigenspace, diagonalization.
61
Summary
Check your summary, are the following key concepts mentioned in your
summary?
❑ eigenvalue
❑ eigenvector
❑ Characteristic equation
❑ eigenspace
❑ Geometric multiplicity
❑ Algebraic multiplicity
❑ diagonalization
❑ Orthogonal diagonalization
62
Post-test modul
4. Two matrices have the same characteristic equation, what can you
conclude? Do they have the same eigenspaces?
64
Congrats, you have completed module 7.
Prepare for the next module