Arch 224 SPR 22
Arch 224 SPR 22
1
Course specification
MATH 224, Linear Algebra 2, Spring 2022
Laurence Barker, Bilkent University. Version: 14 April 2022.
Course Aims: To aquire theoretical and practical skill at some techniques of linear algebra
that advance beyond a first course such as MATH 223 Linear Algebra 1.
Course Description: This is a second course in linear algebra, more advanced and more
theoretically inclined than MATH 223. To obtain a satsfactory grade, it will be necessary
to solve most of the routine problems and to answer brief theoretical questions. To obtain a
high grade, it will also be necessary to solve some of the difficult problems and to give clear
explanations.
Course Requirements: Knowledge of material in a first course in linear algebra, notably,
the technique of diagonalization and the material behind it, such as the theory of coordinate
transformations, the theory of eigenvalues and eigenvectors.
Instructor: Laurence Barker, Office SAZ 129, barker at fen dot bilkent dot edu dot tr.
Assistant: Serkan Sonel, serkan dot sonel at bilkent dot edu dot tr.
Recommanded textbooks:
• Stephen H. Friedberg, Arnold J. Insel, Lawrence E. Spence, “Linear Algebra”, 5th edition,
(Pearson, 2018).
• Bill Jacob, “Linear Algebra”, (W. H. Freeman, New York, 1990).
• Tom M. Apostol, “Linear Algebra”, (Wiley, New York, 1997).
Supplementary material on my homepage: [To be supplied later.]
• Homeworks, with solutions: homework224spr22.pdf .
• Quizzes, with solutions: quiz224spr22.pdf .
• Course notes on selected topics: PDF files with names of the form: LinAlgTheoNotes... .
Weekly Syllabus
The format below is, Week number; Monday date; Subtopics.
1: Mon 30 Jan - Fri 4 Feb: Review of diagonalization over the real and complex numbers.
Rings, fields, finite fields.
2: Mon 7 Feb - Fri 11 Feb: Vector spaces over arbitrary fields. Steinitz Exchange Lemma
and applications. Error-correcting codes.
2
3: Mon 14 Feb - Fri 18 Feb: Error-correcting codes. Unique factorization of polynomial
rings. Annihilating polynomials of a matrix and of a linear map.
4: Mon 21 Feb - Fri 25 Feb: Minimal polynomial of a linear map. Generalized eigenvectors.
5: Mon 28 Feb - Fri 4 Mar: Generalized eigenvectors. Jordan normal form.
6: Mon 7 Mar - Wed 9 Mar: Cayley–Hamilton Theorem and applications.
7: Mon 14 Mar - Fri 18 Mar: Inner product spaces. Cauchy–Schwartz inequality. Triangle
inequality. Orthonormal bases. Pearson correlation coefficient.
8: Mon 21 Mar - Fri 25 Mar: Orthonormal bases. Gram–Schmidt orthogonalization
9: Mon 28 Mar - Fri 1 Apr: Quadratic forms. Bilinear forms. Sylvester’s law of inertia.
10: Mon 4 Apr - Fri 8 Apr: Quadratic forms. Bilinear forms. Sylvester’s law of inertia.
11: Mon 11 Apr - Fri 15 Apr: Symmetric, Hermitian, orthogonal and unitary operators,
their diagonmalizability and their spectral theorems.
12: Mon 18 Apr - Fri 22 Apr: Symmetric, Hermitian, orthogonal and unitary operators,
their diagonmalizability and their spectral theorems.
13: Mon 25 Apr - Fri 29 Apr: Skew-symmetric bilinear forms. Groups preserving bilinear
forms.
14: Thur 5 May - Fri 6 May: Rational canonical form.
15: Mon 9 May - Fri 13 May: Review for Final.
Assessment: The method of assessment is by curve. Grades F, FX, FZ are to be for candidates
judged to be thoroughly incompetent in the routine course material.
• Quizzes 10% (marks for worst 2 quizzes to be dropped).
• Midterm I, 30%, face-to-face exam, Thursday 17 March, 15:30 - 17:20, rooms SA-Z04, B-108.
• Midterm II, 30%, face-to-face exam, Thursday 21 April, 15:30 - 17:20, rooms SA-Z04, B-108.
• Final, 30%, face-to-face exam, Friday, 20 May.
FZ criteria: less than 30% of the sum of the Midterm 1 and Midterm 2 marks.
3
Homework
MATH 224, Linear Algebra 2, Spring 2022, Laurence Barker
version: 15 April 2022
Homework 1: page 5
Solutions 1: page 6
Homework 2: page 8
Solutions 2: page 9
Homework 3: page 12
Solutions 3: page 14
4
Homework 1
Solutions to be discussed in class on or after Tuesday 8 March.
Question 1.1: The modulus of a quaternion q = t + ix + jy + kz, with t, x, y, z ∈ R, is
defined by the Pythagorean formula
√
|q| = t2 + x2 + y 2 + z 2 .
As elements of Mat2 (C), write
[ ] [ ] [ ] [ ]
1 0 −i 0 0 −1 0 i
I= , I= , J = , K= .
0 1 0 i 1 0 i 0
(a) Calculate the determinant of the matrix tI + xI + yJ + zK.
(b) Using part (a), show that, given q, q ′ ∈ H, then |qq ′ | = |q|.|q ′ |.
(c) Let q be a non-zero quaternion. Again writing q = t + ix + jy + kz, give a formula for q −1 .
Question 1.2: A field F is said to be finite provided the underlying set F is finite, in other
words, provided F has only finitely many elements. Show that, if F is finite, then |F | is a
power of a prime, in other words, |F | = pm for some prime p and some positive integer m.
(Hint: First show that F contains a copy of the ring Z/n for some positive integer n. Then
make use of the fact that every finite-dimensional vector space has a basis.)
Question 1.3: Suppose F is finite. Consider a system of F -linear equations Ax = y. Thus, x
and y are column vectors over F and A is a matrix over F . Show that, for each y, the number
|{x : Ax = y}| is zero or a power of a prime.
Question 1.4: Prove the following two propositions concerning the polynomial ring F [t],
where F is a field:
(a) Given nonzero a(t), b(t) ∈ F [t], then there exist unique q(t), r(t) ∈ F [t] such that a(t) =
q(t)b(t) + r(t) and deg(r(t)) < deg(b(t)).
(b) Let a(t), b(t) ∈ F [t]. Let c(t) be a polynomial of maximal degree such that c(t) divides a(t)
and b(t). Then there exist u(t), v(t) ∈ F [t] such that c(t) = u(t)a(t) + v(t)b(t). Furthermore,
there exists a unique such monic c(t).
Question 1.5: Consider the linear coding scheme with Hamming matrix
[ ]
1 0 0 1 0
H= .
0 1 1 0 1
(a) Write down the generating matrix G for the coding scheme.
(b) Write down a decoding table, including the column of syndromes.
(c) Encode the message words 100, 110, 111.
(d) For the received words 00011, 00111, 01111, 11111, write down the syndromes, then write
down the decoded words.
(e) What is the rate of the code?
(f ) If a single codeword is transmitted, what is the maximum number of errors of transmission
(the maximum number of inversions of binary digits) such that any error can be detected?
What is the maximum number of errors of transmission (the maximum number of inversions
of binary digits) such that any error can be corrected?
5
Solutions 1
t − ix −y + iz
det(tI + xI + yJ + zK) = = |t + ix|2 + |y + iz|2 = |q|2 .
y + iz t + ix
Part (b). The required equality follows from part (a) because det(AB) = det(A) det(B)
for 2 × 2 matrices A and B over C.
Part (c). By the formula for the inverse of a 2 × 2 matrix with non-zero determinant, if
q ̸= 0, then
[ ]−1 [ ]
t − ix −y + iz 2 2 2 2 −1 t + ix y + iz
= (t + x + y + z )
y + iz t + ix −y + iz t − ix
ri+1 = qi ri + ri−1
and deg(ri ) > deg(ri−1 ). Since the degrees deg(ri ) are strictly decreasing, the process must
terminate. Let k be such that rk+1 = 0. Let c = rk . If c divides ri−1 and ri , then c divides ri+1
and ri . So, by an inductive argument, c divides a and b. On the other hand, another inductive
argument shows that each ri has the form ui a + vi b for polynomials ui and vi . In particular,
c = ua + vb for some u and v.
Finally, if d is a polynomial dividing a and b, then d must divide c because c = ua + vb.
In particular, deg(d) ≤ deg(c) and if deg(d) = deg(c) then d must be an F -multiple of c. The
required conclusion follows.
6
1 0 0
0 1 0
1.5: Part (a). We have G =
0 0 1.
1 0 0
0 1 1
Part (b). The decoding table is as follows.
000 001 010 011 100 101 110 111 syndrome
00000 00101 01001 01100 10010 10111 11011 11110 00
00001 00100 01000 01101 10011 10110 11010 11111 01
00010 00111 01011 01110 10000 10101 11001 11100 10
00011 00110 01010 01111 10001 10100 11000 11101 11
Part (c). The encodings of 100, 110, 111 are 10010, 11011, 11110, respectively.
Part (d). The received words 00011, 00111, 01111, 11111 have syndromes 11, 10, 11, 01
and decodings 000, 001, 011, 111, respectively
Part (e). The rate is 3/5.
Part (f). The minimum weight of a nonzero codeword is 2. So up to 1 error of transmission
can always be detected, and up to 0 errors of transmission can always be corrected.
7
Homework 2
Solutions to be discussed in class on or after Tuesday 15 March.
−1 2 −1
Question 2.1: Consider the matrix A = 0 −1 1 .
0 0 2
Express A in the form A = P EP −1 where E has Jordan normal form.
−2 1 0
Question 2.2: Repeat Question 1 with A = −1 0 0.
−1 −1 1
Question 2.3: Let A be an n × n matrix over an algebraically closed field F .
(a) Show that, when n = 3, the Jordan normal form of A is determined by the characteristic
polynomial and the minimal polynomial of A.
(b) In the case n = 4, give a counter-example to the conclusion of part (a).
Question 2.4: We write F2 for the field with order 2, and we write Matn (F2 ) to denote the
ring of n × n matrices over F2 . Let ∼ denote the equivalence relation on Matn (F2 ) such that,
given A, B ∈ Matn (F2 ), then A ∼ B when A is similar to B, in other words, A = P BP −1 for
some invertible P ∈ Matn (F2 ).
(a) When n = 2, how many equivalence classes of ∼ include a matrix that has Jordan normal
form?
(b) When n = 3, how many equivalence classes of ∼ include a matrix that has Jordan normal
form?
(c) When n = 4, how many equivalence classes of ∼ include a matrix that has Jordan normal
form?
8
Solutions 2
−x + 2y − z = −x , −y + z = −y , 2z = −z .
−x + 2y − z = −x + 1 , −y + z = −y , 2z = −z .
−x + 2y − z = 2x , −y + z = 2y , 2z = 2z .
λ + 2 −1 0
1 λ 0 = (λ + 2)λ(λ − 1) + λ − 1 = (λ2 + 2λ + 1)(λ − 1) = (λ + 1)2 (λ − 1) .
1 1 λ−1
−2x + y = −x , −x = −y , −x − y + z = z .
−2x + y = −x + 1 , −x = −y + 1 , −x − y + z = z + 1 .
9
1 0 0
Comment: As an aid to checking the answer, we mention that P −1 = −1 1 0.
0 −1 1
2.3: Part (a). Write cA (t) and mA (t), respectively, for the characteristic polynomial and the
minimal polynomial of A in F [t]. We run through all the possible cases.
If A has 3 mutually distinct eigenvalues, λ1 , λ2 , λ3 , then A is diagonalizable and
Now suppose A has distinct eigenvalues λ1 and λ2 with multiplicities 1 and 2, respectively.
Then cA (t) = (t − λ1 )(t − λ2 )2 . Up to renumbering of basis elements, the two possible Jordan
normal forms for A are
λ1 0 0 λ1 0 0
0 λ2 0 , 0 λ2 1
0 0 λ2 0 0 λ2
whose minimal polynomials are (t − λ1 )(t − λ2 ) and cA (t), respectively. Finally, suppose A has
a unique eigenvalue λ. Then cA (t) = (t − λ)3 . Up to renumbering, the three possible Jordan
normal forms for A are
λ 0 0 λ 1 0 λ 1 0
0 λ 0 , 0 λ 0 , 0 λ 1
0 0 λ 0 0 λ 0 0 λ
whose minimal polynomials are (t − λ), (t − λ)2 , cA (t), respectively. Evidently, no two of the
six possible cases have the same polynomials cA (t) and mA (t).
Part (b). Let λ ∈ F . The two distinct matrices
λ 1 0 0 λ 1 0 0
0 λ 0 0 0 λ 0 0
0 0 λ 0 , 0 0 λ 1
0 0 0 λ 0 0 0 λ
are both in Jordan normal form, they both have characteristic polynomial (t − λ)4 ∈ F [t] and
minimal polynomial (t − λ)2 .
2.4: In all three parts, we are to count the equivalence classes of ∼ that include a matrix
having Jordan normal form.
Part (a). The answer is 5, since there are 5 possible cases: 2 distinct eigenvalues; unique
eigenvalue 0 and diagonalizable; unique eigenvalue 0 and non-diagonalizable; unique eigenvalue
1 and diagonalizable; unique eigenvalue 2 and non-diagonalizable.
Part (b). We can classify the equivalence classes according to Jordan normal form, bearing
in mind that renumberings of the Jordan basis yield the same Jordan normal form up to
permutation of the Jordan block matrices.
There are no cases with 3 mutually distinct eigenvalues. In the the case of 2 distinct
eigenvalues, there are 2 choices for which of the eigenvalues 0 or 1 has multiplicity 2 and then,
as we saw in Question 2.3, there are 2 choices for the Jordan normal form. That yields 4
equivalence classes. Meanwhile, in the case of a unique eigenvalue, there are 2 choices for the
eigenvalue, then 3 choices for the Jordan normal form. That yields 6 equivalence classes. So
the total number of equivalence classes is 4 + 6 = 10.
10
Part (c). Let (m1 , m2 , ...) be the dimensions of the Jordan blocks with eigenvalue 0, ar-
ranged such that m1 ≥ m2 ≥ .... Let (n1 , n2 , ...) be defined similarly for eigenvalue 1. Let
m = m1 + m2 + ... and n = n1 + n2 + ..., which are the multiplicities of the eigenval-
ues 0 and 1. The number of equivalence classes is the number of tuples having the form
(m1 , m2 , ...; n1 , n2 , ...) such that m + n = 4.
When m = 0, the possible tuples are (; 1, 1, 1, 1), (; 2, 1, 1), (; 2, 2), (; 3, 1), (; 4).
When m = 1, the possilities are (1; 1, 1, 1), (1; 2, 1), (1; 3).
When m = 2, they are (1, 1; 1, 1), (1, 1; 2), (2; 1, 1), (2; 2).
When m = 3, the number of possibilities is the same as for m = 1.
When m = 4, the number of possibilities is the same as for m = 0.
So the number of equivalence classes is 5 + 3 + 4 + 3 + 5 = 20.
Comment: Consider a field F . Recall that, when F is algebraically closed, every square matrix
over F is similar to a matrix having Jordan normal form. For an arbitrary field F and a square
matrix A over F , we may have to extend to a larger field in order to express A in the form
A = P EP −1 where E has Jordan normal form.
Consider the matrix
0 1 0
A = 0 0 1 ∈ Mat3 (F2 ) .
1 0 0
We have A3 = I. But there does not exist a non-identity matrix E ∈ Mat3 (F2 ) such that
E 3 = I. So A cannot be expressed in Jordan normal form over F2 . However, now let us view
A as a matrix over the field F4 with order 4. The field F4 = {0, 1, ω, ω 2 } has the following
addition and multiplication tables.
y y
x+y 0 1 ω ω2 xy 0 1 ω ω2
x 0 0 1 ω ω2 x 0 0 0 0 0
1 1 ω ω2 0 1 0 1 ω ω2
ω ω ω2 0 1 ω 0 ω ω2 1
ω2 ω2 ω 1 0 ω2 0 ω2 1 ω
It is not hard to check that, as a product of three matrices over F4 , we have
−1
1 1 1 1 0 0 1 1 1
A = 1 ω ω 2 0 ω 0 1 ω ω 2 .
1 ω2 ω 0 0 ω2 1 ω2 ω
11
Homework 3
Solutions to be discussed in class on Thursday 14 April and Tuesday 19th April.
Question 3.1: Let π be the linear map R2 ← R2 such that π(x, y) = (x + y, x + y)/2. Find:
(a) The matrix representing π with respect to the standard basis {(1, 0), (0, 1)} of R2 .
(b) Evaluate the trace tr(π) and the determinant det(π).
Question 3.2: Let e1 = (1, 1, 1) and e2 = (1, 2, 2) and e3 = (1, 2, 3) in R3 . Apply the
Gram–Schmidt process to the basis {e1 , e2 , e3 } to obtain an orthonormal basis for R3 .
Question 3.3: Let
U = {(x1 , x2 , x3 , x4 ) ∈ C4 : x1 + x3 = x2 + x4 = 0}
12
space V . Show that, with respect to some basis of V , the matrix representing ρ has the form
A1 0 ... 0
0 A2 ... 0
.. .. ..
. . .
0 0 ... Am
[ ]
cos(θ) − sin(θ)
where each As is either a 1 × 1 matrix [1] or [−1] or else a 2 × 2 matrix .
sin(θ) cos(θ)
(Hint: Extend to the complex numbers and adapt the trick we used to show that real symmetric
matrics are diagonalizable.)
13
Solutions 3
[ ]
1 1 1
3.1: Part (a). The required matrix is P = .
2 1 1
Part (b). We have tr(π) = tr(P ) = 1 and det(π) = det(P ) = 0.
Comment: Many invariants of a linear map, such as trace, determinant, characteristic poly-
nomial, minimal polynomial, are features of any matrix representing the linear map. Given a
linear map, then the representing matrix depends on the choice of basis. But, when we change
the basis, the invariants do not change. That is why they are called invariants. (I emphasize
this fundamental point because grasping it is the beginning of a comprehension of the theory
of linear algebra.)
3.2: We calculate the orthogonal basis {f1′ , f2′ , f3′ } given by
⟨f1′ | e2 ⟩ ′ ⟨f1′ | e3 ⟩ ′ ⟨f2′ | e3 ⟩ ′
f1′ = e1 , f2′ = e2 − f , f3′ = e3 − f − f .
∥ f1′ ∥2 1 ∥ f1′ ∥2 1 ∥ f2′ ∥2 2
and then the orthonormal basis {f1 , f2 , f3 } given by fi = fi′ / ∥ fi′ ∥. We have f1′ = (1, 1, 1).
Since
⟨f1′ | e2 ⟩ 1+2+2 5
′ = =
∥ f1 ∥ 2 1+1+1 3
5 1
we have f2′ = (1, 2, 2) − (1, 1, 1) = (−2, 1, 1). Since
3 3
⟨f1′ | e3 ⟩ 1+2+3 ⟨f2′ | e3 ⟩ (−2 + 2 + 3)/3 3
′ = =2, ′ = =
∥ f1 ∥ 2 3 ∥ f2 ∥ 2 (4 + 1 + 1)/9 2
1 1
we have f3′ = (1, 2, 3) − 2(1, 1, 1) − (−2, 1, 1) = (0, −1, 1). Therefore,
2 2
√ √ √
f1 = (1, 1, 1)/ 3 , f2 = (−2, 1, 1)/ 6 , f3 = (0, −1, 1)/ 2 .
3.3: We define
√ √ √ √
f1 = (1, 0, −1, 0)/ 2 , f2 = (0, 1, 0, −1)/ 2 , f3 = (1, 0, 1, 0)/ 2 , f4 = (0, 1, 0, 1)/ 2 .
14
1 0 1 0
0 1 0 1
Therefore, B =
1
.
0 1 0
0 1 0 1
3.4: Part (a). As a preliminary, recall that dim(U ) = dim(V ) + dim(V ⊥ ). (This is proved
by extending a basis for V to a basis for U , then applying the Gram–Schmidt process, which
yields an orthonormal basis for V that extends to a orthonormal basis for U .) Hence dim(V ) =
dim((V ⊥ )⊥ ). Plainly, V ≤ (V ⊥ )⊥ . The required conclusion follows.
Part (b). Since V + W ≥ V , we have (V + W )⊥ ≤ V ⊥ . Similarly, (V + W )⊥ ≤ W ⊥ . Hence
(V + W )⊥ ≤ V ⊥ ∩ W ⊥ . For the reverse inequality, let z ∈ V ⊥ ∩ W ⊥ . Given v ∈ V and w ∈ W ,
then ⟨v ⊥ z⟩ = ⟨w | z⟩, hence ⟨v + w | z⟩ = 0 and z ∈ (V + W )⊥ .
Part (c). Using parts (a) and (b), we have
(V ∩ W )⊥ = (V ⊥⊥ ∩ W ⊥⊥ )⊥ = (V ⊥ + W ⊥ )⊥⊥ = V ⊥ + W ⊥ .
z is any complex number satisfying 0 < |z| < 1.) Let W = spanC {x}. Then V ∩ W = {0},
hence (V ∩ W )⊥ = U . Meanwhile, w ̸∈ W ⊥ = V ⊥ ∩ W ⊥ . Therefore, (V ∩ W )⊥ > V ⊥ ∩ W ⊥ .
Comment: For each positive integer m, let em be the element of ℓ2 (C) such that the m-th term
of em is 1 and all the other terms are 0. In functional analysis, we write
∞
∑
(x1 , x2 , ...) = xm em
m=1
and we call the infinite set {e1 , e2 , ...} a topological basis for ℓ2 (C).
However, a vector space S over a field F comes equipped with an addition operation
S × S ∋ (s, t) 7→ s + t ∈ S. By the associativity of that operation, we can form finite sums
s1 + ... + sn for s1 , ..., sn in X. By the commutativity of the addition operation, the sum
s1 + ... + sn does not depend on the ordering of the terms sm . In linear algebra, we define
a basis for S to be a∑subset {ei : i ∈ I} ⊆ S such that every element of X can be uniquely
expressed as a sum i xi ei such that xi ∈ F and only finitely many of the indices xi are
nonzero. Sometimes, a basis in that sense is called an algebraic basis. Using Zorn’s Lemma,
it can be proved that every vector space has an algebraic basis.
In particular, ℓ2 (C) must have an algebraic basis. But it would be very difficult, perhaps
impossible, to explicitly specify any algebraic basis for ℓ2 (C). The above infinite sum only
makes sense because ℓ2 (C) has more structure than just that of a vector space. Since ℓ2 (C) is
an inner product space, we can view ℓ2 (C) as a metric space where the distance between two
vectors u and v is the norm ∥ u − v ∥. Via the metric space structure, we can form limits. To
give sense to the above infinite sum, we define it to be the limit
∞
∑ ∑
n
xm em = lim x m em .
n→∞
m=1 m=1
But span{e1 , e2 , ...} is not the whole of ℓ2 (C). In fact, span{e1 , e2 , ...} is precisely the subspace
V defined in the question. Thus, the topological basis {e1 , e2 , ...} for ℓ2 (C) is an algebraic basis
for V and it is not an algebraic basis for ℓ2 (C).
15
3.5: Part (a). The matrix F is unitary, hence diagonalizable.
Part (b). Given r, t ∈ Z/n, then the (r, t) entry of F 2 is
{
1 ∑ rs st 1 ∑ r+t 1 if r = −t,
ζ ζ = ζ s=
n n 0 otherwise.
s∈Z/n s∈Z/n
It follows that F 4 is the identity matrix. So the minimal polynomial of F must divide X 4 ∈
C[X]. The required conclusion follows.
Part (c). Since F is diagonalizable, part (b) yields Cn = E1 ⊕ E−1 ⊕ Ei ⊕ E−i . So, letting
a = dim(E1 ⊕ E−1 ) and b = dim(Ei ⊕ E−i ), we have a + b = n. On the other hand, E1 ⊕ E−1
is the 1-eigenspace of F 2 , while Ei ⊕ E−i is the −1-eigenspace of F 2 . The evaluation of F 2 in
part (b) implies that a − b = tr(F 2 ) = 1. Therefore,
16
Quizzes, with solutions
MATH 224, Linear Algebra 2, Spring 2022, Laurence Barker
version: 19 May 2022
[ ]
1 1/2
Quiz 1: Diagonalize . That is, express the specified matrix in the form P DP −1
−2 1
with D diagonal.
Solution: Write A for the specified matrix. The charactreristic polynomial of A is
det(λI − A) = λ2 − 2λ + 2
√ [ ]
2± 4−8 x
which has roots = 1 ± i. The eigenvalue 1+i has associated eigenvectors where
2 y
[ ] [ ]
x 1
x + y/2 = (1 + i)x and 2x + y = (1 + i)y. We can put = . Similarly (or by taking
y 2i
[ ]
1
complex conjugates), we see that the eigenvalue 1 − i has an associated eigenvector . So
−2i
[ ] [ ]
1 1 1+i 0
A = P DP −1 , where P = and D = . ⊓⊔
2i −2i 0 1−i
Comment: The example illustrates fact that, to diagonalize a real square matrix, we may need
to extend to the complex numbers.
17
Solution: The characteristic polynomial of A is
t − 1 −1
det(tI − A) = = (t − 1)(t − 5) + 4 = t2 − 6t + 9 = (t − 3)2 .
4 t−5
Solving for an eigenvector f1 = (x, y) with eigenvalue 3, we have
[ ][ ] [ ]
1 1 x x
=3 .
−4 5 y y
In other words, x + y = 3x and −4x + 5y = 3y. Thus, y = 2x. We can put f1 = (1, 2). Solving
for f2 = (x, y) such that Af2 = 3f2 + f1 , we have
[ ][ ] [ ] [ ]
1 1 x x 1
=3 + .
−4 5 y y 2
In other words, x + y = 3x + 1 and −4x + 5y = 3y + 2. Thus, y = 2x + 1. We can put
f2 = (0, 1). The Jordan basis {f1 , f2 } yields
[ ] [ ]
1 0 3 1
P = , E= .
2 1 0 3
Comment: By the uniqueness property of Jordan normal form, there is no other solution for
E. Of course, there are infinitely many solutions for P .
Quiz 4: Let e1 = (1, 1) and e2 = (0, 1). Apply the Gram–Schmidt process to the basis {e1 , e2 }
of R2 to obtain an orthonormal basis {f1 , f2 } for R2 . (Recall, the orthonormality condition is
⟨f1 | f1 ⟩ = ⟨f2 | f2 ⟩ = 1 and ⟨f1 | f2 ⟩ = 0.)
Solution: We construct an orthogonal basis {f1′ , f2′ } where f1′ = e1 and f2′ = e2 − ⟨f1 | e2 ⟩f1 .
Then we construct an orthonormal basis {f1 , f2 } where fi = fi′ / ∥ fi′ ∥. We have ∥ f1 ∥2 = 2, so
√ √
f1 = (1/ 2, 1/ 2) .
√ √ √
Hence f2′ = (0, 1) − (1/ 2, 1/ 2)/ 2 = (−1/2, 1/2). Since ∥ f2′ ∥2 = 1/2, we have
√ √
f2 = (−1/ 2, 1/ 2) .
Quiz 5: Which of the following form a subspace of Matn (R) and, in those cases, what is the
dimension?
(a) The set of symmetric matrices on Rn ?
(b) The set of orthogonal matrices on Rn ?
Solution: Part (a), obviously, yes. The dimension is n(n + 1)/2. Letting ϵi,j be the matrix in
Matn (R) with (i, j) entry 1 and all other entries 0, then the subspace of symmetric matrices
has a basis consisting of the matrices ϵi,j + ϵj,i .
Part (b), obviously, no.
Quiz 6: What is the set of real numbers t such that t is the trace of an orthogonal n × n
matrix over R?
Solution: When n = 1, the set is {−1, 1}. Otherwise, the set is the closed interval [−n, n].
Indeed, this is because the real eigenvalues of an orthogonal matrix are 1 and −1, while the
non-real eigenvalues can be arranged in pairs {z, z −1 } where z and hence z −1 are complex
numbers with modulus unity.
18
MATH 224: Linear Algebra 2. Spring 2022. Midterm 1
LJB, 17 March 2022, Bilkent University.
Time allowed: 110 minutes hours. Please put your name on EVERY sheet of your manuscript.
The use of telephones, calculators or other electronic devices is prohibited. The use of red pens
or very faint pencils is prohibited too. You may take the question sheet home.
1: 35 marks. Consider the linear coding scheme over the field {0, 1} with Hamming matrix
[ ]
1 0 1 1 0
H= .
1 1 1 0 1
3: 10 marks. Let F be a field, let m and n be positive integers with m ≤ n, and let M
and N be F -vector spaces with dimensions m = dim(M ) and n = dim(N ) such that M is a
subspace of N . Let E be the F -vector space consisting of the linear maps α : N → N such
that α(M ) ≤ M . Evaluate dim(E).
19
Solutions to Midterm 1
1 0 0
0 1 0
1: We have G = 0 0 1.
1 0 1
1 1 1
Part (b). Respectively, 000, 001, 011 have encodings 00000, 00111, 01110.
Part (c). The decoding table is as follows.
000 001 010 011 100 101 110 111 syndrome
00000 00111 01001 01110 10011 10100 11010 11101 00
00001 00110 01000 01111 10010 10101 11011 11100 01
00010 00101 01011 01100 10001 10110 11000 11111 10
00100 00011 01101 01010 10111 10000 11110 11001 11
Part (d). Respectively, 10000, 11000, 11001 have syndromes 11, 10, 11 and decodings 101,
110, 111.
Part (e). The received word with syndrome 00 and decoding 000 must be 00000. The
received word with syndrome 01 and decoding 000 must be 00001 or 01000. The received word
with syndrome 01 and decoding 000 must be 00010. The recevied word with syndrome 11 and
decoding 000 must be 00100 or 10000. So the number of possible decoding tables is 1.2.1.2 = 4.
2: Part (a). The characteristic polynomial of A in C[t] is
t −1 0
2 t − 2 −1 = t((t − 1)(t − 4) + 2) + 2(t − 4)
0 2 t−4
20
Part (c). In view of the Jordan normal form of A, the minimal polynomial of A is (t − 2)3 .
3: Extending a basis {e1 , ..., em } for M to a basis E = {e1 , ..., en } for N , then E is the
vector space consisting of those linear maps α : N → N such that, with respect to E, the
matrix representing α has (i, j)-entry 0 whenever i > m ≥ j. The number of other entries is
dim(E) = n2 + m2 − nm.
4: Part (a). By the Cayley–Hamilton Theorem, the only possible eigenvalues of θ are 1 and
−1. When we extend to a larger field containing F , the nullities of θ − idV and θ + idV do
not change, in other words, dim(E1 ) and dim(E−1 ) do not change. So we may assume that F
is algebraically closed. Let T be the matrix representing θ with respect to a Jordan basis for
θ. We are to show that T is diagonal. Supposing otherwise, we may assume that the top-left
Jordan block of T is not a 1 × 1 matrix. Then the (1, 2) entry of T 2 must be 2 or −2, which
is impossible because T 2 is the identity matrix.
Part (b). Arguing as before, we may assume that F is algebraically closed. Again let T
be a matrix representing θ with respect to a Jordan basis for θ. It suffices to show that every
Jordan block of T is a 1×1 matrix or a 2×2 matrix. Supposing otherwise, we may assume that
the top-left Jordan block of T is a square matrix with at least 3 columns. Then the (1, 3)-entry
of T 2 is 1, which is again impossible because T 2 is the identity matrix.
Alternative, faster version of the solution to 4: The following was used in the exam script of
Buruk Yavus. ∏ Recall that, when λi runs over the eigenvalues of a linear map and the minimal
polynomial is i (t − λi )mi , the largest Jordan block with eigenvalue λi is an mi × mi matrix.
We have θ2 − id = 0. So the minimal polynomial of θ must divide t2 − 1. In part (a), we have
t2 − 1 = (t − 1)(t + 1). So the minimal polynomial must be t − 1 or t + 1 or (t − 1)(t + 1). It
follows that all the Jordan blocks must be 1 × 1 matrices, in other words, θ is diagonalizable.
In part (b), we have t2 − 1 = (t − 1)2 . So now the minimal polynomial must be t − 1 or (t − 1)2 .
Hence all the Jordan blocks must be 1 × 1 or 2 × 2 matrices.
21
MATH 224: Linear Algebra 2. Spring 2022. Midterm 2
LJB, 21 April 2022, Bilkent University.
Time allowed: 110 minutes hours. Please put your name on EVERY sheet of your manuscript.
The use of telephones, calculators or other electronic devices is prohibited. The use of red pens
or very faint pencils is prohibited too. You may take the question sheet home.
1: (30 marks). Let e1 = (0, 1, 1) and e2 = (1, 0, 1) and e3 = (1, 1, 0). Let {f1 , f2 , f3 } be the
basis for R3 obtained from {e1 , e2 , e3 } by the Gram–Schmidt process. Evaluate f1 and f2 and
f3 .
∥ f (x) − f (y) ∥ = ∥ x − y ∥
for all x, y ∈ Rn . Show that there exist a ∈ Rn and an orthogonal n × n matrix A such that
f (x) = Ax + a for all x ∈ Rn . (Warning: be careful not to make an invalid assumption of
linearity.)
22
Solutions to Midterm 2
23
MATH 224: Linear Algebra 2. Spring 2022. Makeup 2
LJB, 12 May 2022, Bilkent University.
Time allowed: 110 minutes hours. Please put your name on EVERY sheet of your manuscript.
The use of telephones, calculators or other electronic devices is prohibited. The use of red pens
or very faint pencils is prohibited too. You may take the question sheet home.
1: (30 marks). Let e1 = (0, 1, 2) and e2 = (1, 2, 1) and e3 = (2, 1, 0). Let {f1 , f2 , f3 } be the
basis for R3 obtained from {e1 , e2 , e3 } by the Gram–Schmidt process. Evaluate f1 and f2 and
f3 .
U = {(a, b, c, d) ∈ R4 : a + b + c + d = b + 2c + 3d = 0} .
Express, with respect to the standard basis of R3 , the matrix representing the orthogonal
projection U ← R4 .
24
MATH 224: Linear Algebra 2. Spring 2022. Final
LJB, 20 May 2022, Bilkent University.
Time allowed: 2 hours. Please put your name on EVERY sheet of your manuscript. The use
of telephones, calculators or other electronic devices is prohibited. The use of red pens or very
faint pencils is prohibited too. You may take the question sheet home.
[ ]
1 2
1: (20 marks). Let A = .
2 1
(a) Find the eigenvalues and eigenvectors of A.
(b) Find the rank and signature of the real quadratic form represented by A.
4: (20 marks). Let F denote the field with order |F| = 4, let n be a positive integer, and let
Fn denote the standard F-vector space of dimension n.
(a) What is the number of n-tuples (f1 , ..., fn ) such that the set {f1 , ..., fn } is a basis for Fn ?
(b) How many linear maps Fn → Fn are there?
(c) How many invertible linear maps Fn → Fn are there?
(d) What is the number of linear maps α : Fn → Fn such that det(α) = 1?
25
Solutions to Final
1−λ 2
= (λ − 1)2 − 4 = λ2 − 2λ + 3 = (λ − 3)(λ + 1) .
2 1−λ
∑
n
(m + 1) = 1 + 2 + ... + n + (n + 1) = (n + 1)(n + 2)/2 .
m=0
Part (b). The non-degenerate cases are those where c = 0. The number of such cases is
n + 1.
4: Part (a). There are 4n − 1 choices for f1 , then 4n − 4 choices for f2 and so on, finally
4n − 4n−1 choices for fn . So the number of such n-tuples is
Part (b). Since Matn (F) has dimension n2 as a vector space over F, the specified number
2
is |Matn (F)| = 4n .
26
Part (c). Fixing an ordered basis {e1 , ..., en } for Fn , each Each invertible map α on Fn is
uniquely determined by the ordered basis {α(e1 ), ..., α(en )}. So the number of such maps is
4n(n−1)/2 (4n − 1)(4n−1 − 1)...(4 − 1).
Part (d). Given a nonzero element λ of F and A ∈ Matn (F), then multiplying the top row
of A by λ produces a matrix with determinant λ det(A). So the number of invertible n × n
matrices with determinant λ is independent of λ. There are exactly 3 non-zero elements of F.
So the number of α as specified is the answer to (c) divided by 3. In other words, the number
of such α is 4n(n−1)/2 (4n − 1)(4n−1 − 1)...(42 − 1).
27