DUALITY
DUALITY
F Duality 101
3.F Duality
The Dual Space and the Dual Map
Linear maps into the scalar field F play a special role in linear algebra, and
thus they get a special name:
The vector space L.V; F/ also gets a special name and special notation:
In the following definition, 3.5 implies that each 'j is well defined.
The next result shows that the dual basis is indeed a basis. Thus the
terminology “dual basis” is justified.
If '; 2 W 0, then
In the next example, the prime notation is used with two unrelated mean-
ings: D 0 denotes the dual of a linear map D, and p 0 denotes the derivative of
a polynomial p.
The first two bullet points in the result below imply that the function that
takes T to T 0 is a linear map from L.V; W / to L.W 0 ; V 0 /.
In the third bullet point below, note the reversal of order from ST on the
left to T 0 S 0 on the right (here we assume that U is a vector space over F).
Proof The proofs of the first two bullet points above are left to the reader.
To prove the third bullet point, suppose ' 2 W 0. Then
.ST /0 .'/ D ' ı.S T / D .' ıS /ıT D T 0 .' ıS / D T 0 S 0 .'/ D .T 0 S 0 /.'/;
Some books use the notation V where the first, third, and fourth equal-
and T for duality instead of V 0 ities above hold because of the defini-
and T 0. However, here we reserve tion of the dual map, the second equality
the notation T for the adjoint, holds because composition of functions
which will be introduced when we is associative, and the last equality fol-
study linear maps on inner product lows from the definition of composition.
spaces in Chapter 7.
The equality of the first and last
terms above for all ' 2 W 0 means that
.S T /0 D T 0 S 0.
Solution Recall (see 3.97) that 'j is the linear functional on R5 that selects
that j th coordinate: 'j .x1 ; x2 ; x3 ; x4 ; x5 / D xj .
First suppose ' 2 span.'3 ; '4 ; '5 /. Then there exist c3 ; c4 ; c5 2 R such
that ' D c3 '3 C c4 '4 C c5 '5 . If .x1 ; x2 ; 0; 0; 0/ 2 U, then
Thus ' 2 U 0 . In other words, we have shown that span.'3 ; '4 ; '5 / U 0 .
To show the inclusion in the other direction, suppose ' 2 U 0 . Because
0
the dual basis is a basis of .R5 / , there exist c1 ; c2 ; c3 ; c4 ; c5 2 R such that
' D c1 '1 C c2 '2 C c3 '3 C c4 '4 C c5 '5 . Because e1 2 U and ' 2 U 0 , we
have
The next result shows that dim U 0 is the difference of dim V and dim U.
For example, this shows that if U is a 2-dimensional subspace of R5 , then U 0
0
is a 3-dimensional subspace of .R5 / , as in Example 3.104.
The next result can be proved following the pattern of Example 3.104:
choose a basis u1 ; : : : ; um of U, extend to a basis u1 ; : : : ; um ; : : : ; un of V,
let '1 ; : : : ; 'm ; : : : ; 'n be the dual basis of V 0, and then show 'mC1 ; : : : ; 'n
is a basis of U 0 , which implies the desired result.
You should construct the proof outlined in the paragraph above, even
though a slicker proof is presented here.
However, null i 0 D U 0 (as can be seen by thinking about the definitions) and
dim V 0 D dim V (by 3.95), so we can rewrite the equation above as
The proof of part (a) of the result below does not use the hypothesis that
V and W are finite-dimensional.
Proof
(b) We have
where the first equality comes from (a), the second equality comes from
3.106, and the third equality comes from the Fundamental Theorem of
Linear Maps (3.22).
The next result can be useful because sometimes it is easier to verify that
T0 is injective than to show directly that T is surjective.
Proof
(a) We have
where the first equality comes from the Fundamental Theorem of Linear
Maps (3.22), the second equality comes from 3.95 and 3.107(a), and
the third equality comes from 3.106.
(b) First suppose ' 2 range T 0. Thus there exists 2 W 0 such that
' D T 0 . /. If v 2 null T, then
'.v/ D T 0 . / v D . ı T /.v/ D .T v/ D .0/ D 0:
where the first equality comes from (a), the second equality comes from
the Fundamental Theorem of Linear Maps (3.22), and the third equality
comes from 3.106.
0 1
5 7
@ A 5 3 4
3.112 Example If A D 3 8 , then A D
t .
7 8 2
4 2
Note that here A is a 3-by-2 matrix and At is a 2-by-3 matrix.
.AC /t D C t At :
The setting for the next result is the assumption that we have a basis
v1 ; : : : ; vn of V, along with its dual basis '1 ; : : : ; 'n of V 0. We also have a
basis w1 ; : : : ; wm of W, along with its dual basis 1 ; : : : ; m of W 0. Thus
M.T / is computed with respect to the bases just mentioned of V and W,
and M.T 0 / is computed with respect to the dual bases just mentioned of W 0
and V 0.
X
n
T 0. j/ D Cr;j 'r :
rD1
The left side of the equation above equals j ı T. Thus applying both sides
of the equation above to vk gives
X
n
. j ı T /.vk / D Cr;j 'r .vk /
rD1
D Ck;j :
We also have
. j ı T /.vk / D j .T vk /
Xm
D j Ar;k wr
rD1
X
m
D Ar;k j .wr /
rD1
D Aj;k :
Comparing the last line of the last two sets of equations, we have Ck;j D Aj;k .
t
Thus C D At . In other words, M.T 0 / D M.T / , as desired.
SECTION 3.F Duality 111
4 7 1 8
3.116 Example Suppose A D . Find the row rank of A
3 5 2 9
and the column rank of A.
in F1;4 . Neither of the two vectors listed above in F1;4 is a scalar multiple
of the other. Thus the span of this list of length 2 has dimension 2. In other
words, the row rank of A is 2.
The column rank of A is the dimension of
!
4 7 1 8
span ; ; ;
3 5 2 9
in F2;1 . Neither of the first two vectors listed above in F2;1 is a scalar multiple
of the other. Thus the span of this list of length 4 has dimension at least 2.
The span of this list of vectors in F2;1 cannot have dimension larger than 2
because dim F2;1 D 2. Thus the span of this list has dimension 2. In other
words, the column rank of A is 2.
Notice that no bases are in sight in the statement of the next result. Al-
though M.T / in the next result depends on a choice of bases of V and W,
the next result shows that the column rank of M.T / is the same for all such
choices (because range T does not depend on a choice of basis).
112 CHAPTER 3 Linear Maps
In Example 3.116, the row rank and column rank turned out to equal each
other. The next result shows that this always happens.
The last result allows us to dispense with the terms “row rank” and “column
rank” and just use the simpler term “rank”.
EXERCISES 3.F
1 Explain why every linear functional is either surjective or the zero map.
7 Suppose m is a positive integer. Show that the dual basis of the basis
.j /
1; x; : : : ; x m of Pm .R/ is '0 ; '1 ; : : : ; 'm , where 'j .p/ D p j Š.0/ . Here
p .j / denotes the j th derivative of p, with the understanding that the 0th
derivative of p is p.
12 Show that the dual map of the identity map on V is the identity map
on V 0.
16 Suppose V and W are finite-dimensional. Prove that the map that takes
T 2 L.V; W / to T 0 2 L.W 0 ; V 0 / is an isomorphism of L.V; W / onto
L.W 0 ; V 0 /.
24 Prove 3.106 using the ideas sketched in the discussion before the state-
ment of 3.106.
(a) T is invertible.
(b) The columns of M.T / are linearly independent in Fn;1 .
(c) The columns of M.T / span Fn;1 .
(d) The rows of M.T / are linearly independent in F1;n .
(e) The rows of M.T / span F1;n .
Here M.T / means M T; .u1 ; : : : ; un /; .v1 ; : : : ; un / .
116 CHAPTER 3 Linear Maps
33 Suppose m and n are positive integers. Prove that the function that takes
A to At is a linear map from Fm;n to Fn;m . Furthermore, prove that this
linear map is invertible.
34 The double dual space of V, denoted V 00, is defined to be the dual space
of V 0. In other words, V 00 D .V 0 /0. Define ƒ W V ! V 00 by
.ƒv/.'/ D '.v/
for v 2 V and ' 2 V 0.
(a) Show that ƒ is a linear map from V to V 00.
(b) Show that if T 2 L.V /, then T 00 ı ƒ D ƒ ı T, where T 00 D .T 0 /0.
(c) Show that if V is finite-dimensional, then ƒ is an isomorphism
from V onto V 00.
[Suppose V is finite-dimensional. Then V and V 0 are isomorphic, but
finding an isomorphism from V onto V 0 generally requires choosing a
basis of V. In contrast, the isomorphism ƒ from V onto V 00 does not
require a choice of basis and thus is considered more natural.]
0
35 Show that P.R/ and R1 are isomorphic.
36 Suppose U is a subspace of V. Let i W U ! V be the inclusion map
defined by i.u/ D u. Thus i 0 2 L.V 0 ; U 0 /.
(a) Show that null i 0 D U 0 .
(b) Prove that if V is finite-dimensional, then range i 0 D U 0.
(c) Prove that if V is finite-dimensional, then ei 0 is an isomorphism
0 0
from V =U onto U . 0