section3.2
section3.2
In this sense, the closed real hyperplane ‘separates’ the disjoint convex subsets
E1 and E2 of X, of which E1 is open.
0, then by Proposition 3.7 (i), there is x" ∈ X " such that x" (x1 − x2 ) (= 0, that
is, x" (x1 ) (= x" (x2 ). Thus x1 = x2 if and only if x" (x1 ) = x" (x2 ) for all x" ∈ X " .
This interchangeability between x ∈ X and x" ∈ X " explains the nomenclature
‘dual space’ of X " .
The operator norm on X " is given by
Proof. Let x ∈ X. By the basic inequality (Theorem 2.10 (i)), |x" (x)| ≤
+x" + +x+ for all x" ∈ X " . Also, by a consequence of the Hahn-Banach ex-
tension theorem (Proposition 3.7 (i)), there is x" ∈ X " such that x" (x) = +x+
and +x" + ≤ 1. Hence desired the expression for +x+ follows.
Next, let F ∈ BL(X, Y ). Then for x ∈ X, it follows that +F (x)+ =
sup{|y " (F (x))| : y " ∈ Y " and +y " + ≤ 1}. Hence
as desired. #
$
We shall find the dual spaces of some important normed spaces, and also indi-
cate how the dual spaces of some others can be found. This task is important
because if we know the dual space of a normed space, we can rephrase ques-
tions about the given space in a way that can throw light from a different
angle, and possibly lead us to answers. For example, in Remark 3.8 (i), we
have seen that a criterion for the approximation of an element of a normed
space by elements belonging to a fixed subspace of that normed space can be
given in terms of the elements of the dual space that vanish on that subspace.
The ‘duality’ between X and X " does not mean that results about X and
X are always symmetric in nature. For instance, since K is a (one dimensional)
"
130 3 Dual Spaces, Transposes and Adjoints
Banach space, Theorem 2.10 (iii) shows that X " = BL(X, K) is a Banach
space, even if X is not a Banach space. Actually, the consideration of the dual
space of a dual space gives us a neat way of constructing a completion of a
normed space, and of an inner product space, as we now show.
Let X be a normed space, and let x ∈ X. Define jx : X " → K by
jx (x" ) := x" (x) for x" ∈ X " .
Clearly, jx is linear, and +jx + := sup{|jx (x" )| : x" ∈ X " and +x" + ≤ 1} = +x+
by Proposition 3.7 (i). Hence jx belongs to the dual space (X " )" of X " . We shall
denote the second dual space (X " )" of the normed space X by X "" . Define
J : X → X "" by J(x) := jx for x ∈ X. Then J is linear and +J(x)+ = +x+
for all x ∈ X, that is, J is a linear isometry from X into X "" . It is called the
canonical embedding of X into X "" . If J(X) = X "" , then we say that the
normed space X is reflexive. We shall show that a Hilbert space is reflexive.
Let Xc denote the closure of J(X) in X "" . (If X is a Banach space, then
J(X) is a closed subspace of X "" , and so Xc = J(X).) Since X "" := BL(X " , K)
is a Banach space, and since Xc is closed in X "" , we see that Xc is a Banach
space, and J : X → Xc is a linear isometry such that J(X) is dense in Xc .
The Banach space Xc is called the completion of the normed space X. It is
unique in the following sense. If X1 is a Banach space, and J1 : X → X1 is a
linear isometry such that J1 (X) is dense in X1 , then there is a linear isometry
Φ from Xc onto X1 . This can be seen as follows.
J ! ! Xc
X! J(X)
!! ""
!! "
!! Φ0 ""
J1 !!" # $""" Φ
X1
Define Φ0 : J(X) → X1 by
Φ0 (J(x)) := J1 (x) for x ∈ X.
Then Φ0 ∈ BL(J(X), X1 ), where J(X) is dense in Xc , and X1 is a Banach
space. By Theorem 2.10 (iv), there is Φ ∈ BL(Xc , X1 ) such that Φ(J(x)) =
Φ0 (J(x)) for all x ∈ X. Since +Φ0 (J(x))+ = +J1 (x)+ = +x+ = +J(x)+ for all
x ∈ X, it follows that Φ is also a linear isometry. Also, since Φ(Xc ) is both
closed as well as dense in X1 , we obtain Φ(Xc ) = X1 .
In case (X, -·, ·.) is an inner product space, we introduce an inner product
on the completion Xc of X as follows. For x"" and y "" in Xc , let J(xn ) → x""
and J(yn ) → y "" in X "" , and let -x"" , y "" .c := limn→∞ -xn , yn .. It is easy to
see that -· , ·.c an inner product on Xc , and -J(x), J(y).c = -x, y. for all
x, y ∈ X. Thus the completion of an inner product space is a Hilbert space.
For example, let p ∈ {1, 2}, and let X := C([a, b]) with the norm given by
"# b $1/p
p
+x+p := |x(t)| dt for x ∈ X.
a
3.2 Dual Spaces and Riesz Representation 131
Since X is dense in Lp ([a, b]) by Proposition 0.25, and since Lp ([a, b]) is com-
plete by Proposition 1.23 (iv), Lp ([a, b]) can be identified with the completion
of X. Thus if p := 1, the completion of the normed space X is the Banach
space L1 ([a, b]), and if p := 2, the completion of the inner product space X is
the Hilbert space L2 ([a, b]).
By considering the completion of a normed space (or of an inner product
space), we can extend to incomplete normed spaces (or to incomplete inner
product spaces), results that are initially proved only for Banach spaces (or
only for Hilbert spaces). See Exercises 16 and 17 of this chapter.
The canonical embedding J : X → X "" introduced earlier is useful in a
variety of ways. We give an instance below.
Proof. (i) Suppose E is a bounded subset of X. Then there is α > 0 such that
!
+x+ ≤ α for all x ∈ E. If x" ∈ X , then |x" (x)| ≤ +x" + +x+ ≤ +x" + α for all
x ∈ E, and so x" (E) is a bounded subset of K.
Conversely, suppose x" (E) is a bounded subset of K for every x" in X " . Let
J : X → X "" be the canonical embedding of X into X "" . Then {J(x) : x ∈ E}
is a subset of X "" := BL(X " , K). Now X " is a Banach space, and for each
fixed x" ∈ X " , the set {J(x)(x" ) : x ∈ E} = x" (E) is bounded. By the uniform
boundedness principle (Theorem 2.20), J(E) is a bounded subset of X "" . Since
+J(x)+ = +x+ for each x ∈ X, it follows that E is a bounded subset of X.
(ii) Let the linear map F : X → Y be continuous. Since every y " ∈ Y " is
continuous, we see that y " ◦F is continuous. Conversely, let y " ◦F be continuous
for every y " ∈ Y " . Let E := {F (x) : x ∈ X and +x+ ≤ 1} ⊂ Y . Then y " (E) is
bounded for every y " ∈ Y " by Proposition 2.2. By (i) above, E is a bounded
subset of Y . Thus the linear map F is continuous by Proposition 2.2. #
$
The resonance theorem proved above says that for a subset E of a normed
space X, the boundedness of E in X is the same thing as the boundedness of
x" (E) for every x" ∈ X " . However, for a sequence (xn ) in X, the convergence
of (x" (xn )) for every x" ∈ X " may not imply the convergence of (xn ) in X.
For example, if X := #2 , then we conclude from Example 3.19 (i) that (x" (en ))
" "
√ x ∈ X . But obviously (en ) does not converge in X,
converges to 0 for every
since +en − em +2 = 2 for all n (= m ∈ N. (See Exercise 19 of this chapter.)
Before computing dual spaces of some well-known normed spaces, we prove
two additional facts about X and X " .
(i) Let X0 be a dense subspace of X. For x" ∈ X " , let F (x" ) denote the restric-
tion of x" to X0 . Then the map F is a linear isometry from X " onto X0" .
(ii) If X " is separable, then so is X.
Proof. (i) Let x" ∈ X " . It is clear that F (x" ) ∈ X0" and +F (x" )+ ≤ +x" +. In
fact, if x ∈ X and xn → x, where xn ∈ X0 for all n ∈ N, then
% %
|x" (x)| = % lim x" (xn )% ≤ +F (x" )+ lim +xn + = +F (x" )+ +x+,
n→∞ n→∞
so that +F (x" )+ = +x" +. Also, the map F : X " → X0" is linear. By Theorem
2.10 (iv), every x"0 ∈ X0" has a unique norm-preserving extension x" to X.
Hence the map F is onto.
(ii) Let X " be separable. Suppose X (= {0}. As we have mentioned in
Section 0.3, a nonempty subset of a separable metric space is separable. Let
then {x"1 , x"2 , . . .} be a countable dense subset of {x" ∈ X " : +x" + = 1}. Since
+x"j + = 1, there is xj ∈ X such that +xj + = 1 and |x"j (xj )| > 1/2 for each
j ∈ N. Let D := {k1 x1 + · · · + kn xn : n ∈ N and Re kj , Im kj ∈ Q for j =
1, . . . , n}. Then D is a countable subset of X, and clearly it is dense in the
subspace Y := span {x1 , x2 , . . .} of X. To show that Y is dense in X, we
consider x" ∈ X " such that x" (y) = 0 for all y ∈ Y . Assume for a moment that
x" (= 0, and let y " := x" /+x" +. Then +y " + = 1. Hence there is j ∈ N such that
+x"j − y " + < 1/2, and so |x"j (xj ) − y " (xj )| < 1/2. Then
& ' 1 1
|y " (xj )| = |x"j (xj )− x"j (xj )−y " (xj ) | ≥ |x"j (xj )|−|(x"j (xj )−y " (xj )| > − = 0.
2 2
Now xj ∈ Y and x" (xj ) = +x" +y " (xj ) (= 0 in contradiction to our assumption
that x" (y) = 0 for all y ∈ Y . This shows that if x" ∈ X " and x" (y) = 0 for all
y ∈ Y , then x" = 0. By Proposition 3.7 (ii), Y = X, that is, Y is dense in X.
Thus D is a countable dense subset of X, and so X is separable. #
$
The converse of part (ii) of the above proposition does not hold, as we shall
see in Example 3.19 (ii).
Now we shall calculate the dual of a Hilbert space by using the projection
theorem (Theorem 1.34).
Theorem 3.15. (Riesz representation theorem, 1907) Let H be a Hilbert
!
space, and let f ∈ H . Then there is a unique yf ∈ H, called the representer
of f , such that f (x) = -x, yf . for all x ∈ H. Further, the map T : H " → H
defined by T (f ) := yf , f ∈ H " , is a conjugate-linear isometry from H " onto H.
f (x)
w := x − z.
f (z)
Clearly, w ∈ Z(f ), and so -w, z. = 0, that is, -x, z. = f (x)-z, z./f (z). Then
f (z)
f (x) = -x, z. = -x, yf . for all x ∈ X,
-z, z.
since |-x, yf .| ≤ +x+ +yf + for all x ∈ X by the Schwarz inequality (Proposition
1.12), and -yf , yf . = +yf +2 . Thus +T (f ) = +f +. Finally, given y ∈ H, define
fy (x) := -x, y. for x ∈ X. Then fy ∈ H " , and y is the representer of fy , that
is, T (fy ) = y. Thus T is a conjugate-linear isometry from H " onto H. #
$
Remark 3.16. The Riesz representation theorem does not hold for an in-
complete inner product space. For example, let X := c00 with the usual inner
product. Define f : X → K by
∞
( x(j)
f (x) := , x ∈ X.
j=1
j
and
-kf , g." = -yg , ykf . = -yg , kyf . = k-f, g." .
Also, -f, g." = -yg , yf . = -yf , yg . = -g, f ." . Further, -f, f ." = -yf , yf . ≥ 0,
and -f, f ." = -yf , yf . = 0 if and only if yf = 0, that is, f = 0. Thus -· , ·."
is an inner product on H " . Since H is complete, and the map f 3−→ yf is
an isometry from H " onto H, we see that H " is also complete. Thus H " is a
Hilbert space.
(ii) Consider the canonical embedding J : H → H "" . Let φ ∈ H "" = (H " )" .
By (i) above, H " is a Hilbert space, and by the Riesz representation theorem
(Theorem 3.15), there is a representer g ∈ H " of φ, that is,
φ(f ) = -f, g." = -yg , yf . = f (yg ) = J(yg )(f ) for all f ∈ H " .
Thus φ = J(yg ). This shows that the map J is onto, that is, H is a reflexive
normed space. #
$
Proof. By Theorem 2.10 (iv), we can assume, without loss of generality, that G
is a closed subspace of H. Then G is a Hilbert space, and there is a representer
yg ∈ G of g ∈ G" by the Riesz representation theorem (Theorem 3.15). Define
f : H → K by f (x) := -x, yg . for x ∈ H. Then f is linear, f (y) = -y, yg . =
g(y) for all y ∈ G, and +f + = +yg + = +g+. Hence f is an Hahn-Banach
extension of g.
To prove the uniqueness of the Hahn-Banach extension of g, let f˜ ∈ H "
be such that f˜(y) = g(y) for all y ∈ G, and +f˜+ = +g+. Let ỹ ∈ H denote
the representer of f˜. Then +ỹ+ = +f˜+ = +g+ = +yg + and -yg , ỹ. = f˜(yg ) =
g(yg ) = -yg , yg .. Now
+yg − ỹ+2 = +yg +2 − 2Re -yg , ỹ. + +ỹ+2 = 2+yg +2 − 2Re -yg , yg . = 0,
a linear functional on #1 . Hence fy ∈ (#1 )" and +fy + ≤ +y+∞ . In fact, since
+fy + ≥ |fy (ej )| = |y(j)| for all j ∈ N, we obtain +fy + = +y+∞ . The map
Φ(y) := fy , y ∈ #∞ , gives a linear isometry from #∞ to (#1 )" . Now let f ∈ (#1 )" ,
and define y := (f (e1 ), f (e2 ), . . .). Since |f (ej )| ≤ +f + for all j ∈ N, we see
that y ∈ #∞ , and f = fy . Therefore Φ is a linear isometry from #∞ onto (#1 )" .
Next, let L1 denote L1 ([a, b]), and L∞ denote L∞ ([a, b]). To find (L1 )" , let
*b
us consider y ∈ L∞ , and define fy (x) := a x(t)y(t)dm(t) for x ∈ L1 . Then
*b
the Lebesgue integral a x(t)y(t)dm(t) exists, and |fy (x)| ≤ +x+1 +y+∞ for all
x ∈ L1 . Also, fy is clearly a linear functional on L1 . Hence fy ∈ (L1 )" and
+fy + ≤ +y+∞ . To show +y+∞ ≤ +fy +, that is, |y(t)| ≤ +fy + for almost all
t ∈ [a, b], we let En := {t ∈ [a, b] : |y(t)| > +f !y∞+ + (1/n)} for n ∈ N, and
E
)∞ := {t ∈ [a, b] : |y(t)| > +f y +}. Since E = n=1 En , we obtain m(E) ≤
n=1 m(E n ). It is enough to prove that m(E n = 0 for each n ∈ N. For
)
n ∈ N, let cEn denote the characteristic function of En , and xn := (sgn y)cEn .
Then xn y = |y|cEn , |xn | = cEn and +xn +1 = m(En ). Hence
" $ # # b
1
+fy + + m(En ) ≤ |y|dm = xn y dm = fy (xn ) ≤ +fy + m(En ),
n En a
and so m(En ) = 0 for each n ∈ N, as desired. This shows that +fy + = +y+∞ .
The map Φ(y) := fy , y ∈ L∞ , gives a linear isometry from L∞ to (L1 )" . Now
let f ∈ (L1 )" . For t ∈ (a, b], let ct denote the characteristic function of the
subinterval (a, t] of [a, b], so that ct ∈ L1 . Define z : [a, b] → K by z(a) := 0,
and z(t) := f (ct ) for t ∈ (a, b]. It can be shown that the function z is absolutely
136 3 Dual Spaces, Transposes and Adjoints
tion, that is, functions of bounded variation which vanish at a, and which
are right continuous on (a, b). Then +fy + = +y+BV for y ∈ N BV ([a, b]). The
map Φ(y) := fy , y ∈ N BV ([a, b]), gives a linear isometry from N BV ([a, b]) to
(C([a, b]))" . Further, if f ∈ (C([a, b]))" , then there is a unique y ∈ N BV ([a, b])
such that f = fy . Therefore Φ is a linear isometry from N BV ([a, b]) onto
(C([a, b]))" . We refer the reader to [14, Theorem 6.4.4] for details. !
The results in Examples 3.19 (ii) and (iv) are also known as Riesz rep-
resentation theorems for #1 , L1 ([a, b]) and C([a, b]).
the m×n matrix M whose entry in the jth column and the ith row is yi" (F (xj ))
defines the linear map F : X → Y with respect to the basis x1 , . . . , xn for X
and the basis y1 , . . . , ym for Y , as we have seen in Section 0.2. Now since
F " (yi" ) = F " (yi" )(x1 )x"1 + · · · + F " (yi" )(xn )x"n for each i = 1, . . . , m,
we see that the n×m matrix M " whose entry in the ith column and the jth
row is F " (yi" )(xj ) defines the linear map F " : Y " → X " with respect to the basis
y1" , . . . , ym
"
for Y " and the basis x"1 , . . . , x"n for X " . Since F " (yi" )(xj ) = yi" (F (xj ))
for all i = 1, . . . , m, j = 1, . . . , n, we see that M " = M t , the transpose of the
matrix M . Thus if a matrix M defines a linear map F from X to Y , then the
transpose M t of M defines the linear map F " from Y " to X " . Hence the linear
map F " is called the transpose of the linear map F .
Examples 3.20. (i) Let p, r ∈ {1, 2}, and let F ) ∈ BL(#p , #r ). Define ki,j :=
∞
F (ej )(i) for i, j ∈ N. Consider x ∈ # . Since x = j=1 x(j)ej , the continuity
p
)∞
and the linearity of F shows that F (x) = j=1 x(j)F (ej ). Hence the series
)∞
j=1 ki,j x(j) converges in K to y(i) := F (x)(i) for every i ∈ N. Also, y :=
(y(1), y(2), . . .) = F (x) ∈ #r . Thus the infinite matrix M := [ki,j ] defines F .
(This is not the case if p = ∞ and r ∈ {1, 2, ∞}. See Exercise 21 (i) of this
chapter. On the other hand, if p = 1 and r ∈ {1, 2}, then we need not assume
that F is continuous. See Proposition 2.23 and Exercise 29 (iii) of Chapter 2.)