Hilbert Spaces
Hilbert Spaces
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Hilbert spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Orthogonal projections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Introduction
Hilbert spaces are the closest generalization to infinite dimensional spaces of the Euclidean
spaces.
First, we consider a normed space and we see that if the space is finite dimensional all the norms
defined on it generate the same topology, so that the convergence of sequences does not depend
on the norm that is used. Later we consider linear transformations defined in a normed space
and we see that all of them are continuous if the space is finite dimensional. Continuous linear
transformations are called bounded operators and, by introducing a norm in the space of all
bounded operators, we convert it into a Banach space under certain conditions. Once we have
clear the concepts of convergence of a sequence and completeness of the space, we define Hilbert
spaces and consider some of their properties. Mainly we focus on the Pythagorean theorem, the
Cauchy-Schwarz inequality, the Parallelogram Identity and in the introduction of the concept
of basis for a Hilbert space.
Hilbert spaces
Inner product
For simplicity from now on we only consider vector spaces over C. Let V be a vector space,
an inner product is a function h, i : V × V → C, such that for u, v, w ∈ V and λ ∈ C,
(i) hu, vi = hv, ui
(ii) hλu, vi = λhu, vi ;
(iii) hu + v, wi = hu, wi + hv, wi ;
(iv) hu, ui ≥ 0 and hu, ui = 0 if and only if u = 0.
Cauchy-Schwarz inequality
One of the most important inequalities in an inner product space is the Cauchy-Schwarz
inequality. It states the following,
for any u, v in an inner product space
Hilbert space
A Hilbert space is a vector space with inner product such that it is a Banach space with
the norm induced by the inner product.
The simplest example of a Hilbert space is Cn with the inner product :
n
X
hx, yi = xi yi ,
i=1
where x = (x1 , . . . , xn ) and y = (y1 , . . . , yn ). The metric induced by this inner product is the
usual Euclidean metric in Cn .
The space `2 is an infinite dimensional vector space that is a Hilbert space with the product :
X
ha, bi = an bn , where a = (a1 , a2 , . . .) , b = (b1 , b2 , . . .)
n
The latter equation is called the Parallelogram Identity and is an important tool to determine
if a Banach space is a Hilbert space or not.
Orthogonal projections
Let H be a Hilbert space and M ⊂ H. For a point x ∈ H the distance from x to M is
defined by
d(x, M ) = inf{d(x, m) | m ∈ M }.
Theorem : Let H be a Hilbert space and M a closed subspace of H. Let x ∈ H\M , then there
exists a unique point z ∈ M such that
kx − zk = inf{d(h, m) | m ∈ M } = d(x, M ) := d.
lim kx − ym k = d.
n→∞
2
This fact implies that
2
yn + ym
kyn − ym k2 = 2 kyn − xk2 + 2 kym − xk2 − 4 −x .
2
Then,
Since (x − wn ) converges, it is a Cauchy sequence which implies that (wn ) is a Cauchy sequence,
then z = z1 .