REAL ANALYSIS

Problems
 CLAUDIA TIMOFTE

REAL ANALYSIS

Problems
To my students
 Preface

The present book is a collection of problems in differential calculus. The book

is based on some lectures I delivered for a number of years at the Faculty of Physics
of the University of Bucharest and covers the curriculum on differential calculus for
the students of the first year of this faculty.
The material follows the textbook [34]. Each chapter contains a brief review of
the corresponding theoretical results, worked out examples and proposed problems.
Since the ”learning-by-doing” method is a successful one, the student is encouraged
to solve as many exercises as possible. The basic prerequisites for studying dif-
ferential calculus using this book are undergraduate courses in linear algebra and
one-variable calculus.
The second volume will cover important topics, such as Fourier series and integral
calculus. The reader interested in acquiring a more profound knowledge of differen-
tial calculus is referred to some very good textbooks and monographs recommended
at the end of these notes.
It is my hope that this book will serve as an useful outlook for the students of
the first year of the Faculty of Physics of the University of Bucharest.
I would like to thank to my students for their continuous questions, comments
and suggestions, which helped me to improve the content of these notes.

Claudia Timofte

7
Contents

1 Real Numbers 11
1.1 Elements of Topology of the Real Line. Elementary Inequalities . . . 11
1.2 Number Sequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

2 Multidimensional Spaces 29
2.1 Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.2 Elements of Topology . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.3 Sequences in Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . 39
2.4 Inner Product Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
2.5 Normed Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

3 Series of Real and Complex Numbers 55

4 Limits and Continuity 69

4.1 Limits of Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
4.2 Continuous Functions . . . . . . . . . . . . . . . . . . . . . . . . . . 76

5 Multivariable Differential Calculus 89

5.1 Derivable Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
5.2 Differential Operators . . . . . . . . . . . . . . . . . . . . . . . . . . 111
5.3 Taylor’s Formula . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
5.4 Implicit Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
5.5 Local Extrema . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131

9
10 CONTENTS

6 Sequences and Series of Functions 145

6.1 Sequences of Functions . . . . . . . . . . . . . . . . . . . . . . . . . . 145
6.2 Series of Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
6.3 Power Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
6.4 Taylor Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156

Bibliography . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
Chapter 1

Real Numbers

1.1 Elements of Topology of the Real Line. Elementary

Inequalities
We shall begin with a quick review of some results and ideas from one-variable
calculus. More precisely, we shall recall some results concerning the topolology of
the real line and some useful elementary inequalities. To fix the notation, let us
recall some important sets we often encounter in mathematics; to identify them,
they have acquired special names and notational conventions.
One of these is the empty or the void set ∅, which is the unique set containing
no elements. Special sets of numbers include:
a) the set of natural numbers, N = {0, 1, 2, . . . , n, . . .};

b) the set of natural numbers, without zero, N∗ = {1, 2, . . . , n, . . .};

c) the set of integer numbers, Z = {0, ± 1, ± 2, . . . , ±n, . . .};

{ }
m
d) the set of rational numbers, Q = | m, n ∈ Z, n ̸= 0 ;
n
e) the set of the real numbers R, also called the number line, the number axis,
the real line or the the real axis, having in mind its geometrical representation
(for more details, see [34]).
In what follows, we shall consider (R, +, ·, ≤) as being a completely ordered commu-
tative field.

11
12 REAL ANALYSIS

Definition 1.1 For any real number a, the absolute value or the modulus of a is
defined as follows:
{
a, if a ≥ 0,
|a| =
−a, if a < 0.

As can be seen from the above definition, the absolute value of a is always positive.

Definition 1.2 Let a, b ∈ R, with a < b.

a) The set [a, b] = {x ∈ R | a ≤ x ≤ b} is called the closed interval with end
points a and b.
b) The set (a, b) = {x ∈ R | a < x < b} is said to be the open interval with end
points a and b.
c) The set [a, b) = {x ∈ R | a ≤ x < b} is called the half-open (semi-open,
half-closed) interval with end points a and b.

All the above sets are bounded intervals. We can also consider the following
unbounded intervals: (a, ∞) = {x ∈ R | x > a}; [a, ∞) = {x ∈ R | x ≥ a};
(−∞, b) = {x ∈ R | x < b}; (−∞, b] = {x ∈ R | x ≤ b}; (−∞, ∞) = R.
Let us mention that if we take a, b ∈ R, with a = b, we obtain degenerate
intervals. For instance, (a, a) = ∅ (the empty set) and [a, a] = {a} (a singleton).

Definition 1.3 Let a ∈ R, r ∈ R, r > 0. The set B(a, r) = (a − r, a + r) is called

the open interval centered at the point a and having the radius r.

Definition 1.4 Let a ∈ R, r ∈ R, r ≥ 0. The set B(a, r) = [a − r, a + r] is called

the closed interval centered at the point a and having the radius r.

Remark 1.5 If in the above definition we take r = 0, then B(a, 0) = {a}.

Definition 1.6 A set A ⊆ R is said to be an open set if for any x ∈ A there exists
r > 0 such that B(x, r) ⊆ A.

Remark 1.7 The empty set is considered to be an open set.

Proposition 1.8 Any centered open interval is an open set.

REAL NUMBERS 13

Definition 1.9 A set B ⊆ R is called a closed set if R \ B is an open set.

Remark 1.10 R and ∅ are simultaneously open and closed sets.

Definition 1.11 (The Extended Real Number Line R) Let −∞ and ∞ be two dif-
ferent elements which are not real numbers. They are called points at infinity or
improper numbers. Let R = R ∪ {−∞} ∪ {∞}. We extend to R the usual order
relation defined on R by putting −∞ < x < ∞, for any x ∈ R, and −∞ < ∞. The
set R, endowed with the above order relationship, is called the extended real line.

Remark 1.12 Any nonempty subset of R possesses in R a supremum and an infi-

mum.

Definition 1.13 For some pairs of elements from R, we extend the usual operations
of addition and multiplication in R as follows:

1) a + ∞ = ∞ + a = ∞, ∀a ∈ R, a ̸= −∞;

2) a + (−∞) = (−∞) + a = −∞, ∀a ∈ R, a ̸= ∞;

3) a · ∞ = ∞ · a = ∞, ∀a > 0;

4) a · (−∞) = (−∞) · a = −∞, ∀a > 0;

5) b · ∞ = ∞ · b = −∞, ∀b < 0,

6) b · (−∞) = (−∞) · b = ∞, ∀b < 0;

a a
7) = = 0, ∀a ∈ R.
∞ −∞
Remark 1.14 We do not define:
±∞
∞ + (−∞), (−∞) + ∞, 0 · (±∞), (±∞) · 0, .
±∞
The elements of R are called finite real numbers. Therefore, if a ∈ R, then

−∞ < a < ∞.

The element −∞ is called minus infinity or negative infinity, while the element ∞
is called plus infinity or positive infinity.
14 REAL ANALYSIS

The extended real number system is also called the closed real line and it is
denoted by R = [−∞, +∞]. Intervals in R are sets I ⊆ R of the form (a, b), [a, b], (a, b]
or [a, b), where a, b ∈ R and a < b. So, R = [−∞, +∞].
If a < b, a, b ∈ R, then

(a, b), (a, ∞), (a, ∞], (−∞, a), [−∞, a), R, R,

are open intervals in R.

If a, b ∈ R, with a ≤ b, then [a, b] is a closed interval in R.

Remark 1.15 The set (R, ≤) is a totally ordered set.

Exercise 1.16 Show that the absolute value has the following properties:
√
1) |a| = a2 ;
2) |a| = 0 if and only if a = 0;
3) |a + b| ≤ |a| + |b|;
4) | − a| = |a|;
5) ||a| − |b|| ≤ |a − b|, for any a, b ∈ R.

∩
k
Exercise 1.17 Let A1 , A2 , . . . , Ak ∈ R be open sets. Prove that Ai is an open
i=1
set.

Exercise 1.18 Let {Ai }i∈I be an arbitrary family of open sets in R. Prove that
∪
Ai is also an open set.
i∈I

Exercise 1.19 Prove that any open interval (a, b) is an open set.

Exercise 1.20 Show that any closed interval [a, b] is a closed set.

∪
k
Exercise 1.21 Let B1 , B2 , . . . , Bk ⊆ R be closed sets. Prove that Bi is also a
i=1
closed set.

Exercise 1.22 Let {Bi }i∈I be an arbitrary family of closed sets in R. Prove that
∩
Bi is also a closed set.
i∈I
REAL NUMBERS 15

Hint: use the fact that

∪
k ∩
k
R\ Bi = (R \ Bi )
i=1 i=1
and
∩ ∪
R\ Bi = (R \ Bi ).
i∈I i∈I

Exercise 1.23 If a1 , a2 , . . . , ak ∈ R∗+ and a1 · a2 · · · ak = 1, show that a1 + a2 + · · · +

ak ≥ k.

Hint. Use Use mathematical induction..

Exercise 1.24 Let

x1 + x2 + · · · + xk √
Ak = , Gk = k
x1 · x2 · · · xk ,
k
and
k
Hk = 1
x1 + 1
x2 + ··· + 1
xk
be the arithmetic, geometric and the harmonic mean of the positive real numbers
x1 , x2 , . . . , xk . Prove that Ak ≥ Gk ≥ Hk .

Exercise 1.25 Prove that for any nonnegative real numbers x1 , x2 , . . . , xk , we have
x1 + x2 + · · · + xk √
≥ k x1 · x2 · · · xk
k
and the equality holds true if and only if x1 = x2 = · · · = xk . In other words, the
arithmetic mean is greater than or equal to the geometric mean and they are equal
if and only if all the numbers xi are equal.

Hint. Use mathematical induction.

Exercise 1.26 Let x1 , x2 , . . . , xk be positive numbers. Show that

x1 + x2 + · · · + xk
max{x1 , x2 , . . . , xk } ≥ ≥
k
√ k
k
x1 x2 · · · xk ≥ ≥ min{x1 , x2 , . . . , xk }
1
x1 + 1
x2 + ··· + 1
xk

The equality is obtained if and only if x1 = x2 = · · · = xk .

16 REAL ANALYSIS

The above inequalities can be generalized to power means and weighted power
means.

Exercise 1.27 (Bernoulli’s Inequality) Prove that for any a, b ∈ R, with a ≥ −1

and b ≥ 1, we have
(1 + a)b ≥ 1 + a b.

Hint. Use the fact that the function f : [−1, ∞) → R, defined by f (x) = (1 + x)b −
bx − 1, is monotone and attains a minimum equal to zero at the point x = 0.

Exercise 1.28 Prove that for any a ∈ R, with a ≥ −1 and any n ∈ N∗ , we have

(1 + a)k ≥ 1 + k a.

Hint. Take b = k in Bernoulli’s inequality.

Exercise 1.29 Prove that for any a1 , a2 , . . . , ak ∈ R, with ai ≥ −1 for any i and
having all the same sign, we have

(1 + a1 ) (1 + a2 ) · · · (1 + ak ) ≥ 1 + a1 + a2 + · · · + ak .

Hint. Use mathematical induction.

Exercise 1.30 Prove that for any a1 , a2 , . . . , ak ∈ R∗+ , with k ≥ 2, we have

a1 a2 ak−1 ak
+ + ··· + + ≥ k.
a2 a3 ak a1
Hint. Use Exercise 1.25.

Exercise 1.31 Prove that for any a1 , a2 , . . . , ak ∈ R∗+ , with ai > 0 and such that
a1 · a2 · · · ak = 1, we have

(1 + a1 ) (1 + a2 ) · · · (1 + ak ) ≥ 2k .

Solution. Using the inequality

1 + ai √
≥ ai ,
2
we obtain immediately the result.
REAL NUMBERS 17

Exercise 1.32 Prove that for any x > 0 and any k ∈ N, we have

xk 1
≤ .
1 + x + + · · · + x2k
x2 2k + 1

Solution. Using the inequality Ak ≥ Gk , we get

√
2k+1 1 + x + x2 + · · · + x2k
xk = 1 · x · x2k ≤ .
2k + 1

Exercise 1.33 Let ak be an arithmetic progression containing positive terms. Show

that
√ √ √ a1 + ak
a1 ak ≤ k ≤ k a1 · a2 · · · ak ≤ .
2

Solution. The first inequality can be immediately proven by induction. The second
one is an easy consequence of the geometric-arithmetic mean inequality.

Exercise 1.34 Show that

√ √ k+1
k≤ k! ≤ ∀k ∈ N∗ .
k
,
2

Solution. Use Exercise 1.33.

Exercise 1.35 Let a, b, c > 0. Show that

bc ac ab
+ + ≥a+b+c
a b c

and
1 1 1 1 1 1
+ + ≥√ +√ +√ .
a b c bc ca ab

Solution. Since a2 + b2 + c2 ≥ ab + bc + ca, it follows that b2 c2 + a2 c2 + a2 b2 ≥

a b c (a + b + c), which leads to the first desired result. The second inequality can
be proven in a similar way.
18 REAL ANALYSIS

1.2 Number Sequences

We start this section with by a brief summary of the main concepts and results
about number sequence. This summary is not intended to be a substitute for the
textbook [34] that the student is advised to read carefully.

Definition 1.36 A map f : N → R is called a sequence of real numbers. Denoting

ak = f (k), a sequence may be symbolized by (ak )k∈N or, simply, by (ak )k . For
shortness, the notation (ak ) ⊆ R is also used. The element ak is called the general
term of the sequence (ak )k .

Definition 1.37 Let A be a nonempty set and (ak )k∈N be a given sequence in A.
A subsequence of (ak )k∈N is a sequence of the form (akp )p∈N , where (kp ) ⊆ N is a
strictly increasing sequence, for any p ∈ N.

Definition 1.38 A sequence (ak )k∈N of real numbers is called bounded if there exists
a real number M ≥ 0 such that |ak | ≤ M, ∀k ∈ N.

Example 1.39 For instance, the sequence ak = (−1)k is bounded, since |ak | ≤ 1,
for all k ∈ N.

Remark 1.40 If there exist two real numbers m and M such that m ≤ ak ≤ M , for
any k ∈ N, then the sequence (ak ) is said to be bounded from above and from below.
M is called the upper bound and m the lower bound. A sequence (ak is bounded if
and only if (ak ) has an upper and a lower bound.

Definition 1.41 A sequence (ak ) is said to be unbounded if for any positive number
M , there exists kM ∈ N such that |akM | > M .

Example 1.42 If q > 1, the sequence ak = q k is unbounded.

Definition 1.43 A sequence (ak )k∈N of real numbers is called convergent if there
exists a ∈ R such that for any neighborhood V of a, there exists nV ∈ N such that
ak ∈ V , for any k ≥ kV .

The element a ∈ R is called the limit of the sequence (ak )k∈N and we shall symbolize
this as follows:
a = lim ak .
k→∞
REAL NUMBERS 19

Proposition 1.44 A convergent sequence of real numbers has only one limit.

Proposition 1.45 Let (ak )k∈N be a sequence of real numbers. The sequence (ak )k∈N
is convergent to a ∈ R if and only if for any positive number ε, there exists kε ∈ N
such that
|ak − a| < ε, ∀k ≥ kε .

Proposition 1.46 Let (ak )k∈N and (bk )k∈N be two given sequences of real numbers
with |ak | ≤ bk , for any k ∈ N. If we assume that bk → 0, then ak → 0. As a
consequence, if (ak )k∈N , (bk )k∈N and (ck )k∈N are three given sequences of real numbers
with ak ≤ bk ≤ ck , for any k ∈ N, and if we assume that (ak )k∈N and (ck )k∈N converge
to a certain limit l ∈ R, then (bk )k∈N is convergent to l, as well.

Remark 1.47 If (ak )k∈N and (bk )k∈N are convergent sequences of real numbers,
then:
lim (ak + bk ) = lim ak + lim bk ,
k→∞ k→∞ k→∞

lim (ak bk ) = ( lim ak ) ( lim bk )

k→∞ k→∞ k→∞
and if lim bk ̸= 0 and bk ̸= 0 for any k, then
k→∞

lim (ak /bk ) = ( lim ak )/( lim bk ).

k→∞ k→∞ k→∞

Proposition 1.48 A convergent sequence is bounded.

Proposition 1.49 Any subsequence of a convergent sequence is convergent to the

same limit.

Definition 1.50 A sequence (ak )k∈N of real numbers is called increasing if ak ≤

ak+1 , for all k ∈ N and strictly increasing if ak < ak+1 , for all k ∈ N. The sequence
(ak )k∈N is called decreasing if ak ≥ ak+1 , for all k ∈ N and strictly decreasing if
ak > ak+1 , for all k ∈ N.

Some authors use another terminology; more precisely, they call a sequence (ak )k∈N
of real numbers nonincreasing if ak ≥ ak+1 , ∀k ∈ N. A sequence (ak )k∈N of real
numbers is called nondecreasing if ak ≤ ak+1 , ∀k ∈ N.
20 REAL ANALYSIS

Proposition 1.51 a) Any sequence of real numbers which is nondecreasing and

bounded above is convergent to its least upper bound.
b) Any sequence of real numbers which is nonincreasing and bounded below is
convergent to its greatest lower bound.

Theorem 1.52 (Bolzano-Weierstrass) A bounded sequence always contains a con-

vergent subsequence.

Definition 1.53 A sequence (ak )k∈N of real numbers is said to be a fundamental

sequence or a Cauchy sequence if for any positive number ε, there exists kε ∈ N such
that
|ap − am | < ε, ∀p, m ≥ kε .

Proposition 1.54 Any convergent sequence is fundamental.

Proposition 1.55 Any Cauchy sequence is bounded.

Proposition 1.56 Any Cauchy sequence in R is convergent.

Theorem 1.57 Let (ak )k∈N be a sequence of real numbers. The sequence (ak )k∈N is
convergent if and only if it is a fundamental one.

Definition 1.58 a) A sequence (ak )k∈N ⊆ R is said to be convergent to ∞ if for

any M ∈ R, there exists kM ∈ N such that

ak ≥ M, ∀k ≥ kM .

b) A sequence (ak )k∈N ⊆ R is said to be convergent to −∞ if for any M ∈ R,

there exists kM ∈ N such that

ak ≤ M, ∀k ≥ kM .

Remark 1.59 Let (ak )k∈N ⊆ R.

a) If (ak )k∈N is increasing, then it is convergent in R and

lim ak = sup ak (in R);

k→∞ k∈N
REAL NUMBERS 21

b) If (ak )k∈N is decreasing, then it is convergent in R and

lim ak = inf ak (in R).

k→∞ k∈N

Let (ak )k≥1 ⊆ R. Consider the sequence (bk )k≥1 defined by

bk = inf aj , k ≥ 1.
j≥k

Obviously, this sequence is increasing, and, therefore, it converges to its supremum.

So, there exists
l = lim bk = sup bk . (1.1)
k→∞ k≥1

In a similar manner, the sequence (ck )k≥1 , defined by

ck = sup aj , k ≥ 1,
j≥k

is decreasing, and, therefore, it converges to its infimum. So, there exists

L = lim ck = inf ck . (1.2)

k→∞ k≥1

The element l ∈ R defined by (1.1) is called the limit inferior of the sequence
(ak )k and it is denoted by lim inf ak or by lim ak .
k→∞ k→∞
The element L ∈ R defined by (1.2) is called the limit superior of the sequence
(ak )k and it is denoted by lim sup ak or by lim ak .
k→∞ k→∞
Hence, the inferior and, respectively, superior limits of the sequence (ak )k≥1 are:

lim inf ak = sup inf aj

k→∞ k≥1 j≥k

and
lim sup ak = inf sup aj .
k→∞ k≥1 j≥k

Obviously,
−∞ ≤ lim inf ak ≤ lim sup ak ≤ +∞
k→∞ k→∞

and these quantities always exist.

22 REAL ANALYSIS

Also, it is easy to see that a sequence of real numbers (ak )k≥1 is convergent in R
if and only if
lim inf ak ∈ R,
k→∞

lim sup ak ∈ R
k→∞

and
lim inf ak = lim sup ak .
k→∞ k→∞

So, if a sequence (ak )k≥1 ⊆ R is convergent in R, then

lim ak = lim ak = lim ak .

k→∞ k→∞ k→∞

Let us notice that if (ak )k≥1 is a bounded sequence of real numbers, then its limit
superior can be viewed as being the largest limit of any subsequence of (ak )k≥1 . Of
course, a similar statement is true for the limit inferior. In fact, the limit superior of
an arbitrary sequence can be viewed as being the largest subsequential limit of all
its convergent subsequences, including those possible subsequences tending to +∞
or −∞. Similarly, the limit inferior is the smallest subsequential limit. This remark
is better described in the following theorem:

Theorem 1.60 Let (ak )k be an arbitrary sequence. Let l and, respectively, L be its
limit inferior and, respectively, superior. Let (akp ) be an arbitrary subsequence of
(ak ) such that lim akp exists, it is +∞ or −∞. Then,
p→∞

l ≤ lim akp ≤ L.
p→∞

Moreover, there exists a subsequence (akp ) of (ak ) such that

L = lim akp
p→∞

and there exists a subsequence (a ′ kp ) of (ak ) such that

l = lim a ′ kp .
p→∞
REAL NUMBERS 23

Remark 1.61 If (ak )k ⊆ R+ , then:

ak+1 √ √ ak+1
lim ≤ lim k ak ≤ lim k ak ≤ lim .
k→∞ ak k→∞ k→∞ k→∞ ak

ak+1
Moreover, if there exists lim , then
k→∞ ak

ak+1 √
lim = lim k ak .
k→∞ ak k→∞

Exercise 1.62 Prove that the sequence

k2 + 1
ak = , k≥1
k

is strictly increasing.

Solution. Since
k2 + 1 1
=k+ ,
k k
we obtain
1
ak+1 − ak = 1 − > 0.
k(k + 1)
Therefore, ak+1 > ak , i.e. our sequence is strictly increasing.

Exercise 1.63 Show that the sequence

k
ak = , k≥1
2k

is strictly decreasing and find its limit.

Solution. Since
k+1
ak+1 = ak < ak ,
2k
for k > 1, it follows that the sequence (ak )k is strictly decreasing. Since, obviously,
(ak )k is bounded from below by 0, it follows that (ak )k is convergent. Let a =
1
lim ak . Then, we get a = a, which means that a = 0.
k→∞ 2
24 REAL ANALYSIS

√
Exercise 1.64 Let a1 = 2 and
√ √
ak+1 = 2+ ak , ∀k ≥ 1.

Show that (ak )k is convergent and find its limit.

Solution. By induction, we can prove that 0 < ak < 2 and, since

√ √
a2k+1 − a2k = ak − ak−1 ,

that√(ak )k is monotone. Hence, (ak )k is convergent. Denoting by l its limit, we get

√
l = 2 + l, which, using Cardan’s formula, leads to
(√ √ ( )
1 1( √ ) 1 √ )
79 − 3 249 − 1 .
3 3
l= 79 + 3 249 +
3 2 2

Exercise 1.65 Let a ∈ (−1, 1) and

∑
k
ak = j aj , ∀k ≥ 1.
j=1

a
Prove that (ak )k is convergent and has the limit equal to .
(1 − a)2
Exercise 1.66 Let 

 a1 = 1,

 a = k (a
k k−1 + 1).

Show that ( )
∏
k
1
lim 1+ = e ( Euler’s number).
k→∞
j=1
aj

Exercise 1.67 Let (ak )k≥1 be a convergent sequence having the limit equal to a.
Prove the existence and find the value of the following limit:

1∑ k
l = lim xi .
k→ k i=1

Prove a similar result for the geometric mean of the first k terms of a sequence of
strictly positive real numbers.
REAL NUMBERS 25

Exercise 1.68 Let (ak )k≥1 be given by the following recurrence formula:


 a1 = a2 = 1,

 1
ak+1 = , ∀k ≥ 2.

 1

 ak−1 +
ak

Show that this sequence is convergent and find its limit.

Exercise 1.69 Let (ak )k≥1 be defined by the following recurrence formula:


 a0 = 0,
1( )

 ak+1 = a + a2k , ∀k ≥ 0,
2

where a ∈ [0, 1]. Prove that this sequence is convergent and find its limit.

Exercise 1.70 Test the following sequences for convergence:

ln k!
a) ak = , p ≥ 2;
kp
∑
k
1
b) ak = (−1)i−1 .
i=1
i

Exercise 1.71 Test the following sequences for convergence:

∑
k
1
ak = − ln k ( Euler’s sequence ).
i=1
i

Solution. We prove that the sequence (ak )k is monotone and bounded. To this end,
using Lagrange’s formula for the function ln : [k, k + 1] → R, for k > 0, it follows
that there exists ξ ∈ (k, k + 1) such that ln (k + 1) − ln k = 1/ξ. Then, since

1 1 1
< < ,
k+1 ξ k

we get
1 1
< ln (k + 1) − ln k < .
k+1 k
26 REAL ANALYSIS

Now, since ak+1 − ak = k+1

1
− ln (k + 1) + ln k < 0, it follows that (ak )k is strictly
decreasing. On the other hand,

1 1 1
ak = 1+ + · · ·+ −ln k > (ln 2−ln 1)+(ln 2−ln 1)+· · ·+(ln(k + 1) − ln k)−ln k =
2 3 k
ln(k + 1) − ln k > 0.

Thus, the sequence (ak )k is bounded from below, and, hence, convergent.

Exercise 1.72 Prove that the sequence (ak )k , defined by

cos 1 cos 2 cos k

ak = + + ··· + , k ≥ 1,
1·2 2·3 k · (k + 1)

is convergent.

Solution. It is not difficult to see that (ak )k is a Cauchy sequence in R. Hence, (ak )k
is convergent.

Exercise 1.73 Prove that the sequence (ak )k , defined by

k!
ak = , k ≥ 1,
(2k + 1)!!

is convergent and find its limit.

Solution. It is not difficult to see that

k+1
ak+1 = ak < ak ,
2k + 3

for k > 1. Thus, it follows that the sequence (ak )k is strictly decreasing. Since,
obviously, (ak )k is bounded from below by 0, it follows that (ak )k is convergent. Let
1
a = lim ak . Then, we get a = a, which means that a = 0.
k→∞ 2

Exercise 1.74 Let (ak ) be a sequence in R. Show that ak → 0 if and only if

|ak | → 0.

Exercise 1.75 If ak → a in R and p ∈ N, prove that ak p → ap .

REAL NUMBERS 27

Solution. We prove the result by induction on p. The conclusion is obviously true

for p = 1. Suppose that ak p−1 → ap−1 . Then, ak p = ak p−1 · ak → ap−1 · a = ap .

5k 3 + 4k + 2
Exercise 1.76 Let ak = , for k ∈ N. Prove that ak → 5/4 as k → ∞.
4k 3 + 7k 2 + 5
√
Exercise 1.77 Find lim ( k 2 + 4k − k).
k→∞
( 2
)
sin 4 + π k
Exercise 1.78 Let ak = , for each k ≥ 1. Show that ak → 0 as
k3
k → ∞.

Hint. Use Proposition 1.46.

Exercise 1.79 Let a sequence (ak ) in R be defined as follows: a1 = 0 and 5ak+1 =

3ak + 4, for any k ≥ 1. Show that (ak ) is convergent.

Solution. The sequence ak is bounded and increasing, and, hence, convergent. Let
us denote by l its limit. Passing to the limit in the recurrence formula, we get l = 2.
√
Exercise 1.80 Let a1 = −10 and ak+1 = 1 − 1 − ak . Prove that (ak )k is conver-
gent and find its limit.

Hint. Show that ak < 0, for any k ≥ 1 and (ak )k is increasing.

Exercise 1.81 Compute

1 · 1! + 2 · 2! + · · · k · k!
lim .
k→∞ (k + 1)!

Hint. Let us notice that k · k! = (k + 1)! − k!, for any k ≥ 1. Then,

1 · 1! + 2 · 2! + · · · k · k! (k + 1)! − 1
lim = lim = 1.
k→∞ (k + 1)! k→∞ (k + 1)!

Exercise 1.82 Let (ak )k be a sequence which converges to a. Prove that

a1 + a2 + · · · ak
lim = a.
k→∞ k
28 REAL ANALYSIS

Exercise 1.83 Let (ak )k be a positive sequence which converges to a. Prove that
√
lim k
a1 · a2 · · · ak = a.
k→∞

Exercise 1.84 Show that the sequence (ak )k , for k ≥ 1, defined by

1 1
a”k = 1 + ... + + ,
2 k
is divergent.

Exercise 1.85 Test the following sequence for convergence

k
ak = k (−1) .

Solution. Obviously,
inf aj = 0 and sup aj = ∞.
j≥k j≥k

Therefore,
lim ak = 0 and lim ak = ∞.
k→∞ k→∞

Hence, the sequence (ak )k is divergent.

Exercise 1.86 Find the limit superior and the limit inferior for the following se-
quences:

1) ak = (−1)k ; 2) ak = k (−1)k ;
( )
1
3) ak = k + k (−1)k ; 4) ak = (−1)k a + , a ≥ 0.
k
Chapter 2

Multidimensional Spaces

We start this chapter with a brief review of some useful theoretical results about
metric spaces.

2.1 Metric Spaces

Definition 2.1 Let X ̸= ∅. A map d : X × X → R is called a metric or a distance
on X if:
1) d(x, y) = 0 ⇔ x = y, ∀x, y ∈ X;
2) d(x, y) = d(y, x), ∀x, y ∈ X;
3) d(x, z) ≤ d(x, y) + d(y, z), ∀x, y, z ∈ X (the triangle inequality). The pair
(X, d) is called a metric space. Often, d is omitted and one just writes X for a
metric space if it is clear from the context what metric is used.

Remark 2.2 Any distance takes only positive values, i.e. d(x, y) ≥ 0, for all x, y ∈
X. Hence, d : X × X → R+ .

Indeed, it is not difficult to see that we have:

0 = d(x, x) ≤ d(x, y) + d(y, x) = 2d(x, y) ⇒ d(x, y) ≥ 0, ∀x, y ∈ X.

Exercise 2.3 Let X ̸= ∅. Show that the map d : X × X → R+ , defined by

{
1, x ̸= y,
d(x, y) =
0, x = y,

29
30 REAL ANALYSIS

is a distance on X, called the discrete metric. In this case, the space (X, d) is called
a discrete metric space or a space of isolated points.

Exercise 2.4 Show that on R, the map d : R × R → R+ defined by d(x, y) = |x − y|

is a metric.

Exercise 2.5 Prove that on Rn the following maps are distances:

( n )1/2
∑
d(x, y) = (xi − yi ) 2
( the Euclidean distance);
i=1

∑
n
d1 (x, y) = |xi − yi | (the Manhattan distance);
i=1

d∞ (x, y) = max |xi − yi | (the Chebyshev distance).

1≤i≤n

The metric d∞ is sometimes denoted by du and it is called the uniform metric on

Rn . On the real line R, the three preceding metrics, d, d1 and du , agree.

Exercise 2.6 Let a, b ∈ R, a < b and let

C([a, b]) = {f : [a, b] → R | f is continuous on [a, b]}.

Show that the map d : C([a, b]) × C([a, b]) → R+ , defined by

d(f, g) = max |f (x) − g(x)|,

x∈[a,b]

is a distance on C([a, b]). Therefore, (C([a, b]), d) is a metric space.

Exercise 2.7 Prove that the map

∫b
d(f, g) = |f (x) − g(x)| dx
a

is a metric on C([a, b]).

MULTIDIMENSIONAL SPACES 31

Exercise 2.8 Let (X, d) be a metric space and let d1 : X × X → R+ defined by

d1 (x, y) = ln(1 + d(x, y)), ∀x, y ∈ X.

Prove that d1 defines a new metric on X.

Solution. We notice that due to the fact that d is a distance, i.e. d(x, y) ≥ 0, ∀x, y ∈
M , d1 is well defined. Let us verify that it satisfies all the three axioms in Definition
2.1.
(i) We have to prove that d1 (x, y) = 0 ⇔ x = y. Obviously, d1 (x, y) = 0 ⇔
ln(1 + d(x, y)) = 0 ⇔ 1 + d(x, y) = 1 ⇔ d(x, y) = 0 ⇔ x = y.
(ii) We have to prove that d1 (x, y) = d1 (y, x). But d(x, y) = d(y, x), and hence,
ln(1 + d(x, y)) = ln(1 + d(y, x)), i.e. d1 (x, y) = d1 (y, x).
(iii) We shall prove that for any x, y, z ∈ X, we have d1 (x, z) ≤ d1 (x, y)+d1 (y, z).
Indeed, using the monotonicity of the ln and the fact that d satisfies the triangle
inequality, we have

d1 (x, z) = ln(1 + d(x, z)) ≤ ln(1 + d(x, y) + d(y, z)) ≤

ln(1 + d(x, y) + d(y, z) + d(x, y)d(y, z)) =

ln((1 + d(x, y))(1 + d(y, z)) = ln(1 + d(x, y)) + ln(1 + d(y, z)) =
d1 (x, y) + d1 (y, z).
Hence, d1 is a metric on X.

Exercise 2.9 Prove that on R, the map

√
d(x, y) = |x − y|

is a distance.

Exercise 2.10 Show that on R, the map

|x − y|
d(x, y) =
1 + |x − y|

is a distance.
32 REAL ANALYSIS

Exercise 2.11 Let (X, d) be a metric space. Prove that

d(x, y)
d1 (x, y) =
1 + d(x, y)
is also a distance on X.
a b
Hint. Prove first that ≤ if 0 ≤ a ≤ b.
1+a 1+b
Exercise 2.12 Define d(x, y) = | arctan x − arctan y|, for any x, y ∈ R. Show that
√
d is a metric on R and compute d( 3, −1).

Exercise 2.13 Let d(x, y) = |x2 − y 2 |, for any x, y ∈ R. Show that d is not a
distance on R.

Exercise 2.14 Let d be the Euclidean metric on R2 . Compute d(x, y) for x = (1, 2)
and y = (3, 1) and draw the open ball Br (a) for a = (0, 0) and r = 2.

Exercise 2.15 Let d1 be the Manhattan (taxicab) metric on R2 . Compute d1 (x, y),
for x = (3, 2) and y = (4, 1), and sketch the open ball Br (a) for this metric when
a = (0, 0) and r = 2.

Exercise 2.16 Let du be the uniform metric on R2 . Compute du (x, y) when x =

(3, 2) and y = (4, 1) and draw Br (a) for this metric for a = (0, 0) and r = 2.

Exercise 2.17 Let d be the usual metric on R2 and 0 be the origin. We define ρ
on R2 as follows:
{
d(x, y), if x and y are collinear with 0,
ρ(x, y) =
d(x, 0) + d(0, y), otherwise.

Prove that ρ is a metric on R2 , called the Greek airline metric.

Exercise 2.18 Let ρ be the Greek airline metric on R2 and let x = (1, 2) and
y = (3, 4). Compute ρ(x, y) and sketch Br (a) for this metric when a = (0, 0) and
r = 2.

Exercise 2.19 Let (X, d) be a metric space and x, y, z ∈ X. Prove that

|d(x, z) − d(y, z)| ≤ d(x, y).

MULTIDIMENSIONAL SPACES 33

2.2 Elements of Topology

Definition 2.20 Let (X, d) be a metric space. Also, let x ∈ X and r > 0. The set

B(x, r) = {y ∈ X | d(x, y) < r}

is called the open ball with center at the point x and having the radius r.

Definition 2.21 Let (X, d) be a metric space. Also, let x ∈ X and r ≥ 0. The set

B(x, r) = {y ∈ X | d(x, y) ≤ r}

is called the closed ball with center at the point x and having the radius r.

Remark 2.22 If in the above definition we take r = 0, then B(x; 0) = {x}.

Definition 2.23 Let (X, d) be a metric space, a ∈ X and r > 0. The set

S(a, r) = {x ∈ X | d(a, x) = r}

is called the sphere centered at the point a and having the radius r.

Remark 2.24 The empty set is considered to be an open set.

Proposition 2.25 Any open ball B(x, r) is an open set.

Definition 2.26 A set E ⊆ X is called a closed set if X \ E is an open set.

Proposition 2.27 Any closed ball B(x, r) is a closed set.

Definition 2.28 Let (X, d) be a metric space and A, V ⊆ X. The set V is called a
neighbourhood of A if there exists an open set D such that A ⊆ D ⊆ V . If A = {x},
V is called a neighbourhood of the point x. We shall denote by V(A) the collection
of all the neighbourhoods of A and by V(x) the collection of all the neighbourhoods
of x.

Definition 2.29 A set D ⊆ X is said to be an open set if for any x ∈ D there

exists r > 0 such that B(x, r) ⊆ D.
34 REAL ANALYSIS

Definition 2.30 Let (X, d) be a metric space and A ⊆ X. A point x ∈ X is called

an interior point of A if A ∈ V(x).

We shall denote by Int A or by Å the set containing all the interior points of A.
Let us notice that the interior of a set depends upon the distance we are working
with. Usually, in what follows, if not otherwise stated, our examples will be taken
in the Euclidean space Rn , endowed with the standard distance.

Definition 2.31 Let (X, d) be a metric space and A ⊆ X. A point x ∈ X is called

an adherent point of A if for any V ∈ V(x), V ∩ A =
̸ ∅. The set

A = {x ∈ X | x is an adherent point of A}

is called the adherence or the closure of A.

Example 2.32 If we take X to be the Euclidean space R and if we consider A =

(0, 1) ⊂ R, then A = [0, 1].

Definition 2.33 Let (X, d) be a metric space and A ⊆ X. A point x ∈ X is

called a limit point or an accumulation point or a cluster point of A if for any
V ∈ V(x), (V \ {x}) ∩ A ̸= ∅. The set

A ′ = {x ∈ X | x is a limit point of A}

is called the derived set of A.

Example 2.34 If we take X to be the Euclidean space R and if A = (0, 1) ⊂ R,

then A ′ = [0, 1].

Example 2.35 Let X = R2 , with its usual metric, and let A = ((0, 1) × (0, 1)) ∪
{(2, 7)} ⊆ R2 . Then A ′ = [0, 1] × [0, 1] and Ā = ([0, 1] × [0, 1]) ∪ {(2, 7)}.

Definition 2.36 Let (X, d) be a metric space and A ⊆ X.

∂A = A ∩ CA

is called the boundary of the set A and

Ext A = Int (X \ A)

is called the exterior of A.

MULTIDIMENSIONAL SPACES 35

Example 2.37 In the Euclidean space R, endowed with the standard distance, if
A = (0, 1) ⊂ R, then ∂A = {0, 1} and Ext A = (−∞, 0) ∪ (1, ∞).

Definition 2.38 A point which is not a limit point for A is called an isolated point
of A. A set A which contains only isolated points is said to be discrete. We shall
denote by ′ A the set of all the isolated points of A.

Example 2.39 N is a discrete set in R.

Definition 2.40 Let (X, d) be a metric space and A ⊆ X. The number diam A =
sup{d(x, y) | x, y ∈ A} is called the diameter of the set A.

Definition 2.41 Let (X, d) be a metric space and A ⊆ X. The set A is called
bounded if diam A < ∞.

Definition 2.42 Let (X, d) be a metric space, x ∈ X and A ⊆ X. The number

d(x, A) = inf{d(x, y) | y ∈ A} is called the distance from x to the set A.

Definition 2.43 Let (X, d) be a metric space and A, B ⊆ X. The number d(A, B) =
inf{d(a, b) | a ∈ A, b ∈ B} is called the distance between the sets A and B.

Definition 2.44 A metric space (X, d) is called compact if for any family of open
∪
sets (Dα )α∈A , Dα ⊆ X, such that X = Dα , there exists a finite set J ⊆ A such
∪ α∈A
that X = Dα .
α∈J

Definition 2.45 A set K ⊆ X in a metric space (X, d) is called compact if for any
∪
family of open sets (Dα )α∈A , Dα ⊆ X, such that K ⊆ Dα , there exists a finite
∪ α∈A
set J ⊆ A such that K ⊆ Dα .
α∈J

Example 2.46 Let us consider the metric space (R, d), where d(x, y) = |x − y|.
Then, if a, b ∈ R, with a < b, the closed interval [a, b] is a compact set. Also, notice
that R is not compact and every finite set in (R, d) is compact.

Theorem 2.47 (Heine-Borel) Let (X, ∥ · ∥) be a finite dimensional space and K ⊆

X. Then, K is compact if and only if K is closed and bounded.
36 REAL ANALYSIS

Definition 2.48 A metric space (X, d) is said to be connected if X cannot be re-

presented as the union of two open, nonempty and disjoint sets.

Definition 2.49 A set A ⊆ X in a metric space (X, d) is said to be connected if

there exists no pair of open sets D1 , D2 ⊆ X such that A ⊆ D1 ∪D2 , A∩D1 ∩D2 = ∅
and A ∩ Di ̸= ∅, for all i = 1, 2.

If a set A is not connected, it is said to be disconnected.

Remark 2.50 Let us consider the metric space (R, d), where d(x, y) = |x − y|. A
nonempty set A ⊆ R is connected if and only if A is an interval. As a consequence,
R is connected, the open interval (a, b), with a, b ∈ R, a < b, is also connected, but
Q is not a connected set.

Definition 2.51 Let (X, d) be a metric space and A ⊆ X. The number

diam A = sup{d(x, y) | x, y ∈ A}

is called the diameter of the set A. Notice that diam A ∈ [0, ∞] and diam (A) =
diam A.

Definition 2.52 Let (X, d) be a metric space and A ⊆ X. The set A is called
bounded if diam A < ∞.

In a metric space, any ball (open or closed) with a finite radius is a bounded
set. As a matter of fact, we could define a bounded set as being a set which is
contained in a ball having a finite radius. For instance, the balls B(0, 3) and B(0, 3)
are bounded sets in R3 .

Definition 2.53 Let (X, d) be a metric space, x ∈ X and A ⊆ X. The number

d(x, A) = inf{d(x, y) | y ∈ A}

is called the distance from the point x to the set A.

Definition 2.54 Let (X, d) be a metric space and A, B ⊆ X. The number

d(A, B) = inf{d(a, b) | a ∈ A, b ∈ B}

is called the distance between the sets A and B.

MULTIDIMENSIONAL SPACES 37

Exercise 2.55 If A = N, show that Int A = ∅, A = ∂A = A, A ′ = ∅, ′A = A.

′
Also, for A = Q, prove that Int A = ∅, A = ∂A = A = R, ′ A = ∅.
′
Exercise 2.56 Show that for A = R, we have Int A = A, A = A = A = R,
′ A = ∅, ∂ R = ∅.

Exercise 2.57 For A = [0, 2) ∪ {3} ∪ {7}, show that Int A = (0, 2), A = [0, 2] ∪
{3} ∪ {7}, A ′ = [0, 2], ∂A = {0} ∪ {2} ∪ {3} ∪ {7}, ′ A = {3} ∪ {7}.

Exercise 2.58 Show that in R2 endowed with the discrete metric, the open ball
B(x, r) contains only one point, its center x, if 0 < r < 1, and contains all the
points of R2 , if r ≥ 1.

Exercise 2.59 Prove that in R2 endowed with the Chebyshev distance the open ball
B(x, r) consists of all the points in the interior of a square centered at the point x
and with sides parallel to the coordinate axes and of length equal to 2r.

Exercise 2.60 Prove that in R2 endowed with the Euclidean distance the open ball
B(x, r) consists of all the points of the disk centered at the point x and having the
radius equal to r.

Exercise 2.61 Let X = {−1} ∪ [0, 3) be regarded as a subspace of R endowed with

the Euclidean metric. Find, in this subspace, the open balls B1 (−1), B1 (0), and
B2 (0).

Solution. Following the definition of the Euclidean distance, we get B1 (−1) = {−1},
B1 (0) = [0, 1), and B2 (0) = {−1} ∪ [0, 2).

Exercise 2.62 Let (X, d) be a metric space and A ⊆ X, A ̸= ∅. Then, A is open if

and only if A ∈ V(x), ∀x ∈ A.

Solution. Let us assume that A is open. Then, x ∈ A ⊆ A, ∀x ∈ A. Since

A is open, it follows immediately that A ∈ V(x). Conversely, let us assume that
A ∈ V(x), ∀x ∈ A. Then, for any x ∈ A, there exists Dx open such that x ∈ Dx ⊆ A.
So,
∪ ∪
A= {x} ⊆ Dx ⊆ A.
x∈A x∈A
38 REAL ANALYSIS

Therefore,
∪
A= Dx ,
x∈A

and since Dx are open sets, it follows that A is open, too.

Exercise 2.63 Let (X, d) be a metric space and x ∈ X. The set V(x) possesses the
following properties:
(i) if V1 ∈ V(x) and V1 ⊆ V2 , then V2 ∈ V(x);
(ii) if V1 , V2 ∈ V(x), then V1 ∪ V2 ∈ V(x), V1 ∩ V2 ∈ V(x).
In fact, the union of any collection of neighbourhoods is also a neighbourhood. Also,
the intersection of any finite number of neighbourhoods is a neighbourhood, too.

Exercise 2.64 Let X = R, endowed with the standard distance. If A = [0, 1] ⊂ R,

then Int A = (0, 1).

Exercise 2.65 Let X = R2 equipped with its usual metric and A = Q2 . Show that
Int A = ∅.

Hint. There exists no open ball in R2 that contains only points with both coordinates
rational.

Exercise 2.66 Identify the interior, the closure and the set of all the accumulation
points of each of the following sets: (i) the integers Z in R; (ii) the rational
numbers Q in R; (iii) the complex numbers with rational real and imaginary parts
in C; (iv) the set A = [0, 1) ∪ {3} in R.

Exercise 2.67 Let (X, d) be a metric space and A, B ⊆ X. Show that:

(i) Int A ⊆ A, A ⊆ A, A ′ ⊆ A;
(ii) A ∪ B = A ∪ B, (A ∪ B) ′ = A ′ ∪ B ′ ; A ∩ B ⊆ A ∩ B, (A ∩ B) ′ ⊆ A ′ ∩ B ′ ;
(iii) the interior of A is the largest open set contained in A; the set A is the
smallest closed set which contains A;
(iv) A is open ⇔ A = Int A;
(iv) A = A ∪ A ′ ; A = A ∪ ∂A; ∂A = A \ Int A.
MULTIDIMENSIONAL SPACES 39

Exercise 2.68 Let (X, d) be a metric space and A be a nonempty subset of X.

Prove that for any x, y ∈ X, we have |d(x, A) − d(y, A)| ≤ d(x, y). Also, show that
if A, B are nonempty subsets of X, then d(A, B) = d(A, B).

Exercise 2.69 1) Let A be a connected set and B a set such that A ⊆ B ⊆ A.

Prove that B is connected.
2) If A is a connected set, then A is also connected.
∩
3) Let (Ai )i∈I be a family of connected sets such that Ai ̸= ∅. Prove that
∪ i∈I
A= Ai is a connected set.
i∈I

Exercise 2.70 Let (X, d) be a metric space and A be a nonempty subset of X.

Prove that for any x, y ∈ X, we have

|d(x, A) − d(y, A)| ≤ d(x, y).

Exercise 2.71 Let (X, d) be a metric space and A, B be nonempty subsets of X.

Prove that
d(A, B) = d(A, B).

2.3 Sequences in Metric Spaces

Definition 2.72 Let (X, d) be a metric space and (xk )k ⊆ X. The sequence (xk )k
is called convergent if there exists x ∈ X such that, for any V ∈ V(x), there exists
kV ∈ N such that xk ∈ V , for any k ≥ kV . We write x = lim xk .
k→∞

Remark 2.73 Any metric space has the following property: for any x, y ∈ X with
x ̸= y, there exist U ∈ V(x) and V ∈ V(y) such that U ∩ V = ∅. A space with such
a property is called separated or Hausdorff.

Remark 2.74 A convergent sequence in a metric space has only one limit.

Remark 2.75 We emphasize that the limit of a convergent sequence must be an

element of the space X. For example, if we take X to be the open interval (0, 1) ⊂ R
endowed with the usual distance d(x, y) = |x − y|, then the sequence (xk )k≥2 defined
by xk = 1/k is not convergent, since 0 ∈
/ X.
40 REAL ANALYSIS

Definition 2.76 A sequence (xk )k in a metric space (X, d) is called a fundamental

or a Cauchy sequence if for any ε > 0 there exists kε ∈ N such that d(xk , xp ) <
ε, ∀k, p ≥ kε .

Proposition 2.77 A convergent sequence in a metric space (X, d) is also a Cauchy

sequence.

Remark 2.78 The converse implication in Proposition 2.77 is, in general, not true.
As a counterexample, let (R, d), with d(x, y) = | arctan y−arctan x|. It is not difficult
to see that the sequence (xk ), with xk = k, is fundamental, but not convergent.

Definition 2.79 A metric space (X, d) is called a complete space if in this space
any Cauchy sequence is convergent.

Remark 2.80 A subspace M of a complete metric space (X, d) is complete if and

only if the set M is closed in X.

Example 2.81 (i) The metric space (R, d), with d(x, y) = |x − y|, is complete.
Also, the Euclidean space Rn and the unitary space Cn (endowed with the usual
Euclidean distances) are complete.
(ii) The space lp , with 1 ≤ p < ∞, and the space l∞ are complete.

Example 2.82 (i) In X = (0, 1), the sequence xk = 1/k, with k ≥ 2, is Cauchy,
but it is not convergent (in X).
(ii) The set of all rational numbers Q with the usual metric given by d(x, y) =
|x − y|, for x, y ∈ Q, is not complete.

Definition 2.83 A map f : (X, d) → (Y, ρ) is called an homeomorphism if f is a

bijection and both f and f −1 are continuous. If such a map exists, the metric spaces
(X, d) and (Y, ρ) are called homeomorphic.

Definition 2.84 Let (X, d) and (Y, ρ) be metric spaces. A map φ : X → Y is

called an isometry or a distance-preserving map if for any x, y ∈ X, we have
ρ (φ(x), φ(y)) = d(x, y).

Definition 2.85 Two metric spaces X and Y are said to be isometric if there exists
a bijective isometry from X to Y .
MULTIDIMENSIONAL SPACES 41

Definition 2.86 A completion of a metric space (X, d) is a pair consisting of a

complete metric space (X, e and an isometry φ : X → X
e d) e such that φ(X) is dense
e
in X.

Remark 2.87 Every metric space has a completion. Such a completion is unique
up to isometry.

Exercise 2.88 Let (xk )k be a convergent sequence in a metric space (X, d). If there
exists A ⊆ X and k0 ∈ N such that xk ∈ A, for any k ≥ k0 , then lim xk ∈ A.
k→∞

Exercise 2.89 Let (xk )k be a sequence in a metric space (X, d) and let x ∈ X.
Prove that x = lim xk if and only if for all ε > 0, there exists kε ∈ N such that
k→∞
d(xk , x) < ε, for all k ≥ kε (ε-criterion).

Exercise 2.90 Let C([0, 1]) be the space of all the continuous real-valued functions
∫ 1
on [0, 1], endowed with the metric d(f, g) = |f (t)−g(t)| dt. Show that (C([0, 1]), d)
0
is not a complete metric space.

Exercise 2.91 Let M be a nonempty subset of a metric space (X, d). Show that
x ∈ M if and only if there exists a sequence (xk )k in M convergent to x. Also, prove
that M is closed if and only if the limit x of any convergent sequence (xk )k ⊆ M
belongs to M .

Exercise 2.92 (i) Any Cauchy sequence in a metric space is bounded.

(ii) If a Cauchy sequence (xk )k possesses a subsequence (xkk ) which is conver-
gent to x ∈ X, then (xk )k is convergent to x.
(iii) Let (zk )k ⊆ C and z ∈ C. Then, zk → z if and only if Re zk → Im z and
Im zk → Im z.
(iv) Let (xk ), (yk ) ⊆ Rn such that xk → x, yk → y, with x, y ∈ Rn . If λ, µ ∈ R,
then λ xk + µ yk → λ x + µ y.
( )
Exercise 2.93 Prove that the sequence 1, 12 , . . . , k1 , . . . is not in l1 , but it is in
any lp , for p > 1.

Exercise 2.94 Show that any isometry is injective.

42 REAL ANALYSIS

Exercise 2.95 Let (X, d) be a metric space and M a dense subset of X with the
property that every Cauchy sequence in M is convergent in X. Show that X is
complete.

2.4 Inner Product Spaces

Definition 2.96 Let K be a commutative field and 1K be its multiplicative identity.
Also, let (V, +) be a group. If there exists a map · : K × V → V such that
1) α · (x + y) = α · x + α · y, ∀α ∈ K, ∀x, y ∈ V ,
2) (α + β) · x = α · x + β · x, ∀α, β ∈ K, ∀x ∈ V ,
3) α · (β · x) = (αβ) · x, ∀α, β ∈ K, ∀x ∈ V ,
4) 1K · x = x, ∀x ∈ V ,
then V is called a linear space or a vector space over the field K. The elements of
V are called vectors and the elements of K are called scalars.

Often, boldface letters are used for denoting vectors.

Remark 2.97 If V is a vector space, then the group (V, +) is commutative.

Definition 2.98 Let X be a K-linear space, with K = R or K = C. A map ⟨·, ·⟩ :

X × X → K is called a scalar product or a dot or inner product if the following
three axioms are satisfied:

1) ⟨x, y⟩ = ⟨y, x⟩, ∀x, y ∈ X;

2) ⟨αx + βy, z⟩ = α ⟨x, z⟩ + β ⟨y, z⟩, ∀α, β ∈ K, ∀x, y, z ∈ X;
3) ⟨x, x⟩ ≥ 0, ∀x ∈ X and ⟨x, x⟩ = 0K ⇒ x = 0X .
The pair (X, ⟨·, ·⟩) is called a linear space with scalar product or a pre-Hilbertian
space.

If K = R, we have a real scalar product and, hence, a real pre-Hilbertian space. In

this case, the first axiom becomes ⟨x, y⟩ = ⟨y, x⟩, for all x, y ∈ X. If K = C, we
have a complex scalar product and, hence, a complex pre-Hilbertian space.
MULTIDIMENSIONAL SPACES 43

Let us notice that we can replace axiom 3) in the above definition by the following
one: ⟨x, x⟩ > 0, ∀x ∈ X \ {0X }. Also, notice that the nonnegativity condition
∀x ∈ X, ⟨x, x⟩ ≥ 0 makes sense, because ⟨x, x⟩ ∈ R, for any x ∈ X.
An alternative definition, encountered especially in physics, would require to
consider the inner product to be linear in the second argument rather than in the
first one. In this case, the first argument becomes conjugate linear.

Definition 2.99 Let K = R or K = C and let X be a K-linear space. If X is

finite dimensional and pre-Hilbertian, then X is said to be an Euclidean space. An
Euclidean space X is said to be real if K = R and complex if K = C.

As typical examples, we shall consider the real Euclidean space Rn and the complex
Euclidean space Cn .

Proposition 2.100 (Cauchy-Bunyakovsky-Schwarz Inequality) Let K = R or C and

let X be a pre-Hilbertian space. Then, the following inequality holds true:

|⟨x, y⟩|2 ≤ ⟨x, x⟩ ⟨y, y⟩, ∀x, y ∈ X. (2.1)

Remark 2.101 In (2.1), we have an equality if and only if the vectors x and y are
linear dependent, i.e. there exists λ ∈ K such that x = λ y.

Remark 2.102 If we take X = Rn with the usual Euclidean scalar product, then,
from (2.1), for any x = (x1 , . . . , xn ), y = (y1 , . . . , yn ) ∈ Rn , we obtain the following
well-known inequality:
( n )1/2 ( n )1/2
∑
n ∑ ∑
xi y i ≤ x2i yi2 ,
i=1 i=1 i=1

called Schwarz inequality.

For X = C([a, b]) and the standard scalar product defined above, from (2.1) we
get the well-known Cauchy-Schwarz inequality:
 b 1/2  b 1/2
∫b ∫ ∫
f (x)g(x) dx ≤  f (x) dx  g (x) dx .
2 2

a a a
44 REAL ANALYSIS

The space of square-summable sequences l2 is an inner product space, with the

scalar product given by
∞
∑
⟨x, y⟩ = xi y i for x = (xi )i , y = (yi )i in l2 .
i=1

Then, in this case, for any two sequences x = (xi )i and y = (yi )i in l2 , we get
∞
∑ (∑
∞ )1/2 ( ∑
∞ )1/2
xi y i ≤ |xi |2 |yi |2 .
i=1 i=1 i=1

Definition 2.103 Let X be a pre-Hilbertian space. Two vectors x, y ∈ X are called

orthogonal if ⟨x, y⟩ = 0. We shall denote this by x ⊥ y.

Definition 2.104 Let x and y be nonzero vectors in Rn . The angle between x and
y is the unique number θ ∈ [0, π], given by

⟨x, y⟩
cos θ = √ √ .
⟨x, x⟩ ⟨y, y⟩

This definition makes sense, since, by Cauchy-Bunyakovsky-Schwarz inequality,

⟨x, y⟩
−1 ≤ √ √ ≤ 1.
⟨x, x⟩ ⟨y, y⟩
π
Let us notice that for θ = , we get ⟨x, y⟩ = 0, which justifies Definition 2.103.
2
Exercise 2.105 Prove that the set of all ordered n-tuples of real numbers

Rn = {(x1 , x2 , . . . , xn ) | xi ∈ R, i = 1, . . . , n},

endowed with two algebraic operations, the vector addition + : Rn × Rn → Rn ,

defined by

x + y = (x1 + y1 , . . . , xn + yn ), ∀x = (x1 , . . . , xn ), y = (y1 , . . . , yn ) ∈ Rn

and the scalar multiplication · : R × Rn → Rn , defined by

α · x = (αx1 , . . . , αxn ), ∀α ∈ R, x ∈ Rn ,
MULTIDIMENSIONAL SPACES 45

is a real linear space.The origin of Rn , denoted by 0, is defined as being 0 = (0, . . . , 0).

For brevity, we shall omit the symbol ”·” and we shall write simply αx instead of
α · x. Moreover, when there is no danger of confusion, we shall not denote vectors
by boldface letters.
The standard basis of Rn is given by the set of vectors {e1 , . . . , en }, where


 e1 = (1, 0, . . . , 0),

 e = (0, 1, . . . , 0),
2
(2.2)

 ........................


en = (0, 0, . . . , 1).

Any vector x = (x1 , x2 , . . . , xn ) can be uniquely written as

∑
n
x= xi ei .
i=1

Exercise 2.106 Show that Rn is a real linear space and Cn is a complex linear
space.

Exercise 2.107 If ⟨·, ·⟩ : X × X → K is a scalar product, then

1) ⟨0, x⟩ = ⟨x, 0⟩ = 0, ∀x ∈ X;
2) ⟨x, αy + βz⟩ = α ⟨x, y⟩ + β ⟨x, z⟩ , ∀α, β ∈ K, ∀x, y, z ∈ X.

Exercise 2.108 Let X = Rn , K = R. Prove that the map ⟨·, ·⟩ : Rn × Rn → R

defined by
∑
n
⟨x, y⟩ = xi y i
i=1

is a scalar product on Rn . Therefore, (Rn , ⟨·, ·⟩) is a (real) pre-Hilbertian space.

Exercise 2.109 Let X = Cn , K = C. Show that the map ⟨·, ·⟩ : Cn × Cn → C

defined by
∑
n
⟨x, y⟩ = xi y i
i=1

is a scalar product on Cn . Thus, (Cn , ⟨·, ·⟩) is a (complex) pre-Hilbertian space.

46 REAL ANALYSIS

Exercise 2.110 Let X = C([a, b]) = {f : [a, b] → R | f continuous on [a, b]}. Prove
that the map ⟨·, ·⟩ : X × X → R defined by

∫b
⟨f, g⟩ = f (x) g(x) dx (2.3)
a

is a scalar product. So, (C, ⟨·, ·⟩) is a pre-Hilbertian space.

Exercise 2.111 Let x = (1, −2, 3) and y = (−2, 0, 4) be vectors in Rn . Compute

⟨x, y⟩, where the inner product ⟨·, ·⟩ is defined in Exercise 2.108

Exercise 2.112 Let X be a pre-Hilbertian space. Show that if x ⊥ y, then y ⊥ x,

λ x ⊥ y and x ⊥ λ y, for any λ ∈ K.

Exercise 2.113 Let x, y be two given vectors in Rn . Prove that if ⟨z, x⟩ = ⟨z, y⟩,
for any z ∈ Rn , then x = y.

2.5 Normed Spaces

Definition 2.114 Let K = R or K = C and let X be a K-linear space. A map
∥ · ∥ : X → R is called a norm if:
1) ∥x∥ = 0 ⇒ x = 0X ;
2) ∥αx∥ = |α| ∥x∥, ∀α ∈ K, ∀x ∈ X;
3) ∥x+y∥ ≤ ∥x∥+∥y∥, ∀x, y ∈ X (the triangle inequality). The pair (X, ∥·∥)
is called a normed space.

Remark 2.115 Any norm takes only positive values, i.e. ∥x∥ ≥ 0, for all x ∈ X.
Thus, ∥ · ∥ : X → R+ . Also, as a consequence of the second axiom, we have ∥x∥ =
0 ⇔ x = 0X .

Example 2.116 For p ∈ [1, ∞), the space of p-summable sequences lp is defined
as being the collection of all the sequences x = (xi )∞
i=1 for which

∞
∑
|xi |p < ∞.
i=1
MULTIDIMENSIONAL SPACES 47

The space lp is a normed space with respect to the norm

(∑
∞ )1/p
∥x∥p = |xi |p .
i=1

Proposition 2.117 Any normed space is a metric one.

Remark 2.118 If a metric d on a vector space X satisfies the following properties:

1) d(x, y) = d(x + z, y + z), for any x, y, z ∈ X (translation invariance);
2) d(αx, αy) = |α| d(x, y), ∀α ∈ K, ∀x ∈ X (homogeneity),
then we can define a norm on X by ∥x∥ = d(x, 0).

Definition 2.119 Two norms ∥ · ∥ and ∥ · ∥ ′ are called equivalent if there exist
α, β > 0 such that
∥x∥ ≤ α ∥x∥ ′ ≤ β ∥x∥, ∀x ∈ X.
We write ∥ · ∥ ∼ ∥ · ∥ ′ .

Remark 2.120 Let us notice that two norms on a linear space will generate the
same topology if and only if they are equivalent.

Remark 2.121 Let X be a normed space with dim K X = finite. One can prove
that in such a finite dimensional normed space, any two norms are equivalent.

Definition 2.122 Let X be a normed space. We shall say that X has Heine-Borel’s
property if every bounded sequence in X possesses a convergent subsequence, whose
limit belongs to X.

Remark 2.123 A normed space X has Heine-Borel’s property if and only if X is

finite dimensional.

Definition 2.124 A normed space (X, ∥·∥) which is complete is said to be a Banach
space.

Example 2.125 For any fixed real number p ≥ 1, the Banach space Lp ([a, b]) is
the completion of the normed space of all the continuous real-valued functions on
[a, b], with the norm given by
(∫ )1/p
b
∥f ∥p = |f (x)| dx
p
.
a
48 REAL ANALYSIS

Definition 2.126 A pre-Hilbertian space (X, ⟨·, ·⟩) which is complete is called a
Hilbert space.

Example 2.127 The Euclidean spaces Rn and Cn are Banach spaces. In fact, any
finite dimensional normed space X is a Banach space.

Definition 2.128 Let X be a normed space. A subspace Y of the normed X is a

linear subspace endowed with the norm induced from the one in X.

So, if (X, ∥·∥) is a normed space and Y ⊂ X is a linear subspace, then (Y, ∥·∥) is a
normed space.

Example 2.129 (Weierstrass Approximation) The space of polynomials P (x) is a

dense subspace of C([0, 1]). Also, the set of all continuous functions C([0, 1]) is a
dense subspace of L1 ([0, 1]). So, we can approximate any integrable function by
continuous functions.

Exercise 2.130 Prove that the following maps are norms on Rn :

∑
n
a) ∥x∥1 = |xi |;
i=1
v
u n
u∑
b) ∥x∥2 = t x2i (the Euclidean norm);
i=1

c) ∥x∥∞ = max |xi |;

1≤i≤n
( n )1/p
∑
d) ∥x∥p = |xi |
p
, 1 ≤ p < ∞.
i=1

Exercise 2.131 Show that the following maps are norms on Cn :

∑
n
a) ∥x∥1 = |xi |;
i=1
v
u n
u∑
b) ∥x∥2 = t |xi |2 ;
i=1

c) ∥x∥∞ = max |xi |.

1≤i≤n
MULTIDIMENSIONAL SPACES 49

Exercise 2.132 Prove that the following map is a norm on C([a, b]):
√
∫ b
∥f ∥ = f 2 (x) dx.
a

Exercise 2.133 Show that any scalar product determines a norm.

Solution. Indeed, from a given inner product, we can naturally define a norm by:
√
∥x∥ = ⟨x, x⟩. (2.4)

So, any pre-Hilbertian space is a normed space. Let us remark that the map ∥ · ∥ :
X → R+ is well-defined, since ⟨x, x⟩ ≥ 0, for any x ∈ X. We shall prove that (2.4)
verifies all the axioms in Definition 2.115. Indeed, we have:
√
1) ∥x∥ = 0 ⇔ ⟨x, x⟩ = 0 ⇔ ⟨x, x⟩ = 0 ⇔ x = 0X ;
√ √ √
2) ∥αx∥ = ⟨αx, αx⟩ = αα⟨x, x⟩ =| α | ⟨x, x⟩ = |α| ∥x∥, ∀α ∈ K, ∀x ∈ X;
3) ∥x + y∥2 = ⟨x + y, x + y⟩ = ∥x∥2 + ∥y∥2 + ⟨x, y⟩ + ⟨x, y⟩ = ∥x∥2 + ∥y∥2 +
2Re⟨x, y⟩ ≤ ∥x∥2 + ∥y∥2 + 2|⟨x, y⟩|. Hence, ∥x + y∥2 ≤ ∥x∥2 + ∥y∥2 + 2|⟨x, y⟩|.
Using (3.4), we get ∥x + y∥2 ≤ ∥x∥2 + ∥y∥2 + 2∥x∥ ∥y∥ = (∥x∥ + ∥y∥)2 , which gives
∥x + y∥ ≤ ∥x∥ + ∥y∥.

Exercise 2.134 For m, p ∈ N, we introduce the space of matrices Mm,p of all the
m × p matrices with complex entries. Then, prove that Mm,p is an inner product
space with the trace inner product defined as
∑
m ∑
p
⟨A, B⟩ = aij bij .
i=1 j=1

The norm generated by this inner product on Mm,p is called the Hilbert-Schmidt or
the Frobenius norm of matrices:
(∑
m ∑
p )1/2
∥A∥ = |aij |2 .
i=1 j=1

Remark 2.135 The converse implication in Exercise 2.134 is false. Most real and
complex normed vector spaces do not have inner products. For instance, in R2 , the
norm
∥x∥∞ = max{|x1 |, |x2 |}
50 REAL ANALYSIS

is not generated by a scalar product. A normed space (X, ∥ · ∥) is a pre-Hilbertian

one if and only if for any x, y ∈ X, a certain relationship, called the parallelogram
identity, holds true:

∥x + y∥2 + ∥x − y∥2 = 2(∥x∥2 + ∥y∥2 ).

If the norm satisfies this identity, the associated inner product is given by the so-
called polarization identity. In the real case, this identity, which generates the scalar
product, is:
1( )
⟨x, y⟩ = ∥x + y∥2 − ∥x − y∥2 .
4
In the complex case, the polarization identity is given by
1( )
⟨x, y⟩ = ∥x + y∥2 − ∥x − y∥2 + i∥x + iy∥2 − i∥x − iy∥2 .
4
Additionally, the inner product generated by a given norm is unique, as a consequence
of the polarization identity.

Exercise 2.136 Let X be a real pre-Hilbertian space and let x, y ∈ X. Prove that

∥x + y∥ = ∥x∥ + ∥y∥ ⇔ ⟨x, y⟩ = ∥x∥ · ∥y∥

and
⟨x, y⟩ = ∥x∥ · ∥y∥ ⇔ ∃α ∈ R such that y = αx.

Exercise 2.137 Let X be a pre-Hilbertian space and let us consider k vectors in

X, x1 , . . . , xk , which are two-by-two orthogonal, i.e. xi ⊥ xj = 0, for any i ̸= j.
Prove that
2
∑
k ∑
k
xi = ∥xi ∥2 (Pythagoras).
i=1 i=1

Exercise 2.138 Let x, y ∈ Rn . Prove that x ⊥ y if and only if ∥x + y∥ = ∥x − y∥.

Exercise 2.139 Show that any normed space is a metric one.

Solution. Let (X, ∥ · ∥) be a normed space. If we define d : X × X → R+ by

d(x, y) = ∥x − y∥, it is easy to check that this map is indeed a distance on X. The
metric d is said to be induced by the norm ∥ · ∥. Hence, (X, d) is a metric space.
MULTIDIMENSIONAL SPACES 51

Exercise 2.140 Prove that in Rn we have

∥ · ∥1 ∼ ∥ · ∥2 ∼ ∥ · ∥∞ .

Exercise 2.141 Prove that if X and Y are normed spaces, then the product space
X × Y is also a normed space. For instance, the map

∥(x, y)∥X×Y = ∥x∥X + ∥y∥Y

is a norm on X × Y . Notice that one can also consider other norms, such as

∥(x, y)∥X×Y = max{∥x∥X , ∥y∥Y }

or √
∥(x, y)∥X×Y = ∥x∥2X + ∥y∥2Y .

Exercise 2.142 Let X be a compact topological space and let us consider the space

C(X) = {f : X → K | f is continuous on X},

endowed with the uniform norm, i.e.

∥f ∥u = sup |f (x)| < ∞.

x∈X

Prove that C(X) is a Banach space.

Exercise 2.143 Prove that the space of all bounded sequences (real or complex)
x = (xk )k≥1 with the norm
∥x∥ = sup ∥xk ∥
k
is a Banach space.

Exercise 2.144 Let X be the space of all the continuous real functions on [0, 1]
and let d : X × X → R+ defined by
∫ 1
d (f, g) = |f (x) − g(x)| dx.
0

Prove that d is a metric on X, but the space (X, d) is not complete.

52 REAL ANALYSIS

Exercise 2.145 Show that the space c of convergent sequences in C, endowed with
the supremum norm, is a Banach space.

Exercise 2.146 Prove that the space l∞ of bounded sequences (with the supremum
norm) is a Banach space.

Exercise 2.147 Show that the space of all the continuous real functions on [0, 1],
with the norm ∫ 1
∥f ∥L1 = |f (x)| dx
0
given by the Riemann integral of the absolute value, is not a complete normed space.

Exercise 2.148 (Minkowski Inequality in lp ) Let p ∈ [1, ∞). Prove that for any
two sequences x, y ∈ lp , we have
(∑
∞ )1/p (∑
∞ )1/p (∑
∞ )1/p
|xi + yi |p ≤ |xi |p + |yi |p .
i=1 i=1 i=1

Exercise 2.149 (i) Show that the set c of convergent sequences and the set c0 of
sequences converging to zero are closed subspaces of l∞ .
(ii) Let p ∈ [1, ∞). Prove that the set of p-summable sequences lp is a closed
subspace of l∞ and a dense subspace of c0 .

Exercise 2.150 Let us consider a Banach space X and let Y be a linear subspace
of X. Prove that Y is Banach if and only if Y is closed in X.

Exercise 2.151 Show that the space l∞ of all bounded sequences of real numbers,
with the supremum norm, is a Banach space.

Exercise 2.152 Prove that the space of polynomials P (x) on the interval [0, 1] is
not a Banach space with respect to the supremum norm.

Exercise 2.153 Let x = (1, 1, 0) and y = (2, 0, 0). Compute ⟨x, y⟩, ∥x∥, ∥y∥ and
the angle between x and y.

Exercise 2.154 Let x, y ∈ Rn . Prove that x ⊥ y if and only if ∥x + y∥ = ∥x − y∥.

Exercise 2.155 Show that any normed space is a metric one.

MULTIDIMENSIONAL SPACES 53

Solution. Let (X, ∥ · ∥) be a normed space. Then, if we define d : X × X → R+ by

d(x, y) = ∥x − y∥,

it is easy to verify that this map is indeed a distance on X. The metric d is said to
be induced by the norm ∥ · ∥. Hence, (X, d) is a metric space.

Exercise 2.156 Let x = (x1 , x2 ) ∈ R2 . Prove that

∥x∥1 = |x1 | + |x2 |,

√
∥x∥2 = x21 + x22 ,
and
∥x∥∞ = max{| x1 |, | x2 |}
are norms in R2 and draw the corresponding unit balls and unit circles.

Exercise 2.157 Show that in R3 , the set of all the vectors whose Euclidean norm
is a given constant forms the surface of a sphere, the set of vectors whose 1-norm is
a given constant forms the surface of a cross polytope and the set of vectors whose
∞-norm is a given constant forms the surface of a hypercube.

Exercise 2.158 Prove that in R2 , the following norms are equivalent:

∥ · ∥1 ∼ ∥ · ∥2 ∼ ∥ · ∥∞ .

Hint. It is not difficult to see that

√
∥x∥∞ ≤ ∥x∥2 ≤ ∥x∥1 ≤ 2∥x∥2 ≤ 2∥x∥∞ , for all x ∈ Rn .

Exercise 2.159 Prove that if X and Y are normed spaces, then the product space
X × Y is also a normed space.

Hint. The map

∥(x, y)∥X×Y = ∥x∥X + ∥y∥Y
is a norm on X × Y . Let us notice that we can also consider other norms, such as

∥(x, y)∥X×Y = max{∥x∥X , ∥y∥Y }

54 REAL ANALYSIS

or √
∥(x, y)∥X×Y = ∥x∥2X + ∥y∥2Y .

A similar result holds true for the product of n normed spaces.

Chapter 3

Series of Real and Complex

Numbers

In what follows, we shall consider that X = R or X = C.

Definition 3.1 Let (xk )k≥0 ⊆ X. If

∑
k
Sk = xi , (3.1)
i=0

then the pair ((xk )k≥0 , (Sk )k≥0 ) is called a series (the series associated to the sequence
(xk )n≥0 ).

Instead of the above pair notation, we shall use a simpler one:

∑
xk (3.2)
k≥0

Sk is called the kth partial sum of the series (3.2), while xk is said to be its general
term.

Definition 3.2 If there exists S ∈ X such that

S = lim Sk ,
k→∞

then the series (3.2) is called convergent. In this case, S is said to be its sum.

55
56 REAL ANALYSIS

∑
If the series xk converges to S, we shall write:
k≥0

∞
∑
S= xk .
k=0

Definition 3.3 A series which is not convergent is called divergent.

∑ ∑
Definition 3.4 A series xk is called absolutely convergent if the series |xk |
k≥0 k≥0
is convergent.

Definition 3.5 A series which is convergent, but not absolutely convergent, is called
semi-convergent or conditionally convergent.
∑ ∑
Proposition 3.6 If the series xk is absolutely convergent, then the series xk
k≥0 k≥0
is convergent. The converse implication is, in general, not true.
∑ (−1)k
Example 3.7 The series is only semi-convergent.
k≥1
k
∑
Proposition 3.8 If the series xk is convergent, then the sequence (xk )k is con-
k≥0
vergent and
lim xk = 0.
k→∞

Remark 3.9 The converse implication in Proposition 3.8 is false.

∑1
Example 3.10 The harmonic series is divergent, despite the fact that
k≥1
k

1
xk = → 0.
k
∑
Proposition 3.11 (Cauchy’s Criterion) The series xk is convergent in X if
k≥0
and only if for any ε > 0, there exists kε ∈ N such that

|xk+1 + · · · + xk+p | < ε, ∀k ≥ kε , ∀p ≥ 1. (3.3)

SERIES 57

Proposition 3.12 (Comparison Test) Let (xk )k ⊆ C and (yk )k ⊆ R+ . We assume

that there exists k0 ∈ N such that

|xk | ≤ yk , ∀ k ≥ k0 .
∑ ∑
If the series yk is convergent, then the series xk is absolutely convergent.
k≥0 k≥0

Corollary 3.13 Let xk , yk ∈ R such that

0 ≤ xk ≤ y k , ∀ k ∈ N .

∑ ∑
(i) If yk is convergent, then xk is convergent.
k≥0 k≥0
∑ ∑
(ii) If xk is divergent, then yk is also divergent.
k≥0 k≥0
xk
(iii) If xk , yk ∈ R such that xk , yk > 0 and there exists lim = L ∈ (0, ∞),
k→∞ yk
∑ ∑
then the series xk and yk have the same nature.
k≥0 k≥0

The next test is known as Cauchy’s Test or the Root Test.

Theorem 3.14 Let (xk )k ⊆ C and

√
L = lim sup k
|xk |.
k→∞

Then, we have:
∑
(i) if L < 1, the series xk is absolutely convergent;
k
∑
(ii) if L > 1, the series xk is divergent.
k

Corollary 3.15 If there exists

√
L = lim k
|xk |,
k→∞

then:
58 REAL ANALYSIS

∑
(i) if L < 1, the series xk is absolutely convergent;
k
∑
(ii) if L > 1, the series xk is divergent;
k
∑
(iii) if L = 1, we cannot decide upon the nature of the series xk .
k

The next test is known as D’Alembert’s Test or the Ratio Test.

Theorem 3.16 Let (xk )k≥0 ⊆ C.

xk+1 ∑
(i) If lim sup < 1, then the series xk is absolutely convergent.
k→∞ xk k≥0
xk+1 ∑
(ii) If lim inf > 1, then the series xk is divergent.
k→∞ xk k≥0

Corollary 3.17 If there exists

xk+1
L = lim ,
k→∞ xk
then:
∑
(i) if L < 1, the series xk is absolutely convergent;
k≥0
∑
(ii) if L > 1, the series xk is divergent;
k≥0
∑
(iii) if L = 1, we cannot decide upon the nature of the series xk .
k≥0

Proposition 3.18 (Abel-Dirichlet’s Test) Let (xk )k ⊆ C and (yk )k ⊆ R+ . We

assume that there exists M > 0 such that
∑
k
xi ≤ M, ∀ k ≥ 0.
i=0

If the sequence (yk )k is nonincreasing and

lim yk = 0,
k→∞
∑
then the series xk yk is convergent.
k0
SERIES 59

Proposition 3.19 (Leibniz) If xk ≥ xk+1 ≥ 0, ∀ k ∈ N and lim xk = 0, then the

∑ k→∞
series (−1)k xk is convergent. A series of this form is called a Leibniz series or
k≥0
an alternating series.

Proposition 3.20 (Condensation Test) Let (xk )k≥0 ⊆ R+ be a nonincreasing se-

∑ ∑
quence. Then, the series xk is convergent if and only if the series 2k x2k is
k≥0 k≥0
convergent.

Proposition 3.21 (Raabe-Duhamel’s Test) Let xk > 0, ∀ k ∈ N, and let

( )
xk
Rk = k −1 .
xk+1

If there exists
L = lim Rk ,
k→∞

then:
∑
(i) if L > 1, the series xk is convergent;
k≥0
∑
(ii) if L < 1, the series xk is divergent;
k≥0
∑
(iii) if L = 1, we cannot decide upon the nature of the series xk .
k≥0

∑ ∑
Definition 3.22 Let xk and yk be series of real (or complex) numbers. Let
k≥0 k≥0
∑
us consider the series zk , with
k≥0

∑
zk = xi y j .
i+j=k

∑ ∑
This series is called the Cauchy product series of the series xk and yk .
k≥0 k≥0
60 REAL ANALYSIS

∑ ∑
Theorem 3.23 (Mertens) Let xk and yk be convergent series of real (com-
k≥0 k≥0
plex) numbers. If at least one of our two series is absolutely convergent, then the
∑
Cauchy product series zk , with
k≥0
∑
zk = xi yj
i+j=k

is convergent and ( )
∞
∑ ∞
∑ ∞
∑
zk = ( xk ) yk .
k=0 k=0 k=0
∑ ∑
Theorem 3.24 (Cauchy) Let xk and yk be absolutely convergent series of
k≥0 k≥0
∑
real (or complex) numbers. Then, the Cauchy product series zk is absolutely
k≥0
convergent.

Remark 3.25 In general, a product series of two convergent series is not conver-
gent. For instance, if we take

(−1)k
xk = y k = √ ,
k
∑
then the Cauchy product series zk is divergent.
k≥0

Exercise 3.26 Show that the series

∑ 1
k≥1
k (k + 1)

is convergent and its sum is equal to 1.

Solution. Since the general term of our series can be written as

1 1 1
xk = = − ,
k (k + 1) k k+1
by induction we can prove that the k-th partial sum Sk is
1
Sk = 1 − .
k+1
SERIES 61

Therefore, since
lim Sk = 1,
k→∞
our series is convergent and its sum is equal to 1.

Exercise 3.27 Prove that the series

∑ ( )
1
ln 1 − 2
k≥2
k

is convergent and its sum is equal to − ln 2.

Solution. Since the general term of our series can be written as

( )
1
xk = ln 1 − 2 = ln(k − 1) + ln(k + 1) − 2 ln k,
k

by induction we can show that the k-th partial sum Sk is

k+1
Sk = ln .
2k
Thus, since
lim Sk = − ln 2,
k→∞
our series is convergent and its sum is equal to − ln 2.

Exercise 3.28 Find the sum of the series

∑ 1
arctan .
k≥1
k2 + k + 1

Solution. it is not difficult to see that

1 1
1 −
= k k+1 .
k2 + k + 1 1 1
1+
k k+1
On the other hand, we know that
x−y
arctan x − arctan y = arctan .
1 + xy
62 REAL ANALYSIS

Therefore, the general term of our series can be written as follows:

1 1
xk = arctan − arctan .
k k+1

By induction,
1
Sk = arctan 1 − arctan ,
k+1
π π
which converges to . Hence, our series is convergent and its sum is equal to .
4 4

Exercise 3.29 Compute the sum of the following series:

∑ 1
a) ;
k≥1
4k 2−1
∑ 1
b) , p ∈ N∗ ;
k≥1
k (k + p)
√
∑ k − k2 − 1
c) √ .
k≥1
k (k + 1)

∑1
Exercise 3.30 Prove that the series is divergent.
k≥1
k

Solution. We have

1 1 1 1 1
|S2k − Sk | = + + ··· + ≥k = .
k+1 k+2 2k 2k 2

Therefore, condition (3.3) is not satisfied and, so, our series is divergent.
∑ ∑
Exercise 3.31 If xk and yk are convergent series in X and if α, β ∈ K, show
k≥0 k≥0
that the series
∑
(αxk + βyk )
k≥0

is convergent and
∞
∑ ∞
∑ ∞
∑
(αxk + βyk ) = α xk + β yk .
k=0 k=0 k=0
SERIES 63

Exercise 3.32 Let (zk )k ⊆ C,

zk = xk + i yk .

Show that
∑ ∑ ∑
zk is convergent ⇔ xk and yk are convergent.
k≥0 k≥0 k≥0

Exercise 3.33 Let (xk )k ⊆ Rn , xk = (x1k , x2k , . . . , xnk ). Show that

∑ ∑
xk is convergent ⇔ xik , i = 1, n, are convergent.
k≥0 k≥0

Exercise 3.34 (The geometric series) Let q ∈ R such that |q| < 1. Prove that the
∑ k
series q is convergent and
k≥0

∞
∑ 1
qk = .
k=0
1−q
∑
If |q| ≥ 1, show that the series q k is divergent.
k≥0
∑
Exercise 3.35 If z ∈ C and |z| < 1, show that the series z k is convergent and
k≥0

∞
∑ 1
zk = .
k=0
1−z

Solution. Let q ∈ R such that |q| < 1.

1 − q k+1
Sk = 1 + q + · · · + q k = .
1−q
Therefore,
1
lim Sk = .
k→∞ 1−q
If |q| ≥ 1, then
|xk | = |q k | ≥ 1.
Hence, xk 9 0 and the series is divergent.
64 REAL ANALYSIS

∑ k!
Exercise 3.36 Prove that the series is convergent.
k≥1
(2k)!

Solution. The series is convergent since

k! 1 1
= < k
(2k)! (k + 1) · · · (2k) 2
∑ 1
and the geometric series is convergent.
k≥1
2k

∑ 1
Exercise 3.37 Show that the series √ is divergent.
k≥1
k(k + 1)

Solution. The given series is divergent because

1 1
√ >
k(k + 1) k + 1
∑ 1
and the series is divergent.
k≥1
k+1

∑ 1 ∑ 1
Exercise 3.38 Show that the series and have the same nature.
k≥1
k+1 k≥1
5k + 2

Solution. The conclusion follows immediately because

5k + 2
lim = 5 ∈ (0, ∞).
k→∞ k+1
Exercise 3.39 Test the following series for convergence:
∑ k3 + 1
.
k≥1
k6 + k + 3

∑ 1
Solution. By comparing with the series , which is convergent, it turns out
k≥1
k3
that the given series is convergent.
∑ 1
Exercise 3.40 Prove that the series (−1)k is convergent for p > 0 and diver-
k≥0
kp
gent for p ≤ 0.
SERIES 65

Exercise 3.41 Show that the series

∑ 1

k≥1
kα

is convergent for α > 1 and divergent for α ≤ 1. This series is known as the
generalized harmonic series or Riemann’s series.
∑ 1
Solution. Using the condensation test, the series is convergent if and only if
k≥1
kα
∑ 1
the series 2k is convergent. But
k≥0
(2k )α

( )k
1 1
2k = .
(2k )α 2α−1

1
If α > 1, then < 1. Hence, our series is convergent.
2α−1
( )k
1
If α = 1, then = 1 9 0. Therefore, our series is divergent.
20
1 1
If α < 1, then k α < k and α
> . So, the given series is divergent.
k k
Exercise 3.42 Test the following series for convergence:
∑ 1
, a > 0.
k≥1
k (1 + a + · · · + ak)

Solution. We have to distinguish between three cases: a = 1, a > 1 and 0 < a < 1.
1
For a = 1, the general term of our series becomes and, obviously, the series
k (k + 1)
is convergent.
For a > 1, we have

1 1
< k , for any k ≥ 1.
k (1 + a + · · · + a )
k a
∑ 1 1
Since the geometric series is convergent, having the ratio < 1, using the
k≥1
ak a
comparison test we conclude that our series is convergent.
66 REAL ANALYSIS

In the case 0 < a < 1, we shall compare our series with the classical harmonic series,
which is divergent. Indeed, we have:

1
k (1 + a + · · · + ak ) 1
lim = lim = 1 − a ∈ (0, ∞).
k→∞ 1 k→∞ 1 − ak+1
k 1−a

Hence, in this case, our series is divergent.

Exercise 3.43 Test the following series for convergence:

∑ k!
.
k≥1
kk

Solution. Applying the ratio test, we get

xk+1 (k + 1)! k k kk 1
lim = lim = lim = < 1.
k→∞ xk k→∞ k!(k + 1)k+1 k→∞ (k + 1)k e

Hence, our series is absolutely convergent.

∑ 1 2
Exercise 3.44 Determine the nature of the series 2k (1 − )k .
k≥1
k

Solution. Applying the root test, we get

√ 1 2
lim k
|xk | = lim 2(1 − )k = < 1.
k→∞ k→∞ k e
Therefore, our series is absolutely convergent.

∑ ak
Exercise 3.45 Prove that the series , defined for a > 0, is convergent.
k≥0
k!

Solution. Applying the ratio test, we get

xk+1 ak+1 k! a
lim = lim k
= lim = 0 < 1.
k→∞ xk k→∞ (k + 1)! a k→∞ k + 1

Thus, our series is absolutely convergent.

SERIES 67

∑ 1
Exercise 3.46 Show that the series is convergent.
k≥2
(ln k)k
∑
Exercise 3.47 Prove that the series (ln k)k is divergent.
k≥2

Exercise 3.48 Test the following series for convergence

∑ (2k − 1)!!
.
k≥1
(2k + 2)!!

Solution. Using Raabe-Duhamel’s test, we obtain

( ) ( )
xk 2k + 4 3
lim k − 1 = lim k − 1 = > 1.
k→∞ xk+1 k→∞ 2k + 1 2

So, our series is convergent.

Exercise 3.49 Using the ratio and the root test, discuss the nature of the following
series:
∑ ak ∑ ak ∑ 1
a) , a > 0; b) , a, b > 0; c) ;
k! kb (ln k)k
k≥1 k≥1 k≥2

∑ k! ∑ k 2 k2
d) , e) (2 + sin k) (1 − ) .
kk k
k≥1 k≥1

Exercise 3.50 Compute the sum of the following series:

∑ 1 ∑ 1 ∑ (k + 1)2
a) 2 − 1)
; ; c) ln .
k≥2
k(k k≥1
k(k + 1)(k + 2) k≥1
k (k + 2)

Exercise 3.51 Test the following series for convergence:

√ √
∑ 1 ∑ k+1− k ∑ 1
a) k
; b) ; c) tan .
k≥0
3 +k k≥1
k k≥1
k

Exercise 3.52 Decide upon the nature of the following series:

∑ 1 ∑ 1 ∑ sin k
a) sin ; b) ; c) .
k≥1
k k≥2
k ln k k≥1
2k
68 REAL ANALYSIS

Exercise 3.53 Test the following series for convergence:

∑ (−1)k ∑ 1
a) ; b) √ ;
k≥1
(3k + 1)2 k≥1
k+ k+1

∑ k!
c) , a > 0;
k≥1
a(a + 1) · · · (a + k)

∑ sin k + 1 ∑
e−k , β ∈ R.
β
d) ; e)
k≥2
k(ln k)2 k≥2

Exercise 3.54 Discuss, in terms of p and q, the nature of the following series:
∑ 1
p (ln k) q
.
k≥2
k

Exercise 3.55 Decide upon the nature of the following series:

√ √
∑ k+2− k−2 ∑ ( ak + b ) k
a) ; b) , a, b, c, d > 0;
k≥2
n2 k≥1
ck + d

∑ √ ∑ 1 (k)k
c) ( (k + 1)(k + a) − k) k , a > 0; d) , a > 0.
k≥1 k≥1
k! a
Chapter 4

Limits and Continuity

4.1 Limits of Functions

′
Definition 4.1 Let (X, d) and (Y, ρ) be metric spaces, M ⊆ X, a ∈ M and

f : M → Y.

A number l ∈ Y is called the limit of the function f at the point a if for any V ∈ V(l),
there exists U ∈ V(a) such that, for any x ∈ U ∩ M \ {a}, it follows that f (x) ∈ V .

We shall use the following notation l = lim f (x).

x→a

Remark 4.2 If a function f possesses a limit l at a given point a, then this limit
is unique.
′
Theorem 4.3 Let (X, d) and (Y, ρ) be metric spaces, M ⊆ X, a ∈ M . Also, let
f : M → Y . The following statements are equivalent:
(i) l = lim f (x);
x→a
(ii) ∀ ε > 0 ∃ δε > 0 such that ∀x ∈ M, x ̸= a, with d(x, a) < δε , it follows that
ρ(f (x), l) < ε;
(iii) ∀ (xn )n ⊆ M, xn ̸= a, such that xn → a, it follows that f (xn ) → l.
′
Theorem 4.4 (Cauchy’s Criterion) Let f : E ⊆ Rn → Rm and let a ∈ E . Then,
there exists l = lim f (x) if and only if for any ε > 0, there exists Uε ∈ V(a) such
x→a
′ ′′ ′ ′′
that for any x , x ∈ Uε ∩ E \ {a}, it follows that d(f (x ), f (x )) < ε.

69
70 REAL ANALYSIS

Definition 4.5 Let f : E ⊆ Rn → Rm and let u ∈ Rn , u ̸= 0, a ∈ E ′ . The function

f possesses the limit l ∈ Rm at the point a in the direction of the vector u if there
exists
l = lim f (a + h u) ∈ Rm .
h→0

We shall denote the directional limit of f along the vector u by

lu = lim f (x).
x→au

Notice that, for the existence of the above limit, we need that a+h u ∈ E, for h → 0.

Remark 4.6 If the global limit lim f (x) exists, then all the directional limits lu
x→a
exist, for all u ̸= 0.

The converse implication is, in general, false. As a concrete example, let us consider
the function f : R2 \ {(0, 0)} → R, defined by

x2 y
f (x, y) = .
x4 + y 2

It is not difficult to see that lim f (x, y) doesn’t exist, but all the directional
(x,y)→(0,0)
limits limu for all u ̸= 0 exist.

Remark 4.7 Usually, directions are taken to be normalized, although the above
definition works for arbitrary vectors u ̸= 0. So, in such a case we shall work with
unit vectors (also called by some authors direction vectors), i.e. with vectors with

∥u∥ = 1.

Remark 4.8 We recall now the concept of iterated limits for a two-variable func-
tion. Let f : A ⊆ R2 → R and let (a, b) be an accumulation point of A. The
limits ( )
l12 = lim lim f (x, y)
x→a y→b

and ( )
l21 = lim lim f (x, y)
y→b x→a

are called iterated or repeated limits.

LIMITS AND CONTINUITY 71

′
Remark 4.9 Let f : A ⊆ R2 → R, (a, b) ∈ A . If there exists

lim f (x, y) = l
(x,y)→(a,b)

and there exists

lim (lim f (x, y)) = l12 ,
x→a y→b

then l = l12 . So, if the global limit and one of the iterated limits exist at a given
point, then the values of these limits must be equal.

Let us notice that if the repeated limits exists, but are not equal, then the global
limit doesn’t exist.

Example 4.10 Let

1
x sin +y
f (x, y) = x .
x+y
Then, ( )
1
lim lim f (x, y) = lim sin
x→0 y→0 x→0 x
does not exist and ( )
lim lim f (x, y) = lim 1 = 1.
y→0 x→0 y→0

Also, the global limit lim f (x, y) does not exist.

(x,y)→(0,0)

Example 4.11 If
2x2
f (x, y) = ,
x2 + y 2
then ( )
2x2
lim lim f (x, y) = lim =2
x→0 y→0 x→0 x2

and ( )
lim lim f (x, y) = lim 0 = 0.
y→0 x→0 y→0

Thus, the global limit lim(x,y)→(0,0) f (x, y) again does not exist, despite the fact that
both of the iterated limits exist.
72 REAL ANALYSIS

Exercise 4.12 Let f : Rn → Rm , f = (f1 , . . . , fm ) and l = (l1 , . . . , lm ) ∈ Rm . Show

that
lim f (x) = l ⇔ lim fj (x) = lj , j = 1, m.
x→a x→a
′
Exercise 4.13 Let f, g : E ⊆ Rn → R and let a ∈ E . If we assume that lim f (x)
x→a
and lim g(x) exist and that c is an arbitrary constant, then
x→a

a) lim (f ± g)(x) = lim f (x) ± lim g(x); b) lim (c f )(x) = c lim f (x);
x→a x→a x→a x→a x→a

f (x) lim f (x)

c) lim (f g)(x) = lim f (x) lim g(x); d) lim = x→a ,
x→a x→a x→a x→a g(x) lim g(x)
x→a
provided that g(x) ̸= 0 on E and lim g(x) ̸= 0.
x→a
′
Exercise 4.14 Let f, g : E ⊆ Rn → R and let a ∈ E . If we assume that
d(f (x), l) ≤ g(x), ∀x ∈ E \ {a} and if lim g(x) = 0, show that
x→a

lim f (x) = l.
x→a

′
Exercise 4.15 Let f : E ⊆ Rn → C, f = u + iv and let a ∈ E . Then,


 lim (Ref )(x) = Re l,
 x→a
lim f (x) = l ⇔
x→a 

 lim (Imf )(x) = Im l.
x→a

′
Exercise 4.16 Let f1 , f2 : E ⊆ Rn → R and let a ∈ E . If we assume that

lim f1 (x) = l, lim f2 (x) = l

x→a x→a

and if
f1 (x) ≤ φ(x) ≤ f2 (x), ∀x ∈ U ∩ E \ {a}, U ∈ V(a),
then
lim φ(x) = l.
x→a

x2 − y 2
Exercise 4.17 Let f (x, y) = , ∀(x, y) ∈ R2 \ {(0, 0)}. Prove that the limit
x2 + y 2
of this function, for (x, y) → (0, 0), doesn’t exist.
LIMITS AND CONTINUITY 73

( )
1 α
Solution. If we consider the sequence (xk , yk ) = , , with α > 0, which is an
k k
admissible one, i.e. (xk , yk ) → (0, 0), for k → ∞, we get

1 − α2
lim f (xk , yk ) = .
k→∞ 1 + α2

So, the limit of f (xk , yk ) for k → ∞ depends on α and, hence, the limit of f (x, y)
for (x, y) → (0, 0) doesn’t exist.

x2 y 2
Exercise 4.18 Let f (x, y) = , ∀(x, y) ∈ R2 \ {(0, 0)}. Prove that
x2 + y 2

lim f (x, y) = 0.
(x,y)→(0,0)

Solution. It is easy to see that

x2 ≤ x2 + y 2 , y 2 ≤ x2 + y 2 , ∀(x, y) ∈ R2 .

Therefore, we obtain
|f (x, y)| ≤ x2 + y 2 .

Obviously, since
lim (x2 + y 2 ) = 0,
(x,y)→(0,0)

we get
lim f (x, y) = 0.
(x,y)→(0,0)

Exercise 4.19 Decide if the following limit exists:

x2 y 1
l= lim 2 2
cos 2 .
(x,y)→(0,0) x + y x + y2

Solution. Since
x2 y
lim =0
(x,y)→(0,0) x2 + y 2

and the cosine function is bounded, the limit l exists and it is equals to 0.

Exercise 4.20 Compute the directional limit at the point a = (1, 2, 3), in the di-
rection u = (1, 1, 1), of the function f : R3 → R, defined by f (x, y, z) = x2 + y + yz.
74 REAL ANALYSIS

Solution. It is easy to see that

l = lim f (a + h u) = lim [(1 + h)2 + (2 + h) + (2 + h)(3 + h)] = 9.

h→0 h→0

Exercise 4.21 Let f : R2 \ {(0, 0)} → R defined by

x−y
f (x, y) = xy .
x2 + y 2

Test this function for the existence of directional limits at the point (0, 0).

Solution. It is not difficult to see that

x−y | x2 y | | xy 2 |
0 ≤ xy ≤ + ≤| y | + | x | .
x2 + y 2 x2 + y 2 x2 + y 2

Thus, there exists

lim f (x, y) = 0
(x,y)→(0,0)

and, hence, there exist lu , for all u ̸= 0.

1
Exercise 4.22 Prove that lim sin doesn’t exist.
x→0 x
xy
Exercise 4.23 Show that the limit lim doesn’t exit.
(x,y)→(0,0) x2 + y 2

Exercise 4.24 Prove that

xy
lim √ = 0.
(x,y)→(0,0) x2+ y2

x−y
Exercise 4.25 Show that the limit lim doesn’t exist, but the iterated
(x,y)→(0,0) x + y
limits exist and
lim (lim f (x, y)) ̸= lim ( lim f (x, y)).
x→0 y→0 y→0 x→0

1 1
Exercise 4.26 Prove that the limit lim (x + y) sin sin exists, but we don’t
(x,y)→(0,0) x y
have iterated limits.
LIMITS AND CONTINUITY 75

Exercise 4.27 Compute the directional limits in the direction u = (1, 2), at the
point (0, 0), for the function
xy
f (x, y) = .
x2 + y2
Exercise 4.28 Compute the directional limits, at the point (0, 0), in the direction
(1, 2) for the function
x2 y
f (x, y) = 2 .
x + y2
Exercise 4.29 Show that
1
lim (x2 + y 2 ) sin = 0.
(x,y)→(0,0) x2 + y2

Exercise 4.30 Let f : R2 \ {(0, 0)} → R defined by

1 1
f (x, y) = x sin + y sin .
y x
Prove that the global limit lim f (x, y) exists, but the iterated limits don’t.
(x,y)→(0,0)

Exercise 4.31 Let f : R3 \ {(0, 0, 0)} → R defined as follows:

x2 − y 2 + z 2
f (x, y, z) = .
x2 + y 2 + z 2
Prove that the limit lim f (x, y, z) doesn’t exist.
(x,y,z)→(0,0,0)

Exercise 4.32 Let f : R2 \ {(0, 0)} → R defined as follows:

x2 y 2
f (x, y) = .
x2 y 2 + (x − y)4
Prove that the global limit lim f (x, y) doesn’t exist, but the iterated limits
(x,y)→(0,0)
exist.

Exercise 4.33 Compute the directional limits at the point (π/4, 1), in the direction
→
− √ √
u = ( 2/2, 2/2), for the function
x
f (x, y) = (x2 + x cos y, ln sin ).
y
76 REAL ANALYSIS

Exercise 4.34 Compute the directional limits at the point (1, 1), in the direction
→
− √ √
u = ( 2/2, 2/2), for the function

f (x, y) = (x2 + y 2 , 2 x y).

Exercise 4.35 Let f : R2 \ {(0, 0)} → R defined by

1 − cos(x3 + y 3 )
f (x, y) = .
x2 + y 2
Test this function for the existence of directional limits at the point (0, 0).

4.2 Continuous Functions

Definition 4.36 Let (X, d) and (Y, ρ) be metric spaces, a ∈ X. Also, let f : X →
Y . The function f is said to be continuous at the point a if for any V ∈ V(f (a)),
there exists U ∈ V(a) such that f (U ) ⊆ V .

Definition 4.37 Let (X, d) and (Y, ρ) be metric spaces and f : X → Y . The
function f is said to be continuous on X if it is continuous at each point a ∈ X.

Theorem 4.38 Let (X, d) and (Y, ρ) be metric spaces, a ∈ X. Also, let f : X → Y .
The following statements are equivalent:
(i) f is continuous at the point a;
(ii) for any ε > 0, there exists δε > 0 such that for any x ∈ X with d(x, a) < δε , it
follows that ρ(f (x), f (a)) < ε;
(iii) ∀(xn )n ⊆ X such that xn → a, it follows that f (xn ) → f (a).

Remark 4.39 Let f : R → R. The following statements are equivalent:

(i) f is continuous;
(ii) the inverse image of any open subset of R is an open subset in R;
(iii) the inverse image of any closed subset of R is a closed subset of R.

Remark 4.40 a) Let f : Rn → Rm . Then, f is continuous if and only if the

inverse image of any open subset of Rm is an open subset in Rn .
b) If f : Rn → Rm and g : Rm → Rp are continuous maps, then the map h = g ◦ f :
Rn → Rp is continuous, too.
LIMITS AND CONTINUITY 77

Definition 4.41 Let f : E ⊆ Rn → Rm and let u ∈ Rn , u ̸= 0, a ∈ E. The function

f is said to be continuous at the point a in the direction of the vector u if there exists
lim f (a + h u) = f (a).
h→0

Notice that, for the existence of the above limit, we need that a+h u ∈ E, for h → 0.

Remark 4.42 If f is continuous at the point a, then f is continuous at the point

a in any direction u ̸= 0.

The converse implication is, in general, false.

Remark 4.43 Usually, as in the case of directional limits, we shall work with unit
vectors, i.e. we shall consider that ∥u∥ = 1.

Definition 4.44 Let (X, d) and (Y, ρ) be two metric spaces. A function f : (X, d) →
(Y, ρ) is called uniformly continuous on X if for any ε > 0, there exists δε > 0 such
that for any x ′ , x ′′ ∈ X with d(x ′ , x ′′ ) < δε , it follows that ρ(f (x ′ ), f (x ′′ )) < ε.

Remark 4.45 If f is uniformly continuous on X, then f is continuous on X. The

converse implication is, in general, false.

Indeed, it is easy to see that the function f : R → R, f (x) = x2 is not uniformly

continuous on R, despite the fact that it is obviously continuous on R.

Remark 4.46 1) Let f : R → R. If f is bounded and monotone, then f is

uniformly continuous on R.
2) If f : R → R is uniformly continuous on R, then ∃ a, b ≥ 0 such that

| f (x) |≤ a | x | + b,

for any x ∈ R.

Definition 4.47 Let K = R, C and X and Y be two vector spaces over K. A map
T : X → Y is called linear if

T (αx + βy) = αT (x) + βT (y), ∀x, y ∈ X, α, β ∈ K.

Let us notice that for a linear map,

T (0) = 0.
78 REAL ANALYSIS

Exercise 4.48 Let K = R or K = C and let X be a normed space over K. Also,

let f, g : X → K. If f and g are continuous and α, β ∈ K, show that αf + βg, f g,
f /g, for g ̸= 0, are continuous, too.

Exercise 4.49 Let f : A ⊆ Rn → Rm and a ∈ A ′ . Prove that f is continuous at

the point a if and only if the limit lim f (x) exists and equals f (a). Notice that if a
x→a
is an isolated point for A, then f is continuous at a.

Exercise 4.50 Let f : A ⊆ Rn → Rm , f = (f1 , . . . , fm ) and let a ∈ A ′ . Prove that

f is continuous at the point a if and only if f1 , . . . , fm are continuous at the point
a.
′
Exercise 4.51 If f : A ⊆ Rn → C and a ∈ A , then f is continuous at the point a
if and only if Re (f ) and Im (f ) are continuous at the point a.

Exercise 4.52 If (X, ∥ · ∥) is a normed space, show that the map ∥ · ∥ is continuous.

Exercise 4.53 Prove that the function f : (0, ∞) → R, defined by

2x
f (x) = +x
1+x

is uniformly continuous on R.

Solution. Taking x1 , x2 ∈ (0, ∞), we have

2x1 2x2
f (x1 ) − f (x2 ) = + x1 − − x2
1 + x1 1 + x2

2
≤| x1 − x2 | 1 + < 3 | x1 − x2 | .
(x1 + 1)(x2 + 1)
ε
Therefore, for any ε > 0, there exists δε = > 0 such that for any x1 , x2 ∈ (0, ∞)
3
with | x1 − x2 |< δε , we obtain

| f (x1 ) − f (x2 ) |< 3 | x1 − x2 |< 3δε = ε.

Thus, f is uniformly continuous on (0, ∞).

LIMITS AND CONTINUITY 79

Exercise 4.54 Show that the function f : (0, 3) → R, defined by

1
f (x) = ,
x2
is not uniformly continuous on (0, 3).

Solution. To prove that f is not uniformly continuous on the interval (0, 3), it suffices
to prove that there exists ε0 > 0 and there exist two sequences (xn ) and (yn ), with
d(xn , yn ) < δ, but with ρ(f (xn ), f (yn )) ≥ ε0 , for any n ≥ n0 . Indeed, taking ε0 = 1
and
1 1
xn = √ , y n = √ ,
n n+1
it follows that | xn − yn |→ 0, while | f (xn ) − f (yn ) |= 1 = ε0 > 0. So, the function
f is not uniformly continuous (0, 3).

Exercise 4.55 (Heine-Cantor) Let (X, d) and (Y, ρ) be metric spaces. If (X, d) is
compact and f : (X, d) → (Y, ρ) is continuous on X, then f is uniformly continuous
on X.

Solution. Let us suppose that f is continuous, but not uniformly continuous on X.

Therefore, there exists ε0 > 0 such that for any δ > 0 there exist xδ , yδ ∈ X with
d(xδ , yδ ) < δ and ρ(f (xδ ), f (yδ )) ≥ ε0 . In particular, for any n ∈ N∗ , there exist
xn , yn ∈ X such that
1
d(xn , yn ) < (4.1)
n
and
ρ(f (xn ), f (yn )) ≥ ε0 . (4.2)

Since X is compact, there exists a subsequence (xnk ) of the sequence (xn ) and there
exists an element x ∈ X such that

lim xnk = x. (4.3)

k→∞

In a similar manner, there exist a subsequence (ynk ) of the sequence (yn ) and an
element y ∈ X such that
lim ynk = y. (4.4)
k→∞
80 REAL ANALYSIS

Since
d(ynk , x) ≤ d(ynk , xnk ) + d(xnk , x),

it follows immediately that x = y.

Using the continuity of f , (4.3) and (4.4), it follows that there exists n0 ∈ N such
that
ε0
ρ(f (xnk ), f (x)) <
4
and
ε0
ρ(f (ynk ), f (x)) <
4
for any k ≥ n0 . Thus,

ε0
ρ(f (xnk ), f (ynk )) < , ∀k ≥ n0 ,
2

which contradicts (4.2). Hence, f is uniformly continuous on X.

Remark 4.56 Let us notice that a contraction mapping between two metric spaces
is uniformly continuous.

Exercise 4.57 Let I ⊆ R be an open interval and f : I → R be derivable on I. If

its derivative is bounded on I, then f is uniformly continuous on I.

Solution. Let M > 0 such that | f ′ (x) |≤ M , for all x ∈ I. Using Lagrange’s
theorem, it follows that for any x, y ∈ I there exists θ between x and y such that

f (x) − f (y) = f ′ (θ)(x − y).

So,
| f (x) − f (y) |≤ M | x − y |, for all x, y ∈ I.
ε
Let ε > 0 and δε = . Therefore, for any x, y ∈ I with | x − y |< δε , we obtain
M
ε
| f (x) − f (y) |≤ M = M,
M

which implies that f is uniformly continuous on I.

LIMITS AND CONTINUITY 81

Exercise 4.58 Show that the function f : R → R defined by

f (x) = 7x + cos x,

is uniformly continuous on R.

Solution. The function f is obviously continuous and it is also uniformly continuous

on R, since it is derivable and its derivative is bounded.

Exercise 4.59 Let f : K ⊆ R → R, with K compact. If f is continuous on K, then

f is bounded on K and attains its maximum and minimum values on K, i.e. there
exist a, b ∈ K such that f (a) = inf f (K) and f (b) = sup f (K).

Solution. Since K is compact and f : K → R is continuous, it follows that f (K) is

compact in R, i.e. it is bounded and closed. Let m = inf f (K) and M = sup f (K).
Therefore, m, M ∈ f (K) = f (K) and, hence, there exist a, b ∈ K such that m =
f (a) and M = f (b).

Exercise 4.60 Let f : (X, d) → (Y, ρ) be a continuous function. If K ⊆ X is

compact, then f (K) is compact. If A ⊆ X is connected, then f (A) is connected.

Solution. Let (Fα )α∈A be a family of open sets such that

∪
f (K) ⊆ Fα .
α∈A

It follows that
∪ ∪
K ⊆ f −1 (f (K)) ⊆ f −1 ( Fα ) = f −1 (Fα ).
α∈A α∈A

Since f is continuous and (Fα )α∈A is a family of open sets, it follows that f −1 (Fα ) ∈
D. Using the fact that K is compact, there exists J finite, J ⊆ A such that
∪
K⊆ f −1 (Fα )
α∈J

and, so,
∪
f (K) ⊆ Fα .
α∈J
Thus, f (K) is compact.
82 REAL ANALYSIS

Exercise 4.61 Let X/K , K = R or K = C, be a compact space and let us consider

the space
C(X) = {f : X → K | f is continuous on X},
endowed with the uniform norm, i.e.

∥f ∥u = sup | f (t) |< ∞.

t∈X

Prove that C(X) is a Banach space.

Exercise 4.62 Let f : (X, d) → (Y, ρ) be a continuous function. If A ⊆ X is

connected, then f (A) is connected. So, connectedness is preserved by continuous
maps. This result can be considered as being a generalization of the intermediate
value theorem.

Solution. We shall argue by contradiction. Let us suppose that f (A) is not a

connected set. Then, there exist D1 , D2 ⊆ Y open sets such that


 f (A) ⊆ D1 ∪ D2 ,




f (A) ∩ D1 ∩ D2 = ∅,






f (A) ∩ Di ̸= ∅, ∀i = 1, 2.

Since f is continuous, it follows that f −1 (Di ) ∈ D, ∀i = 1, 2. Therefore,



 A ⊆ f −1 (D1 ) ∪ f −1 (D2 ),




A ∩ f −1 (D1 ) ∩ f −1 (D2 ) = ∅,






A ∩ f −1 (Di ) ̸= ∅, ∀i = 1, 2.

So, A is not connected, which contradicts our hypotheses. Thus, our assumption is
false and, hence, f (A) is connected.

Exercise 4.63 Let (X, D) be a topological space and f : (X, D) → (R, DR ). If f is

continuous on X, prove that f (X) is an interval.

Solution. The result is an easy consequence of Exercise 4.62.

LIMITS AND CONTINUITY 83

Exercise 4.64 Show that every product of a family of connected spaces is also
connected.

Exercise 4.65 Let X and Y be two normed spaces. If T : X → Y is linear and

continuous at a point a ∈ X, then T is continuous on X.

Solution. Let x0 ∈ X. Since T is continuous at the point a, it follows that for any
ε > 0 there exists δε > 0 such that for any x ∈ X with ∥x − a∥ < δε , we have

∥T (x) − T (a)∥ < ε.

Let t ∈ X, with ∥t − x0 ∥ < δε , and x = a + (t − x0 ). Obviously, x − a = t − x0 and

∥x − a∥ = ∥t − x0 ∥ < δε . Since T is continuous at the point a and ∥x − a∥ < δε , we
get
∥T (x) − T (a)∥ < ε.

From the linearity of T , we obtain

T (x) = T (a + (t − x0 )) = T (a) + T (t) − T (x0 ).

Thus,
T (x) − T (a) = T (t) − T (x0 ),

which implies that

∥T (t) − T (x0 )∥ < ε,

for any t with ∥t − x0 ∥ < δε . Hence, T is continuous at any point x0 ∈ X.

Exercise 4.66 Let X and Y be two normed spaces and T : X → Y be a linear

map. Show that T is continuous on X if and only if there exists M ≥ 0 such that

∥T (x)∥ ≤ M ∥x∥, ∀x ∈ X.

Solution. Let us prove the implication (i) ⇒ (ii). This is equivalent, in fact, to
proving that non (ii) ⇒ non (i). Thus, let us suppose that for any M ≥ 0, there
exists xM ∈ X such that
∥T (xM )∥ > M ∥xM ∥.
84 REAL ANALYSIS

In particular, taking M = n ∈ N∗ , it follows that there exists xn ∈ X such that

∥T (xn )∥ > n∥xn ∥.

So, ( )
1
∥T xn ∥ > 1, ∀n ∈ N∗ ,
n∥xn ∥
which means that
1
T( xn ) 9 0.
n∥xn ∥
On the other hand,
1
lim xn = 0.
n→∞ n∥xn ∥
Hence, since ( )
1
T xn 9 T (0),
n∥xn ∥
it follows that T is not continuous at the point 0.
(ii) ⇒ (i). Let a ∈ X. Since T is linear, we get

∥T (x) − T (a)∥ = ∥T (x − a)∥.

Therefore, there exists M > 0 with

∥T (x − a)∥ ≤ M ∥x − a∥,

which means that

∥T (x) − T (a)∥ ≤ M ∥x − a∥.

Hence, T is continuous at any point a ∈ X.

Exercise 4.67 Let Y be a normed space. If T : Rn → Y is linear, then T is

continuous on Rn .

Solution. Let {e1 , . . . , en } be the canonical basis of Rn and x = (x1 , . . . , xn ) ∈ Rn .

Therefore,
∑
n
x= xi ei .
i=1
LIMITS AND CONTINUITY 85

Using the linearity of T , we obtain

∑
n ∑
n
∥T (x)∥ = ∥T ( xi ei )∥ = ∥ xi T (ei )∥ ≤
i=1 i=1

∑
n ∑
n ∑
n
∥xi T (ei )∥ = |xi |∥T (ei )∥ ≤ ∥x∥ ∥T (ei )∥.
i=1 i=1 i=1

∑
n
Denoting by M = ∥T (ei )∥, we get
i=1

∥T (x)∥ ≤ M ∥x∥, for any x ∈ Rn .

Thus, the map T is continuous on Rn .

Exercise 4.68 Let

 √

 1 − cos x2

 , x ∈ [−π/2, π/2] \ {0},
f (x) = 1 − cos x



 a, x = 0.

Find the values of a for which f is continuous.

Exercise 4.69 Let




sin a(x − 1)
 6 , x ∈ [0, 1),
f (x) = x−1



−a + 5x, x ∈ [1, 2].

Find the values of a for which f is continuous.

Exercise 4.70 Test the following function for continuity:

 xy

 (x, y) ̸= (0, 0),
 x2 + y 2 ,
f (x, y) =



0, (x, y) = (0, 0).
86 REAL ANALYSIS

Exercise 4.71 Test the following function for continuity:

 xy
 (x, y) ̸= (0, 0),
 √x2 + y 2 ,

f (x, y) =



0, (x, y) = (0, 0).

Exercise 4.72 Test the following function for continuity:


 1
 2 2
 (x + y ) sin , (x, y) ̸= (0, 0),
x2 + y2
f (x, y) =



0, (x, y) = (0, 0).

Exercise 4.73 Test the following function for continuity:



 x2 y

 , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2



 0, (x, y) = (0, 0).

Exercise 4.74 Let



 | x |α | y |β

 , (x, y) ̸= (0, 0),
2
(x + y )2 γ
f (x, y) =




0, (x, y) = (0, 0).

Prove that f is continuous ⇔ α + β > 2γ.

Exercise 4.75 Test the following function for continuity:



 x2

 , y ̸= 0,
f (x, y) = y



 0, y = 0.

Exercise 4.76 Let



 1 − cos(x3 + y 3 )

 , (x, y) ̸= (0, 0),
2 2
x +y
f (x, y) =



 0, (x, y) = (0, 0).

Test this function for continuity and directional continuity at the point (0, 0).
LIMITS AND CONTINUITY 87

Exercise 4.77 Let



 x2 y 2

 , (x, y) ̸= (0, 0),
x2 y 2 + (x2 − y)2
f (x, y) =



 0, (x, y) = (0, 0).

Test this function for continuity and directional continuity at the point (0, 0).

Exercise 4.78 Let



 |x| y 2

 √ , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2




0, (x, y) = (0, 0).

Test this function for continuity and directional continuity at the point (0, 0).

Exercise 4.79 Test the following function for continuity:


 1
 |x| sin
 , (x, y) ̸= (0, 0),
x2 + y2
f (x, y) =



0, (x, y) = (0, 0).

Exercise 4.80 Show that the function f : R → R, given by

√
f (x) = 1 + x2 ,

is uniformly continuous on R.

Exercise 4.81 Prove that the function f : (0, π/2) → R, defined by

f (x) = sin x,

is uniformly continuous on (0, π/2).

Exercise 4.82 Show that the function f : (0, ∞) → R, defined by

x
f (x) = x + ,
1+x
is uniformly continuous on (0, ∞).
88
Chapter 5

Multivariable Differential
Calculus

5.1 Derivable Functions

In what follows, we shall work only with real Banach spaces.

Definition 5.1 Let E and F be Banach spaces, ∅ ̸= U ⊆ E, U open, a ∈ U . Also,

let f : U → F . The function f is said to be derivable or Fréchet differentiable at
the point a if there exists f ′ (a) ∈ L(E, F ) such that

∥f (x) − f (a) − f ′ (a) ◦ (x − a)∥

lim = 0. (5.1)
x→a ∥x − a∥
x ̸= a

f ′ (a) is called the derivative of the function f at the point a.

Remark 5.2 If we put



 f (x) − f (a) − f ′ (a) ◦ (x − a)

 , ∀x ∈ U \ {a},
∥x − a∥
ωf,a (x) =



 0 ,
F x = a,

then the condition (5.1) becomes

lim ωf,a (x) = 0F .

x→a

89
90 REAL ANALYSIS

So, f is derivable at the point a if there exist f ′ (a) ∈ L(E, F ) and ωf,a : U → F
such that

f (x) = f (a) + f ′ (a) ◦ (x − a) + ∥x − a∥ωf,a (x), ∀x ∈ U (5.2)

and
lim ωf,a (x) = 0F . (5.3)
x→a

Theorem 5.3 (Uniqueness of the Derivative) If f : U ⊆ E → F is derivable at the

point a ∈ U , then there exists only one linear mapping f ′ (a) ∈ L(E, F ) such that
(5.1) holds true.

Notice that due to the uniqueness of the derivative f ′ (a) ∈ L(E, F ), we can define
a map
f ′ : U → L(E, F ).

Also, notice that the domain of the linear mapping f ′ (a) is the entire space E,
despite the fact that the function f is defined only locally about the point a.

Proposition 5.4 If the function f : U ⊆ E → F is derivable at the point a ∈ U ,

then f is continuous at the point a.

Exercise 5.5 If f : U ⊆ E → F is constant on U , then f is derivable on U and

f ′ (a) = 0, ∀a ∈ U .

Solution. Obviously, we have f (x) = f (a) + 0 ◦ (x − a), ∀x ∈ U . Therefore, f is

derivable at the point a and f ′ (a) = 0.

Exercise 5.6 If f ∈ L(E, F ), then f is derivable at any point a ∈ E and f ′ (a) =

f, ∀a ∈ E.

Solution. Since f is linear, then

f (x) − f (a) − f (x − a) 0
= = 0, ∀x ∈ E \ {a}.
∥x − a∥ ∥x − a∥

So, f is derivable at any point a ∈ E and f ′ (a) = f, ∀a ∈ E.

MULTIVARIABLE DIFFERENTIAL CALCULUS 91

Exercise 5.7 (Linearity of the Derivative) Let E and F be Banach spaces, U ⊆ E,

U open, a ∈ U . Also, let f, g : U → F . If f and g are differentiable at the point a,
then the sum f + g is differentiable at the point a and

(f + g) ′ (a) = f ′ (a) + g ′ (a).

Moreover, if α ∈ R, then αf is differentiable at the point a and

(αf ) ′ (a) = αf ′ (a).

Theorem 5.8 (Chain Rule) Let E, F, G be Banach spaces, ∅ ̸= U ⊆ E, ∅ ̸= V ⊆ F ,

U, V open. If f : U → V is derivable at the point a ∈ U and g : V → G is derivable
at the point f (a) , then g ◦ f is derivable at the point a and

(g ◦ f ) ′ (a) = g ′ (f (a)) ◦ f ′ (a).

Remark 5.9 If f ′ is continuous on U , we shall say that f is continuously diffe-

rentiable on U . We shall use the following notation:

C 1 (U, F ) = {f : U → F | f is continuously differentiable on U }.

Definition 5.10 Let E, F be Banach spaces, ∅ ̸= U ⊆ E, U open, f : U → F, a ∈

U . The function f is said to be twice (two-times) differentiable at the point a if:
1) ∃V ∈ V(a), V open, such that f is derivable on V ;
2) f ′ : V → L(E, F ) is derivable at the point a.
The derivative of f ′ at the point a is denoted by f ′′ (a) and it is called the second
derivative of f at the point a.

Remark 5.11 If the function f is two-times differentiable on U and the map

f ′′ : U → L(E, L(E, F ))

is continuous on U , then we shall say that f is twice continuously differentiable on

U and we shall use the notation:

C 2 (U, F ) = {f : U → F | f is twice continuously differentiable on U }.

92 REAL ANALYSIS

Remark 5.12 f ′′ (a) ∈ L(E, L(E, F )) ≃ L2 (E, E; F ).

By usual induction, we can define

C n (U, F ) = {f : U → F | f is n-times continuously differentiable on U }.

Putting
C 0 (U, F ) = {f : U → F | f is continuous on U },
we can define
∩
C ∞ (U, F ) = C n (U, F ).
n∈N
A function f ∈ C ∞ (U, F ) is said to be infinitely (indefinitely) derivable on U .

Definition 5.13 Let X be a vector space and let A ⊆ X. The set A is said to be
convex if for any x, y ∈ A the segment [x, y] ⊆ A, i.e. for any x, y ∈ A and for any
t ∈ [0, 1], we have
(1 − t)x + ty ∈ A.

Definition 5.14 Let A ⊆ X be a convex set. The function f : A → R is called

convex if for any x, y ∈ A and for any t ∈ [0, 1], it follows that

f ((1 − t)x + ty) ≤ (1 − t)f (x) + tf (y).

Proposition 5.15 Let E be a Banach space. If f : [a, b] → E is continuous on

[a, b], derivable on (a, b) and if there exists M ≥ 0 such that ∥f ′ (t)∥ ≤ M , for any
t ∈ (a, b), then
∥f (b) − f (a)∥ ≤ M (b − a).

Theorem 5.16 (The first theorem of finite increments) Let f : U ⊆ E → F ,

∅ ̸= U open and convex. If f is derivable on U , then

∥f (v) − f (u)∥ ≤ ∥v − u∥ sup ∥f ′ (x)∥, ∀u, v ∈ U.

x∈[u,v]

Corollary 5.17 Let f : U ⊆ E → F , where ∅ ̸= U is open and convex. If f is

derivable on U and if there exists M ≥ 0 such that ∥f ′ (x)∥ ≤ M , for any x ∈ U , it
follows that
∥f (v) − f (u)∥ ≤ M ∥v − u∥, ∀u, v ∈ U.
MULTIVARIABLE DIFFERENTIAL CALCULUS 93

Theorem 5.18 (The second theorem of finite increments) If f : U ⊆ E → F ,

∅ ̸= U open and convex, is derivable on U , then

∥f (b)−f (a)−f ′ (c)◦(b−a)∥ ≤ ∥b−a∥ sup ∥f ′ (x)−f ′ (c)∥, ∀a, b ∈ U, c ∈ [a, b].
x∈[a,b]

We consider now the case in which

E = Rn , F = Rm .

Exercise 5.19 Let ∅ ̸= U ⊆ Rn be an open set and a ∈ U . Show that if the functions
f, g : U → R are derivable at the point a, then f ± g, λf, λ ∈ R, f g, f /g, g ̸= 0,
are derivable at the point a. Moreover, if f is injective and continuous on U and
f ′ (a) ̸= 0, prove that the inverse function f −1 is derivable at the point b = f (a) and

′ 1
(f −1 ) (f (a)) = ′ (a)
.
f

Proposition 5.20 (Chain Rule) Let U, V ⊆ R be open nonempty sets and let f :
U → R and g : V → R such that f (U ) ⊆ V . If f is derivable at the point a ∈ U and
g is derivable at the point b = f (a) ∈ V , then g ◦ f is derivable at the point a and

(g ◦ f ) ′ (a) = g ′ (f (a))f ′ (a).

Exercise 5.21 Let f : R → R,


 1
 2
 x sin , x ̸= 0,
f (x) = x



0, x = 0.

Prove that f is derivable on R, but f is not a C 1 function on R.

Exercise 5.22 Prove that

2x
2 arctan x + arcsin = π sgn x, ∀ | x |≥ 1.
1 + x2
94 REAL ANALYSIS

Let us consider now briefly another important case, i.e. the case in which E = Rn
and F = Rm . So, let ∅ ̸= U ⊆ Rn be an open set, f : U → Rm and a ∈ U . If

f = (f1 , . . . , fm ),

then f is derivable at the point a if and only if each component fi , with i = 1, m, is

derivable at the point a ( the componentwise nature of differentiability).

Example 5.23 The function f : R2 → R3 defined by

f (x, y) = (x2 + y 2 , xy, x3 + y 3 )

is obviously differentiable on R2 , since its three components are composed of ele-

mentary functions.

Definition 5.24 Let us define

pi : Rn → R, pi (x) = xi , ∀x = (x1 , . . . , xn ) ∈ Rn

pi are called the canonical projections.

Remark 5.25 pi are linear and continuous. Thus, they are are derivable.

Theorem 5.26 Let f : U ⊆ Rn → R, U open and nonempty. If f is derivable at the

point a ∈ U , then f is partial derivable with respect to each variable xi , 1 ≤ i ≤ n,
at the point a and
∑n
∂f
f ′ (a) = (a) pi .
i=1
∂xi

Proposition 5.27 Let ∅ ̸= U ⊆ Rn , U open, f : U → Rm derivable at the point

a ∈ U . The matrix associated to the linear map f ′ (a) : Rn → Rm in the canonical
bases of Rn and Rm , called the Jacobi matrix, is
 
∂f1 ∂f1
 ∂x (a) · · · ∂x (a) 
 1 n 
 
 
 
Mf (a) =  .............................. 
 
 
 
 ∂fm ∂fm 
(a) · · · (a)
∂x1 ∂xn
MULTIVARIABLE DIFFERENTIAL CALCULUS 95

If m = n, the determinant
Jf (a) = det Mf (a)

is called the Jacobian of the function f at the point a.

If f : U ⊆ Rn → Rn , U open and nonempty and if f = (f1 , . . . , fn ), we shall

denote the Jacobian of the vector valued function f at the point a by

∂(f1 , ..., fn )
Jf (a) = (a).
∂(x1 , . . . , xn )

Exercise 5.28 Compute the Jacobi matrix at the point (1, 1) for the function f :
R2 → R2 defined by
f (x, y) = (x2 + y 2 , 2xy).

Solution. It is easy to see that

 
2 2
 
Mf (1, 1) =  
2 2

and its Jacobian is Jf (1, 1) = 0.

Theorem 5.29 Let U be an open nonempty set in Rn and f : U → R. Then,

∂f
f ∈ C 1 (U ) if and only if f is derivable with respect to each variable xi and :
∂xi
U → L(R, R), 1 ≤ i ≤ n, are continuous.

Usually, we denote the canonical projections pi by

pi = dxi

and we call dxi the differential of xi . So, f ′ (a) ∈ L(Rn , R) and

∑
n
∂f
f ′ (a) = (a) dxi , (5.4)
i=1
∂xi

where
∂f f (a1 , . . . , ai−1 , xi , ai+1 , . . . , an ) − f (a1 , . . . , ai−1 , ai , ai+1 , . . . , an )
(a) = lim .
∂xi xi →ai xi − ai
96 REAL ANALYSIS

In fact, {p1 , . . . , pn } is the canonical basis for L(Rn , R) and, so, (5.4) is just the
unique representation of the linear map f ′ (a) in this basis. The partial derivatives
∂f
(a) are exactly the coefficients of f ′ (a) in the canonical basis.
∂xi
Since f ′ (a) ∈ L(Rn , R) ≃ Rn , the derivative f ′ (a) can be also regarded as being the
vector
∂f ∂f
f ′ (a) ≃ ( (a), . . . , (a)).
∂x1 ∂xn
Remark 5.30 Let ∅ ̸= U ⊆ Rn , U open, f : U → R derivable at the point a ∈ U .
Then, there exists a unique vector y ∈ Rn such that

f ′ (a)(x) = ⟨x, y⟩.

This vector is denoted by grada f and it is called the gradient of the function f at
the point a.

Exercise 5.31 Let f : R2 → R be defined by

√
f (x, y) = x2 + y 2 .

Prove that f is not differentiable at the point (0, 0).

Solution. If f would be differentiable at the point (0, 0), then its partial derivatives
at the point (0, 0) would exist. In this case,
∂f f (x, 0) − f (0, 0) |x|
(0, 0) = lim = lim
∂x x→0 x−0 x→0 x

and
∂f f (0, y) − f (0, 0) |y|
(0, 0) = lim = lim .
∂y y→0 y−0 y→0 y
But these limits don’t exist and, hence, f is not differentiable at the point (0, 0).

Exercise 5.32 Define f : R2 → R as follows:

 xy

 (x, y) ̸= (0, 0),
 x2 + y 2 ,
f (x, y) =



0, (x, y) = (0, 0).

Test it for differentiability at the point (0, 0).

MULTIVARIABLE DIFFERENTIAL CALCULUS 97

Solution. If f would be differentiable at the point (0, 0), then f would be continuous
at the point (0, 0), i.e. lim f (x, y) = f (0, 0). But lim f (x, y) doesn’t
(x,y)→(0,0) (x,y)→(0,0)
even exist and, hence, f is not differentiable at the point (0, 0). Still, the partial
∂f ∂f
derivatives (0, 0) and (0, 0) exist and are equal to zero.
∂x ∂x
Exercise 5.33 Test the following function for differentiability:


 x2 y

 , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2



 0, (x, y) = (0, 0).

Solution. Obviously, f is differentiable on R2 \ {(0, 0)} and

∂f ∂f 2ab3 a2 (a2 − b2 )
f ′ (a, b) = ( (a, b), (a, b)) = ( 2 , ),
∂x ∂y (a + b2 )2 (a2 + b2 )2

for any (a, b) ̸= (0, 0).

Let us see now what happens at the origin. It is easy to see that f is continuous
at the point (0, 0) and its first partial derivatives exist. Indeed,

∂f f (x, 0) − f (0, 0) 0
(0, 0) = lim = lim = 0
∂x x→0 x−0 x→0 x

∂f
and, in a similar manner, (0, 0) = 0. Therefore, if the function f would be
∂y
differentiable at the point (0, 0), then the derivative of f at this point should be the
zero map and

f (x, y) − f (0, 0) − f ′ (0, 0) ◦ (x − 0, y − 0)

lim = 0,
(x, y) → (0, 0) ∥(x − 0, y − 0)∥

i.e.
x2 y
x2 + y 2
lim √ = 0.
(x, y) → (0, 0) x2 + y 2

But this limit doesn’t exist and, hence, f is not differentiable at the origin.
98 REAL ANALYSIS

Exercise 5.34 Define f : R2 → R as follows:



 1 x = y ̸= 0,
f (x, y) =

 0 otherwise.

Show that f is not continuous at the point (0, 0), but both partial derivatives
∂f ∂f
(0, 0) and (0, 0) exist.
∂x ∂x
Solution It is easy to see that if we let (x, y) to approach the origin along the line
x = y, then
lim f (x, y) = 1 ̸= f (0, 0)
(x,y)→(0,0)

and this implies the fact that f is not continuous at the origin. However, both
partial derivatives exist at the origin. Indeed,

∂f f (x, 0) − f (0, 0) 0
(0, 0) = lim = lim = 0
∂x x→0 x−0 x→0 x

∂f
and, in a similar manner, (0, 0) = 0.
∂y

Exercise 5.35 Let f : R2 → R be defined by

f (x, y) = ln(1 + 2x2 + 3y 2 ).

Compute f ′ (1, 2).

Exercise 5.36 Test the following function for differentiability:

 xy
 (x, y) ̸= (0, 0),
 √ 2

x + y2
,
f (x, y) =



0, (x, y) = (0, 0).

Exercise 5.37 Test the following function, defined on R2 , for differentiability:


 1
 2 2
 (x + y ) sin , (x, y) ̸= (0, 0),
x2 + y2
f (x, y) =



0, (x, y) = (0, 0).
MULTIVARIABLE DIFFERENTIAL CALCULUS 99

Exercise 5.38 Test the following function for differentiability:



 x2 y 3

 , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2



 0, (x, y) = (0, 0).

Partial derivatives of higher order.

Let f : U ⊆ Rn → R. Then,

f ′′ (a) ∈ L2 (Rn , Rn ; R).

Theorem 5.39 (Schwarz) Let f : U ⊆ Rn → R, ∅ ̸= U open. If f is two-times

derivable at the point a ∈ U , then


 ∂2f ∂2f

 (a) = (a), ∀i, j = 1, n,


 ∂xi ∂xj ∂xj ∂xi
(5.5)

 ∑
n

 ′′ (a) = ∂2f



f (a) pi ⊗ pj .
i,j=1
∂xi ∂xj

In (5.5),
∂f ∂f
(a1 , . . . , xi , . . . , an ) − (a1 , . . . , ai , . . . , an )
∂2f ∂xj ∂xj
(a) = lim
∂xi ∂xj xi →ai xi − ai
and pi ⊗ pj is the tensor product of the linear maps pi and pj , defined by

pi ⊗ pj : Rn × Rn → R, (pi ⊗ pj )(x, y) = pi (x)pj (y) = xi yj .

In fact, {pi ⊗ pj }1≤i,j≤n is the canonical basis of L2 (Rn , Rn ; R). So, (5.5) is the
unique representation of the bilinear map f ′′ (a) in this basis. The mixed partial
∂2f
derivatives (a) are the coefficients of f ′′ (a) in the canonical basis.
∂xi ∂xj
Just as the Jacobi matrix was defined for representing (in the canonical bases)
the first derivative f ′ (a) of a function f : U ⊆ Rn → Rm which is derivable at the
point a ∈ U , in the case of the second derivative, for a function f taking values in
R, we have the following analogue representation of the second derivative:
100 REAL ANALYSIS

Theorem 5.40 Let ∅ ̸= U ⊆ Rn be an open set and f : U → R be a twice differen-

tiable function on U . Then, the second derivative of f at the point a is determined,
in the canonical basis, by the Hessian matrix:
 
∂2f ∂2f
 ∂x2 (a) · · · (a) 
 1 ∂x1 ∂xn 
 
 
 
Hf (a) =  ................................. 
 
 
 
 ∂2f ∂2f 
(a) · · · (a)
∂xn ∂x1 ∂x2n

Exercise 5.41 Let f : R3 → R be given by

f (x, y, z) = xy 2 z 3 .

Then,  
0 2yz 3 3y 2 z 2
 
 
 
Hf (x, y, x) =  2yz 3 2xz 3 6xyz 2 .
 
 
3y 2 z 2 6xyz 2 6xy 2 z

Remark 5.42 If f ∈ C 2 (U ), then

∂2f ∂2f
(a) = (a), ∀i, j = 1, n.
∂xi ∂xj ∂xj ∂xi

Remark 5.43 The existence of the mixed partial derivatives of the second order for
a given function doesn’t imply their symmetry.

As a counterexample, it is not difficult to see that for the function f : R2 → R,

defined by: 
 xy x − y , (x, y) ̸= (0, 0),
 2 2


f (x, y) = x2 + y 2



 0, (x, y) = (0, 0),
one has
∂2f ∂2f
(0, 0) ̸= (0, 0).
∂x∂y ∂y∂x
MULTIVARIABLE DIFFERENTIAL CALCULUS 101

∂2f
Indeed, let us compute (0, 0). We get:
∂x∂y

∂f ∂f
(x, 0) − (0, 0)
∂2f ∂y ∂y
(0, 0) = lim .
∂x∂y x→0 x−0

But
∂f f (x, y) − f (x, 0)
(x, 0) = lim =x
∂y y→0 y−0
and
∂f f (0, y) − f (0, 0)
(0, 0) = lim = 0.
∂y y→0 y−0
So,
∂2f x−0
(0, 0) = lim = 1.
∂x∂y x→0 x − 0

∂2f
On the other hand, computing (0, 0), we obtain:
∂y∂x

∂f ∂f
∂2f (0, y) − (0, 0)
(0, 0) = lim ∂x ∂x .
∂y∂x y→0 y−0

But
∂f f (x, y) − f (0, y)
(0, y) = lim = −y
∂x x→0 x−0
and
∂f f (x, 0) − f (0, 0)
(0, 0) = lim = 0.
∂x x→0 x−0
So,
∂2f −y − 0
(0, 0) = lim = −1.
∂y∂x y→0 y − 0

Hence,
∂2f ∂2f
(0, 0) ̸= (0, 0).
∂x∂y ∂y∂x

As already mentioned, for simplicity, we shall use the notation:

pi = dxi .
102 REAL ANALYSIS

Also, we shall usually omit to write explicitly the symbol ” ⊗ ”. So, we have:
∑
n
∂2f
f ′′ (a) = (a) dxi dxj .
i,j=1
∂xi ∂xj

For the particular case n = 2, we get

∂2f ∂2f ∂2f ∂2f

f ′′ (a, b) = (a, b) dx 2
+ (a, b) dx dy + (a, b) dy dx + (a, b) dy 2 .
∂x2 ∂x∂y ∂y∂x ∂y 2

Remark 5.44 For m ≥ 2, by induction, we get

∂mf ∂mf
(a) = (a),
∂x1 · · · ∂xm ∂xσ(1) · · · ∂xσ(m)

for any permutation σ : {1, . . . , m} → {1, . . . , m}, and

∑
n
∂mf
f (m)
(a) = (a) pi1 ⊗ · · · ⊗ pim .
i1 ,...,im =1
∂xi1 · · · ∂xim

Exercise 5.45 Verify that the function f : R2 → R, defined by f (x, y) = ex cos y is

a solution of Laplace’s equation, i.e.

∂2f ∂2f
+ = 0.
∂x2 ∂y 2

Solution. Indeed, since f ∈ C 2 (R2 ), we have

∂2f
= ex cos y
∂x2
and
∂2f
= −ex cos y.
∂y 2
Therefore, their sum is zero.

Exercise 5.46 Compute the second derivative at the point (1, 1) of the function
f : R2 → R, defined by:
2 2
f (x, y) = ex +y .
MULTIVARIABLE DIFFERENTIAL CALCULUS 103

Solution. Obviously, f ∈ C 2 (R2 ) and it is not difficult to compute its second order
partial derivatives at the point (1, 1). As a result, we get

f ′′ (1, 1) = 6 e2 dx2 + 4 e2 dx dy + 4 e2 dy dx + 6 e2 dy 2 .

Exercise 5.47 Compute the first and the second differential for the function f :
R2 → R, f (x, y) = x3 + y 3 + ln (2 + x2 + y 2 ) at the point (1, 1).

Exercise 5.48 Compute the second derivative at the point (2, 2) of the function
f : R2 → R2 , defined by

f (x, y) = (x4 + y 4 , x2 + y 2 ).

Exercise 5.49 For the function f : R2 → R, defined by:



 x2 − y 2

 xy sin 2 , (x, y) ̸= (0, 0),
2
x +y
f (x, y) =



 0, (x, y) = (0, 0),

prove that
∂2f ∂2f
(0, 0) ̸= (0, 0).
∂x∂y ∂y∂x

Exercise 5.50 Compute the first and the second differential at the point (1, 1) for
the function f : R2 → R, defined by

f (x, y) = sin (x2 + y 2 ).

Definition 5.51 Let U be a nonempty open set in Rn and let f : U → Rm . Also,

let u ∈ Rn , u ̸= 0. If there exists

f (a + tu) − f (a)
δf (a, u) = lim ∈ Rm ,
t→0 t

then δf (a, u) is called the derivative of the function f , at the point a, in the direction
u.
104 REAL ANALYSIS

Sometimes, we shall use similar notation, i.e.

∂f
δf (a, u) = (a)
∂u
or
δf (a, u) = f ′ u (a).
Usually, a direction in Rn is specified by a unit vector, i.e. a vector u ∈ Rn with
∥u∥ = 1. So, often, we shall consider that the vectors u are taken to be normalized,
although the definition above works for arbitrary (even zero) vectors.

Theorem 5.52 Let U be a nonempty open set in Rn . Let f : U → Rm and u ∈

Rn , u ̸= 0. If f is derivable at the point a ∈ U , then f is derivable at the point a in
any direction u ̸= 0 and

δf (a, u) = f ′ (a)(u), ∀u ̸= 0.

We focus on the particular case in which U is an open nonempty set in Rn and

f : U ⊆ Rn → R. If a ∈ U , the function f is called Gâteaux differentiable at the
point a if it is derivable at a in any direction u ∈ Rn . The number δf (a, u) is
called the Gâteaux differential of f at the point a in the direction u and the map
df (a) : Rn → R, defined by
df (a)(u) = δf (a, u)
is the Gâteaux derivative of the function f at the point a.

Let us notice that we cannot establish a connection between the continuity of

a given function and its directional derivability. For instance, on one hand, the
function f : R2 → R, defined by
√
f (x, y) = x2 + y 2

is continuous at the point (0, 0), but it is not Gâteaux differentiable at this point.
On the other hand, if we consider the function f : R2 → R, defined by


 x2

 , y ̸= 0,
f (x, y) = y



 0, y = 0,
MULTIVARIABLE DIFFERENTIAL CALCULUS 105

it is not difficult to see that f is Gâteaux differentiable at the point (0, 0), but it is
not continuous at this point.

It is worth noting that the Gâteaux derivative is not, in general, linear, unlike
the Fréchet derivative. Moreover, let us mention that a similar notion can be defined
for functions between more general spaces, such as locally convex topological vector
spaces or Banach spaces.

Exercise 5.53 Let U be a nonempty open set in Rn and let fi : U → R, i = 1, n,

∑
n
be derivable at the point a ∈ U in the direction u. Show that ci fi , where ci ∈ R,
i=1
is derivable at the point a in the direction u and
( )
∂ ∑ n ∑n
∂fi
ci fi (a) = ci (a).
∂u i=1 i=1
∂u

Exercise 5.54 Let U be a nonempty open set in Rn . If f, g : U → R are derivable

at the point a ∈ U in the direction u, then f g is derivable at the point a in the
direction u and
∂ ∂f ∂g
(f g)(a) = (a)g(a) + f (a) (a).
∂u ∂u ∂u
Exercise 5.55 Let U be a nonempty open set in Rn . Show that if f : U → Rm , f =
(f1 , . . . , fm ), then f is derivable at the point a ∈ U in the direction u if and only if
f1 , . . . , fm are derivable at the point a in the direction u.

Remark 5.56 Let f : U ⊆ Rn → R, U ̸= ∅, U open, a = (a1 , . . . , an ) ∈ U . We

know that
∂f f (a1 , . . . , xj , . . . , an ) − f (a1 , . . . , aj , . . . , an )
(a) = lim .
∂xj xj →aj xj − aj

If we take
t = xj − aj ,
then
∂f f (a + tej ) − f (a) ∂f
(a) = lim = (a),
∂ej t→0 t ∂xj
where
ej = (0, . . . , 1, . . . , 0).
106 REAL ANALYSIS

Hence, partial derivatives can be seen as particular directional derivatives along the
standard basis vector directions.

Remark 5.57 Let us suppose that f : Rn → R is derivable at a given point a. Then,

δf (a, u) = f ′ (a)(u) = ∇f (a) · u, ∀u ̸= 0.

So, the slopes in all directions are known from slopes in n directions (given by the
partial derivatives).

Exercise 5.58 If f : R2 → R is defined by

f (x, y) = 4 − 2x2 − y 2

and
1
u = − √ (1, 1),
2
then
∂f √
(1, 1) = 3 2.
∂u

Exercise 5.59 Let U be a nonempty open set in Rn and let f : U → Rm . Also, let
u ∈ Rn , u ̸= 0. Show that if f is derivable at the point a in the direction u, then f
is derivable at a in the direction −u and

∂f ∂f
(a) = − (a).
∂(−u) ∂u

More generally, if f is derivable at the point a in the direction u, then f is derivable

at a in the direction αu, α ∈ K and

∂f ∂f
(a) = α (a).
∂(αu) ∂u

Exercise 5.60 Let U be a nonempty open set in Rn and let f : U → Rm . Also, let
u ∈ Rn , u ̸= 0. Prove that if f is derivable at the point a in the direction u, then f
is continuous at a in the direction u.
MULTIVARIABLE DIFFERENTIAL CALCULUS 107

Exercise 5.61 Let us consider the function f : R2 → R, defined by:



 x2 y

 , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2



 0, (x, y) = (0, 0).

Prove that f is not differentiable at the point (0, 0), despite the fact that it possesses
directional derivatives at this point with respect to any direction u ̸= 0.

Exercise 5.62 Compute the directional derivative of the function f : R2 → R2 ,

defined by
f (x, y) = (x2 + y, x + y 2 )
at the point a = (2, 3), in the direction of the vector u = (1, 1).

Exercise 5.63 Let f : R2 → R, defined by:



 xy 2

 , (x, y) ̸= (0, 0),
f (x, y) = x2 + y 2



 0, (x, y) = (0, 0),

a) Prove that f is continuous at the point (0, 0).

b) Compute the partial derivatives of f at (0, 0).
c) Compute the directional derivatives of the function f at the point (0, 0) along
any direction u with ∥u∥ = 1.
d) Prove that f is not differentiable at the point (0, 0).

Proposition 5.64 Let ∅ ̸= U ⊆ Rn , U open, f : U → Rm derivable at the point

a ∈ U . The matrix associated to the linear map f ′ (a) : Rn → Rm in the canonical
bases of Rn and Rm is
 
∂f1 ∂f1
 ∂x (a) · · · ∂x (a) 
 1 n 
 
 
 
Mf (a) =  ................................  ∈ M(m, n; R).
 
 
 
 ∂fm ∂fm 
(a) · · · (a)
∂x1 ∂xn
108 REAL ANALYSIS

If m = n, the determinant
Jf (a) = det Mf (a)
was called the Jacobian of the function f at the point a and it was also denoted by

∂(f1 , . . . , fn )
Jf (a) = (a).
∂(x1 , . . . , xn )

Theorem 5.65 (Chain Rule) Let E, F, G be Banach spaces, U ⊆ E, V ⊆ F , U, V

nonempty open sets. If f : U → V is derivable at the point a ∈ U and g : V → G is
derivable at the point f (a) , then g ◦ f is derivable at the point a and

(g ◦ f ) ′ (a) = g ′ (f (a)) ◦ f ′ (a).

Proposition 5.66 Let f : U ⊆ Rn → Rm , g : V ⊆ Rm → Rk , U, V nonempty open

sets. If f is derivable at a ∈ U and g is derivable at b = f (a) ∈ V , then

Mg◦f (a) = Mg (b) · Mf (a). (5.6)

Corollary 5.67 Let U, V be nonempty open subsets of Rn , f : U → Rn , f =

(f1 , . . . , fn ) derivable at the point a ∈ U , g : V → Rn , g = (g1 , . . . , gn ) derivable
at the point b = f (a) ∈ V . Then, the map h = g ◦ f : U → Rn , h = (h1 , . . . , hn ), is
derivable at the point a and

∂(h1 , . . . , hn ) ∂(g1 , . . . , gn ) ∂(f1 , . . . , fn )

(a) = (b) (a).
∂(x1 , . . . , xn ) ∂(f1 , . . . , fn ) ∂(x1 , . . . , xn )

Exercise 5.68 Let g : R → R be an arbitrary C 1 function and let

F (x, y) = g(x2 + y 2 ).

∂F ∂F
Compute and .
∂x ∂y

Solution. If we denote by u(x, y) = x2 + y 2 , then



 ∂F dg ∂u dg

 = = 2x = g ′ 2x,
 ∂x du ∂x du



 ∂F dg ∂u dg
 = = 2y = g ′ 2y.
∂y du ∂y du
MULTIVARIABLE DIFFERENTIAL CALCULUS 109

Exercise 5.69 Let

F (x, y) = xy + g(x + y, x3 + y 3 ),
∂F ∂F
where g : R2 → R is an arbitrary given function of class C 1 . Compute and .
∂x ∂y

Solution. If we denote by
u(x, y) = x + y

and by
v(x, y) = x3 + y 3 ,

then
∂F ∂g ∂u ∂g ∂v
=y+ + ,
∂x ∂u ∂x ∂v ∂x
i.e.
∂F ∂g ∂g
=y+ + 3x2 .
∂x ∂u ∂v
In a similar manner, we get

∂F ∂g ∂g
=x+ + 3y 2 .
∂y ∂u ∂v

Exercise 5.70 Let

F (x, y, z) = xyz + g(x + y + z, x2 + y 2 + z 2 , xyz),

∂F ∂F
where g : R3 → R is an arbitrary given function of class C 1 . Compute , and
∂x ∂y
∂F
.
∂z
Solution. If we denote
u(x, y, z) = x + y + z,

v(x, y, z) = x2 + y 2 + z 2

and
w(x, y, z) = xyz,

then
∂F ∂g ∂u ∂g ∂v ∂g ∂w
= yz + + + ,
∂x ∂u ∂x ∂v ∂x ∂w ∂x
110 REAL ANALYSIS

i.e.
∂F ∂g ∂g ∂g
= yz + + 2x + yz .
∂x ∂u ∂v ∂w
In a similar manner, we get

∂F ∂g ∂g ∂g
= xz + + 2y + xz .
∂y ∂u ∂v ∂w

and
∂F ∂g ∂g ∂g
= xy + + 2z + xy .
∂z ∂u ∂v ∂w
Exercise 5.71 Let
F (x, y) = xy + g(x2 + y 2 , xy),
∂2F ∂2F
where g : R2 → R is an arbitrary given function of class C 2 . Compute ,
∂x2 ∂y 2
∂2F
and .
∂x∂y

Solution. If we denote by
u(x, y) = x2 + y 2

and by
v(x, y) = xy,

then
∂2F 2
2∂ g ∂2g 2
2∂ g ∂g
2
= 4x 2
+ 4xy + y 2
+2 ,
∂x ∂u ∂u∂v ∂v ∂u
∂2F ∂2g ∂2g ∂g ∂g
= 1 + 4xy 2 + (2x2 + 2y 2 ) + xy 2 +
∂x∂y ∂u ∂u∂v ∂v ∂u
and
∂2F 2
2∂ g ∂2g 2
2∂ g ∂g
2
= 4y 2
+ 4xy + x 2
+2 .
∂y ∂u ∂u∂v ∂v ∂u

Exercise 5.72 Compute the first and the second differential for the function

F (x, y) = (x2 + y 2 )u(x + y),

where u : R → R is an arbitrary function of class C 2 .

MULTIVARIABLE DIFFERENTIAL CALCULUS 111

Exercise 5.73 Let

F (x, y) = xyu(x + y, xy),
where u : R2 → R is a given function of class C 2 . Compute the first and the second
differential of F .

Exercise 5.74 Let F (x, y, z) = (x2 + y 2 + z 2 )u(x + y + z, xyz), where u ∈ C 2 .

Compute the first and the second differential of F .

Exercise 5.75 Let F (x, y) = u(x + y, xy, x2 + y 2 ), where u ∈ C 2 . Compute

∂2F ∂2F
∆F = 2
+ .
∂x ∂y 2
Exercise 5.76 Prove that the function

z(x, y) = f (x + φ(y)),

where f, φ ∈ C 2 (R), satisfies the equation:

∂z ∂ 2 z ∂z ∂ 2 z
= .
∂x ∂x∂y ∂y ∂x2
Exercise 5.77 Prove that the function

g(x, t) = φ(x − at) + ψ(x + at),

where φ, ψ are given functions of class C 2 and a > 0, satisfies the equation:

∂2g 2
2 ∂ g
= a ,
∂t2 ∂x2
called the equation of the vibrating string.

5.2 Differential Operators

Definition 5.78 Let ∅ = ̸ U ⊆ Rn , U open. Also, let f : U ⊆ Rn → R be a scalar
field, f ∈ C 1 (U ) and a ∈ U . The gradient of the function f at the point a is defined
as being
grad f : U → Rn , (grad f )(a) = grada f.
112 REAL ANALYSIS

Thus, the gradient of f at the point a can be written as

( )
∂f ∂f
(grad f )(a) = (a), . . . , (a) .
∂x1 ∂xn

If we introduce the nabla symbol ∇, we have

( )
∂f ∂f
∇f (a) = (a), · · · , (a)
∂x1 ∂xn
or
∑
n
∂f
∇f (a) = (a)ei .
i=1
∂xi
The differential operator ( )
∂ ∂
∇= ,···,
∂x1 ∂xn
is called the Hamiltonian operator. So, in the n-dimensional Euclidean space Rn ,
this operator can be written as

∑
n
∂
∇= ei
i=1
∂xi

or, using the Einstein summation notation, as

∂
∇= ei
∂xi

Remark 5.79 Let f : U ⊆ Rn → R be differentiable at the point a ∈ U and let

u ∈ Rn be a unit vector. Then, f is derivable at the point a in the direction u and

∂f
(a) = ⟨∇f (a), u⟩ = ∥∇f (a)∥ cos θ,
∂u
where θ is the angle between the vectors ∇f (a) and u. Therefore, the rate of change
of the function f in the direction u depends on u and varies from −∥∇f (a)∥ (when
θ = π, i.e. u points in a direction opposite to ∇f (a)) to ∥∇f (a)∥ (when θ = 0, i.e.
u points in the same direction as ∇f (a)). The vector ∇f (a) points in the direction
of the greatest rate of increase of the function f at the point a and the greatest rate
of change is exactly the magnitude of this vector, i.e. ∥∇f (a)∥.
MULTIVARIABLE DIFFERENTIAL CALCULUS 113

Exercise 5.80 The gradient ∇f is orthogonal to the level surface f (x) = C.

Solution. Since ∇f · dr = df and f (x) = C, it is not difficult to see that ∇f · dr = 0.

Exercise 5.81 Compute the gradient of the scalar field f : R3 → R, defined by

f (x, y, z) = 2x + y 2 − cos z.

Solution. The gradient of f is the vector ∇f = (2, 2y, sin z).

Exercise 5.82 Compute the gradient of the scalar field f : R3 → R, defined by

f (x, y, z) = x y z.

Solution. The gradient of f is the vector ∇f = (y z, x z, x y).

In what follows, we shall use the notation −
→
v to denote a vector v. Notice the
little abuse of notation, since up to now we didn’t use this arrow notation when
referring to vectors in Rn .
→
−
Exercise 5.83 Let r be the length of the position vector −
→
r ̸= 0 of a point (x, y, z)
in R3 , i.e.
r = ∥−→
r ∥ ̸= 0.
( )
1
Compute grad .
r
Solution. We have ( ) −
→
1 r
grad =− .
r r3
More general, it is easy to see that
f ′ (r) −
→
gradf (r) = r,
r
∗
for any f ∈ C 1 (U ), U ⊆ R+ .

Definition 5.84 Let ∅ ̸= U ⊆ Rn , U open and f : U ⊆ Rn → R be a scalar field

such that f ∈ C 2 (U ). The Laplacian of the function f is defined as being:

∂2f ∂2f
∆f = 2 + ··· + 2 .
∂x1 ∂xn
114 REAL ANALYSIS

So, the Laplace operator is a second order differential operator defined as the sum
of all the unmixed second partial derivatives:

∑
n
∂2
∆= .
i=1
∂x2i

Remark 5.85 A function f is said to be harmonic if ∆f = 0.

Exercise 5.86 Let f : R2 \ {(0, 0)} → R be defined by

f (x, y) = ln(x2 + y 2 ).

Prove that f satisfies Laplace’s equation, i.e.

∆f = 0.

Solution. It is not difficult to see that

∂2f 2(y 2 − x2 )
= .
∂x2 (x2 + y 2 )2

In a similar manner,
∂2f 2(x2 − y 2 )
= .
∂y 2 (x2 + y 2 )2
Hence,
∂2f ∂2f
∆f = 2
+ 2 = 0.
∂x ∂y
This proves that our function f is harmonic.

Definition 5.87 Let ∅ ̸= U ⊆ Rn , U open and − →

v : U ⊆ Rn → Rn be a vector field
such that −
→
v ∈ C 1 (U ). The divergence of the vector −
→
v is defined as being

∂v1 ∂vn
div −
→
v = + ··· + .
∂x1 ∂xn

Remark 5.88 A vector field − →v is called solenoidal (or, sometimes, incompressible)

−
→
if div v = 0 (no sources or sinks).
MULTIVARIABLE DIFFERENTIAL CALCULUS 115

→
−
Exercise 5.89 Let −
→
r = (x, y, z) ∈ R3 , −
→ ̸ 0 and
r =

r = ∥−
→
r ∥,

i.e. √
r= x2 + y 2 + z 2 .
Prove that the divergence of the field

→ q→
− − r
E = 3
r
−
→
is zero. Hence, E is a solenoidal field.
→
−
Solution. Let E = (Ex , Ey , Ez ), where
qx qy qz
Ex = 3
, E y = 3 , Ez = 3 .
r r r
Since, by the chain rule,
∂r3
= 3xr,
∂x
it is easy to see that
∂Ex r3 − 3x2 r
=q .
∂x r6
In a similar manner,
∂Ey r3 − 3y 2 r
=q
∂y r6
and
∂Ez r3 − 3z 2 r
=q .
∂z r6
Therefore,
→
−
div E = 0.

Exercise 5.90 Show that

div−
→
r = 3.

Exercise 5.91 Compute the divergence of the vector field

( )
−
→
v = x y z, x + y + z, x2 + y 2 + z 2 .
116 REAL ANALYSIS

Solution. The divergence of −

→
v is the scalar field div−
→
v = y z + 1 + 2 z.

Definition 5.92 Let ∅ = ̸ U ⊆ R3 , U open and −

→
v : U → R3 be a vector field,
→
−
v ∈ C 1 (U ). The differential operator
( )
∂v3 ∂v2 ∂v1 ∂v3 ∂v2 ∂v1
rot −
→
v = − , − , −
∂x2 ∂x3 ∂x3 ∂x1 ∂x1 ∂x2

is called the curl or the rotation of the vector −

→
v.

We shall also denote by curl −

→
v the rotation of the vector field −
→
v.
−
→
The curl of v can be interpreted as the symbolic vector product of the Hamil-
tonian operator ∇ by the vector field −
→v:

curl →
−
v =∇×−
→
v,

i.e.
−
→
e1 −
→
e2 −
→
e3

∂ ∂ ∂
curl →
−
v =
∂x1 ∂x2 ∂x3

v1 v2 v3

Remark 5.93 A vector field −

→
v is called irrotational if curl →
−
v = 0 (irrotational,
nonturbulent flow).

Exercise 5.94 Prove that

curl−
→
r =0

and
curl (f (r)−
→
r ) = 0,
∗
for any f ∈ C 1 (U ), U ⊆ R+ .

Exercise 5.95 Compute the curl of the vector field

( )
−
→
v = x y z, x + y + z, x2 + y 2 + z 2 .
MULTIVARIABLE DIFFERENTIAL CALCULUS 117

−
→ −
→ → −
Exercise 5.96 Let V = V0 + −
ω ×→r be the velocity field in a rigid solid. Show
that
−
→
curl V = 2−
→
ω.

and
−
→
div V = 0.

Remark 5.97 If − →v is an irrotational field in a simply connected neighborhood U of

a point x, then in this neighborhood, −→
v is a potential field, i.e. −
→
v is given in terms
of the gradient of a scalar field Φ:

−
→
v = −∇Φ.

Exercise 5.98 Let U ⊆ R3 be a nonempty open set and f, g : U → R, f, g ∈ C 1 (U ),

α, β ∈ R. Prove that:
a) grad (α f + β g) = α grad f + β grad g; b) grad (f g) = g grad f + f grad g;

ggrad f − f grad g
c) grad (f /g) = , g(x) ̸= 0, ∀x ∈ U .
g2
Exercise 5.99 Show that

div (α −
→
u +β−
→
v ) = α div −
→
u + β div −
→
v,

for all α, β ∈ R, ∀−
→
u,−
→
v ∈ C 1.

Exercise 5.100 Prove that

div (φ−
→
v ) = φ div −
→
v + (grad φ) · −
→
v,

for all φ, −
→
v ∈ C 1.

Exercise 5.101 Show that

div (−
→
u ×−
→
v)=−
→
v · rot −
→
u −−
→
u · rot −
→
v,

for all −
→
u,−
→
v ∈ C 1 . As a consequence, if →
−
u and −
→
v are irrotatational vector fields,
→
− −
→
then u × v is solenoidal.
118 REAL ANALYSIS

Exercise 5.102 Show that

div (grad φ) = △ φ,

for all φ ∈ C 2 .

Exercise 5.103 Show that

rot (grad φ) = 0,

for all φ ∈ C 2 .

Exercise 5.104 Show that

rot (α −
→
u +β−
→
v ) = α rot −
→
u + β rot →
−
v, ∀α, β ∈ R,

for all →
−
u,−
→
v ∈ C 1.

Exercise 5.105 Show that

rot (φ−
→
v ) = φ rot −
→
v −−
→
v × grad φ,

for all φ, −
→
v ∈ C 1.

Exercise 5.106 Prove that

rot (rot →
−
u ) = grad (div −
→
u ) − △−
→
u,

for any −
→
u ∈ C 2.

Exercise 5.107 Show that

div (rot −
→
v ) = 0,

for any −
→
v ∈ C 2.
MULTIVARIABLE DIFFERENTIAL CALCULUS 119

5.3 Taylor’s Formula

Theorem 5.108 Let ∅ ̸= I ⊆ R be an open interval and f : I → R. If f possesses
derivatives up to the order p + 1 on I, then for any a, x ∈ I, a ̸= x, there exists ξp
between a and x such that:

∑
p
f (k) (a) f (p+1) (ξp )
f (x) = (x − a)k + (x − a)p+1 . (5.7)
k=0
k! (p + 1)!

(5.7) is called Taylor’s formula for the function f at the point a.

If we denote by
∑
p
f (k) (a)
Tp (x, a) = (x − a)k
k=0
k!

the Taylor’s polynomial of degree p and by

f (p+1) (ξp )
Rp (x) = (x − a)p+1
(p + 1)!

the p − th remainder of Taylor’s formula in Lagrange’s form, (5.7) becomes:

f (x) = Tp (x, a) + Rp (x). (5.8)

Theorem 5.109 Let ∅ ̸= I ⊆ R be an open interval and f : I → R, f ∈ C p+1 (I).

Then, for any x0 , x ∈ I, we have
∫ x
1
f (x) = Tp (x, x0 ) + (x − t)p f (p+1) (t) dt.
p! x0

∫ x
1
Rp (x) = (x − t)p f (p+1) (t) dt
p! x0

is called the p − th remainder in the integral form.

Remark 5.110 If in Theorem 5.107 we expand about the origin, i.e. we take a = 0,
we get the so-called Maclaurin’s formula.
120 REAL ANALYSIS

Proposition 5.111 Let ∅ ̸= I ⊆ R be an open interval and f : I → R, f ∈

C (p+1) (I). If [a, a + h] ⊂ I, then

f ′′ (a) 2 f (p) (a) p

f (a + h) = f (a) + f ′ (a)h + h + ··· + h +
2! p!
∫ 1
1
(1 − t)p f (p+1) (a + th)hp+1 dt.
p! 0

Let us write down Maclaurin’s series for some important elementary functions.

1) For the function f : R → R defined by f (x) = ex , we have

∞
∑ xk
ex = .
k=0
k!

2) For f : R → [−1, 1] defined by f (x) = cos x, we have

∞
∑ x2k
cos x = (−1)k .
k=0
(2k)!

3) For f : R → [−1, 1], f (x) = sin x.

∞
∑ x2k+1
sin x = (−1)k .
k=0
(2k + 1)!

Exercise 5.112 Let f : R → R, defined by

f (x) = x3 ex .

Prove that ∞
∑ xk+3
f (x) = .
k=0
(k)!

Exercise 5.113 Let f : (−1, 1] → R be defined by

f (x) = ln (1 + x).

Prove that ∞
∑ xk+1
f (x) = (−1)k .
k=0
k+1
MULTIVARIABLE DIFFERENTIAL CALCULUS 121

Exercise 5.114 Let f : (−3, 3) → R, defined by

x
f (x) = .
9 + x2
Prove that ∞
∑ x2k+1
f (x) = (−1)k .
k=0
9k+1

Exercise 5.115 For f : (−1, 1) → R, given by

1
f (x) = ,
1−x
show that ∞
∑
f (x) = xk .
k=0

Exercise 5.116 Expand in Maclaurin’s series the function f : (−1, 1) → R, defined

by
1
f (x) = .
1+x
Exercise 5.117 Expand in Maclaurin’s series the function f : (−1, 1) → R, defined
by
1
f (x) = .
1 − x2
Exercise 5.118 Show that
m(m − 1) 2 m(m − 1)(m − 2) 3
(1 + x)m = 1 + mx + x + x + ···. (5.9)
2! 3!
This expansion, called the binomial expansion, is valid for −1 < x < 1.

Exercise 5.119 Using the binomial expansion, deduce the expression for the clas-
sical kinetic energy from the formula of total relativistic energy.

Solution. The total relativistic energy of a particle of mass m and velocity v is given
by
( )−1/2
v2
E = mc 2
1− 2 .
c
122 REAL ANALYSIS

From (5.9), with x = −v 2 /c2 and m = −1/2, we have

1 3 v2
E = mc2 + mv 2 + mv 2 2 + · · · .
2 8 c
So, ( )
1 3 v2
2
E = mc + mv 2 1 + + ··· .
2 4 c2
The first term, mc2 is the rest mass energy. Then,
( )
1 3 v2
Ekinetic = mv 2 1 + + ··· .
2 4 c2

If the particle velocity is much smaller than the velocity of light, i.e. if v ≪ c, the
expression in the parentheses reduces to unity and we see that we obtain the classical
result for the kinetic part of the total relativistic energy.

Theorem 5.120 Let E be a Banach space, U an open nonempty convex subset of

E and f : U → R. If f is m + 1-times differentiable on U , then, for any a, x ∈ U ,
there exists ξ between a and x such that:
∑
m
1 1
f (x) = f (p) (a) (x − a)p + f (m+1) (ξ) (x − a)m+1 . (5.10)
p=0
p! (m + 1)!

(5.10) is called Taylor’s formula for the function f at the point a.

Corollary 5.121 If E = Rn , we have:

∑
n
∂f 1 ∑ n
∂2f
f (x) = f (a) + (a)(xi − ai ) + (a)(xi − ai )(xj − aj ) + · · ·
i=1
∂xi 2! i,j=1 ∂xi ∂xj

1 ∑ n
∂mf
+ (a)(xi1 − ai1 ) . . . (xim − aim )
m! i ,...,i =1 ∂xi1 . . . ∂xim
1 m

1 ∑
n
∂ m+1 f
+ (ξ)(xi1 − ai1 ) . . . (xim+1 − aim+1 )
(m + 1)! i ∂xi1 . . . ∂xim+1
1 ,...,im+1 =1
or
∑
n
∂f
f (x1 , . . . , xn ) = f (a1 , . . . , an ) + (a1 , . . . , an )(xj − aj )
j=1
∂xj
MULTIVARIABLE DIFFERENTIAL CALCULUS 123

1 ∑ n
∂2f
+ (a1 , . . . , an )(xj − aj )(xk − ak )
2! j,k=1 ∂xj ∂xk

1 ∑ ∂mf
+··· + (a1 , . . . , an )(x1 − a1 )j1 . . . (xn − an )jn
m! j
1 +···+jn =m
∂xj11 . . . ∂xjnn
1 ∑ ∂ m+1 f
+ (ξ)(x1 − a1 )k1 . . . (xn − an )kn .
(m + 1)! k
1 +···+kn =m+1
∂xk11 . . . ∂xknn

Remark 5.122 In the particular case n = 2, we get:

( )
1 ∂f ∂f
f (x, y) = f (x0 , y0 ) + (x0 , y0 )(x − x0 ) + (x0 , y0 )(y − y0 )
1! ∂x ∂y
( )
1 ∂2f ∂2f ∂2f
+ (x 0 , y 0 )(x − x 0 )2
+ 2 (x 0 , y 0 )(x − x 0 )(y − y 0 ) + (x0 , y0 )(y − y0 )2 +· · ·
2! ∂x2 ∂x∂y ∂y 2
( )
1 ∂mf ∂mf
+ (x ,
0 0y )(x − x0 )m
+ C 1
m (x0 , y0 )(x − x0 )m−1 (y − y0 + · · ·
m! ∂xm ∂xm−1 ∂y
∂mf
+ (x0 , y0 )(y − y0 )m )
∂y m
(
1 ∂ m+1 f ∂ m+1 f
+ (ξ, η)(x − x0 )m+1
+ C 1
m+1 (ξ, η)(x − x0 )m (y − y0 ) + · · ·
(m + 1)! ∂xm+1 ∂xm ∂y
)
∂ m+1 f
+ m+1 (ξ, η)(y − y0 )m+1 ,
∂y
where 

 ξ = x0 + t(x − x0 ),
t ∈ (0, 1).

 η = y + t(y − y ),
0 0

Remark 5.123 Let E be a Banach space, U an open nonempty convex subset of

E, f : U → R, f ∈ C m+1 (U ). Then, for any a, x ∈ U , we have:

∑
m
1
f (x) = f (p) (a) (x − a)p + εf,a (x) ∥x − a∥m , (5.11)
p=0
p!

with
lim εf,a (x) = 0.
x→a
124 REAL ANALYSIS

Exercise 5.124 Write Taylor’s formula of the third order for the function f : U →
R, f (x, y) = ln(1 + x + y), about the point (0, 0). Here,

U = {(x, y) ∈ R2 | x + y > −1}.

Solution. Obviously, f is four times differentiable on the convex set U and, comput-
ing the needed derivatives, we obtain

1 1 1
ln(1 + x + y) = x + y − (x + y)2 + (x + y)3 − (x + y)4 (1 + ξ + η)−4 ,
2 3 4
where (ξ, η) = (tx, ty), with t ∈ (0, 1).

Exercise 5.125 Write Taylor’s formula of the third order for the function f : R2 →
R, f (x, y) = ex+y , about the point (1, −1).

Solution. The function f is four times differentiable on the convex set R2 . Computing
the needed derivatives, we obtain

1 1 1 eξ+η
ex+y = 1 + (x + y) + (x + y)2 + (x + y)3 + (x + y)4 ,
1! 2! 3! 4!
where (ξ, η) = (1 + tx, −1 + ty), with t ∈ (0, 1).

Exercise 5.126 Write Taylor’s formula of the order 2 about the point (x0 , y0 ) =
(0, 0) for the function f : R2 → R, defined by f (x, y) = ex sin y.
( )
π
Exercise 5.127 Write Taylor’s formula of the order 2 at the point (x0 , y0 ) = 0,
2
for the function f : R2 → R, defined by f (x, y) = e2x cos y.
( )
π
Exercise 5.128 Write Taylor’s formula of the order 2 at the point (x0 , y0 ) = 0,
2
for the function f : R2 → R, defined by f (x, y) = cos x cos y.

Exercise 5.129 Write Taylor’s formula of the order 2 at the point (x0 , y0 ) = (1, 1)
for the function f : (0, ∞) × R → R, defined by

f (x, y) = xy .
MULTIVARIABLE DIFFERENTIAL CALCULUS 125

5.4 Implicit Functions

Definition 5.130 Let E, F be Banach spaces, U a nonempty open subset of E, V
a nonempty open subset of F . A function f : U → V is called an homeomorphism
if:
1) f is bijective;
2) f : U → V is continuous on U ;
3) f −1 : V → U is continuous on V .

Example 5.131 The function f : R → R defined by f (x) = x3 is an homeomor-

phism on R.

Definition 5.132 Let E and F be Banach spaces, U a nonempty open subset of E,

V a nonempty open subset of F . A function f : U → V is called a C 1 -diffeomorphism
if:
1) f is bijective;
2) f : U → V , f ∈ C 1 (U );
3) f −1 : V → U , f ∈ C 1 (V ).

Example 5.133 The function f : (0, 1) → (0, 3) defined by f (x) = 3x is a C 1 -

diffeomorphism.

Theorem 5.134 (Local Inversion Theorem) Let E and F be Banach spaces, U

a nonempty open subset of E, f : U → F , f ∈ C 1 (U ) and a ∈ U such that
f ′ (a) ∈ Isom (E, F ). Then, there exist V ⊆ E, W ⊆ F open sets such that a ∈ V ⊆
U, b = f (a) ∈ W and f : V → W is a C 1 -diffeomorphism.

Corollary 5.135 Let U be a nonempty open subset of Rn , f : U → Rn , f ∈ C 1 (U )

and a ∈ U such that
∂(f1 , . . . , fn )
(a) ̸= 0.
∂(x1 , . . . , xn )
Then, there exist V, W ⊆ Rn open sets such that a ∈ V ⊆ U, b = f (a) ∈ W and
f : V → W is a C 1 -diffeomorphism.
126 REAL ANALYSIS

Example 5.136 The simplest example of a diffeomorphism in Rn is offered by the

translation operator. Indeed, if we fix a ∈ Rn , then the map Ta : Rn → Rn , defined
by
Ta (x) = x + a, ∀x ∈ Rn ,
is a C 1 -diffeomorphism.

Example 5.137 Let U = (0, ∞) × (0, 2π) ⊆ R2 and V = R2 \ {[0, ∞) × {0}} ⊆ R2 .

For the function f : U → V , defined in polar coordinates by

f (ρ, θ) = (ρ cos θ, ρ sin θ),

we have:
∂(f1 , f2 )
| = ρ.
∂(ρ, θ) (ρ,θ)
It is easy to see that f ∈ C 1 (U ). Also, for any ρ ∈ (0, ∞), f ′ (ρ, θ) ∈ Isom (U, V ).
So, f is a C 1 -diffeomorphism on U .

Theorem 5.138 Let E, F be Banach spaces, ∅ ̸= U ⊆ E × F , U open, (a, b) ∈

∂h ∂h
U, h : U → F continuous on U , h(a, b) = 0, : U → L(F, F ) continuous, (a, b)
∂y ∂y
bijective. Then, there exist a number r > 0 and a function φ : B(a, r) → F such
that:
1) (x, φ(x)) ∈ U, ∀x ∈ B(a, r);
2) φ is continuous on B(a, r);
3) h(x, φ(x)) = 0, ∀x ∈ B(a, r);
4) φ(a) = b;
5) φ unique.
Moreover, if h is derivable at the point (a, b), then φ is derivable at the point a and
( )−1
∂h ∂h
φ ′ (a) = − (a, b) ◦ (a, b). (5.12)
∂y ∂x

Corollary 5.139 (The case E = F = R) Let ∅ ̸= U ⊆ R2 , U open, (a, b) ∈

∂h
U, h : U → R continuous on U , h(a, b) = 0, : U → L(R, R) ≃ R continuous,
∂y
∂h
(a, b) ̸= 0. Then, there exist r > 0 and φ : (a − r, a + r) → R such that:
∂y
MULTIVARIABLE DIFFERENTIAL CALCULUS 127

1) (x, φ(x)) ∈ U, ∀x ∈ (a − r, a + r);

2) φ is continuous on (a − r, a + r);
3) h(x, φ(x)) = 0, ∀x ∈ (a − r, a + r);
4) φ(a) = b;
5) φ unique.
Moreover, if h is derivable at the point (a, b), then φ is derivable at the point a and

∂h
(a, b)
φ ′ (a) = − ∂x . (5.13)
∂h
(a, b)
∂y

Corollary 5.140 (The case E = Rn , F = Rm ) Let ∅ ̸= W ⊆ Rn × Rm , W open,

(a, b) ∈ W, f : W → Rm , f = (f1 , . . . , fm ), fi = fi (x1 , . . . , xn , y1 , . . . , ym ), i = 1, m
such that:
1) fi ∈ C 1 , i = 1, m;

2) fi (a, b) = 0, i = 1, m;
∂(f1 , . . . , fm )
3) (a, b) ̸= 0.
∂(y1 , . . . , ym )
Then, there exist ∅ ̸= U × V ⊆ W , U × V open, with (a, b) ∈ U × V , and gi : U →
R, i = 1, m, gi ∈ C 1 such that the system:


 f1 (x1 , . . . , xn , y1 , . . . , ym ) = 0,




........................................,






fm (x1 , . . . , xn , y1 , . . . , ym ) = 0

is equivalent to the following one:



 y1 = g1 (x1 , . . . , xn ),




............................, (x1 , . . . , xn ) ∈ U.






ym = gm (x1 , . . . , xn ),
128 REAL ANALYSIS

Moreover,
bj = gj (a1 , . . . , an ), j = 1, m
and
∂(f1 , . . . , fm )
(x, g(x))
∂yj ∂(y1 , . . . , yj−1 , xi , yj+1 , . . . , ym )
(x) = − ,
∂xi ∂(f1 , . . . , fm )
(x, g(x))
∂(y1 , . . . , ym )
for any x = (x1 , ..., xn ) ∈ U, i = 1, n, j = 1, m, g = (g1 , . . . , gm ).

The above corollary gives conditions for the solvability of a system of functional
equations and offers formulas for calculating the partial derivatives of the implicitly
specified functions.

Example 5.141 As an application of the implicit function theorem, consider the

so-called triple product rule, also known as the cyclic chain rule, the cyclic relation,
or Euler’s chain rule, which relates the partial derivatives of three interdependent
variables. This rule finds its applications, for instance, in thermodynamics, where
frequently three variables can be related by a function of the form F (x, y, z) = 0, so
each variable is given as an implicit function of the other two variables. For example,
an equation of state for a fluid might relate in this manner the temperature, the
pressure and the volume.
Let F : D ⊂ R3 → R, D nonempty open set , F ∈ C 1 (D) and let us assume that

∂F ∂F ∂F
(x, y, z) · (x, y, z) · (x, y, z) ̸= 0.
∂x ∂y ∂z

∂F
Since F is of class C 1 on D and (x, y, z) ̸= 0, it follows that locally, around
∂x
the point (x, y, z), we can express x in terms of y and z, i.e. there exists X such
that
x = X(y, z)
and
F (X(y, z), y, z) = 0.
Therefore,
∂
[F (X(y, z), y, z)] = 0,
∂y
MULTIVARIABLE DIFFERENTIAL CALCULUS 129

i.e.
∂F ∂X ∂F
+ = 0,
∂x ∂y ∂y
which implies that
∂F
∂X ∂y
=− .
∂y ∂F
∂x
In a similar manner, we get

∂F ∂F
∂Y ∂Z
= − ∂z , = − ∂x .
∂z ∂F ∂x ∂F
∂y ∂z

So, if
F (x, y, z) = 0,

then, locally,
∂X ∂Y ∂Z
· · = −1. (5.14)
∂y ∂z ∂x
Formula (5.14) is known as the triple product rule.

Exercise 5.142 Compute the derivative of the function y = f (x) implicitly defined
by the equation
x2 + 4y 2 + 2xy = 12

in the neighbourhood of the point (2, 1).

Solution. The function h(x, y) = x2 + 4y 2 + 2xy − 12 satisfies all the conditions

of Corollary 5.138. Therefore, there exists a derivable function φ, defined on a
neighbourhood of the point x = 2, such that φ is unique, φ(2) = 1 and

∂h
(2, 1) 1
φ ′ (2) = − ∂x =− .
∂h 2
(2, 1)
∂y
130 REAL ANALYSIS

Exercise 5.143 Consider the following system:



 x + y + z = 1,

 x3 − y 3 + z 3 = −1.

Prove that, in a neighbourhood of the point (1, 1, −1), we can uniquely determine y
dy dz d2 y d2 z
and z as functions of x. Also, compute (1), (1), 2
(1), (1).
dx dx dx dx2
Solution. If we take f = (f1 , f2 ) : R × R2 → R2 , defined by


 f1 (x, y, z) = x + y + z − 1,

 f (x, y, z) = x3 − y 3 + z 3 + 1,
2

it is easy to see that f ∈ C ∞ (R3 ), f (1, 1, −1) = (0, 0) and

∂(f1 , f2 )
(1, 1, −1) = 6 ̸= 0.
∂(y, z)
Therefore, using Corollary 5.139, it follows that there exists an open set U ⊆ R and
there exist two functions g1 , g2 : U → R, of class C 1 , such that, locally,


 y = g1 (x),

 z = g (x)
2

and
g1 (1) = 1, g2 (1) = −1.
So, on U , we have 

 x + g1 (x) + g2 (x) = 1,

 x3 − g 3 (x) + g 3 (x) = −1.
1 2
So, by differentiation, we get
dg1 dg2
(1) = 0, (1) = −1.
dx dx
In a similar manner, we obtain
d2 g1 d2 g2
(1) = 0, (1) = 0
dx2 dx2
MULTIVARIABLE DIFFERENTIAL CALCULUS 131

Exercise 5.144 Compute the derivative of the function y = f (x) implicitly defined
by the equation x2 − y − cos y = 0 in a neighbourhood of the point (1, 0).

Exercise 5.145 Compute the first and second order partial derivatives for the func-
tion z=f(x,y) defined implicitly by the equation x3 + y 3 + z 3 − 3xyz = 0 in a neigh-
bourhood of the point (−1, 1, 0).
∂2f
Exercise 5.146 Compute (1, 0) for the function z = f (x, y) defined by the
∂x∂y
equation x2 + y 2 − z 2 + xz − yz − 1 = 0 in a neighbourhood of the point (1, 0, 1).

Exercise 5.147 Compute the first and second order partial derivatives for the func-
tion z=f(x,y) defined implicitly by the equation x3 + y 3 + z 3 − 3xyz = 0 in a neigh-
bourhood of the point (−1, 1, 0).

Exercise 5.148 Compute the differential d f (0, 0) for the function z=f(x,y) defined
implicitly by the equation x + y + z − sin xyz = 0 in a neighbourhood of the point
(0, 0, 0).

Exercise 5.149 Consider the following system:



 x + yz − z = 1,
3


 x3 − xz + y 3 = 0.

Prove that, in a neighbourhood of the point (1, −1, 0), we can uniquely determine x
dx dy
and y as functions of z. Compute (0), (0).
dz dz

5.5 Local Extrema

Definition 5.150 Let E be a Banach space, U ⊆ E an open nonempty subset,

a ∈ U and f : U → R.
a) The function f attains a local minimum at the point a if there exists V ∈ V(a)
such that f (x) ≥ f (a), for any x ∈ V ∩ U .
b) The function f possesses a local maximum at the point a if there exists
V ∈ V(a) such that f (x) ≤ f (a), for any x ∈ V ∩ U .
132 REAL ANALYSIS

We shall use the terms global or absolute maximum and, respectively, global or
absolute minimum, to refer to the overall maximum and minimum values of the
function on the range under consideration. Also, the term local is synonymous with
relative. Moreover, extremum is a term that will be used to denote both a maximum
and a minimum: a local extremum will be a local or relative maximum or minimum,
and a global extremum will be a global or absolute maximum or minimum.

Definition 5.151 Let E be a Banach space, U ⊆ E an open nonempty subset,

a ∈ U and f : U → R. The function f is said to attain a strict local minimum at
the point a if there exists V ∈ V(a) such that f (x) > f (a), for any x ∈ V ∩ U \ {a}.
Of course, f attains a strict local maximum at the point a if f (x) < f (a), for any
x ∈ V ∩ U \ {a}.

For instance, the point (0, 0) is a strict local minimum for the function f (x, y) =
x2 + y 2 , but not for g(x, y) = (x + y)2 .
It is not difficult to see that, exactly like in the one-dimensional case, we have
the following result:

Theorem 5.152 (Fermat) Let E be a Banach space, U ⊆ E an open nonempty

subset, a ∈ U and f : U → R. If f is derivable at the point a and a is a local
extremum for f , then f ′ (a) = 0.

Remark 5.153 The points a at which f ′ (a) = 0 are called stationary points.

In one-variable calculus, we know that if a function f : I → R defined on an open

interval I ⊆ R has a local extremum at a point a ∈ I, then either f ′ (a) = 0 or f ′ (a)
does not exist. A critical point is a point (belonging to I) where the derivative of
f is equal to zero or a point where the function is not differentiable. Analogously,
in multivariable calculus, a point for which the derivative of a function f : D → R,
defined on an open set D ⊆ Rn , vanishes or at which the function is not differentiable
is said to be a critical point. Let us mention that in the multivariable case critical
points are also sometimes defined as being points where the Jacobian matrix of a
given function is not of maximum rank.
A stationary point is always a critical one, but the converse is not true, i.e. a
critical point is not always a stationary one. However, for a smooth function of
MULTIVARIABLE DIFFERENTIAL CALCULUS 133

several real variables, these notions coincide, and, so, the condition that a point is
a critical one for f is equivalent to the fact all the partial derivatives of f must be
zero at that point.
Also, let us notice that exactly like in the one-dimensional case, one can prove
that if we consider a function f : Rn → R which is continuous on an open set U and
if S is a nonempty closed and bounded subset of U , then f has a maximum value
and a minimum value on S. Notice that this result needs no reference to derivatives.
Moreover, let us notice that global extrema of a given function f on a closed
and bounded set S can occur only at boundaries, non-differentiable points and sta-
tionary points. But, sometimes, dealing with the boundary of a given set and with
non-differentiable points requires a significant amount of work. Therefore, in this
paragraph, we shall work only with smooth functions defined on open sets and, in
such a case, as already mentioned, local extrema can be found among the stationary
(critical) points of the given function. Still, we have to keep in mind that this is
only a necessary condition, since not all the stationary points are local extrema. So,
a local extremum must occur at a stationary point, but the converse may not be
true. A stationary point which is not a local extremum is called a saddle point.

Definition 5.154 Let E be a real Banach space. h : E → R is called a quadratic

e : E × E → R, bilinear, symmetrical and continuous such that
form if there exists h

e
h(x) = h(x, x), ∀x ∈ E.

Example 5.155 If E = Rn , then

∑
n
h(x) = aij xi xj ,
i,j=1

with aij = aji , is a quadratic form.

Definition 5.156 The quadratic form h : Rn → R is called non-degenerate if

det(aij ) ̸= 0.

Definition 5.157 Let h : Rn → R be a quadratic form. Then:

134 REAL ANALYSIS

a) h is called positive definite if h(x) > 0, for any x ∈ Rn , x ̸= 0;

b) h is called positive semi-definite if h(x) ≥ 0, for any x ∈ Rn ;
c) h is called negative definite if h(x) < 0, for any x ∈ Rn , x ̸= 0;
d) h is called negative semi-definite if h(x) ≤ 0, for any x ∈ Rn ;
e) h is called indefinite if it is neither positive nor negative semi-definite.

Remark 5.158 If h : Rn → R is a positive definite and non-degenerate quadratic

form, then there exists m > 0 such that h(x) ≥ m∥x∥2 , ∀x ∈ Rn .

Definition 5.159 Let f : U ⊆ Rn → R, U an open nonempty set, f ∈ C 2 (U ) and

a ∈ U . The quadratic form

Hf (a)(x) = f ′′ (a)(x, x), ∀x ∈ Rn

is called the Hessian of f at the point a.

Remark 5.160 Let f : U ⊆ Rn → R, U open nonempty set, f ∈ C 2 (U ) and a ∈ U .

a) The Hessian Hf (a) is non-degenerate if and only if
( )
∂2f
det (a) ̸= 0.
∂xi ∂xj

b) The Hessian Hf (a) is positive semi-definite if and only if

∑
n
∂2f
(a)xi xj ≥ 0, ∀x ∈ Rn .
i,j=1
∂xi ∂xj

c) The Hessian Hf (a) is negative semi-definite if and only if

∑
n
∂2f
(a)xi xj ≤ 0, ∀x ∈ Rn .
i,j=1
∂xi ∂xj

Usually, in the definition of the Hessian of a given function f at a point a we shall

consider that f ′ (a) = 0, i.e. the point a is a stationary one. We shall say that a
stationary point a ∈ U is non-degenerate if the Hessian Hf (a) is non-degenerate.
MULTIVARIABLE DIFFERENTIAL CALCULUS 135

Theorem 5.161 Let U ⊆ Rn be an open nonempty convex set, f : U → R, f ∈

C 2 (U ) and a ∈ U a non-degenerate critical point.
a) If the Hessian Hf (a) is positive definite, then a is a strict local minimum
for f .
b) If the Hessian Hf (a) is negative definite, then a is a strict local maximum
for f .

Theorem 5.162 Let U ⊆ R2 be an open nonempty convex set, f : U → R, f ∈

C 2 (U ), a ∈ U a non-degenerate critical point. Let

∂2f ∂2f
(a) (a)
∂x2 ∂x∂y
D2 (a) = ̸= 0.
∂2f ∂2f
(a) (a)
∂y∂x ∂y 2

If D2 (a) < 0, then a is not a local extremum for f . If D2 (a) > 0, then a is a strict
∂2f
local minimum if D1 (a) = (a) > 0 and a strict local maximum if D1 (a) < 0.
∂x2
Let us notice that if the point a is degenerate, then the test is inconclusive.

Theorem 5.163 (Sylvester) Let U ⊆ Rn be an open nonempty convex ( set, f): U →

∂ 2f
R, f ∈ C 2 (U ), a ∈ U a non-degenerate critical point, i.e. det (a) ̸= 0.
∂xi ∂xj
For 1 ≤ k ≤ n, let us consider the kth leading principal minor

∂2f ∂2f
2 (a) · · · (a)
∂x1 ∂x1 ∂xk

Dk (a) = ······················ .

∂2f ∂2f
(a) · · · (a)
∂xk ∂x1 ∂x2k

Then:
a) if ∆1 (a) > 0, ∆2 (a) > 0, . . . , ∆n (a) > 0, then Hf (a) is positive definite and
a is a strict local minimum;
136 REAL ANALYSIS

b) if ∆1 (a) < 0, ∆2 (a) > 0, . . . , (−1)n ∆n (a) > 0, then Hf (a) is negative definite
and a is a strict local maximum.

Notice that if Hf (a) is positive or negative semi-definite, we cannot decide upon the
nature of the point a using this method. The test is inconclusive and this is an open
case. Also, notice that if the Hessian Hf (a) is indefinite, then the point a is a saddle
point for f . If the point a is degenerate, no conclusion can be drawn.

Exercise 5.164 Find the local extrema of the function f : R2 → R, defined by

f (x, y) = x3 + 3xy 2 − 15x − 12y.

Solution. Obviously, f ∈ C ∞ (R2 ). The critical points for the function f are the
′
solutions of the equation f (x, y) = 0, i.e. solutions for the following system:


 ∂f

 (x, y) = 0,
 ∂x



 ∂f
 (x, y) = 0.
∂y
So, computing the partial derivatives of f , we have to solve the system

 2 2
 x +y =5
(5.15)

 xy = 2

which, obviously, has four solutions: (1, 2), (2, 1), (−1, −2), (−2, −1). So, we have
four critical points and for deciding which of them are local extrema for the function
f we shall use Theorem 5.162. So, we have to compute the partial derivatives of the
second order for f . We obtain:

∂2f ∂2f ∂2f ∂2f

= 6x, = 6x, = = 6y.
∂x2 ∂y 2 ∂x∂y ∂y∂x
Let
∂2f ∂2f
(a) (a)
∂x2 ∂x∂y
D2 (a) = .
∂2f ∂2f
(a) (a)
∂y∂x ∂y 2
MULTIVARIABLE DIFFERENTIAL CALCULUS 137

Now, we shall take look at each critical point and we shall decide, using Theorem
5.162, if it is a local extremum or not.
For the point (1, 2), we obtain D2 (1, 2) < 0 and, so, this point is not a local
extremum. Also, the point (−1, −2) is not a local extremum, because D2 (−1, −2) <
0.
For the point (2, 1), we get D2 (2, 1) > 0 and D1 (2, 1) > 0. Therefore, this point is
a local minimum and fmin = f (2, 1) = −28. In a similar manner, we obtain that the
point (−2, −1) is a local maximum, because D2 (−2, −1) > 0 and D1 (−2, −1) < 0.
Moreover, fmax = f (−2, −1) = 28.

Exercise 5.165 Find the local extrema of the function f : R3 → R, defined by

f (x, y, z) = x2 + y 2 + z 2 + 4x + 2y − 8z.

Solution. It is not difficult to see that the only critical point of the function f is
(−2, −1, 4). For this point, D3 (−2, −1, 4) > 0, D2 (−2, −1, 4) > 0, D1 (−2, −1, 4) >
0. Hence, the point (−2, −1, 4) is a local minimum. Moreover, fmin = −21.

Exercise 5.166 Show that the function f : R2 → R, defined by

f (x, y) = x2 + 2xy − 4x − y 2 ,

has no extrema.

Solution. The point (1, 1) is the only stationary point of f . The Hessian of f at this
point is  
2 2
 
Hf (1, 1) =  .
2 −2
Therefore, (1, 1) is a saddle point. The function f has no extrema.

Exercise 5.167 Determine the nature of the stationary points of the function f :
R2 → R, defined as being

2 +y 2
f (x, y) = (x2 + y 2 )2 ex .
138 REAL ANALYSIS

Exercise 5.168 Find the local extrema for f : R2 → R, defined by f (x, y) =

x2 − (y − 2)2 .

Exercise 5.169 Find the local extrema for f : R3 → R, defined by f (x, y, z) =

x2 + y 2 + z 2 − xy + x − 2z.

Exercise 5.170 Find the local extrema for f : R3 → R, defined by f (x, y, z) =

x4 + y 4 + z 4 + xyz.

Exercise 5.171 Find the local extrema for f : R3 → R, defined by f (x, y, z) =

2x2 + 2y 2 + z 2 + 2(xy + yz + x + y + 3z).
2
Exercise 5.172 Find the local extrema for f : (0, ∞) → R, defined by
4 2
f (x, y) = xy + + − 3.
x y
Let us look now at the problem of finding local conditional extrema of a given
function f . Very often, we need to consider the problem of minimizing or maximizing
a function under one or several constraints imposed on its variables. Equivalently,
we have to optimize some function whose domain is a given level set. For instance,
we might want to maximize the geometric mean of n positive numbers subject to
the constraint that their arithmetic mean is 1 or we would like to know what shape
should a rectangular parallelepiped with a given volume have in order to minimize
its surface area. Also, similar questions are quite relevant for analyzing physical
processes, in which, for instance, an object is constrained on some track or surface
or in which various coordinates are related (like position and angle when a wheel
rolls without slipping).
In constrained optimization problems, Lagrange’s multipliers method, named af-
ter Joseph Louis Lagrange, is a mathematical tool that allows us to find the extrema
of a function of several variables subject to one or more constraints. This mathe-
matical approach was introduced by Lagrange in the framework of statics, in order
to determine the general equations of equilibrium for problems with constraints.

Definition 5.173 Let S be a nonempty subset of a topological space X, f : X → R

and a ∈ S. The point a is called a local conditional extremum for the function f if
a is a local extremum for the function f |S .
MULTIVARIABLE DIFFERENTIAL CALCULUS 139

Theorem 5.174 (The existence of Lagrange’s multipliers) Let U be an open subset

of Rn × Rm , h : U → Rm , f : U → R, S = h−1 (0) and c = (a, b) ∈ S such that h and
∂h
f are of class C 1 , (c) : Rm → Rm is bijective and the point c is a local conditional
∂y
extremum for f . Then, there exists Λ ∈ L(Rm , R) such that c is a stationary point
for f − Λ ◦ h, i.e.
′ ′
f (c) − Λ ◦ h (c) = 0. (5.16)

In other words, the extrema of f on S can be found among the stationary points of
the auxiliary function f − Λ ◦ h.
The map Λ being in L(Rm , R), it follows that there exists λj ∈ R such that

∑
m
Λ= λj q j ,
j=1

where qj : Rm → R, j = 1, m, are the canonical projections.

If hj = qj ◦ h, we obtain

∂f ∑m
∂hj
(c) − λj (c) = 0, 1 ≤ i ≤ n + m. (5.17)
∂xi j=1
∂xi

The coefficients λj , j = 1, m, are called Lagrange’s multipliers associated to the

function f , the surface S and the point c.
By this method, we replace the problem of finding the stationary points of a
constrained function in n variables with m constraints to the problem of finding the
stationary points of an unconstrained function of n + m variables. Introducing, for
each constraint, a new unknown scalar variable, the Lagrange multiplier, we define
a new function (the Lagrangian) in terms of the original function, the constraints,
and the Lagrange multipliers. Then, we have to find the stationary points of this
auxiliary function L and to decide which of them is an extremum. The local extrema
of the Lagrangian will be exactly the local conditional extrema of the function f ,
subject to the constraints hj .

Algorithm for finding local conditional extrema

1) Write the Lagrangian L = f − Λ ◦ h.

140 REAL ANALYSIS

2) Solve the system

∂f ∑m
∂hj
(c) − λj (c) = 0, 1 ≤ i ≤ n + m, hj = 0, 1 ≤ j ≤ m (5.18)
∂xi j=1
∂xi

and find the stationary points of the Lagrangian L.

3) Analyze the definiteness of the Hessian of the Lagrangian L and determine
the local extrema of L, which are exactly the local conditional extrema of f under
the constraints hj .

Let us notice that Lagrange’s method only provides candidates for extrema. We
must check if indeed the function f possesses an extremum and then we have to
carefully evaluate f at every critical point in order to decide upon the nature of all
theses critical points and to determine correctly the extrema.
Also, it is worth mentioning that Lagrange multipliers can fail to identify all the
conditional extrema if ∇h = 0. So, additionally to Lagrange’s method, we have to
check carefully the points with ∇h(x, y) = 0.

Exercise 5.175 Find the local extrema of the function f : R3 → R, f (x, y, z) =

x − 2y + 2z, under the constraint x2 + y 2 + z 2 = 9.

Solution. Let

F (x, y, z, λ) = x − 2y + 2z − λ(x2 + y 2 + z 2 − 9).

The stationary points of the Lagrangian F can be found by solving the following
system: 

 1 − 2λx = 0
 






 −2 − 2λy = 0
(5.19)



 2 − 2λz = 0






 2 2
x +y +z =92
( )
1 1 1
We get = , i.e. λ = ± . Hence, the stationary points of F are
λ2 1, −2, 2;
( 4 ) 2 2
1
and −1, 2, −2; − .
2
MULTIVARIABLE DIFFERENTIAL CALCULUS 141

1
For λ = , the associated quadratic form is negative definite, i.e. the point
2
(1, −2, 2) is a local maximum for F and a local conditional maximum for the function
f , the maximum value being fmax = 9.
1
For λ = − , the associated quadratic form is positive definite, i.e. the point
2
(−1, 2, −2) is a local minimum for F and, of course, a local conditional minimum
for f , the minimum value being fmin = −9.

Example 5.176 In information theory, the information entropy, introduced by

Claude Elwood Shannon in 1948, is a measure of the uncertainty associated with a
random variable.
The information entropy of a discrete random variable X, that can take the
values {x1 , . . . , xn }, is
∑
n
H(X) = − p(xi ) log2 p(xi ),
i=1

where p(xi ) = P r(X = xi ) = pi is the probability mass function of X.

Alternatively, we can think of an experiment in which n events (outcomes), with
probabilities p1 , p2 , . . . , pn can occur. Of course,

0 < pi ≤ 1

and
p1 + · · · + pn = 1. (5.20)

The entropy associated to this experiment is

∑
n
H(p1 , . . . , pn ) = − pj log2 pj . (5.21)
j=1

Obviously,
H(p1 , . . . , pn ) ≥ 0, ∀p1 , . . . , pn .

Let us find the extrema of H, under the constraint (5.20). Let

F (p1 , . . . , pn , λ) = H(p1 , . . . , pn ) − λ(p1 + · · · + pn − 1).

142 REAL ANALYSIS

Solving the system


 ∂F ∂F

 = 0, . . . , =0
∂p1 ∂pn



p1 + · · · + pn = 1,
we obtain
1
p1 = p2 = · · · = pn = ,
n
for
1
λ=− (1 − ln n).
ln 2
It is not difficult to see that the quadratic form associated to H is negative definite
at the point ( )
1 1
a= ,..., ,
n n
which means that the entropy attains a maximum when the probabilities p1 , . . . , pn
are equal (uncertainty is highest when all possible events are equiprobable). In other
words, the maximum entropy probability distribution is the uniform one. Notice that
maximal entropy means least information content.

Let us notice that by this method it is not always possible to find all the conditional
extrema of a given function (see, for instance, [19] and [34]), i.e. the Lagrange
equations ∇f (x, y) = λ∇h(x, y), h(x, y) = 0 do not give us all the conditional
extrema.

Exercise 5.177 Find the local extrema of the function f : [0, ∞)3 → R, defined by
f (x, y, z) = xyz, subject to the constraint x + y + z = 1.

Exercise 5.178 Find the local extrema of the function f : R2 → R, defined by

f (x, y) = xy, subject to the constraint x2 + y 2 = 1.

Exercise 5.179 Find the local extrema of the function f : (0, ∞)3 → R, defined by
f (x, y, z) = xy + yz + zx, subject to the constraint xyz = 1.

Exercise 5.180 Find the local extrema of the function f : (0, ∞)3 → R, given by
f (x, y, z) = x2 + y 2 + z 2 , under the constraint x + y + z = 1.
MULTIVARIABLE DIFFERENTIAL CALCULUS 143

Exercise 5.181 Find the rectangle which is inscribed in the ellipse

x2 y 2
+ 2 = 1, a>b>0
a2 b
and has the largest perimeter.

Exercise 5.182 Find the local extrema of the function f : R3 → R, defined by

f (x, y, z) = x2 + y 2 + z 2 , subject to the constraint

x2 y 2 z 2
+ 2 + 2 = 1,
a2 b c
for a > b > c > 0.
144
Chapter 6

Sequences and Series of

Functions

6.1 Sequences of Functions

Definition 6.1 Let us consider a sequence of functions (fk )k≥1 , defined on a set
∅ ̸= A ⊆ R :
fk : A → R, k ≥ 1.

The sequence (fk )k≥1 is said to be pointwise convergent at the point a ∈ A if the
number sequence (fk (a))k≥1 is convergent.

The sequence (fk )k≥1 is said to be pointwise convergent on the set A if (fk )k≥1 is
convergent at any point a ∈ A. In this case, we can define a function f : A → R, by
putting
f (x) = lim fk (x), x ∈ A.
k→∞

The function f is called the limit of (fk )k≥1 on A. We shall use the notation fk → f
to denote the fact that f is the limit of the sequence (fk )k .
We shall denote by Ac the set of all the points where (fk )k is pointwise convergent.

Example 6.2 Let fk : (−1, 1) → R defined by fk (x) = xn , for k ≥ 1. Then,

lim fk (x) = 0, i.e. (fk )k is convergent and Ac = (−1, 1).
k→∞

145
146 REAL ANALYSIS

Example 6.3 Let fk : R → R given by

sin kx
fk (x) = , k ≥ 1.
k2

It follows immediately that

lim fk (x) = 0,
k→∞

i.e. (fk )k is convergent and Ac = R.

Example 6.4 If fk : (0, ∞) → R is given by

fk (x) = (−1)k ekx , k ≥ 1,

then (fk )k is not convergent and Ac = ∅.

Definition 6.5 Let ∅ ̸= A ⊆ R and fk : A → R, k ≥ 1. The sequence (fk )k≥1 is

said to be uniformly convergent on Au ⊆ A to f if for any ε > 0 there exists kε ∈ N
such that for any x ∈ Au ,
|fk (x) − f (x)| < ε,

for any k ≥ kε .

u
We shall write fk −→ f to denote the fact that the sequence (fk )k≥1 is uniformly
convergent to f .

Proposition 6.6 Let fk : A ⊆ R → R, k ≥ 1, be a convergent sequence and let

f (x) = lim fk (x). Let Au ⊆ A. If
k→∞

ak = sup |fk (x) − f (x)|

x∈Au

and
lim ak = 0,
k→∞

then (fk )l is uniformly convergent on Au .

SEQUENCES AND SERIES OF FUNCTIONS 147

Example 6.7 Let fk : [0, 1] → R, fk (x) = xk , k ≥ 1. Obviously, fk → f , where



 0 if x ∈ [0, 1),
f (x) =

 1 if x = 1.

On the other hand, one can see immediately that

ak = sup |fk (x) − f (x)| = 1,

x∈[0,1]

i.e. ak 9 0. Therefore, the sequence (fk )k is not uniformly convergent to f on [0, 1].

Proposition 6.8 Let ∅ ̸= A ⊆ R and fk : A → R, k ≥ 1. If the sequence (fk )k is

uniformly convergent to f on A and all the maps fk are continuous at a ∈ A, then
f is continuous at a.

Remark 6.9 Let us notice that if ∅ ̸= A ⊆ R and the sequence fk : A → R, k ≥ 1,

is uniformly convergent to f on A and fk are continuous at a ∈ A, then

lim lim fk (x) = lim lim fk (x).

x→a k→∞ k→∞ x→a

Example 6.10 The pointwise convergence does not preserve, in general, the proper-
ties of the functions fk . For instance, the pointwise limit of a sequence of continuous
functions may not be continuous. As an example, let us consider the sequence of
continuous functions
fk (x) = xk , x ∈ [0, 1],
which is pointwise convergent to the function
{
0, if x ∈ [0, 1),
f (x) =
1, if x = 1.

Obviously, f is discontinuous at the point x = 1.

Proposition 6.11 (Cauchy’s Criterion) Let ∅ ̸= A ⊆ R and fk : A → R, k ≥ 1.

The sequence (fk )k is uniformly convergent on A if and only if for any ε > 0 there
exists kε ∈ N such that for any k ≥ kε , for any p ∈ N and for any x ∈ A, we have

|fk+p (x) − fk (x)| < ε.

148 REAL ANALYSIS

Remark 6.12 Let fk : [a, b] → R be a monotone sequence of functions which is

pointwise convergent to f on [a, b]. If fk and f are continuous, then (fk )k is uni-
formly convergent to f on [a, b].

Exercise 6.13 Let fk : R → R, defined by

3k + cos kx
fk (x) = , k ≥ 1.
k
Show that (fk )k is uniformly convergent on R.

Solution. Obviously, fk → f , where f (x) = 3, for any x ∈ R. On the other hand,

one can see immediately that

ak = sup |fk (x) − f (x)| → 0,

x∈R

i.e. the sequence (fk )k is uniformly convergent to f on R.

Exercise 6.14 Let fk : [0, ∞) → R defined by

x
fk (x) = .
1 + 2knx
Show that (fk )k is uniformly convergent.

Solution. The sequence (fk )k is pointwise convergent to f (x) = 0, for x ≥ 0. Also,

(fk )k converges uniformly to f , since

ak = sup |fk (x) − f (x)| → 0.

x∈[0,∞)

Exercise 6.15 Test the following sequences of functions for convergence:

a) fk : (−1, 1) → R, fk (x) = xk , k ≥ 1;
sin kx
b) fk : R → R, fk (x) = , k ≥ 1;
k3
x
c) fk : [0, ∞) → R, fk (x) = , k ≥ 1.
k+x
Exercise 6.16 Test the following sequences of functions for convergence:
x
a) fk : [0, 1] → R, fk (x) = , k ≥ 1;
k+x
kx
b) fk : (0, 1) → R, fk (x) = , k ≥ 1;
k+x
c) fk : R → R, fk (x) = arctan (kx), k ≥ 1.
SEQUENCES AND SERIES OF FUNCTIONS 149

6.2 Series of Functions

Definition 6.17 Let ∅ ̸= A ⊆ R, fk : A → R, k ≥ 1, and

∑
k
Sk (x) = fi (x). (6.1)
i=1

The pair ((fk )k≥1 , (Sk )k≥1 ) is said to be a series of functions (the series associated
to the sequence (fk )k≥1 ).
∑ ∑
We use the notation fk . Sk is called the kth partial sum of the series fk and
k≥1 k≥1
fk is said to be its general term.
∑
Definition 6.18 The series fk (x) is said to be convergent at x ∈ A if the se-
k≥1
quence (Sk (x))k≥1 is convergent. The limit S(x) of (Sk (x))k≥1 is called the sum of
∑
the convergent series fk (x) at the point x.
k≥1

We shall use the following symbol to denote the sum of a convergent series:
∞
∑
S= fk .
k=0

Definition 6.19 A series which is not convergent is called divergent.

∑
Definition 6.20 A series fk is called absolutely convergent at x if the number
k≥0
∑
series |fk (x)| is convergent.
k≥0
∑
Definition 6.21 The series fk is called uniformly convergent on the set Au ⊆ A
k≥0
if (Sk )k≥1 is uniformly convergent on Au .
∑
Proposition 6.22 (Cauchy’s Criterion) The series fk is uniformly convergent
k≥0
on Au ⊆ A if and only if for any ε > 0 there exists kε ∈ N such that

|fk+1 (x) + · · · + fk+p (x)| < ε, ∀k ≥ kε , ∀p ≥ 1, ∀x ∈ Au .

150 REAL ANALYSIS

Theorem 6.23 (Weierstrass) Let fk : A ⊆ R → R, k ≥ 1. If there exists ak ≥ 0

such that
|fk (x)| ≤ ak ,
∑ ∑
for any k and for any x ∈ A ′ ⊆ A and if ak is convergent, then fk is
k≥1 k≥1
absolutely and uniformly convergent on A ′ ⊆ A.
∑
Theorem 6.24 Let ∅ ̸= A ⊆ R and fk : A → R, k ≥ 1. If fk is uniformly
k≥1
∑
convergent on A and fk are continuous at a ∈ A, then the sum of the series fk
k≥1
is continuous at a ∈ A.

Theorem 6.25 Let I ̸= ∅ be an interval in R and fk : I → R, k ≥ 1. If fk are

continuous and the sequence (fk )k≥1 is uniformly convergent to f on I, then, for
any interval [α, β] ⊆ I, we have:
∫ β ∫ β
lim fk (x) dx = f (x) dx.
k→∞ α α

Theorem 6.26 Let I ≠ ∅ be an interval in R and fn : I → R, n ≥ 1. If fn are

∑
continuous and fn is uniformly convergent to f on I, then, for any interval
n≥1
[α, β] ⊆ I, we have:
∑∫ β ∫ β
fn (x) dx = f (x) dx.
n≥1 α α

Theorem 6.27 Let I ̸= ∅ be a bounded interval in R and fk : I → R, k ≥ 1,

such that fk are derivable and fk ′ are continuous. If there exists x0 ∈ I such that
′
(fk (x0 ))k≥1 is convergent and if (fk )k≥1 is uniformly convergent on I to g : I → R,
then there exists f : I → R such that (fk )k≥1 is uniformly convergent to f on I, f
is derivable and
f ′ = g.

Theorem 6.28 Let I ̸= ∅ be a bounded interval in R and fk : I → R, k ≥ 1,

′
such that fk are derivable and fk are continuous. If there exists x0 ∈ I such that
∑ ∑ ′
fk (x0 ) is convergent and if fk is uniformly convergent on I to g : I → R,
k≥1 k≥1
SEQUENCES AND SERIES OF FUNCTIONS 151

∑
then there exists f : I → R such that fk is uniformly convergent to f on I, f is
k≥1
derivable and
f ′ = g.

Example 6.29 Let us consider

sin kx
fk (x) = , for p > 1 and x ∈ R.
kp
∑
The series fk is absolutely and uniformly convergent on R, because
k≥1

sin kx 1
fk (x) = ≤ p
kp k
∑ 1
and the series is convergent for p > 1.
k≥1
kp

∑ cos kx
Exercise 6.30 Show that the series is uniformly convergent on R.
k≥1
x2 + k 2

Solution. Since
cos kx 1 1
≤ 2 ≤ 2
x2 + k 2 x + k2 k
∑ 1
and the number series is convergent, it follows immediately that our series is
k2 k≥1
uniformly convergent on R.

Exercise 6.31 Test the following series of functions for convergence:

∑ sin kx
a) fk , where fk : R → R, fk (x) = ;
k≥1
k3

∑ 2x
b) fk , where fk : R → R, fk (x) = arctan ;
k≥1
x2 + k4

∑ (−1)k
c) fk , where fk : [0, ∞) → R, fk (x) = .
k≥1
x+k
152 REAL ANALYSIS

6.3 Power Series

Definition 6.32 Let x0 ∈ R, ak ∈ R, k ≥ 0. A series of functions for which

fk (x) = ak (x − x0 )k , k ≥ 0,

is called a power series on R. We shall denote such a power series by

∑
ak (x − x0 )k . (6.2)
n≥0

The above series is convergent for x = x0 .

Theorem 6.33 (Cauchy-Hadamard) Let R ≥ 0 be defined as follows:

1
R= √ ,
lim k
|ak |
k→∞

√ √
with the convention that R = 0 if lim k | ak | = ∞ and R = ∞ if lim k |ak | = 0.
k→∞ k→∞
Then:

1) if R > 0, the power series (6.2) is absolutely convergent for any x such that
|x − x0 | < R and divergent for any x with |x − x0 | > R;

2) if R > 0, the power series (6.2) is uniformly convergent over any compact
set [x0 − r, x0 + r] with 0 < r < R;

3) if R = 0, the series (6.2) is convergent only for x = x0 .

Remark 6.34 The non-negative quantity R is called the radius of convergence for
the series (6.2).

The set
Dc = {x ∈ R | |x − x0 | < R}

is called the interval or the set of convergence for the series (6.2). At the end points
of the interval of convergence, i.e. at the points x − x0 = R and x − x0 = −R, the
power series (6.2) may be both convergent or divergent.
SEQUENCES AND SERIES OF FUNCTIONS 153

ak
Remark 6.35 If there exists lim , then
k→∞ ak+1
ak
R = lim .
k→∞ ak+1
ak
Moreover, if there exists lim , then
k→∞ ak+1
ak
R = lim .
k→∞ ak+1
∑
Example 6.36 The radius of convergence of the series k! xk is equal to 0. There-
k≥0
fore, this series is convergent only for x = 0, i.e. Dc = {0}.
∑ xk
Example 6.37 The radius of convergence for the series is equal to ∞. Thus,
k≥0
k!
the set of convergence is Dc = R.

Exercise 6.38 Find the radius and the domain of convergence for the series
∑ (x − 5)k
(−1)k−1 .
k≥1
k 3k

Solution. It is easy to see that the radius of convergence for this series is equal to
3. Therefore, using Cauchy-Hadamard theorem, we see that our series is convergent
for x ∈ (2, 8) and divergent for x ∈ (−∞, 2) ∪ (8, ∞). Let us analyze what happens
∑ (−1)2k−1
at the end points x = 2 and x = 8. For x = 2, our series becomes ,
k≥1
k
∑ (−1)k−1
which is a divergent series. For x = 8, our series becomes and, using
k k≥1
Leibniz criterion, it is a convergent series. So, the interval of convergence of the
given power series is
Dc = (2, 8].

Remark 6.39 Every convergent power series defines on its interval of convergence
Dc a function
∞
∑
f (x) = ak (x − x0 )k .
k=0
154 REAL ANALYSIS

When two functions f and g are decomposed into power series about the same point
x0 , the power series of their sum or difference can be obtained by termwise addition
or subtraction. More precisely, if:
∞
∑
f (x) = ak (x − x0 )k
k=0

and ∞
∑
g(x) = bk (x − x0 )k ,
k=0
then ∞
∑
(f ± g)(x) = (ak ± bk )(x − x0 )k .
k=0

Also, we can define the product of the power series f (x) and g(x) as being:

∞ ∑
∞ ∞
( k )
∑ ∑ ∑
(f g)(x) = ai bj (x − x0 )
i+j
= ai bk−i (x − x0 )k .
i=0 j=0 k=0 i=0

The sequence
∑
k
ck = ai bk−i
i=0

is called the convolution of the sequences (ak )k and (bk )k .

Remark 6.40 Usually, we shall work with power series about the point x0 = 0, i.e.
with series of the form
∑
ak xk ,
k≥0

usually called Maclaurin series.

Definition 6.41 A power series

∞
∑
f (x) = ak (x − x0 )k
k=0

is said to be invertible if there exists a power series g(x) such that f (x) g(x) = 1,
for any x ∈ Dc .
SEQUENCES AND SERIES OF FUNCTIONS 155

∞
∑
Remark 6.42 The power series ak xk is invertible if and only if a0 ̸= 0.
k=0

Example 6.43 The power series 1 − x is invertible and its inverse is the geometric
∑
series xk .
k≥0

Remark 6.44 If a power series having the radius R is uniformly convergent over
[x0 − r, x0 + r], 0 < r < R, then its sum defines a continuous function at any point
x with |x − x0 | < R.

Remark 6.45 Let R be the radius of convergence for the series (6.2). Then, the
∑
series k ak (x − x0 )k−1 (obtained by differentiating (6.2) with respect to x term
k≥1
by term) has the same radius of convergence.

Remark 6.46 Let R > 0 be the radius of convergence for the series (6.2) and let f ,
defined on (x0 − R, x0 + R), be the sum of this series. Then, f is indefinite derivable
(term by term) on this interval.

Example 6.47 For any value of x between −1 and +1, we may write
1
= 1 − x2 + x4 − x6 + · · · + (−1)k x2k + · · · .
1 + x2
Integrating this series term by term between the limits 0 and x, where |x| < 1, we
find
x x3 x2k+1
arctan x = − + · · · + (−1)k + ···.
1 3 2k + 1
Since the new series converges also for x = 1, it follows that
π 1 1 1
= 1 − + − · · · + (−1)k + ···.
4 3 5 2k + 1
Exercise 6.48 Compute the radius and the domain of convergence for the following
series:
∑ xk ∑ xk ∑ ∑ xk
k
a) ; b) ; c) k! x ; d) ;
k≥0
k! k≥1
kk k≥0 k≥1
k2
∑ xk ∑ (x − 5)k ∑ (x − 1)2k
e) ; f) (−1)k−1 ; g) .
k≥1
k 2k k≥1
k 3k k≥1
k 9k
156 REAL ANALYSIS

Exercise 6.49 Compute the sum of the series:

∑ xk
S(x) = , x ∈ [−1, 1).
k≥1
k

Exercise 6.50 Compute the sum of the series

∑ xk
S(x) = (−1)k+1 , x ∈ (−1, 1].
k≥1
k

6.4 Taylor Series

Definition 6.51 Let I be an open nonempty interval in R, f : I → R, f ∈ C ∞ (I)
and x0 ∈ I. The power series
∑ 1
f (k) (x0 )(x − x0 )k
k≥0
k!

is called the Taylor series of the function f at the point x0 .

The function f is called analytic if for any x0 ∈ I, there exists r > 0 such that
the radius of convergence of the Taylor series of f at the point x0 is R ≥ r and
∞
∑ 1
f (x) = f (k) (x0 )(x − x0 )k , ∀x ∈ I, |x − x0 | < r. (6.3)
k=0
k!

This definition characterizes the class of the functions which can be locally approx-
imated by convergent power series.
Let us notice that every power series with a positive radius of convergence is
analytic on the interior of its region of convergence. Also, notice that sums and
products of analytic functions are analytic.
For an analytic function, the coefficients ak can be computed as
f (k) (x0 )
ak = .
k!
So, every analytic function can be locally represented by its Taylor series. The global
form of an analytic function is completely determined by its local behavior, i.e. if
f and g are two analytic functions defined on the same open nonempty interval I,
and if there exists an element c ∈ I such that f (k) (c) = g (k) (c), for all k ≥ 0, then
f (x) = g(x) for all x ∈ I.
SEQUENCES AND SERIES OF FUNCTIONS 157

Remark 6.52 If a function is analytic, then it is indefinitely derivable, but, in

the real case, the converse implication is not generally true, i.e. not any function
f ∈ C ∞ (I) is analytic.

Example 6.53 The function f : R → R, defined by


 1
 −
2
f (x) =
 e x , x ̸= 0,

0, x = 0,

is indefinitely derivable on R, but it is not analytical.

Theorem 6.54 Let f : (a, b) → R be an indefinitely derivable function on the open

interval (a, b) and let x0 ∈ (a, b). If there exist R > 0 and M > 0 such that for any
x ∈ (x0 − R, x0 + R) ⊂ (a, b) and for any k ≥ 0,

|f (k) (x)| ≤ M k ,

then f is analytic at the point x0 .

Theorem 6.55 Let I be an open nonempty interval in R, f : I → R, f ∈ C ∞ (I)

and x0 ∈ I. Then, the function f can be expanded in a Taylor series
∞
∑ 1
f (x) = f (k) (x0 )(x − x0 )k ,
k=0
k!

(i.e.f is the sum of its associated Taylor series) if and only if

lim Rk (x) = 0.
k→∞

Elementary functions

Using power series, we can rigorously define the most common used elementary
functions of real arguments.

1) A polynomial functions P (x) can be defined as being a power series with a

finite number of nonzero coefficients:

P (x) = a0 + a1 x + · · · + ak xk ,
158 REAL ANALYSIS

with ai ∈ R. The radius of convergence of this power series is ∞ and the polynomial
function is indefinitely derivable on R.

2) Rational functions are functions of the form

P (x)
f (x) = ,
Q(x)

where P and Q are polynomial functions in x and Q is not the zero polynomial. The
domain of f is the set of all points x for which the denominator Q(x) is not zero.

3) The exponential function exp : R → R is defined by

∑ xk
exp(x) = .
k≥0
k!

This function is also denoted by ex and its radius of convergence is ∞.

4) The sine function sin : R → [−1, 1] is defined by

∑ x2k+1
sin x = (−1)k .
k≥0
(2k + 1)!

Its radius of convergence is ∞.

5) The cosine function cos : R → [−1, 1] is defined by

∑ x2k
cos x = (−1)k .
k≥0
(2k)!

Its radius of convergence is ∞.

6) The hyperbolic sine function sinh : R → R, defined by

∑ x2k+1
sinh x = .
k≥0
(2k + 1)!

Its radius of convergence is ∞.

SEQUENCES AND SERIES OF FUNCTIONS 159

7) The hyperbolic cosine function cosh : R → R, defined by

∑ x2k
cosh x = .
k≥0
(2k)!

Its radius of convergence is ∞.

∑ xk+1
8) ln (1 + x) = (−1)k , |x| < 1.
k≥0
k+1

The above series is also convergent for x = 1 and we get

1 1 1
ln 2 = 1 − + − + ···
2 3 4

∑ α(α − 1) · · · (α − k + 1)
9) (1 + x)α = 1 + xk , α ∈ R, x ∈ (−1, 1).
k≥1
k!
The above series is called the binomial series. If α ∈ N, we get the well-known
Newton’s formula.

Exercise 6.56 Prove that the above elementary functions gave the following prop-
erties:
1) ex+y = ex · ey , ∀x, y ∈ R;
′
2) (ex ) = ex , ∀x ∈ R;

3) eix = cos x + i sin x, ∀x ∈ R (Euler’s formula);

eix − e−ix
4) sin x = , ∀x ∈ R;
2i

eix + e−ix
5) cos x = , ∀x ∈ R;
2
ex − e−x
6) sinh x = , ∀x ∈ R;
2
ex + e−x
6) cosh x = , ∀x ∈ R;
2
160 REAL ANALYSIS

7) sin2 x + cos2 x = 1, ∀x ∈ R;

8) cosh2 x − sinh2 x = 1, ∀x ∈ R;
′ ′
9) (sin x) = cos x, (cos x) = − sin x, ∀x ∈ R;
′ ′
10) (sinh x) = cosh x, (cosh x) = sinh x, ∀x ∈ R;

11) sin (−x) = − sin x, cos (−x) = cos x, ∀x ∈ R;

12) sinh (−x) = − sinh x, cosh (−x) = cosh x, ∀x ∈ R;

13) sin (x + y) = sin x cos y + cos x sin y, ∀x, y ∈ R;

14) cos (x + y) = cos x cos y − sin x sin y, ∀x, y ∈ R;

15) sinh (x + y) = sinh x cosh y + cosh x sinh y, ∀x, y ∈ R;

16) cosh (x + y) = cosh x cosh y + sinh x sinh y, ∀x, y ∈ R.

Bibliography

[1] M. Abramowitz, I.E. Stegun, Handbook of Mathematical Functions with

Formulas, Graphs, and Mathematical Tables, Dover Publications, Inc., New
York, 1977.

[2] G. Arfken, H. Weber, Mathematical Methods for Physicists, Elsevier Aca-

demic Press, 2005.

[3] P. Bamberg, S. Sternberg, A Course in Mathematics for Students of

Physics, Cambridge University Press, 1990.

[4] G. N. Berman, A Problem Book in Mathematical Analysis, MIR Publishers,

Moscow, 1981.

[5] N. Boboc, Mathematical Analysis, Tipografia Universităţii Bucureşti, 1988

(in Romanian).

[6] A. M. Bruckner, J. B. Bruckner, B. S. Thomson, Real Analysis,

Prentice- Hall, 1997.

[7] Ya.S. Bugrov, S.M. Nikolsky, Differential Equations, Multiple Integrals,

Series, Theory of Functions of Complex Variable, Mir Publishers, Moscow,
1983.

[8] H. Cartan Calcul différentiel, Hermann, Paris, 1967.

[9] K. Ciesielski Set Theory for the Working Mathematician, Cambridge Uni-
versity Press, 1997.

161
162 REAL ANALYSIS

[10] I. Colojoară, Mathematical Analysis, Editura Didactică şi Pedagogică,

Bucharest, 1983 (in Romanian).

[11] N. Cotfas, L. A. Cotfas, Elements of Mathematical Analysis, Editura Uni-

versităţii din Bucureşti, 2010 (in Romanian).

[12] R. Courant, Differential and Integral Calculus, Wiley, New York, 1992.

[13] R. Courant, D. Hilbert, Methods of Mathematical Physics, Wiley, New

York, 1989.

[14] L. Elsgolts, Differential Equations and the Calculus of Variations, Mir Pub-
lishers, Moscow, 1980.

[15] D. Flondor, N. Donciu, Algebra and Mathematical Analysis. Problem Book,

Editura Didactică şi Pedagogică, Bucharest, 1979 (in Romanian).

[16] D. Flondor, O. Stănăşilă, Lessons of Mathematical Analysis, Editura

ALL, Bucharest, 1993 (in Romanian).

[17] A. Halanay, V. Olariu, S. Turbatu, Mathematical Analysis, Editura

Didactică şi Pedagogică, Bucharest, 1983 (in Romanian).

[18] P. Halmos, Naive set theory, Princeton, NJ: D. Van Nostrand Company,
1960; reprinted by Springer-Verlag, New York, 1974.

[19] O. Knill, Multivariable Calculus, Math 21a, Harvard University, 2004.

[20] S. Lang, Analysis I, Addison-Wesley Publ. Co., Reading, Massachusetts,

1968.

[21] L.H. Loomis, S. Sternberg, Advanced Calculus, Addison-Wesley Reading,

1968.

[22] C.P. Niculescu, Fundamentals of Mathematical Analysis, Vol. I, Editura

Academiei Române, Bucharest, 1996 (in Romanian).

[23] S.M. Nikolsky, A Course of Mathematical Analysis, Mir Publishers,

Moscow, 1981.
BIBLIOGRAPHY 163

[24] V. Olariu, Mathematical Analysis, Editura Didactică şi Pedagogică,

Bucharest, 1981 (in Romanian).

[25] M. Roşculeţ, Mathematical Analysis, Editura Didactică şi Pedagogică,

Bucharest, 1979 (in Romanian).

[26] W. Rudin, Principles of Mathematical Analysis, McGraw-Hill, New York,

1964.

[27] L. Schwarz, Cours d’analyse, 2 tomes, Hermann Paris, 1967.

[28] Gh. Sireţchi, Series. Set Theory. Elementary Functions, Tipografia Univer-
sităţii Bucureşti, 1984 (in Romanian).

[29] Gh. Sireţchi, General Topology, Tipografia Universităţii Bucureşti, 1983 (in
Romanian).

[30] Gh. Sireţchi, Differential Calculus, Tipografia Universităţii Bucureşti, 1983

(in Romanian).

[31] O. Stănăşilă, Mathematical Analysis, Editura Didactică şi Pedagogică,

Bucharest, 1981 (in Romanian).

[32] P. Szekeres, A Course in Modern Mathematical Physics, Cambridge Uni-

versity Press, 2006.

[33] D. Stefănescu, Real Analysis, Tipografia Universităţii Bucureşti, 1990 (in

Romanian).

[34] C. Timofte, Differential Calculus, Editura Universităţii din Bucureşti, 2009.

[35] S. Turbatu, D. Ştefănescu, Mathematical Analysis. Problem Book, Ti-

pografia Universităţii Bucureşti, 1985 (in Romanian).