Math 215 Lecture Notes
Math 215 Lecture Notes
Mathematical Analysis
Lecture Notes
Anıl Taş∗
September 2005
∗
M.A. student at the Department of Economics, Bilkent University, Bilkent, 06800,
Ankara, Turkey. E-mail: [email protected]. This course was given by Prof. Mefharet
Kocatepe in the 2005 Bilkent Summer School.
Contents
1 The Real And Complex Number Systems 3
1.1 The Real Number System . . . . . . . . . . . . . . . . . . . . 3
1.2 Extended Real Numbers . . . . . . . . . . . . . . . . . . . . . 8
1.3 The Complex Field . . . . . . . . . . . . . . . . . . . . . . . . 9
3 Basic Topology 18
3.1 Metric Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
3.2 Subspaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
3.3 Compact Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
3.4 The Cantor Set . . . . . . . . . . . . . . . . . . . . . . . . . . 31
3.5 Connected Sets . . . . . . . . . . . . . . . . . . . . . . . . . . 33
5 Continuity 64
5.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
5.2 Continuity And Compactness . . . . . . . . . . . . . . . . . . 67
5.3 Continuity And Connectedness . . . . . . . . . . . . . . . . . 69
5.4 Uniform Continuity . . . . . . . . . . . . . . . . . . . . . . . . 69
7 Figures 86
2
1 The Real And Complex Number Systems
1.1 The Real Number System
R : The set of real numbers
m
Q : The set of rational numbers (Numbers in the form n
where m, n are
integers, n 6= 0)
Z : The set of integers, {0, 1, −1, 2, −2, 3, −3, . . .}
N : The set of natural numbers, {1, 2, 3, 4, . . .}
Proofs:
1) Direct Proofs
2) Indirect Proofs
a) Proof by Contraposition
b) Proof by Contradiction
1.1 Example (Direct Proof). If f is differentiable at x = c then f is con-
tinuous at x = c.
f 0 (c) 0 f (c)
= f (c)
3
Proof. Assume n is odd then n = 2k + 1 for some integer k. Then
n2 = 4k 2 + 4k + 1 = 2(2k 2
| {z + 2k}) + 1
an integer
So n2 is odd.
√
1.3 Example (Indirect Proof: Proof by Contradiction). Show that 2 is
not a rational number.
Proof. If c|2 {z
= 2} then c| is not{zrational}. We assume p and ∼ q, proceed and
p q
get a contradiction. So assume c2 = 2 and c is rational. Then c = mn
where
2 m2
m, n ∈ Z, n 6= 0 and m, n have no common factors. We have c = n2 then
m2 = 2n2 . So m2 is even and m is even. Then m = 2k for some integer k.
We get 4k 2 = 2n2 or 2k 2 = n2 . Then n2 is even and n is even. Then n = 2`
for some integer `. So m and n have a common factor. A contradiction.
Some Symbols And Notation
• p ⇒ q : if p then q (p implies q)
• 3 : such that
• ∴ : therefore, so
4
1.5 Example. Let A = {p : p ∈ Q, p > 0, p2 < 2} and B = {p : p ∈ Q, p >
0, p2 > 2}.
Claim: A has no largest element and B has no smallest element.
−2 2
Proof. Given any p ∈ Q, p > 0, let q = p − pp+2 = 2p+2
p+2
. Then q ∈ Q and
2
q > 0. Let p ∈ A, i.e. p < 2. Then show q ∈ A and p < q.
p2 − 2
p2 − 2 < 0 so q = p − >p
p+2
2
4p2 + 4 + 8p − 2p2 − 8 − 8p 2(p2 − 2)
2 2p + 2
q −2= −2= = <0
p+2 p2 + 4 + 4p (p + 2)2
So q 2 < 2. Then we have q ∈ A and A has no largest element.
Properties of R
1) R has two operations + and · with respect to which it is a field.
(i) ∀x, y ∈ R, x+y ∈R
(ii) ∀x, y ∈ R, x + y = y + x (commutativity of +)
(iii) ∀x, y, z ∈ R, x + (y + z) = (x + y) + z (associativity of +)
(iv) ∃ an element (0 element) such that ∀x ∈ R, x+0=x
(v) ∀x ∈ R ∃ an element −x ∈ R such that x + (−x) = 0
(vi) ∀x, y ∈ R, x·y ∈R
(vii) ∀x, y ∈ R, x·y =y·x
(viii) ∀x, y, z ∈ R, x · (y · z) = (x · y) · z
(ix) ∃ an element 1 6= 0 in R such that ∀x ∈ R, x·1=x
1 1
(x) ∀x 6= 0 in R there is an element x
in R such that x · x
=1
(xi) ∀x, y, z ∈ R, x · (y + z) = x · y + x · z
1.6 Remark. Note that Q with + and · is also a field.
2) R is an ordered field, i.e. there is a relation < with the following properties
(i) ∀x, y ∈ R one and only one of the following is true:
5
(ii) ∀x, y, z ∈ R, x < y and y < z ⇒ x < z (Transitive Law)
3) R is complete.
1.11 Remark. Bounded below and lower bound are defined analogously.
6
(i) b ∈ E
(ii) b ∈
/E
1.16 Theorem.
Proof.
(a) Assume it is not true. So there are x, y ∈ R such that x > 0 for which
there is no n ∈ N such that nx > y. So for all n ∈ N we have nx ≤ y.
Let E = {nx : n ∈ N} = {x, 2x, 3x, . . .}. Then y is an upper bound
for E and E 6= ∅. So E has a least upper bound, say α ∈ R. Since
x > 0, α − x < α. Then α − x is not an upper bound for E. So there
is an element of E, say mx (where m ∈ N) such that α − x < mx.
Then α < (m + 1)x. This element of E is bigger than α = sup E.
Contradiction.
7
(b) Let x, y ∈ R be such that x < y. Then y − x > 0. By part (a),
∃n ∈ N such that n(y − x) > 1, i.e. ny > 1 + nx. In (a), replace
y by nx and x by 1 > 0. So ∃m1 ∈ N such that m1 > nx. Let
A = {m : m ∈ Z, nx < m}. Then A 6= ∅ since m1 ∈ A. Since A
is non-empty set of integers which is bounded below, A has a smallest
element m0 . Then nx < m0 and m0 ∈ Z. m0 − 1 ∈ / A. So we have
nx ≥ m0 − 1. So m0 − 1 ≤ nx < m0 . Then nx < m0 , m0 ≤ 1 + nx and
1 + nx < ny. So nx < m0 < ny. If we divide this by n > 0, we get
x < mn0 < y. mn0 is a rational number.
Uniqueness of Least Upper Bound: Assume E ⊂ R is non-empty and
bounded above. Then E has only one least upper bound.
Proof. Assume b, b0 are two least upper bounds for E.
(i) b = sup E and b0 is an upper bound for E ⇒ b ≤ b0
α = sup E ⇔ (i) ∀x ∈ E, x ≤ α
and
(ii) Given any ε > 0, ∃y ∈ E such that α − ε < y
8
1.3 The Complex Field
Let C denote the set of all ordered pairs (a, b) where a, b ∈ R. We say
Under these operations C becomes a field with (0, 0), (1, 0) being the zero
element and multiplicative unit.
Define φ : R → C by φ(a) = (a, 0). Then
9
p
(d) |Re z| ≤ |z| (i.e. |x| ≤ x2 + y 2 )
Proof of (e).
= B 2 A − |BCC
{z } − CBC
2
| {z } +|C| B
B|C|2 |C|2 B
2
= B AB − |C|
10
Replacing bj by bj and using z = z, |z| = |z| we get
2 ! !
Xn n
X n
X
a j j ≤
b |aj |2 |bj |2
j=1 j=1 j=1
n
!2 n
! n
!
X X X
aj b j ≤ a2j b2j
j=1 j=1 j=1
11
2 Sets And Functions
2.1 General
Let X and Y be two non-empty sets. A function f : X → Y is a rule which
assigns to each x ∈ X a unique element y = f (x) in Y .
2.1 Example. Given x ∈ R, consider its decimal expansion in which there
is no infinite chain of 9’s. x = 41 is represented as 0.25000 · · · instead of
0.24999 · · · Let y = f (x) be the fortyninth digit after the decimal point. We
have f : R → {0, 1, 2, . . . , 9}.
12
(d) f (A1 ∪ A2 ) = f (A1 ) ∪ f (A2 )
Proof of (b).
A ⊂ f −1 (f (A))
Let x ∈ A and let y = f (x). Then y ∈ f (A), i.e. f (x) ∈ f (A). So
x ∈ f −1 (f (A)) and A ⊂ f −1 (f (A)).
A = f −1 (f (A)) for all A ⊂ X ⇔ f is 1-1
(⇐): Assume f is 1-1. Show for all A ⊂ X, A = f −1 (f (A)), i.e. show
A ⊂ f −1 (f (A)) and f −1 (f (A)) ⊂ A. So show f −1 (f (A)) ⊂ A. Let x ∈
| {z }
always true
f −1 (f (A)). Then f (x) ∈ f (A). Then ∃x0 ∈ A such that f (x) = f (x0 ).
Since f is 1-1, x = x0 . So x ∈ A and f −1 (f (A)) ⊂ A.
(⇒): Assume A = f −1 (f (A)) for all A ⊂ X. Show f is 1-1. Assume f is
not 1-1. Then there are x1 , x2 ∈ X such that x1 6= x2 and f (x1 ) =
f (x2 ). Let y = f (x1 ) = f (x2 ). Let A = {x1 }. Then f (A) = {y} and
f −1 (f (A)) = {x1 , x2 , . . .}. Then A 6= f −1 (f (A)). Contradiction.
Let {Ai : i ∈ I} be an arbitrary class of subsets of a set X indexed by a set
I of subscripts. We define
[
Ai = {x : x ∈ Ai for at least one i ∈ I}
i∈I
\
Ai = {x : x ∈ Ai for every i ∈ I}
i∈I
S T
If I = ∅, then we define i∈∅ Ai = ∅ and i∈∅ Ai = X. (If we require of an
element that it belongs to each set in the class and if there are no sets in the
class, then every element x ∈ X satisfies this requirement.) If A ⊂ X we
define AC = {x : x ∈/ A} complement of A.
!C !C
[ \ \ [
Ai = AC
i , A i = ACi (De Morgan’s Laws)
i∈I i∈I i∈I i∈I
13
(a) f −1 (B C ) = (f −1 (B))C
(i) A ∼ A
(ii) A ∼ B ⇒ B ∼ A
(iii) A ∼ C ⇒ A ∼ C
14
• X is at most countable if X is finite or countable.
m\n 1 2 3 4 ···
1 1 1 1
1 1 2 3 4
···
. . .
2 2 2 2
2 1 2 3 4
···
. . .
3 3 3 3
3 1 2 3 4
···
. . .
4 4 4 4
4 1 2 3 4
···
.. .. .. .. .. ..
. . . . . .
this order omitting the ones which are already listed before. Then we get the
following sequence
1 1 2 1 3 1 2 3 4
, , , , , , , , ···
1 2 1 3 1 4 3 2 1
Define f : N → Q+ as follows
1 1 2 1
f (1) = , f (2) = , f (3) = , f (4) = ···
1 2 1 3
15
Suppose X is countable, so we have 1-1, onto function f : N → X. Let
f (n) = xn . Then we can write the elements of X as a sequence
X = {x1 , x2 , x3 , . . .}
Define
( ( (
0 if y11 = 1 0 if y22 = 1 0 if ynn = 1
z1 = z2 = zn =
1 if y11 = 0 1 if y22 = 0 1 if ynn = 0
2.13 Example. [0, 1], (0, 1), R, (a, b) are all uncountable. They are all
numerically equivalent.
16
2.16 Example. Let X = {(x, y) : 0 < x < 1, 0 < y < 1}. Then X ∼ (0, 1).
Define g : (0, 1) → X by g(x) = x, 12 .
Let
f (x, y) = 0.x1 y1 x2 y2 x3 y3 · · ·
Then f, g are 1-1 so by the above theorem X ∼ (0, 1).
17
3 Basic Topology
3.1 Metric Spaces
In R, Rk = {(x1 , . . . , xk ) : x1 , . . . , xk ∈ R} we have the notion of distance.
In R, d(x, y) = |x − y|
In Rk , x = (x1 , . . . , xk ), y = (y1 , . . . , yk ). We have
p
d(x, y) = (x1 − y1 )2 + · · · + (xk − yk )2
d: X × X}
| {z →R
{(x,y):x,y∈X}
18
3.2 Example.
1) X 6= ∅ any set. Given any x, y ∈ X let
1 if x 6= y
d(x, y) =
0 if x = y
≤ d∞ (x, z) + d∞ (z, y)
19
d∞ is called the `∞ metric on Rk .
4) Let S be any fixed non-empty set. A function f : S → R is called bounded
if f (S) is a bounded subset of R, i.e. there are two numbers A, B such that
∀s ∈ S, A ≤ f (s) ≤ B.
√
For example, f : R → R, f (s) = arctan s is bounded, f (s) = s2 + 1 is
unbounded.
Let X = B(s) = all bounded functions f : S → R. Let f, g ∈ B(S), then
f − g is also bounded. We define
a + b < sup(A + B) + 2δ
a + b − sup(A + B)
< sup(A + B) +
2
a + b sup(A + B)
<
2 2
Contradiction.
Proof of (iii). Given f, g, h ∈ B(S), let
20
Then sup C = d(f, g), sup A = d(f, h) and supB = d(h, g). Let x ∈ C. Then
∃s ∈ S such that x = |f (s) − g(s)|. Then
x = |f (s) − g(s)|
= |(f (s) − h(s)) + (h(s) − g(s))|
≤ |f (s) − h(s)| + |h(s) − g(s)|
| {z } | {z }
call y call z
=y+z ∈A+B
Br [p] = {x ∈ X : d(x, p) ≤ r}
3.4 Example.
p
1) X = Rk , d2 (x, y) = (x1 − y1 )2 + · · · + (xk − yk )2 . (See Figure 2).
5) X = B(S) with sup metric. Let S = [a, b]. Then Br (f ) is the set of all
functions g whose graph is in the shaded area. (See Figure 5).
21
3.5 Definition. Let (X, d) be a metric space and E a subset of X.
Proof. Let q ∈ Br (p). Show that ∃s > 0 such that Bs (q) ⊂ Br (p). Since
q ∈ Br (p) we have d(q, p) < r. So r − d(q, p) > 0. Show Bs (q) ⊂ Br (p). Let
| {z }
let this be s
x ∈ Bs (q), i.e. d(x, q) < s. Then
So x ∈ Br (p).
22
7) E 0 is the set of all limit points of E. We define E = E ∪ E 0 . E is called
the closure of E.
We have p ∈ E ⇔ for every neighborhood N of p we have N ∩ E 6= ∅.
Proof.
Proof.
23
(⇐): Trivial.
(c) E is the smallest closed set that contains E, i.e. if F is any closed set
such that E ⊂ F then E ⊂ F .
Proof.
(a) Show (E)C is an open set. Let p ∈ (E)C . Then ∃r > 0 such that
Br (p) ∩ E = ∅. This means Br (p) ⊂ E C . Show that actually Br (p) ⊂
(E)C . If not true, ∃q ∈ Br (p) such that q ∈
/ (E)C , i.e. q ∈ E. Then for
every neighborhood N of q we have N ∩ E 6= ∅. This is also true for
N = Br (p), i.e. Br (p) ∩ E 6= ∅. But Br (p) ∩ E = ∅. Contradiction. So
Br (p) ⊂ (E)C .
24
1) The union of any collection of open sets is open.
2) The intersection of a finite number of open sets is open.
3) The intersection of any collection of closed sets is closed.
4) The union of a finite number of closed sets is closed.
5) E is open ⇔ E C is closed.
6) E is closed ⇔ E = E.
7) E is the smallest closed set that contains E.
8) E is open ⇔ E = int E.
9) int E is the largest open set that is contained in E.
3.13 Example. Intersection of infinitely many open sets may not be open.
Let X = R, d(x, y)T= |x − y|. For n = 1, 2, 3, . . . let En = − n1 , n+1
n
. All
En ’s are open but ∞ E
n=1 n = [0, 1] is not open.
3.2 Subspaces
3.15 Definition. Let (X, d) be a metric space and Y 6= ∅ be a subset of X.
Then Y is a metric space in its own right with the same distance function.
In this case we say (Y, d) is a subspace of (X, d).
25
3.17 Theorem. Let E ⊂ Y ⊂ X. Then
Proof.
(a) (⇒): Let E be open relative toSY . Then ∀p ∈ E ∃rp > 0 such that
BrXp (p) ∩ Y ⊂ E. Let F = p∈E BrXp (p). Then F is an open set in
X. Show F ∩ Y = E.
!
[ [
F ∩Y = BrXp (p) ∩ Y = BrXp (p) ∩ Y ⊂ E
p∈E p∈E | {z }
⊂E for all p
26
3.19 Example.S X = R, d(x, y) = |x − y|, E = (0, 1). For every x ∈ E let
Gx = (−1, x). x∈E Gx = (−1, 1) ⊃ E. So {Gx : x ∈ E} is an open cover of
E.
3.20 Example.
S∞ X = R2 with d2 and E = B1 (0). For n ∈ N let Gn =
B n+1 n=1 Gn = E. So {Gn : n ∈ N} is an open cover of E.
n (0).
Proof.
27
Proof. We will show K C is open. Let p ∈ K C . Show ∃r > 0 such that
Br (p) ⊂ K C ∀q ∈ K (since q 6= p). d(q, p) > 0. Let
d(q, p)
rq = Vq = Brq (p) Wq = Brq (q)
2
S
Then Vq ∩ Wq = ∅. Find Vq and Wq ∀q ∈ K K ⊂ q∈K Wq . The collection
{Wq : q ∈ K} is an open cover of K. Since K is compact, ∃q1 , . . . , qn ∈ K
such that K ⊂ Wq1 ∪ · · · ∪ Wqn . Let V = Vq1 ∩ · · · ∩ Vqn . Then V is an open
set and p ∈ V . If rqk = min{rq1 , . . . , rqn } then V = Brqk (p). Show V ⊂ K C .
If it is not true, then ∃z ∈ V but z ∈ / K C , i.e. z ∈ K. Then z ∈ Wqi for
some i ∈ {1, . . . , n}. z ∈ V ⊂ Vqi (the same i). So z ∈ Wqi ∩ Vqi = ∅.
Contradiction.
28
3.29 Example. X = R, d(x, y) = |x − y|, En = [n, +∞) = {x : x ∈ R, x ≥
n}, n = 1,
T2, 3, . . . Then En ’s are closed, En 6= ∅ and E1 ⊃ E2 ⊃ E3 ⊃ · · ·
∞
We have n=1 En = ∅.
3.34 Theorem. Let K be a compact subset of a metric space (X, d). Then
K is bounded.
29
3.35 Theorem (Heine-Borel). A subset K of Rk is compact ⇔ K is closed
and bounded.
Proof.
E = {p = (x1 , . . . , xk ) ∈ Rk : a1 ≤ x1 ≤ b1 , . . . , ak ≤ xk ≤ bk }
ai + b i
ci =
2
We divide each side of E into two parts and this way we divide E into 2k
subcells. Call them Q1 , Q2 , . . . , Q2k . Then at least one of these Qj ’s cannot
be covered by finitely many sets, Gα ’s. Call this Qj E1 . For all p, q ∈ E we
have d2 (p, q) ≤ δ and for all p, q ∈ E1 , d2 (p, q) ≤ 2δ . Next divide E1 into 2k
subcells by halving each side and continue this way. This way we obtain a
sequence {En } of k-cells such that
(a) E ⊃ E1 ⊃ E2 ⊃ E3 ⊃ · · ·
30
By (a), ∞
T ∗
T∞ ∗
n=1 E n 6
= ∅. Let p ∈ n=1 En . Then p ∈ E. Since {Gα : α ∈ A} is
an open cover of E, there is an α0 ∈ A such that p∗ ∈ Gα0 . Since Gα0 is open,
there is r > 0 such that Br (p∗ ) ⊂ Gα0 . Find a natural number n0 such that
δ
r
< 2n0 , i.e. 2nδ 0 < r. Now we show that En0 ⊂ Gα0 . p∗ ∈ En0 . Let p ∈ En0
be an arbitrary point. By (c), d2 (p, p∗ ) ≤ 2nδ 0 . Also, 2nδ 0 < r. So d2 (p, p∗ ) < r.
So p ∈ Br (p∗ ) ⊂ Gα0 . Thus, p ∈ En0 ⇒ p ∈ Gα0 . So En0 ⊂ Gα0 . This means
En0 can be covered by finitely many sets from {Gα : α ∈ A} (indeed just by
one set). This contradicts (b).
Proof.
(⇒): Let K be compact. Assume claim is not true. Then there is an infinite
subset A ⊂ K such that A has no limit point in K. So, given any
point p ∈ K, p is not a limit point of A. So there is rp > 0 such
that Brp (p) contains no point of A different from p. The collection of
{Brp (p) : p ∈ K} is an open cover of K. Since K is compact, there are
p1 , p2 , . . . , pn ∈ K such that K ⊂ Brp1 (p1 ) ∪ Brp2 (p2 ) ∪ · · · ∪ Brpn (pn ).
Since A ⊂ K and A is an infinite set, one of the open balls on the right
hand side must contain infinitely many points of A. Contradiction.
(⇐): Omitted.
31
Continue this way by removing the open middle thirds of the remaining
intervals. This way we get a sequence E1 ⊃ E2 ⊃ E3 ⊃ · · · ⊃ En ⊃ · · · such
that En is the union of 2n disjoint closed intervals of length 31n . We define
∞
\
C= En
n=1
32
3.5 Connected Sets
3.39 Definition. Let (X, d) be a metric space and A, B ⊂ X. We say A
and B are separated if A ∩ B = ∅ and A ∩ B = ∅.
(⇐): Omitted.
33
4 Sequences And Series
4.1 Sequences
Let (X, d) be a metric space. A sequence in X is a function f : N → X. If
pn = f (n), we denote this sequence by (pn ) or {pn }.
(−1)n
4.1 Example. X = R2 , pn = 1−n n
, n
where n = 1, 2, 3, . . . Then
p1 = (0, −1)
−1 1
p2 = ,
2 2
−2 −1
p3 = ,
3 3
..
.
1−n (−1)n
4.3 Example. X = R2 , pn = n
, n . p = (−1, 0). Show pn → p. Let
√
ε > 0 be given. Let n0 be any natural number such that ε2 < n0 . Let n be
any natural number such that n0 ≤ n.
s 2 2
1−n (−1)n
d2 (pn , p) = − (−1) + −0
n n
s
2 2
1 (−1)n
= +
n n
r √
2 2
= 2
=
n n
√
2
≤ <ε
n0
34
1
4.4 Remark. {xn } = n
converges to x = 0 in (R, | · |), but it is divergent
in ((0, 2), | · |).
4.5 Definition. We say that the sequence {pn } is bounded if the set E =
{p1 , p2 , p3 , . . .} is a bounded subset of X, i.e. there is a constant M > 0 such
that for all pi , pj ∈ E we have d(pi , pj ) ≤ M .
4.6 Theorem.
(a) Let {pn } be a sequence such that pn → p and pn → p0 . Then p = p0 .
(b) If {pn } is convergent then {pn } is bounded.
(c) Let E 6= ∅ be subset of X. Then p ∈ E ⇔ there is a sequence {pn }
contained in E such that pn → p.
Proof.
(a) Let pn → p and pn → p0 . Assume p 6= p0 . Then d(p, p0 ) > 0. Let ε0 =
d(p,p0 )
3
then ε0 > 0. We have pn → p so there is n1 ∈ N such that for all
n ≥ n1 we have d(pn , p) < ε0 . We also have pn → p0 so there is n2 ∈ N
such that for all n ≥ n2 we have d(pn , p0 ) < ε0 . Let n0 = max{n1 , n2 }.
Then n0 ≥ n1 ⇒ d(pn0 , p) < ε0 and n0 ≥ n2 ⇒ d(pn0 , p0 ) < ε0 . Then
3ε0 = d(p, p0 ) ≤ d(p, pn0 ) + d(pn0 , p0 ) < ε0 + ε0 = 2ε0 . So 3ε0 < 2ε0 .
Since ε0 > 0, this cannot be true.
(b) Let pn → p. For ε = 1 > 0, there is n0 ∈ N such that for all n ≥ n0 we
have d(pn , p) < 1. If i, j ≥ n0 , then d(pi , pj ) ≤ d(pi , p) + d(p, pj ) < 1 +
1 = 2. Let K = max{1, d(p1 , p), . . . , d(pn0 −1 , p)}. Then for all n ∈ N we
have d(pn , p) ≤ K. For any i, j ∈ N, d(pi , pj ) ≤ d(pi , p)+d(p, pj ) ≤ 2K.
(c) (⇐): {pn } in E such that pn → p. Show p ∈ E. Given r > 0 we have
n0 ∈ N such that for all n ≥ n0 , d(pn , p) < r. So pn0 ∈ Br (p) ∩ E.
So Br (p) ∩ E 6= ∅. So p ∈ E.
(⇒): Let p ∈ E. Then for every r > 0, Br (p) ∩ E 6= ∅.
..
.
1
For r = , find pn ∈ B 1 (p) ∩ E
n n
35
Then {pn } is a sequence in E. Given ε > 0 let n0 be such that
1
ε
< n0 . Then for all n ≥ n0 we have d(pn , p) < n1 ≤ n10 < ε. So
pn → p.
4.7 Theorem. Let {sn } and {tn } be sequences in R such that sn → s and
tn → t where s, t ∈ R. Then
(a) sn + tn → s + t
(b) For all constants c ∈ R, csn → c · s
(c) sn tn → s · t
1 1
(d) If s 6= 0 then sn
→ s
36
4.8 Theorem.
37
4.2 Subsequences
4.9 Definition. Let {pn } be a sequence in X. Let {nk } be a sequence of
natural numbers such that n1 < n2 < n3 < · · · Then the sequence {pnk } is
called a subsequence of {pn }.
Proof.
So the sequence {pn } has limit points (2, 0) and (0, 0).
1
4.14 Example. In X = R, xn = n + (−1)n n + n
1
n is even ⇒ xn = 2n + → +∞
n
1
n is odd ⇒ xn = →0
n
We do not accept +∞ as a limit since +∞ is not a member of R. So 0 is
the only limit point of the sequence {xn } but {xn } is divergent since it is not
bounded.
38
4.15 Theorem.
(a) Let (X, d) be a compact metric space and {pn } be any sequence in X.
Then {pn } has a subsequence that converges to a point p ∈ X.
Proof.
(a) Case 1: {pn } has only finitely many distinct terms. Then at least one
term, say pn0 is repeated infinitely many times, i.e. the sequence {pn }
has a subsequence all of whose terms are p. Then the limit of this
subsequence is p = pn0 ∈ X.
Case 2: {pn } has infinitely many distinct terms. Then the set E =
{p1 , p2 , p3 , . . .} is an infinite subset of the compact set X. So it has a
limit point p ∈ X. Then p is the limit of a subsequence of {pn }.
4.17 Example. In X = R
Z n
cos t
xn = dt
1 t2
39
so d(xn , xm ) = |xn − xm | = 0 < ε. If n 6= m, assume m < n.
d(xn − xm ) = |xn − xm |
Z n Z m
cos t cos t
= 2
dt − 2
dt
t t
Z1 n 1
cos t
= dt
m t2
Z n
cos t cos t | cos t| 1
≤ t2 dt
We know 2 = 2
≤ 2
t t t
Zmn n
1 1 1 1
≤ 2
dt = − = − +
m t t m n m
1 1
≤ ≤ <ε
m n0
1
Given ε > 0, choose n0 ∈ N such that ε
< n0 . Then for all n, m ∈ N with
n0 ≤ m ≤ n we have d(xn , xm ) < ε.
√
4.18 Example. X = R, xn = n. If n = m + 1 then
d(xn , xm ) = |xm+1 − xm |
√ √ √ √
= | m + 1 − m| = m + 1 − m
√ √
√ √ m+1+ m
= ( m + 1 − m) √ √
m+1+ m
1 1
=√ √ <√
m+1+ m m
1
Given ε > 0, choose n0 ∈ N such that ε2
< n0 . Then for all m ≥ n0 we have
d(xm+1 , xm ) < ε.
So the distance between successive terms gets smaller as the index gets larger
but this sequence {xn } is not a Cauchy sequence. For example, for ε = 1,
consider
√ √
d(xm , x3m+1 ) = | m − 3m + 1|
√ √ √ √
= 3m + 1 − m = m + 2m + 1 − m
q√ √
≥ ( m + 1)2 − m
√ √
≥ m+1− m≥1
40
(a) Every convergent sequence in X is Cauchy.
Proof.
(a) Assume pn → p. Show {pn } is Cauchy. Given ε > 0 let ε0 = 2ε > 0.
Since pn → p, there is n0 ∈ N such that d(pn , p) < ε0 for all n ≥ n0 .
Let n, m ≥ n0 . Then
4.22 Theorem.
(a) Every compact metric space (X, d) is complete.
41
Proof.
(a) Let (X, d) be a compact metric space and let {pn } be a Cauchy sequence
in X. Then {pn } has a subsequence {pnk } which converges to a point
p ∈ X. Show pn → p. Let ε > 0 be given. Let ε0 = 2ε > 0. {pn }
is Cauchy, so there is N1 ∈ N such that for all n, m ≥ N1 we have
d(pn , pm ) < ε0 . pnk → p, so there is N2 such that for all k ≥ N2 we
have d(pnk , p) < ε0 . Let N = max{N1 , N2 }. Then for all n ≥ N
(B(S), d) is complete.
Proof.
42
Monotone Sequence Property In R
Let {sn } be a sequence in R. We say
{sn } is increasing if s1 ≤ s2 ≤ s3 ≤ · · · ≤ sn ≤ sn+1 ≤ · · ·
{sn } is decreasing if s1 ≥ s2 ≥ s3 ≥ · · · ≥ sn ≥ sn+1 ≥ · · ·
{sn } is monotone if {sn } is either increasing or decreasing.
Proof.
s − ε < sn < s + ε
−ε < sn − s < ε
|sn − s| < ε
d(sn , s) < ε
4.27 Example. Let A > 0 be fixed. Start with any x1 > 0 and define
1 A
xn = xn−1 + n = 2, 3, 4, . . .
2 xn−1
√
Then limn→∞ xn = A. We will show x2 ≥ x3 ≥ x4 ≥ · · · For n ≥ 2
A2
2 1 2
xn − A = xn−1 + 2 + 2A − A
4 xn−1
A2
1 2
= xn−1 + 2 − 2A
4 xn−1
2
1 A
= xn−1 − ≥0
4 xn−1
43
√
So x2n ≥ A for all n ≥ 2. Since all xn > 0, xn ≥ A for all n ≥ 2. For n ≥ 2
1 A
xn − xn+1 = xn − xn +
2 x
n
1 A
= xn −
2 xn
2
1 xn − A
= ≥0
2 xn
So xn ≥ xn+1 for all n ≥ 2. So {xn }∞ n=2 is decreasing and bounded. So
limn→∞ xn = x exists. Then we solve for x. We have that
xn+1 = 12 xn + xAn
↓ ↓
x = 21 x + Ax
Then
A
2x = x +
x
x2 = A
√
x=∓ A
√
Since all xn > 0, limit x cannot be negative. So x = A.
44
4.30 Example. xn = n + (−1)n n + n1 . Subsequential limits are +∞ and 0.
So E = {0, +∞}.
x∗ is called the lower limit (or limit inferior ) of {xn } and it is denoted by
r\s 1 2 3 4 ···
1 1 3 5 7 ···
2 2 6 10 14 · · ·
3 4 12 20 28 · · ·
4 8 24 40 56 · · ·
.. .. .. .. .. ..
. . . . . .
0
{2s
S∞ − 1, 2(2s − 1), 4(2s − 1), . . .} Then for s 6= s , Ns ∩ Ns0 = ∅. Also
s=1 Ns = N. Define a sequence {xn } in R as follows: Given n ∈ N, there is
sn
a unique s such that n ∈ Ns . Define xn = n+1 . What are the subsequential
limits of {xn } ? What are lim supn→∞ xn and lim inf n→∞ xn ?
n
If n ∈ N1 = {1, 2, 4, 8, . . .} then xn = →1
n+1
2n
If n ∈ N2 = {3, 6, 12, 24, . . .} then xn = →2
n+1
..
.
sn
If n ∈ Ns = {· · · } then xn = →s
n+1
So all 1, 2, 3, . . . are subsequential limits. Then we have {1, 2, 3, . . .} ⊂ E.
Then sup E = +∞, i.e. lim supn→∞ xn = +∞.
45
sn n
Since xn = n+1 , s ≥ 1 ⇒ xn ≥ n+1 so all xn ≥ 12 . So if x is a subsequential
1
limit of {xn } then x ≥ 2 . Can we have a subsequential limit x such that
1 sn 2n
2
≤ x ≤ 1 ? If n ∈ Ns where s ≥ 2 then xn = n+1 ≥ n+1 ≥ 1. If n ∈ N1
n
then xn = n+1 → 1. So 1 is the smallest subsequential limit of {xn }. Thus
lim inf n→∞ xn = 1.
Properties
(i) lim inf n→∞ xn ≤ lim supn→∞ xn
(a) For every ε > 0 there is a natural number n0 such that for all
n ≥ n0 , xn < x + ε
and
(b) For every ε > 0 there are infinitely many n such that x − ε < xn
46
√
(c) limn→∞ n
n=1
nα
(d) If p > 0 and α ∈ R are constants then limn→∞ (1+p)n
=0
Note: This is usually expressed as polynomials tend to increase slower
than exponentials.
(e) If x is constant and |x| < 1, i.e. −1 < x < 1 then limn→∞ xn = 0
Proof of (b).
√ √
If p = 1 then np = 1 for all n, so limn→∞ n p = 1.
√
If p > 1 let xn = n p − 1. Then xn > 0 for all n.
n(n − 1) 2
p = (1 + xn )n = 1 + nxn + xn + · · · + xnn
| 2 {z }
positive
q √
If p < 1 then n p1 → 1 by the previous case so n p → 1.
√
Proof of (c). Let xn = n
n − 1. Then xn ≥ 0 for all n.
n α
Proof of (d). If α ≤ 0 we have limn→∞ (1+p) n = 0. So assume α > 0. Fix a
47
n
n
X n
(1 + p) = p` · 1n−`
`=0
`
n k n(n − 1) · · · (n − k + 1) k
> p = p
k k!
n k
nk nk−α nα k
> 2 pk = k pk = p
k! 2 k! 2k k!
2k k! 1 nα
> >0
pk nk−α (1 + p)n
nα
By sandwich property, we have limn→∞ (1+p)n
= 0.
4.5 Series
4.35 Definition. Given a sequenceP{an } in R, the symbol ∞
P
n=1 an is called
∞
an (infinite) series. Given a series n=1 an we define the following sequence
{sn }
s 1 = a1
s2 = a1 + a2
s3 = a1 + a2 + a3
..
.
sn = a1 + a2 + · · · + an
If
P∞ limn→∞ sn = ∓∞ or limn→∞ sn does not exist we say that the series
n=1 an is divergent.
P∞ 1 1 1 1
4.36 Example. n=1 (n+1)2 −1 = 22 −1
+ 32 −1
+ 42 −1
+ · · · Then
1 1 A B
an = 2
= = +
(n + 1) − 1 n(n + 2) n n+2
1
Then A = 2
and B = − 12 . We get
1 1
2 1 2 1 1 1n+2−n
− = − =
n n+2 2 n n+2 2 n(n + 2)
48
1 1 1
So an = 2 n
− n+2
. Then
s n = a1 + a2 + · · · + an
1 1 1 1 1 1 1 1 1 1 1 1
= − + − + − + ··· + −
2 1 3 2 2 4 2 3 5 2 n n+2
Cancellation pattern: ( |X) + ( | ) + (X| )+ · · · Then
1 1 1 1 1 1 3 1 1
sn = + − − = − −
2 1 2 n+1 n+2 2 2 n+1 n+2
1 3 3 3 1 1 3
Then limn→∞ sn = 2
· 2
= 4
so s = 4
i.e. 22 −1
+ 32 −1
+ ··· = 4
P∞
4.37 Example. Let r ∈ R be a constant. Consider n=0 rn = 1 + r + r2 +
r3 + · · · geometrical series.
sn = 1 + r + r 2 + · · · + r n
rsn = r| + r2 +{z· · · + rn} +rn+1
sn −1
n+1
rsn = sn − 1 + r
1 − rn+1 = sn − rsn
1 − rn+1
sn = if r 6= 1
1−r
1
If |r| < 1, i.e. −1 < r < 1 then rn+1 → 0 so limn→∞ sn = 1−r
If r = 1 then sn = n + 1 → +∞
For any other value of r, limn→∞ sn does not exist. So the geometrical series
is convergent only for −1 < r < 1.
∞
X 1
rn = 1 + r + r2 + r3 + · · · = if − 1 < r < 1
n=0
1−r
49
P
4.39 Theorem. If an is convergent then limn→∞ an = 0.
Proof. an = sn − sn−1 → s − s = 0.
4.40 Example. ∞ n
P
n=1 (−1) = (−1) + 1 + (−1) + 1 + (−1) + · · · is divergent
since limn→∞ (−1)n does not exist. So limn→∞ (−1)n 6= 0.
0 if n is even
sn =
−1 if n is odd
P∞
4.41 Definition. A series n=1 an is said to be non-negative if there is
n0 ∈ N such that for all n ≥ n0 we have an ≥ 0.
P P
4.42 Theorem. Let an be a non-negative series. Then an is convergent
⇔ {sn } is bounded.
Proof.
50
P
(a) Use Cauchy criterion. Let ε > 0 be given. Since cn is convergent,
there
Pn is n 1 ∈ N such that for all n, m ≥ n 1 with m ≤ n we have
| k=m ck | < ε. Let n2 = max{n0 , n1 }. Let n ≥ m ≥ n2 . Then
n
X
ak = |am + am+1 + · · · + an | ≤ |am | + |am+1 | + · · · + |an |
|{z} | {z } |{z}
k=m ≤cm ≤cm+1 ≤cn
4.44 Theorem
P∞ (Cauchy Condensation
P∞ Test). Suppose a1 ≥ a2 ≥ a3 ≥ · · · ≥
k
0. Then n=1 an is convergent ⇔ k=0 2 a2k = a1 + 2a2 + 4a4 + 8a8 + · · ·
is convergent.
51
1
P
then limn→∞ an 6= 0. So is divergent.
np
Summary: Let p be a constant. Then ∞ 1
P
n=1 np is convergent ⇔ p > 1.
P∞ 1 P∞ 1 P∞ 1
For example, n=1 n2 and n=1 n n are convergent but
√
n=1 n and
P∞ 1 P∞ 1
P ∞ 1
n=1 n are divergent. n=1 n1.00001 is convergent. n=1 1+ 1 is not a
√
n n
1
p-series since the exponent 1 + n
is not a constant.
4.46 Remark. ∞
X 1 π2
=
n=1
n2 6
The Number e
The series ∞
X 1 1 1 1
= 1 + 1 + + + + ···
n=0
n! 2! 3! 4!
is convergent. For n ≥ 2
1 1 1
an = = ≤ n−1
n! |2 · 3{z· · · n} 2
n−1 factors
1 n
P 1
P P∞ P∞ 1
2n−1
=2 2
is convergent. So by comparison test, n=0 an = n=0 n!
is convergent.
4.47 Definition. ∞
X 1
e=
n=0
n!
p
Proof. Suppose e is rational. Then e = q
where p, q are natural numbers.
52
1
Since all an > 0, we have sn < e for all n. We have 0 < e − sq < q!q
1 1 1
e − sq = + + + ···
(q + 1)! (q + 2)! (q + 3)!
1 1 1
= 1+ + + ···
(q + 1)! q + 2 (q + 2)(q + 3)
1 1 1
< 1+ + + ···
(q + 1)! q + 1 (q + 1)(q + 1)
∞ n
1 X 1 1
= Geometrical series with r =
(q + 1)! n=0 q + 1 q+1
1 1 1 q+1 1
< 1 = =
(q + 1)! 1 − q+1 (q + 1)! q q!q
Proof.
(a) Find β such thatpα < β < 1. Then there is n0 ∈ N such that forP alln
n
n ≥ n0 we have |an | < β. That is, |an | < β for all n ≥ n0 .
n
β
is
Pconvergent (geometrical series, 0 < β < 1) so by comparison test,
an is convergent.
53
(b) We have α > 1. Since lim sup is the largest subsequential p limit, we can
find a subsequence {nkp } of natural numbers such that nk |ank | → α.
nk
Since α > 1, we have P |ank | > 1 ⇒ |ank | > 1. Then “limn→∞ an = 0”
cannot be true. So an is divergent.
P1 q
n 1
(c) n
is divergent and α = 1. (in fact lim n→∞ n
= 1)
P 1 q
n 1
n2
is convergent and α = 1. (in fact lim n→∞ n2
= 1)
(−2)n n
4.52 Example. Consider ∞ Then an = (−2)
P
n=1 n n
. We apply root test.
q P (−2)n
n
pn
|an | = n 2n = √2
n n . We have α = limn→∞ √
2
n n = 2. α > 1 so n
is
divergent.
P
4.53 Theorem (Ratio Test). Let an be an arbitrary series.
|an+1 | P
(a) If lim supn→∞ |an |
< 1 then an is convergent.
|an+1 | P
(b) If lim inf n→∞ |an |
> 1 then an is divergent.
|an+1 | |an+1 |
(c) If lim inf n→∞ |an |
≤ 1 ≤ lim supn→∞ |an |
then no information.
Then
(n+1)3
( 1
|an+1 | n2 10n+2
if n is odd
=
|an | (n+1)2
10n−1 if n is even
n3
54
So lim supn→∞ |a|an+1
n|
|
= +∞ and lim inf n→∞ |a|an+1
n|
|
= 0. So ratio test gives no
information. Then try root test.
( (√n n)2
p
n 10
if n is odd
|an | = √
( n n)3
100
if n is even
1 1
p
10
and 100 are the only subsequential limits of { n |an |}. We have
p 1
P
lim supn→∞ n |an | = 10 < 1. So by root test, the series an is conver-
gent.
1·3···(2n−1)·(2n+1)
|an+1 | an+1 2·4···(2n)·(2n+2) 2n + 1
= = 1·3···(2n−1)
= →1
|an | an 2n + 2
2·4···(2n)
55
4.58 Definition (Power Series). Let {cn } be a fixed sequence of real numbers
and x ∈ R be a variable. The series
∞
X
2 n
c0 + c1 x + c2 x + · · · + cn x + · · · = cn xn
n=0
General Question: Given a power series, find the set of all x for which the
power series is convergent.
We apply root test.
p p p
lim sup n |cn xn | = lim sup |x| n |cn | = |x| lim sup n |cn | = |x|α
n→∞ n→∞
| n→∞{z }
call α
1
cn xn is convergent.
P
If |x|α < 1, i.e. |x| < α
then
1
cn xn is divergent.
P
If |x|α > 1, i.e. |x| > α
then
cn xn is associated a radius of
P
4.60 Theorem. With any power series
convergence R, 0 ≤ R ≤ +∞ such that
(i) The series converges for all x with |x| < R
(ii) The series diverges for all x with |x| > R
R = α1 where α = lim supn→∞ n |cn | or α = limn→∞ |c|cn+1 |
p
n|
if this limit exists.
If α =P 0 then R = +∞. If α = +∞ then R = 0. (For R = 0, it means the
series cn xn converges only for x = 0.)
P∞
4.61 Example. Consider n=0 n!xn = 1+x+2!x2 +3!x3 +· · · Then cn = n!
|cn+1 |
α = lim = lim (n + 1) = +∞
n→∞ |cn | n→∞
|cn+1 | 1
α = lim = lim =0
n→∞ |cn | n→∞ n + 1
P xn
So R = +∞ and n!
converges for all x ∈ R with |x| < +∞, i.e. for all
x ∈ R.
56
P∞ xn 1
4.63 Example. Consider n=1 n . Then cn = n
s
1 1
α = lim sup n = lim sup √ =1
n→∞ n n→∞
n
n
So R = 1 and
P xn
The series n
is convergent for all x with |x| < 1, i.e. −1 < x < 1
P xn
The series n
is divergent for all x with |x| > 1, i.e. x < −1, 1 < x
No information for |x| = 1, i.e. x = ∓1
If x = 1, ∞
P 1n
P∞ 1
n=1 n = n=1 n is divergent. (p-series with p = 1)
P∞ (−1)n
If x = −1, n=1 n = −1 + 12 − 13 + 14 − · · ·
Abel’s Partial Summation Formula: Let {an } and {bn } be two se-
quences.
n
X
An = ak = a1 + a2 + · · · + an
k=1
Then
n+1
X n
X
ak bk = An+1 bn+1 − Ak (bk+1 − bk )
k=1 k=1
4.64 Theorem (Dirichlet’s Test). Let {an } and {bn } be two sequences of
real numbers. An = nk=1 ak = a1 + · · · + an . Assume
P
57
(b) b1 ≥ b2 ≥ b3 ≥ · · ·
(c) limn→∞ bn = 0
Then ∞
P
n=1 an bn is convergent.
{An } is bounded, so there is a constant M > 0 such that |An | ≤ M for all n.
−M ≤ An+1 ≤ M
1 + 112 2 3 1 + 12 2 3 1 + 12 2 3
√ + √ − √ + √ 4 + √ − √ + √ 7 + √ − √ + ···
1 2 3 4 5 6 7 8 9
Then b1 = √11 , b2 = √12 , b3 = √13 · · · bn = √1n · · · {bn } satisfies (b) and (c).
Also a1 = 1 + 112 , a2 = 2, a3 = −3, a4 = 1 + 412 , a5 = 2, a6 = 3, a7 = 1 + 712 ,
a8 = 2, a9 = −3, . . .
Then A1 = 1 + 112 , A2 = 3 + 112 , A3 = 1
12
, A4 = 1
12
+ 1 + 412 , A5 = 1
12
+ 3 + 412 ,
58
1 1
A6 = 12
+6+ 42
···
1 1 1
We have An ≤ 3 + 2
+ 2 + 2 + · · · So {An } is bounded. So the series is
|1 4 {z 7 }
2
≤ π6
convergent by Dirichlet’s test.
are convergent.
is convergent.
P∞ P∞ (−1)n+1 (−1)n+1
The
P∞ series Pn=1 cn = n=1 n
i.e. cn = n
is convergent but
∞ 1
|c
n=1 n | = n=1 n is divergent.
P P P
4.67 Definition.P Let cn be a series. If cn is convergent
P but |cn | is di-
vergent,Pwe say cn is conditionally convergent. If |cn | is also convergent,
we say cn is absolutely convergent.
P P
4.68 Theorem. If |cn | is convergent then cn is also convergent.
P
Proof. Use Cauchy criterion. Let ε > 0 be given. SinceP |cn | is convergent,
there is n0 such that for all n ≥ m ≥ n0 we have | nk=m |ck || < ε. Let
n ≥ m ≥ n0 . Then n
X X n
ck ≤ |ck | < ε
k=m k=m
P P
So cn satisfies Cauchy criterion. Then cn is convergent.
For absolute convergence we can use root test, ratio test or comparison test.
For conditional convergence we can use Dirichlet’s test or alternating series
test. (Only for alternating series.)
59
4.69 Example. Consider
∞
X (−1)n+1 1 1 1
=1− + − + ··· = S
n=1
n 2 3 4
60
4.71 Theorem. Assume ∞
P P∞
n=1 a n is absolutely convergent, i.e. n=1 |an |
is convergent. Then every rearrangement of ∞
P
a
n=1 n is convergent and it
converges to the same sum.
P∞ P∞
Proof. Let n=1 aφ(n) be a rearrangement of n=1 an . Let
s n = a1 + a2 + · · · + an
tn = aφ(1) + aφ(2) + · · · + aφ(n)
|sn − tn − 0| =|sn − tn |
=|a1 + a2 + · · · + aN + aN +1 + · · · + an
−aφ(1) − aφ(2) − · · · − aφ(p) − · · · − aφ(n) |
| {z }
N of them will be cancelled
| {z }
The remaining terms will be of the form −ak where k>N
61
4.74 Example.
P∞ 1 P∞ 1
n=1 n and n=1 − n+1 are both divergent.
P∞ 1 1
P∞ 1
n=1 n − n+1
= n=1 n(n+1) is convergent.
P∞ 2 n n
− 5 (−1)
4.75 Example. n=0 3 4n
is convergent.
∞ n ∞ n
X 2 X 1 1 1 4
−5 − = 2 −5 1
= 3 − 5 = −1
n=1
3 n=1
4 1− 3 1 − −4 5
c 0 = a0 b 0
c 1 = a0 b 1 + a1 b 0
c 2 = a0 b 2 + a1 b 1 + a2 b 0
..
.
n
X
cn = a0 bn + a1 bn−1 + · · · + an−1 b1 + an b0 = ak bn−k
k=0
P∞ P∞ P∞
n=0 cn is called the Cauchy product of n=0 an and n=0 bn .
Then ∞
P
n=0 cn is convergent and has sum C = AB.
4.77 Remark. The above theorem is not true if both series are conditionally
convergent.
62
4.78 Example. Consider the Cauchy product of the conditionally conver-
gent series
∞
X (−1)n 1 1 1 1
√ = √ − √ + √ − √ + ···
n=0
n+1 1 2 3 4
(−1)n
with itself. We have an = bn = √
n+1
. Then
n n
X (−1)k (−1)n−k n
X 1
cn = √ ·√ = (−1) p
k=0
k+1 n−k+1 k=0
(k + 1)(n − k + 1)
We have
n2 n 2
(n−k+1)(k+1) = nk+n−k 2 −k+k+1 = n+1+k(n−k) ≤ n+1+ = +1
4 2
n2
When 0 ≤ x ≤ n, max. of x(n − x) is 4
so we have
n n
X 1 X 1
|cn | = p ≥ q
(k + 1)(n − k + 1) n
k=0 k=0 2
+ 1
n
X 1 n+1 2n + 2
= n = n = ≥1
k=0 2
+1 2
+1 n+2
P
So “limn→∞ cn = 0” cannot be true. So the series cn is divergent.
63
5 Continuity
5.1 General
Let (X, dX ) and (Y, dY ) be two metric spaces. Let E 6= ∅ be a non-empty
subset of X, f : E → Y , p ∈ E 0 , q ∈ Y . We say limx→p f (x) = q (or f (x) → q
as x → p) if for every ε > 0 there is δ > 0 with the following property: For
every x ∈ E with dX (x, p) < δ we have dY (f (x),q) < ε. Equivalently, for
every ε > 0 there is δ > 0 such that f BδX (p) ∩ E ⊂ BεY (q). δ > 0 depends
in general on ε > 0 and the point p. For limx→p f (x), f (p) need not be
defined.
5.1 Example. Let X = R2 with d2 and Y = R with | · | metric.
Let E = {(x, y) : (x, y) ∈ R2 and xy 6= 0}. f : E → R, f (x, y) = xy sin xy
that for all (x, y) ∈ E with d2 ((x, y), (a, 0)) < δ we have that |f (x, y)−1| < ε.
Let (x, y) ∈ E be such that d2 ((x, y), (a, 0)) < δ i.e.
(x − a)2 + (y − 0)2 < δ 2 ⇒ |x − a| < δ and |y − 0| < δ
a − δ < x < a + δ so 0 < x. Let t = xy . Then
aδ 0 aδ 0
|y| |y| δ 0 1+δ 0 aδ 0
0 < |t| = = < = 1+δaδ0 = a+aδ 0 −aδ 0
= = δ0
|x| x a−δ a − 1+δ0 1+δ 0
a
y
So t = x
satisfies 0 < |t| < δ 0 , thus
sin t
sin y
t − 1 < ε i.e. y x − 1 < ε
x
Proof.
(⇒): Suppose limx→p f (x) = q. Let {pn } be an arbitrary sequence in E such
that limn→∞ pn = p and pn 6= p. Show limn→∞ f (pn ) = q. Let ε > 0
be given. Since limx→p f (x) = q, there is δ > 0 such that for all x ∈ E
with dX (x, p) < δ we have dY (f (x), q) < ε. Since limn→∞ pn = p,
there is n0 such that for all n ≥ n0 , dX (pn , p) < δ. Let n ≥ n0 .
Then dY (f (pn ), q) < ε since x = pn (for n ≥ n0 ) satisfies x ∈ E and
dX (x, p) < δ.
64
(⇐): Proof by contraposition. Suppose limx→p f (x) 6= q. So there is an
ε0 > 0 such that for every δ > 0 there is x ∈ E such that dX (x, p) < δ
and dY (f (x), q) ≥ ε0 .
Let δ = 1, find x = p1 ∈ E s.t. dX (p1 , p) < 1 and dY (f (p1 ), q) ≥ ε0
1 1
Let δ = , find x = p2 ∈ E s.t dX (p2 , p) < and dY (f (p2 ), q) ≥ ε0
2 2
..
.
1 1
Let δ = , find x = pn ∈ E s.t. dX (pn , p) < and dY (f (pn ), q) ≥ ε0
n n
Then {pn } is a sequence in E such that limn→∞ pn = p and
limn→∞ f (pn ) 6= q.
lim f (x)g(x) = AB
x→p
f (x) A
lim = if B 6= 0
x→p g(x) B
Proof.
(⇒): Let f be continuous on X. Let V ⊂ Y be an arbitrary open set. Show
f −1 (V ) is an open set in X. Let p ∈ f −1 (V ) be an arbitrary point.
Then f (p) ∈ V . V is open, so there is s > 0 such that BsY (f (p)) ⊂ V . f
is continuous at p. Then for ε = s > 0, we find δ > 0 such that for all x
with dX (x, p) < δ we have dY (f (x), f (p)) < ε. Show BδX (p) ⊂ f −1 (V ).
Let x ∈ BδX (p), i.e. dX (x, p) < δ ⇒ dY (f (x), f (p)) < ε = s ⇒ f (x) ∈
BsY (f (p)) ⊂ V . f (x) ∈ V , so x ∈ f −1 (V ).
65
(⇐): Suppose f −1 (V ) is open for every open set V ⊂ Y . Show f is continuous
on X, i.e. show f is continuous at every point of X. Let p ∈ X be
an arbitrary point. Let ε > 0 be given. The set V = BεY (f (p)) is an
open set in Y . Then f −1 (V ) is an open set in X. Also p ∈ f −1 (V ).
Then there is δ > 0 such that BδX (p) ⊂ f −1 (V ). Let x be such that
dX (x, p) < δ, i.e. x ∈ BδX (p). Then x ∈ f −1 (V ), i.e. f (x) ∈ V , i.e.
dY (f (x), f (p)) < ε.
C
Proof. F ⊂ Y is closed ⇔ F C is open. Using f −1 (F C ) = (f −1 (F )) and
“f is continuous ⇔ the inverse image of every open set is open” we get the
result.
66
5.11 Example. X = Rk . Fix a coordinate, say j-th coordinate. Define
f : Rk → R. f is continuous on Rk . x = (x1 , x2 , . . . , xk ) → xj . Fix
p = (p1 , p2 , . . . , pk ) in Rk . Show f is continuous at p. Given ε > 0, choose
δ = ε. Let x ∈ Rk be any point such that d2 (x, p) < δ. Then
q
|f (x) − f (p)| = |xj − pj | = (xj − pj )2
p
≤ (x1 − p1 )2 + · · · + (xk − pk )2 = d2 (x, p) < δ = ε
E ⊂ f −1 (Gα1 ) ∪ · · · ∪ f −1 (Gαn )
f (E) ⊂ f f −1 (Gα1 ) ∪ · · · ∪ f −1 (Gαn )
= f f −1 (Gα1 ) ∪ · · · ∪ f f −1 (Gαn )
⊂ G α1 ∪ · · · ∪ Gαn
67
Proof. For sup S only. Let α = sup S. Show every neighborhood B of α
contains a point s from S. B = (α − ε, α + ε). Since α − ε < sup S, α − ε
cannot be an upper bound for S. So there is an element s ∈ S such that
α − ε < S. Also if s ∈ S then s ≤ α < α + ε. So α − ε < s < α + ε, i.e.
s ∈ B.
5.16 Corollary. Let f : [a, b] → R be continuous on [a, b]. Then there are
two points p, q ∈ [a, b] such that for all x ∈ [a, b] we have f (p) ≤ f (x) ≤ f (q).
Proof. Show that for every closed set F ⊂ X, the inverse image g −1 (F ) is a
closed set in Y . We have g −1 (F ) = f (F ). X is compact, F is closed so F is
compact. f is continuous, so f (F ) is compact. So f (F ) is closed.
68
5.3 Continuity And Connectedness
5.20 Theorem. Let X, Y be metric spaces and f : X → Y be continuous.
Assume X is connected. Then f (X) is also connected. (Continuous image
of a connected set is connected.)
X ⊂ f −1 (f (X)) = f −1 (E ∪ F ) = f −1 (E) ∪ f −1 (F ) = A ∪ B
69
(ii) f is uniformly continuous on E if for every ε > 0 there is δ =
δ(ε) > 0 such that for all points p, q ∈ E with dX (p, q) < δ we have
dY (f (p), f (q)) < ε. (δ depends only on ε. The same δ works for all
p ∈ E.)
⇒
Uniform Continuity Continuity
:
εp2
< p ⇔ εp2 < p + εp2
1 + εp
So 0 < p − δ and
εp2 εp2
δ δ 1+εp 1+εp εp2
|f (p) − f (q)| < < = = 2 −εp2 = =ε
pq p(p − δ) εp2
p p − 1+εp p p+εp p2
1+εp
70
Contradiction.
0
Case 2: 13 < δ. Let δ 0 = 13 < δ. As in case 1, let p = δ 0 and q = δ 0 + δ2 . Then
|p − q| < δ 0 < δ and |f (p) − f (q)| ≥ 1. Contradiction.
n o
Let δ = min δ(p31 ,ε) , · · · , δ(p3n ,ε) . Then δ > 0. Show this δ > 0 has the
property in the definition of uniform continuity. Let p, q ∈ E be two ar-
bitrary points such that dX (p, q) < δ. We have that p ∈ B δ(pi ,ε) (pi ) and
3
q ∈ B δ(pj ,ε) (pj ) for some pi , pj from p1 , . . . , pn .
3
71
Assume δ(pi , ε) ≤ δ(pj , ε). Also
ε
dX (pi , pj ) ≤ dX (pi , p) + dX (p, q) + dX (q, pj ) < δ(pj , ε) ⇒ dY (f (pi ), f (pj )) <
| {z } | {z } | {z } 3
<
δ(pi ,ε) <δ δ(pj ,ε)
3 < 3
So we have
72
6 Sequences And Series Of Functions
6.1 General
Consider the following sequence of functions defined for 0 ≤ x ≤ 1.
So we have Z 1 Z 1
lim fn (x)dx 6= lim fn (x)dx
n→∞ 0 0 n→∞
73
x2
P∞
6.4 Example. fn (x) = (1+x2 )n
and E = R. Consider f (x) = n=0 fn (x)
where n = 0, 1, 2, . . .
2 x2 x2 x2
f (x) = x + + + ··· + + ···
1 + x2 (1 + x2 )2 (1 + x2 )n
2 n !
1 1 1
= x2 1 + 2
+ 2
+ ··· + + ···
1+x 1+x 1 + x2
| {z }
1
geometric series with r=
1+x2
1
= x2 1 = 1 + x2 if x 6= 0
1− 1+x2
If x = 0 then f (0) = 0 + 0 + · · · = 0. So
1 + x2 if x 6= 0
f (x) =
0 if x = 0
P
So the sum f (x) of continuous functions fn (x) is not continuous on R.
Pointwise convergence is not strong enough for the calculus of limits of se-
quences of functions.
6.6 Example. Let 0 < c < 1 be a fixed constant. Let E = [0, c], fn (x) = xn .
We have for every fixed x ∈ E, limn→∞ fn (x) = limn→∞ xn = 0. So f (x) = 0,
i.e. xn → 0 pointwise on E. Does xn → 0 uniformly on E ? Let ε > 0 be
given. Since limn→∞ cn = 0, we have N such that cN < ε. Let n ≥ N , x ∈ E
6.7 Example. E = [0, 1), fn (x) = xn . For every fixed x with 0 ≤ x < 1, we
have limn→∞ fn (x) = limn→∞ xn = 0. So f (x) = 0 and fn → f , i.e. xn → 0
pointwise on E = [0, 1). But this convergence is not uniform. Assume fn → f
74
uniformly on E. Then for ε = 14 we can find N1 such that for all n ≥ N1 and
for all x ∈ E = [0, 1) we have |fn (x) − f (x)| < 41 i.e. xn < 14 . Also
n n
n+1 1 n 1
lim = lim 1 + = e ⇒ lim =
n→∞ n n→∞ n n→∞ n+1 e
So for ε = 1e − 13 > 0 we have N2 such that for all n ≥ N2 we have
n n
n 1 1 1 1 1 n 1 1 1
n+1 − < − ⇒− + < − < −
e e 3 e 3 n+1 e e 3
n
1 n
⇒ < for all n ≥ N2
3 n+1
N
Let N = max{N1 , N2 }, x = N +1
and x ∈ E. Since N ≥ N1 , we have xN < 41
1
N
and since N ≥ N2 , we have 3
< xN . So 13 < NN+1 < 41 i.e. 13 < 41 which is
not true.
Cauchy Criterion For Uniform Convergence
Let E 6= ∅, fn : E → R, n = 1, 2, . . . Assume for every ε > 0 there is a
natural number N = N (ε) such that for all n, m ≥ N (ε) and for all x ∈ E
we have |fn (x) − fm (x)| < ε. Then there is a function f : E → R such that
fn → f uniformly on E.
If we have a series of functions ∞
P
n=1 fn (x) defined on a set E, we define
sn (x) = f1 (x) + · · · + fn (x). If there is a function
P∞ f : E → R such that
sn → f uniformly on E then we say the series n=1 fn (x) = f (x) uniformly
on E.
Cauchy Criterion: Assume for every ε > 0, there is a natural number
N = N (ε) Psuch that for all n, m ≥ N (ε) with n ≥ m and for all x ∈ E
n
we
P∞ have | k=m k (x)| < ε. Then there is a function f : E → R such that
f
n=1 fn (x) = f (x) uniformly on E.
| cos(2nx)| 1
|fn (x)| = ≤ = Mn for all x ∈ E
(2n − 1)(2n + 1) (2n − 1)(2n + 1)
75
P∞
Mn is
n=1 Pconvergent since 0 < Mn ≤ n12 . So there is a function f : R → R
∞
such that n=1 fn (x) = f (x) uniformly on R.
P∞ x
6.9 Example. Consider n=1 n+n2 x2 and E = [0, +∞). We have
x
fn (x) = |fn (x)| =
n + n2 x2
To find Mn we use calculus. Find max. of fn (x) for x ≥ 0.
n + n2 x2 − xn2 2x n − n2 x2 1 1
fn0 (x) = 2 2 2
= 2 2 2
= 0 ⇒ x2 = ⇒ x = √
(n + n x ) (n + n x ) n n
0≤x≤ √1
n
⇒ x2 ≤ 1
n
⇒ n2 x2 ≤ n ⇒ 0 ≤ n − n2 x2 ⇒ fn0 (x) ≥ 0
√1
n
≤x⇒ 1
n
≤ x2 ⇒ n ≤ n2 x2 ⇒ n − n2 x2 ≤ 0 ⇒ fn0 (x) ≤ 0
So fn (x) has its max. at the point x = √1 .
n
√1
1 n 1
Mn = fn √ = =
n n+ n2 n1 2n3/2
Mn = 12
P P 1
P∞ n3/2
is convergent. So there is a function f : E → R such that
x
n=1 n+n2 x2 = f (x) uniformly on the set E = [0, +∞).
cn xn con-
P P
So by the root test, Mn is convergent. So the power series
verges uniformly on E = [−r, r] where 0 < r < R.
76
6.3 Uniform Convergence And Continuity
6.11 Theorem. Let (X, d) be a metric space and E 6= ∅ subset of X.
fn : E → R, n = 1, 2, . . . and f : E → R. Assume fn → f uniformly on E.
Let x0 be a limit point of E and assume for every n, limx→x0 fn (x) = An .
Then {An } is convergent and limx→x0 f (x) = limn→∞ An . That is
77
6.12 Corollary. Let (X, d) be a metric space. Let fn : X → R, n = 1, 2, . . .
f : X → R. Assume fn → f uniformly on X and each fn is continuous on
X. Then f is also continuous on X. (Uniform limit of continuous functions
is continuous.)
lim f (x) = lim lim fn (x) = lim lim fn (x) = lim fn (x0 ) = f (x0 )
x→x0 x→x0 n→∞ n→∞ x→x0 n→∞
limx→x0 ∞
P P∞
n=1 fn (x) and n=1 limx→x0 fn (x)
q q
P∞
limx→x0 f (x) n=1 fn (x0 )
q q
equal
f (x0 ) = f (x0 )
So limx→x0 ∞
P P∞ P
n=1 fn (x) = n=1 limx→x0 fn (x) if fn (x) = f (x) uniformly
on X.
78
6.16 Example. Consider
∞
X
x(1 − x)n = x(1 − x) + x(1 − x)2 + x(1 − x)3 + · · ·
n=1
= x(1 − x) 1 + (1 − x) + (1 − x)2 + · · ·
| {z }
geometric series with r=1−x
P∞ nx2
6.17 Example. limx→0+ n=1 n3 +x3 = ? Take E = [0, 1].
nx2 n 1
fn (x) = |fn (x)| =
3 3
≤ 3 = 2 = Mn
n +x n n
79
Find r > 0 such that −R < −r < x0 < r < R. If E = [−r, r] then the power
series converges uniformly on E and x0 ∈ E. So
∞
X ∞
X
n
lim cn x = lim cn xn
x→x0 x→x0
n=0 n=0
P∞ n
So given a power series n=0 cn x with R > 0 and given any x0 such that
−R < x0 < R, we have
∞
X ∞
X ∞
X
n n
lim cn x = lim cn x = cn xn0
x→x0 x→x0
n=0 n=0 n=0
So let ε0 = ε
2(b−a)
80
If x = 0 < x < 1 then fn (x) = n2 xn (1 − x) → 0
So f (x) = 0 for all 0 ≤ x ≤ 1. Do we have fn → f uniformly on [0, 1] ?
Z 1 Z 1
?
f (x)dx = lim fn (x)dx
0 n→∞ 0
81
Then we have
∞ Z 1 ∞ Z 1
X x X 1 1
γ= dx = − dx
n=1 0
n(x + n) n=1 0
n x+n
∞ 1 X ∞
X 1 1
= x − ln(x + n) = − ln(1 + n) + ln n
n=1
n 0 n=1
n
n
X 1 !
= lim − ln(1 + k) + ln k
n→∞
k=1
k
n
!
X 1
= lim − ln 2 + ln 1 − ln 3 + ln 2 − · · · − ln(1 + n) + ln n
n→∞
k=1
k
n
!
X 1
= lim − ln(n + 1)
n→∞
k=1
k
Let us define n
X 1
αn = − ln(n + 1)
k=1
k
Then limn→∞ αn = γ.
n
X 1
= αn + ln(n + 1)
k=1
k
= αn + ln n + ln(n + 1) − ln n
= γ + ln n + ln(n + 1) − ln n + αn − γ
| {z }
call σn
= γ + ln n + σn
82
P∞ 1
P∞
6.24 Example. n=1 2n n
= ? Consider xn with R = 1. Take x0 = 12 .
n=0
∞
Z 1/2 X ! Z 1/2 1/2
n 1 1
x dx = dx = − ln(1 − x) = − ln = ln 2
0 n=0 0 1−x 0 2
∞ Z 1/2 ∞
1/2 ∞ ∞
n+1
X
n
X x X 1 X 1
x dx = = =
n + 1 n+1
2 (n + 1) n=1 2 n n
n=0 0 n=0 n=00
We know that
∞
! ∞ Z
Z 1/2 X X 1/2
n
x dx = xn dx
0 n=0 n=0 0
So we get
∞
X 1
n
= ln 2
n=1
2 n
Proof. {fn } is uniformly convergent on [a, b]. Use Cauchy criterion. Let
ε > 0 be given. Let ε0 = · · · Find N1 such that for all n, m ≥ N1 , |fn (x0 ) −
fm (x0 )| < ε0 . Find N2 such that for all n, m ≥ N2 and for all x ∈ [a, b],
|fn0 (x) − fm
0
(x)| < ε0 . Let N = max{N1 , N2 } and n, m ≥ N . Take x ∈ [a, b].
Apply Mean Value Theorem to fn − fm on the interval [x0 , x] (or [x, x0 ]).
Then there is a point t between x0 and x
fn (x) − fm (x) − (fn (x0 ) − fm (x0 )) = (fn0 (t) − fm0
(t))(x − x0 )
|fn (x) − fm (x) − (fn (x0 ) − fm (x0 ))| = |fn (t) − fm (t)| |x − x0 | < ε0 (b − a)
0 0
| {z } | {z }
<ε0 ≤b−a
Then we have
|fn (x) − fm (x)| ≤ |fn (x) − fm (x) − (fn (x0 ) − fm (x0 ))| + |fn (x0 ) − fm (x0 )|
< ε0 (b − a) + ε0 = ε0 (b − a + 1)
83
So let ε0 = b−a+1
ε
. Then there is a function f : [a, b] → R such that fn → f
uniformly on [a, b] and f 0 (x) = g(x) for all x ∈ [a, b].
Given any x with −R < x < R, we can find a number r such that 0 < r < R
and −r ≤ x ≤ r. So
∞
!0 ∞
X X
n
cn x = cn nxn−1
n=0 n=1
84
6.28 Remark. This result is not true for a general series of functions.
P∞ n
6.29 Example. n=1 2n = ? Let x = 21 . Then we have
∞ ∞ ∞
!0 0
X
n
X
n−1
X
n 1 1
nx = x nx =x x = =
n=1 n=1 n=1
1−x (1 − x)2
THE END
85
7 Figures
Br (p) Br [p]
86
Figure 3: Br (p) with d1 metric
Figure 5: Br (f )
87
Figure 6: p is an interior point of E but q is not
88
The set E Set of limit points
of E
89
E is bounded F is unbounded
90