Introduction To Proof in Analysis
Introduction To Proof in Analysis
Steve Halperin
July, 2016
Contents
Chapter 1 Introduction
Chapter 7 Derivatives
1
Chapter 1
Introduction
2
2. The last statement (the conclusion) states that the assertion is true.
Definition 2 A mathematical statement either defines notation or termi-
nology. or else it is a clear, unambiguous assertion, usually using mathematical
terms.
Here are some easy examples of mathematical proofs:
Example 1 1. Prove that if a student is in Math 310 (the hypothesis), s/he
is registered at the University of Maryland(the conclusion).
5. The Division Proposition: If p < n are natural numbers then for some
natural number m < n and for some integer r with 0 r < p,
n = mp + r.
3
We call r the remainder.
4
(b) Consequently you will need to always write in clear, unambiguous
complete sentences, which say precisely what you mean.
Homework requirements
1. Learning to write proofs is not like learning how to multiply matrices, and
it can take mental effort and time.
2. Remain calm; if you put enough time into this class, you will figure out
how to write proofs.
3. Give yourself plenty of time to work on a proof.
4. Before you start the proof, look back at the given definitions and lemmas
that you think might be useful for this proof. Make sure you fully under-
stand the definitions and lemmas and see if you can find a way to connect
them back to what you are trying to prove.
5. Restate definitions in your proofs, so you are less likely to use a definition
incorrectly.
6. Working in groups is fine, but make sure you try each exercise thoroughly
on your own first. You will not have your group to help when it comes
time to take the test.
5
7. Never hesitate to ask Professor Halperin a question when you are stuck:
either in class, in his office, or by email. He will welcome your interest: I
know!
8. Most importantly: This class is designed to help you learn how to write
proofs. While it is important you understand the concepts, you must be
able to use what you learn to complete a correctly written proof in order
to succeed.
In Summary, to succeed in this course you will need to:
6. Get help from me in class, by email, or in office hours, when you do not
understand something.
7. Join a study group, but never as a freeloader. If you freeload tour home
work score may be OK, but your tests and exams will NOT be.
Students who invest this time and effort usually do well. Students
who do not make this effort usually do not.
6
Chapter 2
You learn a second language most easily by speaking it with others to whom
it comes naturally. You learn to drive a car by driving it and to walk by walk-
ing. You learn to write/speak mathematics by writing it and presenting it and
getting feedback when you get it right and how to correct it when you dont.
The golden rule when writing: never write anything whose meaning is
unclear to yourself ! You can also use this text to find many detailed exam-
ples of how to write a proof correctly.
Definition 3
7
we denote this by xS.We often write
S = {x, y, z, },
Note: The objects listed in a sequence form a set, as seen in the following
example.
Example 2
1. The list 0, 1, 0, , 1, 0, 1, is a sequence. The corresponding set is the
collection {0, 1} which only has two elements.
2. The list 2, 4, 2, 4, 6, 2, 4, 6, 8, 2, 4, 6, 8, 10, is a sequence. The correspond-
ing set is the collection of even natural numbers.
Mathematical language also relies heavily on symbols to express assertions
and proofs in a short and clear manner, but in any specific proof each
symbol must have a precise meaning and the same symbol may never
be used with two different meanings.In particular, we fix the following
symbols for the entire course.
Example 3 Basic notation
1. N will denote the set of natural numbers, and we write N = {1, 2, 3, . . .}.
2. Z will denote the set of integers: Z = {0, 1, 2, 3 . . .}.
3. Q will denote the set of rational numbers: these are the real numbers wich
can be written p/q with p Z and q N. Note that p/q = r/s if and only
if ps = rq.
4. R will denote the set of real numbers.
5. C will denote the set of complex numbers.
6. The absolute value of a real number x is denoted by |x| and is defined
by:
x, x 0,
|x| =
x, x<0
Note that |x| 0 for all x R.
7. q.e.d. stands for quid erat demonstrandum, which is Latin for what was
to be proved. It is used at the end of a proof to signal that the proof is
complete.
8
Definition 4 1. An integer n is even if it is divisible by 2.
2. An integer n is odd if it is not even.
3. A prime number is a natural number n which is larger than 1 and is not
divisible by any natural number except 1 and n.
Example 4 Sigma and Pi notation
More generally,
n
X
vki = vk1 + vk2 + vk3 + vkn .
i=1
In this notation the i just indexes the terms being added or multiplied,
and we could use any letter instead without changing the meaning. Thus
n
X n
X n
X
vi = vl = vq = v1 + v2 + vn .
i=1 l=1 q=1
More generally,
n
Y
vki = vk1 vk2 vk3 vkn .
i=1
and
n
Y
C = C C = C n.
i=1
9
Proposition 1 (Difference theorem) For any real numbers a, b R and
any n N,
n1
X
bn an = (b a) bi an1i .
i=0
and so
n1
X n
X n1
X
b( bi an1i ) = bi ani = bn + bi ani .
i=0 i=1 i=1
10
2.2 Logical statements
In Mathematics, you will frequently encounter statements about statements!
Moreover, just as we use symbols to represent unspecified numbers, functions,
and matrices, so also we may use symbols to represent statements!
Example 6 Here are four statements:
4. B implies A.
In this example, The statement A implies B is true, and the statement B
imples A is false.
Here are some frequently used logical statements and expressions:
A B.
A B.
11
The next Lemma shows that a statement and its contrapositive are equiva-
lent! The proof relies on the fact that in mathematics, every statement is either
true or false.
Proof:
1. Suppose that A implies B. Then if B is not true, A cannot be true! Thus
if the statement A implies B is true, so is its contrapositive. On the other
hand, suppose the contrapositive is true. Then if A is true it cannot be
that B is not true. Thus B is true and so A implies B.
Thus if n N then
|1 xn | = 1/n 1/N.
Therefore if if N = 3k then for n N, |1 xn | 1/3k < 1/2k.
2. This example illustrates the importance of using words carefully
and correctly.
12
(b) Statement: For each > 0 there is an N N such that |xn 0| <
for n N .
The first is correct and the second is false.
To see that the second assertion is false pick = 1/2. Then for all n,
|xn 0| = 1
13
(b) For each date there is a student in the class who was born on that
date.
The first statement is true and the second is false.
On the other hand, any natural number, when divided by 2 has a remain-
der of either 0 or 1.
If the remainder is 0 then the number is divisible by 2, and so it is even.
Proof: The rational number must have the form p/q in which p Z
and q N.(Establishes notation)
If p 0 then p/q < 1.
Otherwise p N and p/q p < p + 1. q.e.d.
Exercise 1 1. For each statement below decide if it is true or false and either
provide a proof that it is true or give an example to show that it is false.
(a) If x Z and x 0 then x N.
14
2. Describe what is wrong with each of the following statements:
(a) Laptops are popular among college students. Therefore at least one
student at Maryland has a laptop.
3. Does (a) or (b) correctly add such that to the statement: every student
has a height h?
(a) Every student has a height h such that h a where a is the height of
the tallest student.
(b) Every student has a height h such that every student is in a class.
4. Is the following statement true or false? Provide a proof for your answer.
Suppose A and B are natural numbers, and that A = 5 if and only if
B = 2. If B 6= 2, then A = 7.
5. What is the contrapositive of the following statements?
(a) A 6= 8 if B = 9.
(b) A = 8 if B 6= 9.
6. What is the converse of the following statements?
(a) B = 9 if A = 8.
(b) A 6= 8 if B = 9.
7. What is the hypothesis and what is the conclusion in the following asser-
tions?
(a) The cube of an odd natural number is odd.
Is the original statement true? Is the converse true? Provide proofs that
show your answers are correct.
15
10. What is the converse of the statement A implies B? Construct an ex-
ample where a statement is false but the converse is true.
11. What is the converse of the statement A is true if and only if B is true.?
What is the difference in meaning between the original statement and the
converse?
12. Is (a) or (b) a proof that the following statement is wrong? Statement:
All ducks are red.
(a) There exists a yellow duck, A. Therefore not all ducks are red.
(b) We have not seen all ducks. Therefore some may not be red.
13. Prove that if k N and k 2 is even then k 2 is divisible by 4.
14. Suppose x, y are positive real numbers and n N.
(a) Show that x < y if and only if xn < y n .
(b) If x < y show that if n > 1 then y n xn < n(y x)y n1 .
15. In each of the following statements, replace the blanks by words/expressions
from the list:
let, therefore, if, only if, only, since, therefore, some, then, by, even, im-
plies, because, each, not, true, false, hypothesis, zero, one, theorem, follows
16
ni is odd, ni = 2mi 1, where mi is an integer.
k
X 2m
X 2m
X 2m
X 2m
X
ni = (2mi 1) = 2 (mi ) 1=2 (mi ) 2m.
i=1 i=1 i=1 i=1 i=1
Pk
i=1 ni is
q.e.d.
(b) Statement: If k N and k 2 is divisible by 3, then k 2 is divisible by
9.
(p + 1)n pn 1.
q.e.d.
17
1. Prove that there are infinitely many prime numbers.
Proof: Suppose the statement there are infinitely many prime numbers
is false.
Then there would be only finitely many prime numbers.
Thus there would be a largest prime number p.
Let n be the number obtained by first multiplying all the natural numbers
from 1 to p and then adding 1. (Establishes notation)
Then n > p.
Dividing n by any natural number k p gives a remainder 1.
Therefore n is not divisible by any natural number k p. But n must be
divisible by some prime number q.
Therefore there must be a prime number q > p.
This contradicts the hypothesis that p was the largest prime number.
Therefore there must be infinitely many primes. q.e.d.
2.5 Induction
We use induction both to prove statements and to make constructions. Proof
by induction is based on the following induction principle, which we take as an
18
axiom. In other words, we assume it is true without proof!
1. S(1) is true.
2. Whenever S(n) is true then also S(n + 1) is true.
Then S(n) is true for all n N.
19
3. Statement: For every n N,
k=n 2
X n(n + 1)
k3 = .
2
k=1
When n = 1 both sides of the equation equal 1 and so they equal each
other.
20
An important application of proof by induction is the Binomial theorem,
which requires a definition and some more notation.
Definition 6 1. For any natural number n, n factorial is the product of
all the natural numbers from 1 to n:
n! = nk=1 k.
Proof: First, we use the definition above to rewrite the left hand side as
n! n!
+ .
(i 1)!(n (i 1))! i!(n i)!
Multiply the numerator and the denominator of the first term by i to get
n! n! i
= .
(i 1)!(n (i 1))! i!(n + 1 i)!
Then multiply the numerator and the denominator of the second term by n+1i
to get
n! n! (n + 1 i)
= .
i!(n i)! i!(n + 1 i)!
Finally, add together to get
n! n! n! (i + n + 1 i) (n + 1)!
+ = = .
(i 1)!(n (i 1))! i!(n i)! (i)!(n + 1 i)! (i)!(n + 1 i)!
21
q.e.d.
We consider the two terms separately. The second term may be written as
n n
X n i ni+1 n+1
X n
ab =b + ai bni+1 .
i i
i=0 i=1
For this first term set k = i + 1. Then as i runs from 0 to n 1, k runs from 1
to n, and
n i = (n + 1) (i + 1) = n + 1 k.
Thus the first term may be rewritten as
n
X n
ak bn+1k + an+1 .
k1
k=1
Now in this sum, k is a dummy variable. We could have used any symbol
such as m, n, p, . . .. In particular we could have used i. Thus this term may be
rewritten as
n
X n
ai bn+1i + an+1 .
i1
i=1
22
This shows that the statement is true for n + 1, and so by induction it is true
for all n. q.e.d.
There is another form of the induction principle we shall also use, as illus-
trated in the next Proposition:
Proposition 3 Suppose given a sequence of statements S(n), one for each
n N, and that
1. S(1) is true.
2. Whenever S(k) is true for k n then also S(n + 1) is true.
Then S(n) is true for all n N.
Proof: Let T (n) be the statement: S(k) is true for all k n.
Since S(1) is true, so is T (1).
Suppose by induction that T (n) is true.
Then S(k) is true for all k n.
Therefore by hypothesis, S(n + 1) is true.
Since S(k) is true for k n as well, it is true for k n + 1.
Thus T (n + 1) is true.
Now it follows from the induction principle that T (n) is true for all n.
Therefore S(n) is true for all n. q.e.d.
The principle of induction can also be used for construction, via the following
23
2. An infinite sequence (xn )n1 satisfying xn+1 > x2n can be constructed by
induction as follows:
(a) Set x1 = 1
(b) Assume xi is constructed for i n and set
xn+1 = x2n + 1.
Exercise 3 Induction
Pn n(n+1)
1. Show by induction that i=0 i= 2 .
Pn n(n+1)(2n+1)
2. Show by induction that i=0 i2 = 6 .
3. Use the Binomial theorem to show that if p, k N then
p+1 k k
( ) > .
p p
Conclude that
p k p
( ) < .
p+1 k
4. Show by induction on n N that the product of n odd natural numbers is
odd.
5. Construct by induction an infinite sequence of natural numbers (xn )n1
Pn1
such that for n 2, xn > i=1 xi .
2.6 Counterexamples
Suppose you are given a statement of such as all natural numbers are
prime, and you want to prove that it is false. Since the statement asserts a
property for all natural numbers, you only have to find a single example (eg.
6 = 2.3) to show that the statement is false.
This is an example of a counterexample: counterexamples are examples
which demonstrate that assertions are false. Thus the example asked for in
Exercise 2.3 is a counterexample to the assertion that all natural numbers have
rational square roots.
There is a much deeper example from the theory of equations. You learned
in school that the quadratic equation
ax2 + bx + c = 0
24
has two solutions, x = b b2 4ac)/2a. One might ask whether the solutions
to higher order equations can also be expressed in formulas that only use nth
roots, for some natural numbers n, and indeed this is true for cubic and quartic
equations.
However, it is not true for all fifth degree equations, as was shown by Abel
and Ruffini in 1824. The easiest way to show this is by an explicit counterex-
ample and a very simple one was proved about a century ago by a famous
algebraist, Emil Artin, who showed that roots of the equation x5 x 1 = 0
cannot be expressed in this way.
Exercise 4 Counterexamples
1. Show that the following statement is false: If a, b N then a3 + b3 is the
cube of a natural number.
2. Prove that the sum of an odd number of natural numbers is odd if each of
the natural numbers is odd. What is the converse statement? Show by a
counterexample that the converse is false.
3. What is the converse to the statement: Suppose n is an integer. If n is
an odd natural number then n2 is odd. Decide if it is true or false and
prove your answer.
4. Prove or disprove the following statement: For every x Q there is a
unique n N which is the closest natural number to x.
5. Construct an example to show that if in each of two school classes the
average GPA of the boys is bigger than that of the girls it may not be
the case that when the classes are combined this is still true: i.e., in the
combined classes the average GPA of the girls may be bigger than that of
the boys.
6. Show by counterexample that the following statement is false: For every
p, q N, p2 + q 2 > (p + q)2 50p 51q.
7. Show by counterexample that the following statement is false: If t, u, s
N satisfy s > 39, t > s + 5, and u > 33, then t + u > 82.
25
The classical example is Fermats last theorem ! Fermat was a 17th century
number theorist, and after he died in 1637 the following statement was found
written in the margin of one of his books: I have found the most wonderful
result, but the margin is too small for me to write down the proof. The simple
assertion was this: If a, b, c, n are natural numbers all greater than 1, and if
an + bn = cn ,
then n = 2.
In the following three hundred years the search for a proof was one of the
holy grails of mathematics. Much of our knowledge in number theory and
geometry was developed in the process. And finally in 1995 Andrew Wiles
(Princeton) published a proof using many of the results which had been estab-
lished over the preceding centuries.
Some of you may wonder about the relation of mathematics to the physi-
cal world we live in. Now mathematical knowledge itself is validated just by
proofs, and so its correctness stands for all time and does not depend in any
way on our physical experience. Nonetheless, much of mathematics is inspired
by that physical experience, mathematical knowledge is regularly applied in al-
most every branch of science and engineering, and indeed many mathematicians
focus on building mathematical models and computational algorithms that di-
rectly reflect/compute physical phenomena. As a Nobel Laureate in Physics,
Eugene Wigner, wrote in 1960 in a paper entitled The Unreasonable Effective-
ness of Mathematics . . . the mathematical formulation of the physicists often
crude experience leads in an uncanny number of cases to an amazingly accurate
description of a large class of phenomena.
26
Chapter 3
3.1 Sets
The basic vocabulary of Mathematics is that of sets and maps. It is used in
every branch of the subject.
Definition 7 Sets
4. A finite set is a set with only finitely many elements. In this case |S|
denotes the number of elements in S.
Example 10 Sets
27
1. The set S = {1, 2, 3} has three elements: 1, 2, and 3 and so |S| = 3.
2. The empty set has no elements and so || = 0.
3. Each of N, Q, R, and C are infinite sets.
W = {x S | },
Example 11 Subsets
1. The set S of even integers is the subset of Z given by
S = {n Z | n is divisible by 2}.
N = {n Z | n > 0 }.
Definition 9 Products
28
1. The product of two sets S and T is the set S T whose elements are
the ordered pairs (x, y) with x S and y T . We often write this as
S T = {(x, y) | x S and y T }.
Example 12 Products
1. The product of the sets S = {2, 17, 99} and T = {5, 2} is the set
S T = {(2, 5), (17, 5), (99, 5), (2, 2), (17, 2), (99, 2)}.
because (2, 1) and (4, 2) are different elements in the product but 2/1 =
4/2.
T
2. The intersection of the S is the set S whose elements are the ele-
ments which belong to each of the S :
\
S = {x S | x S for every S }.
Definition 11 The power set P (S) is the set whose elements are all the sub-
sets of S.
29
1. The union of the sets {1,2,3} and {2,4,8} is {1,2,3,4,8}. The intersection
of these sets is {2}. The original two sets each have three elements, the
union has five elements, and the intersection has one element.
2. The union of the sets {1, 2}, {2, 3} and {3, 4} is the set {1, 2, 3, 4}. The
intersection of the first three sets is .
3. Let S be the set of even integers and let T be the set of odd integers. Then
ST =Z and S T = .
Exercise 5 Sets
1. Let S be the set of all even integers, and let T be the set of all integers
divisible by 3.
(a) What is S T ?
(b) Let W be the set of integers which are not in S T . Is W infinite or
finite?
2. Suppose S and T and |S| = 3 and |T | = 4
(a) What is |S T |?
(b) What is |P (T )|?
3. Two sets S and T are disjoint if S T = .
(a) If S and T are disjoint sets show that for any set W , S W and
T W are disjoint.
30
(b) If S and T are disjoint sets for which sets W are S W and T W
disjoint?
(c) If S and T are disjoint sets show that P (S) P (T ) = {}.
4. If S and T are finite sets show that
|S T | + |S T | = |S| + |T |.
6. Use the previous problem and induction to prove that if S is a finite set
then |P (S)| = 2|S| .
3.3 Maps
Definition 12 Maps
1. A map
:ST
between sets consists of three things:
(a) A set S, called the domain of the map;
(b) A set T , called the target of the map; and
(c) A rule which assigns to each element x S a single specified ele-
ment y T . The element y is called the image of x and is denoted
by y = (x).
2. If : S T is a map between sets then the image of is the subset
Im T defined by
Im = {(x) | x S}.
In particular, Im = (S).
4. If S and T are sets, the set whose elements are all the maps from S to T
is denoted by T S .
Note:
1. To define a map we must specify three things: the domain, the target,
and the rule - see Example 14, below.
31
2. Do not confuse a set, S with a map, .
(a) A set is a collection of objects.
(b) A map, : S T ia a rule connecting each element x S to a
single element (x) T .
Example 14 Maps
1. The rule which assigns both 1 and 2 to 1 and k to k for k 2 is not a
map from N to N because two different elements are assigned to 1.
2. If S and T are sets then the collection of all maps from S to T is a set.
32
Remark: A map from R to R is often called a real valued function, and the
formulas you are used to from calculus usually define real valued functions on
R. However, not every real valued function has a formula.
Definition 13 Composites
T U,
( )(x) = ((x)), x S.
(f h)(p) = p, p Z.
x1 6= x2 (x1 ) 6= (x2 ).
33
3. A map : S T is a bijection if and only if is both onto and 1-1.
Caution: Do not confuse the definition of a map with the definition of a 1-1
map:
1. A map : S T associates to each x S a single element (x) T .
In other words:
1. If is a map from S to T , then for each x S there is a single y T such
that maps x to y.
AND
(b) for each y in the image of there is a single x which is mapped to y.
34
4. Let Let f : {1, 2, 3, 4} {a, b, c, d} be defined by f (1) = c, f (2) = a, f (3) =
d, and f (4) = b. and let h : {a, b, c, d} {a, b, c, d} be defined by h(a) =
b, h(b) = c, h(c) = d, h(d) = d. Then
(a) f h is not defined.
(b) h is not onto and is not 1-1.
(c) h f is given by (h f )(1) = d, (h f )(2) = b, (h f )(3) = d, and (h
f )(4) = c.
5. The map : N N defined by
(n) = n + 1
Exercise 6 Maps
1. Suppose f : S T is a map and U and W are subsets of S.
(a) If U W = does it follow that f (U ) f (W ) = ?
(b) If f (U ) f (W ) = does it follow that U W = ?
idS (x) = x, x S.
35
2. If : S T is a bijection, then the inverse of is the map 1 : T S
defined by
2. (Associativiity of composition):
( ) = ( ).
3. If is a bijection then
4. If : T S is a map satisfying
Proof:
1. For x S,
(idT )(x) = idT ((x)) = (x) and ( idS )(x) = (idS (x)) = (x).
2. For x S,
and
36
4. If y T then
y = ((y)) Im .
Therefore is onto.
Moreover, if x1 , x2 S and (x1 ) = (x2 ) then
x1 = ((x1 )) = ((x2 )) = x2 .
= idT = ( 1 ) = ( ) 1 = 1 .
q.e.d.
Example 17 Inverses
1. Let f : {1, 2, 3, 4} {a, b, c, d} be defined by f (1) = c, f (2) = a, f (3) =
d, and f (4) = b. Then f is a bijection and its inverse is given by f 1 (a) =
2, f 1 (b) = 4, f 1 (c) = 1, f 1 (d) = 3.
2. Let A be an n n matrix, and regard A as a map from the set of column
vectors to itself by setting A(v) = Av (matrix multiplication). If B is a
second n n matrix, then (A B)(v) = A(B(v)) = A(Bv) = (AB)v. Thus
the map A B is just multiplication by the product matriz AB.
3. In the example above, suppose A is an invertible matrix with inverse matrix
A1 . Then using elementary linear algebra it follows that multiplication
by A is a bijection, and that the inverse map is multiplication by A1 .
4. Itr follows from what you learn in an elementary calculus course that the
map f : R R given by f (x) = x3 is a bijection. The inverse maps any
real number x to its unique cube root.
5. Let (xn )n1 be a sequence of real numbers such that for all n, xn < xn+1 .
Then define S R by
S = {xn | n 1}.
Define f : R R by setting
x, x/S
f (x) = x2k1 , x = x2k ,
x2k , x = x2k1 .
Then f is a bijection.
37
Proposition 5 Let S be a non-void set. Then a bijection,
is given by
1 xU
(U )(x) =
0 x
/ U.
(f ) = {x S | f (x) = 1},
( )(U ) = {x S | (U )(x) = 1} = U.
f : S {0, 1}
by setting
1 (x)(x) = 0
f (x) =
0 (x)(x) = 1.
Then by construction it is never true for any x S that (x)(x) = f (x). But if
(y) = f for some y S then
(y)(y) = f (y),
38
(b) : R R, defined by
1 x = 1,
(x) =
x+2 x 6= 1.
(b) Recall that a map : S R is 1-1 if and only if: for every x, y S:
(x) = (y) if x = y. Recall that every natural number has a unique
square. Therefore if k = n then k 2 = n2 . Therefore the map is 1-1.
q.e.d.
39
(b) The composite of onto set maps and is onto if the target of is
the domain of .
(a) If T is finite and the map is 1-1 show that S is finite and that |S|
|T |.
(b) If S is finite and the map is onto show that |T | is finite and that
|S| |T |.
9. Suppose : S T is a map and that S and T are finite sets with the
same number of elements. Show that the following three conditions are
equivalent:
(a) is a bijection.
(b) is onto.
(c) is 1-1.
10. Construct two maps and , both from the same set S to the same set
T , and such that S and T are different sets and is 1-1 but not onto and
is onto but not 1-1.
11. If S and T are finite sets show that there are |T ||S| elements in the set of
maps from S to T .
12. How many elements are there in the subset of bijections of a finite set S
to itself ?
40
Example 18 Suppose : S T is a map. Then the relation
{(x, (x)) | x S} S T
Exercise 8 Relations
1. Identify whether which of the following subsets R S T is a relation
determined by a map:
(a) S is all of R and T is all of Z, and R = {(2, 3), (3, 4), (4, 5)}.
(b) S = N, T = R and R = {(n, 1/n)|n N}.
(c) S = N, T = N and R = {(n2 , 1/n) | n N}.
2. Show that the relation {(x2 , x) | x R} R2 is not the relation of a
map.
3. Which are the integers n N such that the relation
{(xn , x) | x R} R2 is the relation of a map from R to R?
4. If S and T are finite sets, how many relations are there between S and T ?
Compare this with the number of maps from S to T - see Exercise 5.
41
Example 19
1. The single set S is a partition of a non-empty set S. The corresponding
relation is xRy for every x, y S. Thus R = S S.
2. The family of subsets Sx , x S of a non-empty set S is a partition of S,
since every x belongs to a single Sx . The corresponding relation iis xRy
if and only if x = y.
3. A partition of the set, S, of sophomore students at the University of Mary-
land is defined by: For each possible GPA, , S is the set of students
whose GPA is .
Proof::
1. The relation is reflexive because x and x belong to the same Si .
42
Proof: Fix an equivalence relation, , in S.
S(x) = {y S | y x}.
Now let {Si } denote the family of distinct subsets of S such that each Si = S(x)
for some x S.
By reflexivity each x S(x) and so the Si are not empty and every x in S
belongs to some Si .
Thus to show this is a partition we have to show that any element of S can
belong to only one subset Si .
In other words we have to show that if y S(x) and y S(z) then S(x) = S(z).
S(u) S(x).
S(x) S(u).
S(x) S(u).
43
Therefore {Si } is a partition and Step 1 is proved.
Denote the relation of the partition by R, so that xRy if and only if x and
y are in the same subset Si of the partition.
Then by definition,
But we know that if x, y S(w) then S(x) = S(w) = S(y) and so x y. Thus
R =.
Step 3. The partition {Si } is the unique partition which has as its equiva-
lence relation.
y x if and only if y T .
Thus T = S(x).
It follows that every T is one of the S(x).
Since every element of S is in some T it follows that every S(x) is one of the
T .
Therefore the partition {T } is the partition {Si }. q.e.d.
Definition 19 If is an equivalence relation in a set S then the elements Si of
the corresponding partition are called the equivalence classes of the relation.
44
(a) If each Si has the same number of elements, k,show that k divides n
and that n/k = m.
(d) If each Si has an odd number of elements show that m is even if and
only if n is even.
6. Recall that P (Q) denotes the set of all subsets of Q. Thus the elements
of P (Q) are the subsets S Q. Define a relation
P (Q) P (Q)
by setting ST if
(a) for every a S there is some b T such that b a, and
(b) for every c T there is some d S such that d c.
Then
(a) Show that is an equivalence relation.
(b) Show that if {Si } is an equivalence class of subsets then
[
Si
i
S = {b Q | b < a} and T = {b Q | b a}
equivalent?
7. Let T S denote the set of maps from a set S to a set T . Define a relation
R T S T S by setting
f Rg
if f (x) = g(x) except for finitely many points x S (depending, of course,
on f and g). Show this is an equivalence relation.
45
Chapter 4
such that
|x a| < .
This allows us to extend properties of the rationals to the reals in a rigorous way.
46
1. Algebra: The operations of addition, subtraction, multiplication and
division.
2. Order: If b and a are rational numbers then
The basic properties of the ordering in the rationals are contained in the
next lemma. While they are utterly and totally familiar we shall give formal
proofs to provide more examples of what a proof looks like.
Lemma 4
1. For each rational number a Q exactly one of the following three possi-
bilities is true:
(a) a > 0
(b) a = 0
(c) a < 0
In particular, if a, b Q then
b > a b a > 0.
47
2. (a) If a < b and b < c then
with p, q, m, n N.
It follows that
(a + c) (a + b) > 0 c b > 0.
Therefore
cb ca = c(b a) = pm/qn > 0.
Property One: The real numbers are a set, denoted by R, containing the
rational numbers.
48
Property Two (Algebra): The operations of addition, subtraction, mul-
tiplication and division are defined for real numbers, coinciding with the old
operations in the rationals, and with the same properties.
x < m.
n < x.
49
3. For each positive real number x there are natural numbers k, m such that
1/k < x < m.
(d) First,
1/x > 0 and 1/y > 0 1/x and 1/y > 0 (1/x)(1/y) > 0 1/xy > 0.
Multiplication by 1/xy therefore preserves the inequality x < y and
this gives 1/y < 1/x.
(e) First, if x < y then
y = x + (x y) < y + (x y) = x,
and so multiplication by 1 reverses inequalities. Yhus in general, if
z < 0 and x < y then we have z > 0 and so by Property 3,
(zx) = (z)x < (z)y = (zy).
Multiplication by 1 reverses this inequality and gives zx > zy.
50
2. By Property 3 applied to x, for some n N we have x < n. Since
multiplication by 1 reverses inequalities it follows that
n < x.
3. Since x > 0, 1/x > 0. Thus by Property Three there are natural numbers
k, m N such that
1/x < k and x < m.
By what we proved above this implies that 1/k < x and so
q.e.d.
The preceding Lemma establishes properties you have been taking for granted
for years. Henceforth we will use these properties without referring to the
Lemma for justification.
The next result is absolutely fundamental for this course. It states that
any real number can be approximated arbitrarily well by rational numbers.
2. In particular,
Proof:
1. By Property Three amd Lemma 5 there are natural numbers i, j such that
j < x < i.
Set p = i(2k + 1) and q = j(2k + 1). Then we may rewrite this inequality
as
q p
<x< .
2k + 1 2k + 1
Observe first that if mZ and x < m/(2k + 1) then
q m
<x< ,
2k + 1 2k + 1
and so q < m.
51
Therefore there is a least integer r such that
r
x< .
2k + 1
Then
r1 r2
x and so x> .
2k + 1 2k + 1
Thus
r2 r
<x<
2k + 1 2k + 1
and
r r2 2
= < 1/k.
2k + 1 2k + 1 2k + 1
2. This is immediate from what was just proved.
q.e.d.
x < b < y.
Proof: By Lemma 5, for some k N, 1/k < y x. and so x + 1/k < y. Now
by the Sandwich theorem, for some b Q,
1/y p < x.
y > (1/k) + 1.
Therefore
y p > (1/k + 1))p > p/k.
52
Now multiply by k/py p to obtain
k/p > 1/y p .
This holds for any p N.
Finally, by Lemma 5, x > 1/n for some n N. Now choose p = kn. Then
1/y p < k/kn = 1/n.
q.e.d.
Exercise 10 Inequalities
1. Is it true that there are rational numbers a < b such that for any natural
number k, b a < 1/k?
2. If x, y, z, w are positive real numbers such that x < y and z < w show that
xz < yw. State the converse and either prove it or provide a counterex-
ample to show it is false.
3. Show that if x < y are real numbers then there are infinitely many rational
numbers b such that x < b < y.
4. Suppose c Q and y, z are any real numbers. Show that if c > y + z then
there are rational numbers a > y and b > z such that
c > a + b.
5. Show that the product of a positive real number with a negative real number
is negative.
6. Let x and y be positive real numbers. Show that if x > 1 then (i) xy > y,
(ii) 0 < 1/x < 1, and (iii) 0 < y/x < y.
7. If a < b are non-negative real numbers show that for any p N, bp ap
p(b a)bp1 . (Hint:use the Difference theorem (Proposition 1).
53
3. |x| is the larger of x and x.
4. Thus the statement |x| < is the same as x < and x < , and hence
then x = y.
1. |xy| = |x||y|.
2. x2 0 and so |x2 | = x2 .
3. |x + y| |x| + |y| (The triangle inequality).
4. ||x| |y|| |x y|.
3. Note that
54
Therefore |x + y|2 (|x| + |y|)2 . It follows that
Since the second factor on the right is not negative it follows that
|x| + |y| |x + y| 0.
and
|x y| + | x| |x y x| = |y|.
Therefore
Therefore
|x y| ||x| |y||.
q.e.d.
But
x a < x < a + and a x < x > a .
Thus
|x a| < a < x < a + .
q.e.d.
55
2. If x, z R show that for each > 0 there is some > 0 such that if y R
satisfies |y x| < then |zy zx| < .
3. If x R show that for each > 0 there is some > 0 such that if y R
satisfies |y x| < then |y 2 x2 | < . (Hint: Use y 2 x2 = (y x)(y +x).)
4. If x R and x 6= 0 show that for each > 0 there is some > 0 such that
if y R satisfies |y x| < then y 6= 0 and |1/y 1/x| < .
4.4 Bounds
Definition 20 Bounds
1. A nonvoid subset S R is bounded above if for some b R,
x b for all x S.
a x for all x S.
Proof:: The statement that every element of S is a lower bound for T is true if
and only if x T for every x S.
This is equivalent to the statement:
56
1. Any real number x 1 is a lower bound for N.
2. N is not bounded above.
In fact if x is any real number then by Property 3.5 there is some natural
number m such that x < m.
Thus x is not an upper bound for N, and so N does not have an upper
bound.
3. S = {1/n | n N} is bounded above by any number 1 and bounded
below by any number 0.
Exercise 12 Bounds
1. Show that if x is a positive real number then x + 1 is not a lower bound
for N.
5. Show that the set of real numbers of the form x/y with |x| > |y| > 0 is not
bounded above or below.
6. Show that the set of real numbers of the form x/y with |y| > |x| > 0 is
bounded. Find explicit upper and lower bounds and prove your answers
are correct.
7. Suppose S T R are non-void sets. If S T show that S has exactly
one element.
8. More generally, suppose S R and T R are non-void sets. If S T
show that S T can have at most one element. If S T is non void show
that its unique element is an upper bound for S and a lower bound for T .
57
4.5 Least upper and greatest lower bounds
In everything we have done so far there is nothing to suggest that there
are real numbers which are not rationals!
All we have assumed about the real numbers at this point is listed in Prop-
erties One, Two, and Three at the start of Section 4.2.
We correct this with one final property, still as an axiom. This is the fun-
damental property of the real numbers and is the key fact which makes
analysis possible.
S = {x R| x 1}
or if
S = {x R| x < 1},
then in both cases lub(S) = 1. However, in the first case, 1 S and in the
second case 1
/ S.
Analogous to least upper bounds, a non empty set which is bounded below
has a greatest lower bound:
58
Definition 22 The real number a in Proposition 7 is called the greatest lower
bound for S and is denoted by glb(S) or by inf(S).
y S.
We recap what it means for b to be the least upper bound of a non-void set
S. It means exactly this:
Sb
and
59
S, |b x| < b u.
Since b x > 0 we have
b x = |b x| < b u,
Example 21
1. glb(N) = 1.
In fact, since 1 N, any lower bound x for N satisfies x 1
But 1 n for all n N. Thus 1 is a lower bound for N and so it is the
greatest lower bound: glb(N) = 1.
In fact for x 1
1 1 + 1/x.
Moreover, if y > 1 then by Property 3 there is some n N with 1/n <
y 1. Thus
1 + 1/n < y
and so y is not a lower bound for S. Thus 1 is the greatest lower bound.
60
(c) For each > 0 there is an element x S such that 0 b x < .
5. Suppose S T are subsets of R:
(a) If T R is a non-void set bounded below show that S is bounded
below and that glb(T ) glb(S);
(b) If T is bounded above show that S is bounded above and that lub(T )
lub(S).
4.6 Powers
We begin by recalling from Sec. 2.3 the definition of integral powers of a real
number x, which we do by induction.
Definition 23 Let x be a non-zero real number. If n N then xn is defined
inductively by
x1 = x and xn+1 = x xn .
Then we set x0 = 1 and xn = 1/xn .
1. For x, y S,
x < y xn < y n .
2. The map
S S, x 7 xn
is a bijection.
Proof::
1. The Difference theorem (Proposition 1) gives
n1
X
y n xn = (y x) y i xn1i .
i=0
Pn1
Since both x and y are positive, i=0 y i xn1i is positive. Therefore
y n xn > 0 y x > 0.
61
We need to show that if y is a positive real number and n N then there
is a positive real number x such that xn = y.
T = {x S | xn > y}.
xn = y.
By Property 3.1, exactly one of the following three possibilities must hold:
xn < y, xn > y, or xn = y.
(a) We show that if xn < y then x is not the greatest lower bound of T ,
which is a contradiction .
cn < y < z n ,
Thus c is a lower bound for T . But since xn < cn we have x < c and
so x would not be the greatest lower bound.
62
But if such a b exists then by the definition of T, b T . Now by the
first assertion of the Proposition,
b < x,
y xn
1/k < .
2n xn1
Set c = x + 1/k. Then c > x and so
Thus
cn xn < (1/k)xn1 2n < y xn ,
and so cn < y. This completes the construction of c.
xn y
1/k < .
nxn1
63
Set b = x 1/k. Then 0 < b < x and so
Therefore y < bn .
q.e.d.
We can now define any rational power of a positive real number. For this
we need the following:
(x1/n )m = (x1/q )p ,
64
and the Lemma is proved.
q.e.d.
Now let a be any rational number. We can express a in the form a = m/n
with m Z and n N. Lemma 10 shows that if x is a positive real number
then (x1/n )m ) does not depend on the choice of m and n. Thus we may make
the
Definition 25 Let x be any positive real number and let a be any rational num-
ber. Then
xa = (x1/n )m ,
where a = m/n and m Z and n N.
Exercise 14 Powers
1. Show that if a, b are rational numbers and x is a positive real number then
xa xb = xa+b .
2. Show that if a, b are rational numbers and x is a positive real number then
(xa )b = xab .
3. Show that if x R satisfies x > 1 and if c Q is positive, then xc > 1.
4. Show that if x > 1 is a real number and if a < b are positive rational
numbers then 0 < xa < xb .
5. Show that if a Q is positive and if 0 < x < y then xa < y a .
6. If k N and x > 0 is a real number, show by induction on k that
7. Identify what is wrong with the following attempt to prove the assertion in
the previous exercise:
Proof: Let S(k) be the statement xk x if x < 1. When k = 1 then S(1)
reads x x which is true. Since x < 1, it follows that xk < 1. Therefore
xk x < 1.q.e.d.
8. If x, R are positive and if x < 1 show that for some N N,
xa < if a Q and a N.
9. Let p, q N and x > 0 be a real number. When is xp/q > x and when is
xp/q < x? Prove your answer is correct.
10. Let x R and let S be the set of those rationals of the form u = p/10k
satisfying the three conditions: (i) p Z, (ii) k N, and (iii) u < x.
Show that x = lub(S). Hint: Follow the following steps:
65
(a) Let > 0 be an arbitrary positive number. Use Proposition 8 to
conclude that there are rational numbers a, b such that x < a <
b < x.
(b) Show that for some k N, 10k b 10k a > 2. Explain why this implies
that some integer p satisfies 10k a < p < 10k b.
(c) Conclude that p/10k S and that x < p/10k < x.
Then simply define the real numbers to be the subsets of the rationals that are
bounded above and full, and identify each rational p/q with the set of all ratio-
nals p/q. Intuitively we have just filled in the holes among the rationals.
If S and T are sets of rationals that are bounded above and full, then we
think of these sets as real numbers x and y and define x < y if S ( T , and
x > y if S ) T . Then set x + y to be the set
Of course, we then need to prove that all these definitions are well-defined,
that all algebraic rules are still true, that the properties above for the order
hold, and that the operations and order for the rationals remain as before. And
then, of course, we need to prove Properties One through Four. All this is long
and boring, so instead we will simply take for granted the existence of the real
numbers satisfying those properties.
66
Chapter 5
Infinite Sequences
Infinite sequences (xi ) of real numbers are therefore a fundamental tool for
applications because they can be used to approximate a real number x to within
a given tolerance. Intuitively that means that the error, |xi x|, gets arbitrar-
ily small as i gets larger. In other words, if we want to approximate x within
a given tolerance we may simply use one of the xi as long as i is sufficiently large.
Infinite sequences are also a fundamental tool in analysis, and for this we
need as always to formalize the intuitive idea above:
Definition 27 An infinite sequence (xi )ik of real numbers converges to
x R if for each > 0 there is some integer N k (usually depending on )
such that
|xi x| < if i N.
67
Proof: Suppose the sequence (xi ) converges to both x and y.
Then for each > 0 there is some N such that for i N both |xi x| < /2
and |xi y| < /2.
It follows that
n N |xn x| < 1.
Thus for n N,
Example 23
1. The infinite sequence 0, 1, 1, 2, 2, 3, 3, . . . which lists all the integers.
This sequence does not converge.
2. The infinite sequence (xn )n1 defined by xn = 1/n. This sequence con-
verges to 0.
3. The infinite sequence (xn )n1 defined inductively by x1 = 1, and
n1
X
xn = 2 xi .
i=1
68
5. The infinite sequence (xn )n1 defined by: xn = 1+(1/2)n . This sequence
converges to 1.
Lemma 12 If (xi ) and (yi ) are infinite sequences of real numbers converging
respectively to x and y, then (xi yi ) converges to xy.
Therefore for n N ,
|xn yn xy| = |xn yn xyn +xyn xy| |xn x||yn |+|x||yyn | < (|y+1)+|x| .
2(|y| + 1) 2(|x| + 1)
q.e.d
Exercise 15 Convergence
As always, provide complete proofs for your answers.
1. In each of the examples in 23 supply proofs for the statements about con-
vergence.
2. Suppose (xn )n1 is an infinite sequence of real numbers converging to x.
Define the sequence (yn )n1 by yn = x2n . Is this sequence convergent, and
if so, what is its limit? Prove your answer is correct.
3. Suppose (xn )n1 is an infinite sequence of real numbers. Suppose the
sequence yn = x3n converges to y and that the sequence zn = x3n+2 con-
verges to z. If y 6= z show that the original sequence (xn ) is not convergent.
4. Show that if x is any real number then there is an infinite sequence of
rational numbers converging to x.
5. Suppose (xn )n1 is an infinite sequence of real numbers converging to x.
Define a sequence (yn )n1 by yn = xn+1 xn . Prove that the sequence
(yn )n1 is convergent, and find its limit. Prove your answer is correct.
6. Suppose (xi ) and (yi ) are infinite sequences of real numbers converging
respectively to x and y.
(a) Show that (xi + yi ) converges to x + y.
(b) If y 6= 0 show that for some n N, yi 6= 0 for i n. In this case
prove that the infinite sequence (1/yi )in converges to 1/y.
69
(a) If (xi ) is a convergent sequence and if each xi b, show that limi (xi )
b.
(b) If (xi ) is a convergent sequence and if each xi a, show that limi (xi )
a.
Lemma 13
1. An increasing sequence, (xi )ik , which is bounded above converges, and
Proof:
1. Set S = {xi | i k}.
Then S is bounded above.
Fix any > 0.
By the definition of lub(S), lub(S) is not an upper bound for S.
Therefore there is some xp such that
xp > lub(S) .
70
Since the sequence is increasing, for any i p,
xi > lub(S) .
xi lub(S).
Therefore, for i p,
0 lub(S) xi < .
In particular,
|lub(S) xi | < , i p.
Since was any positive real number,this is precisely the statement that
the sequence converges to lub(S).
lub(T ) = glb(T ).
Thus by the first part of the Lemma, if > 0 there is a p N such that
q.e.d.
Exercise 16
1. Show that convergent sequences are bounded. (Hint: If xn converges to x
then for some N, x 1 < xn < x + 1 if n N . Then show that the entire
sequence is bounded.
2. Which of the following infinite sequences are bounded, which are increas-
ing, which are decreasing, and which converge to a limit? If the sequence
is convergent, find the limit. As always prove your answers.
71
(a) 1, 1, 1, 1, 1, 1, . . ..
(b) (xq )q1 = x1/q where 0 < x < 1 is fixed.
(c) (xq )q1 = x1/q where x = 1.
(d) (xq )q1 = x1/q where x > 1 is fixed.
3. Suppose a Q is positive. If (xi ) is a sequence of positive real numbers
converging to x > 0, show that the sequence (xai ) converges and find its
limit, proving your answer. Is the converse true? (Hint: use the following
steps:
(a) Show by induction that for n N, (xni ) converges and find its limit.
1
(b) Show that for n N, (xin ) converges and find its limit.
(c) Complete the proof when the exponent is a positive rational.
4. Suppose x is a real number and that 0 < x < 1.
(a) Show that the set S = {xn | n N} is bounded below.
(b) Show that glb(S) = glb({xn | n 2}).
(c) Show that glb(S) = x glb(S), and conclude that glb(S) = 0.
(d) Prove that the sequence (xn )n1 converges and find its limit. Prove
your answer.
|xn x| < /2 if i N.
Thus if n, m N ,
Conversely, suppose that for each > 0 there is some integer N such that
|xn xm | < if n, m N.
Sn = {xi | i n}.
72
Since for n < N, |xn | M ax{|x1 |, , |xN 1 |}, it follows that for all n,
Thus S1 is bounded.
an an+1
Thus the sequence an is bounded above. Apply Lemma 13 to conclude that the
sequence an is convergent to a = lub{an }.
|xm aN | < /3
Therefore, for n N ,
[a, b] = {x R | a x b}.
73
Theorem 2 Let
Sm Sm+1 Sm+2 Sk
Then
1. (ak ) is an increasing sequence bounded above, and convergent to a =
lub{ak };
2. (bk ) is a decreasing sequence bounded below, and convergent to b = glb{bk };
3. b a 0.
4. (bk ak ) is a decreasing sequence of non-negative numbers convergent to
b a;
5. \
[ak , bk ] = [a, b].
k
ak ak+1 bk+1 bk .
ak bk b1 .
Thus the sequence (ak ) is both increasing and bounded above. Therefore by
Lemma 13, the sequence converges to a = lub{ak }.
a1 ak bk .
The sequence (bk ) is also bounded below. Thus by Lemma 13, the sequence (bk )
converges to b = glb({bk }.
74
\
[ak , bk ] = [a, b].
k
ak a x b bk ,
T
and so x [ak , bk ]. Thus x k [ak , bk ]; i.e.,
\
[ak , bk ] [a, b].
k
T
On the other hand, suppose x k [ak , bk ]. Then for all k
ak x bk .
Thus x is an upper bound for the set {ak } and a lower bound for the set {bk }.
It follows that
x a and x b.
Thus x [a, b], and \
[ak , bk ] [a, b].
k
|xk c| < .
75
Exercise 17
1. Construct a sequence of open intervals I(n) of length l(n) such that the
sequence (l(n)) converges to zero, and such that each (I(n) and I(n + 1)
have a point in common, but such that
\
I(n) = .
n
2. Let Sn be the set of rational numbers a satisfying 21/n < a < 2+1/n.
Find n Sn .
3. Let Sn be the sets in the previous problem. If xn Sn , does the sequence
(xn ) converge? If so, find its limit.
4. Let Sn be the set of non-zero numbers in [1/n, 1/n]. What is the inter-
section of these sets?
5. Let Sn be the open interval (1, 1 + 1/n). What is the intersection of these
sets?
5.4 Subsequences
Definition 31 A subsequence of a sequence (xn )nk is a sequence of the form
(yi = xni )ir , in which nr < nr+1 < nr+2 . . . is a sequence of integers.
Exercise 18 Subsequences
1. Construct a sequence which has two convergent subsequences converging
to different limits.
4. Show that a sequence which is not bounded above has an increasing subse-
quence which is not bounded above.
5. Let (xn ) be a sequence such that the set S = {xn } is finite. Show that
there is a subsequence (xni ) such that for all i, xni = xn1 .
Proof: Let (xn )n1 be a bounded sequence, and let S = {xn | n 1}.
Since the sequence is bounded there are numbers a1 < b1 such that
S [a1 , b1 ].
76
We first construct by induction on n a decreasing sequence of intervals
bn a n b1 a1
bn+1 an+1 = = .
2 2n
This completes the inductive construction.
xni [ai , bi ].
xn1 = x1 S [a1 , b1 ]
77
Then suppose by induction that the xni are constructed for i r.
Since [ar+1 , br+1 ] contains xk for infinitely many k there is a least integer p > nr
such that xp [ar+1 , br+1 ].
Set xnr+1 = xp .
78
Chapter 6
Continuous Functions of a
Real Variable
As you may easily imagine, functions of a real variable are also a core part
of mathematics itself. In fact this field is a prime example of how mathematics
interacts with other disciplines: many of the problems and theorems in mathe-
matics in this area are inspired by questions and phenomena from outside, while
the results and techniques that mathematicians discover frequently get applied
elsewhere.
79
This chapter focuses on two key concepts in the analysis of functions: limits
and continuity. But first we establish some basic definitions.
Definition 32 Intervals
1. An interval is a subset of R of one of the following forms (where a and
b are any real numbers):
(a) R
(b) [a, b], (a, b], [a, b) or (a, b)
(c) [a, ), (a, ), (, b] or (, b)
2. The intervals in (b) are called finite; the first is closed, the next two are
half closed, and the fourth is open.
3. The numbers a and b are called the end points of their intervals.
4. The closure of an interval D is the union of D together with any end
points. It is denoted by D.
f :DS
3. f : R R defined by
0, x Q,
f (x) =
1, x 6 Q.
80
5. f : (0, 1) R defined by: f (x) is the number in the 25th decimal place of
x.
6.
0, x < 0,
f (x) =
1, x 0.
Pn
7. f (x) = i=0 k xk , where the k are real numbers and n 6= 0. Such a
function is called a polynomial of degree n.
6.2 Limits
Suppose f : D S is a real-valued function. An important question which
arises is:
There is a good practical reason for this question. In practice one can never
make an exact measurement at a specific point, c. The best one can do is make
measurements nearby and hope they give a good approximation to a measure-
ment at c itself.
1. We consider only values of the function near c and not the value at c.
2. The values of the function at points near c must bunch ever more
closely together as the points get closer to c.
This idea is formalized in the following way:
as x c. Then u1 = u2 .
81
Proof: Fix > 0. Choose 1 > 0 and 2 > 0 so that for x D ,
|f (x) u1 | < /2 if 0 < |x c| < 1 , and
|f (x) u2 | < /2 if 0 < |x c| < 2 .
Set to be the lesser of 1 and 2 . Then for x D and 0 < |x c| < we
have
|u2 u1 | = |u2 f (x) + f (x) u1 | |u2 f (x)| + |f (x) u1 | < .
Thus |u2 u1 | < for all > 0 and so u2 = u1 . q.e.d.
0 < |x c| < .
Thus the limit depends on the values of f (x) when x is close to but dif-
ferent from c. Even when c is in the interval D the value of f (c) is
irrelevant to the definition of limxc f (x).
2. If f : D S is a real-valued function and c D, then there are two
possibilities, and either could be correct:
(a) The limit of f (x) as x c exists, or
(b) This limit does not exist.
3. If f : D S is a real-valued function and c D then there are three
possibilities:
(a) The limit of f (x) as x c exists and limxc f (x) = f (c), or
(b) The limit of f (x) as x c exists and limxc f (x) 6= f (c), or
(c) The limit of f (x) as x c does not exist.
Example 25 Limits
82
2. D = S = R and
5x + 1, x 6= 1,
f (x) =
17, x = 1.
Then, as above, limx1 f (x) = 6, but f (1) = 17.
3. D = (, 1), S = R and f (x) = 5x + 1. Then
limx1 f (x) = 6.
Review of Negations:
If Statement A is true then for each > 0 there is a > 0 satisfying the
requirements of the definition above.
It means precisely that for every x D such that 0 < |x c| < it is true
that |f (x) u| < .
Thus to say that no > 0 will work for that means that for each > 0
there is some x D such that
Statement B: for some > 0 and every > 0 there is some x D such
83
that 0 < |x c| < and |f (x) u| .
Example 26 D = S = R and
1/|x|, x 6= 0,
f (x) =
0, x = 0.
Therefore f (x) does not converge to u as x 0. Since u was any real number,
the limit does not exist.
limxc f (x) = u
if and only if
limn f (xn ) = u
whenever (xn ) is a sequence of points in D different from c, but convergent to
c.
84
2. If limn f (xn ) = u whenever (xn ) is a sequence of points in D different
from c but convergent to c, then limxc f (x) = u.
For the first statement our hypothesis is limxc f (x) = u.
Then if (xn ) is any sequence of points in D different from but converging to c,
we need to prove that
limn f (xn ) = u.
In other words, for any > 0 we need to show that for some N ,
|f (xn ) u| < if n N.
For the second statement our hypothesis is that whenever (xn ) is a sequence
of points in D different from but converging to c then
limn f (xn ) = u,
limxc f (x) = u.
For some > 0 and every > 0 there is some x D such that:
85
This defines a sequence (xn ) of points in D different from c.
Moreover, for any real number > 0 there is some k N such that 1/k <
(Property Three for the real numbers).
Therefore, for n k
|xn c| < 1/n 1/k < .
Thus the sequence (xn ) converges to c.
Now our hypothesis states that since (xn ) converges to c, it follows that
f (xn ) converges to u. But we constructed the sequence so that
|f (xn ) u|
It follows that Statement B cannot be correct and therefore that limxc f (x) =
u.
q.e.d.
Exercise 19 Limits
1. If c < d are points in an interval D, show that [c, d] D.
86
5. Suppose f : D S is a real-valued function in an interval D. Suppose
further that for some c D and some > 0, f (x) 6= 0 if 0 |x c| < .
Show that
1
limxc
f (x)
exists if limxc f (x) exists and limxc f (x) 6= 0.
6. Suppose f : R R is a polynomial. Use Exercise 19.4 to show that for
all y R,
limxy f (x) = f (y).
xn an
f (x) = .
xa
Show that limxa f (x) exists, find the limit and prove your answer is
correct.
87
6.3 Continuity
Let f : D S be a real-valued function defined in an interval, D. If c D and
if limxc f (x) exists then we have two numbers:
However, if these numbers are the same then we can approximate the value
at c of f by the values nearby c. Functions for which these two numbers are
the same have many good properties, and play a crucial role in mathematics.
In fact they have a name:
Remark:
88
2. Fix any > 0.
Choose > 0 so that
q.e.d.
89
(b) Show that the functions f+ : D R and f : D R defined by
f (x), f (x) 0,
f+ (x) = and
0, f (x) < 0.
f (x), f (x) 0,
f (x) =
0, f (x) > 0.
are continuous. (Hint: Consider 1/2(f + |f |).)
Remark: In contrast with Lemma 15, because [a, b] is closed the does not
depend on x.
If the Proposition is false there is some > 0 such that for each > 0 there
is a correspnding pair of points x, y [a, b] satisfying
In particular, we may find sequences (xn ) and (yn ) of points in [a, b] such that
1
|f (xn ) f (yn )| and |xn yn | < .
n
Since the sequences (xn ) and (yn ) are bounded it follows from Theorem 3 that
the sequence (xn ) contains a convergent subsequence (ui ) = (xni ).
In the same way the sequence (vi ) = (yni ) contains a convergent subsequence
(vik ).
Now Exercise 15.3 asserts that the subsequence (uik ) is also convergent.
Set
limk (uik ) = x and limk (vik ) = y.
90
Since the xn and the yn are in [a, b], it follows from Exercise 15 that x [a, b]
and y [a, b].
and so x = y.
|f (yn ) f (xn )|
for all n.
Consequences of Theorem 4.
1. Maximum and minimum values. Since [c, d] is the image of f there
must be points u, v [a, b] such that
Thus
f (u) f (x) f (v)
for all x [a, b].
2. Intermediate values. Since [c, d] is the image of f it follows that for
every y [c, d] there is some x [a, b] such that
f (x) = y.
91
Important Remarks: Let f : D S be a continuous function defined in the
interval D = [a, b].
1. Then the Theorem states that
Example 27
1. [a, b] = [1, 1] and
x, x 0,
f (x) =
2x, x 0.
Here the image of f is the interval [2, 0] and f attains its minimum at
1 and its maximum at 0.
2. f is defined in (0, 1) by f (x) = 1/x. Here the values of f are not bounded
above but are bounded below by 1; however, f does not attain a minimum
value since
glb{f (x)} = 1
and 1 is not a value of f .
f (xni ) > ni
92
and so this sequence is not bounded above. Therefore it cannot be convergent,
which is a contradiction, and so S must be bounded above.
Since S is bounded above, for each n there is some yn S such that
1
0 lub(S) yn < .
n
In particular, limn (yn ) = lub(S).
f (x) f (v).
93
Now suppose xn and yn are constructed. Since w is not a value, either
xn + yn xn + yn
f( ) < w or f ( ) > w.
2 2
In the first case, set
xn + yn
xn+1 = and yn+1 = yn .
2
In the second case, set
xn + yn
xn+1 = xn and yn+1 = .
2
T
Now by Theorem 2, In is a single point c. Moreover, the Corollary to that
Theorem states that
limn xn = c = limn yn .
But f (xn ) < w for all n, and thus f (c) w. Also f (yn ) > w for all n, and thus
f (c) w.
It follows that f (c) = w, contradicting our hypothesis that w was not a value
of f . q.e.d.
for all x [a, b]. If w [f (u), f (v)], then either w = f (u) or w = f (v) or
f (u) < w < f (v). But in this third case it follows from Proposition 18 that
w = f (x) for some x [a, b].
Exercise 21
In these exercises you may assume the standard properties of sin x and cos
x.
1. Let f : D S be any real-valued function defined in an interval D.
(a) Show that if f attains a maximum then that maximum is lub(S) where
S = {f (x) | x D}.
(b) If f attains a minimum value, what is it?
2. (a) Use Exercise 18.5 to show that sin(1/x) is a continuous function in
(0, ).
94
(b) Show that this function attains a maximium and a minimum value.
(c) Show that it is not the restriction of a continuous function defined in
[0, ).
0 < xa < xb .
expx : R R
Theorem 5 Let x > 1 be a real number. Then the function expx : R R has
the following properties:
1. expx (a) = xa if a is rational.
95
4. For all u, y R
Therefore
expx (a) = inf (E(a)) = xa .
xa E(y).
Thus if c is a rational number such that a < c < y it follows from Exercise
12 that
0 < xa < xc expx (y).
In the same way it follows that
If a S(y) and b S(z) then a + b S(x + y). It follows that for a S(y)
and b S(z),
96
Therefore expx (y + z) is a lower bound for E(y)xb . It follows that
On the other hand, suppose c S(y + z). It follows from Exercise 8.4 that
for some a S(y) and some b S(z),
c a + b.
Therefore
xc xa+b = xa xb expx (y)expx (z).
Therefore expx (y)expx (z) is a lower bound for E(y + z) and so
4. For all u, y R
|expx (u) expx (y)|
xexpx (y) if 0 < |u y| < 1.
|u y|
Lemma 16 For any natural number p and any positive real number t,
(1 t)(1 + t) = 1 t2 < 1.
which closes the induction and completes the proof of the Lemma.
q.e.d.
97
Lemma 17 Suppose a and b are rational numbers and x > 1 is a real
number. If 0 < a < b, then
xa 1 xb 1
< .
a b
Proof: Since both a and b are rational and positive we may find natural
numbers k, m, n such that
m n
a= and b = .
k k
Since a < b it follows that m < n.
Therefore it is sufficient to consider the case that n = m + 1 and prove
that
xm/k 1 x(m+1)/k 1
< .
m/k (m + 1)/k
Set w = x1/k .
Then multiply both sides by 1/k to see that it is enough to show that
wm 1 wm+1 1
< ,
m m+1
or, equivalently,
It follows that
(m + 1)wm < 1 + mwm+1 ,
and therefore
98
Suppose 0 < h < 1 is a rational number.
Apply Lemma 17 with a = h and b = 1 to obtain
0 < expx (y h) < expx (y t) < expx (y) < expx (y + t) < expx (y + h).
Therefore
|expx (u) expx (y)| < hxexpx (y).
It follows that
|expx (u) expx (y)|
<h
xexpx (y)
for every rational h such that h < h < 1. Therefore
Then if |u y| < ,
Exercise 22
99
1. Show that if a continuous function in [a, b] is a 1-1 map it is monotone.
2. For 0 < x 1 define a function expx by setting exp1 (y) = 1, y R and
1
expx (y) = 1
xy
if 0 < x < 1 and y R. Then show for 0 < x < 1 that expx satisfies
statements 1,3,5 of Theorem 5.
3. If 0 < x < 1 show that expx is a monotone function.
4. If x > 0 and y, z are any real numbers show that
(xy )z = xyz .
100
Chapter 7
Derivatives
Recall that the graph of a real function f defined in an interval D is the set of
points {(x, f (x)) | x D}. While every such function has a graph, the function
with domain [0, 1] given by
0, x Q,
f (x) =
1, x / Q.
has a graph which cannot be drawn in any reasonable way.
@@ @@
@ @
101
If the graph has a tangent line then the secants should approach the tangent
line as y approaches x and so the slopes of the secants should approach the
slope of the tangent line. We have thus finally developed our intuitive idea to
the point where we can formalize it:
Definition 40 Let f be a real-valued function defined in an interval, D. Then
f is differentiable at x D if
f (y) f (x)
limyx exists.
yx
In this case we call the limit the derivative of f at x, and denote it by f 0 (x).
102
rate of change. Magnificently, as we shall see, this actually works in practice
and makes the derivative of central importance for applications.
Remark: The next Proposition shows how the search for a maximum or a
minimum can be reduced to solving the equation f 0 (c) = 0. This is, of course,
of fundamental importance for many applications where the location of maxima
and minima is important.
Proposition 20 Suppose f is a real-valued function in an interval D with a
derivative at a point c D. If for some a < c < b, (a, b) D, and if either
f (x) f (c), x (a, b),
or else
f (x) f (c), x (a, b),
0
then f (c) = 0.
Proof: Suppose f (x) f (c), x (a, b). If y (a, c) then
f (y) f (c)
0
yc
and so taking the limit as y approaches c from the left we find that f 0 (c) 0.
On the other hand, if y (c, b) then
f (y) f (c)
0
yc
and so f 0 (c) 0. Thus f 0 (c) = 0.
This Proposition is also the main step in the proof of the important
103
We first consider the special case that f (a) = f (b).
Proposition 21 (Rolles Theorem) Suppose f is a differentiable function in
an interval [a, b] and f (a) = f (b). Then for some z (a, b),
f 0 (z) = 0.
Now if both u and v are endpoints of [a, b] then f (u) = f (v), and it follows
that f is constant. In this case f 0 is identically zero, as is immediate from the
definition of derivative.
104
3. Show that if f is a differentiable function in (a, b) and if f 0 (x) > 0 for all
x (a, b), then for any a < x < y < b, f (x) < f (y).
4. If f is a differentiable function in [a, b] and f 0 (x) = 0 for all x (a, b),
show that f (x) = f (y) for all x, y (a, b). Then use continuity to conclude
that f (x) = f (a) for all x [a, b].
5. Suppose f and g are differentiable functions in an interval [a, b]. If f (a) =
g(a) and if f 0 (x) = g 0 (x) for all x (a, b), show that f (x) = g(x) for all
x [a, b].
105
Chapter 8
All the way back in the distant mists of public school we learned that the area of
a rectangle is its length times its width. So how do we go about defining the area
of a more complicated region, R, contained inside a large rectangle in the plane?
One very simple way works as follows: first, grid the big rectangle into non-
overlapping smaller ones. Then add the areas of the little rectangles that touch
R and call that an upper area. Next, add the areas of the little rectangles en-
tirely contained in R, and call that a lower area.
Intuitively, every upper area should be bigger than the area of R and every
lower area would be less than the area of R. Thus, if we set
If we get lucky and it happens that inf (U ) = sup(L) we would define this
number to be the area of R.
The first situation is exemplified by the region R bounded by the x-axis, the
y-axis, the line x = 1 and the graph of the function f defined by
0, x Q,
f (x) = .
1, x/ Q.
Here our method does not work, but there is, in fact, a more sophisticated
way of defining area, and that method gives this region an area of one.
106
There are however, even more complicated regions for which there is no rea-
sonable way to assign an area!
Nonetheless our method does work for the region between the graph of a
continuous function and the x-axis, except that we have to count the area below
the x-axis negatively,and it is this signed area we use to define the integral.
We proceed to formalize this intuitive idea.
Definition 42 Upper and lower sums.
ii) If f is a real-valued function defined in an interval [a, x], then an upper sum,
u, and a lower sum, l, for f are numbers respectively of the form
r
X
u= yi (xi xi1 )
i=1
and
r
X
l= wi (xi xi1 ),
i=1
wi f ([xi1 , xi ]) yi .
glb(U ) = lub(L).
Step One: Every upper sum is larger then every lower sum.
defined respectively by partitions (xi ) and (x0j ). Then we can merge the two
partitions to get a partition x00k , 0 k q in which each x00k is either an xi or an
107
x0j and each xi and x0j is one of the x00k . Call the intervals [x00k1 , x00k ] the little
intervals.
yk00 = yi
Finally, recall that each little interval is contained in some [xi1 , xi ] and in
some [yj1 , yj ]. It follows that
and so
q
X q
X
l= wk00 (x00k x00k1 ) yi00 (x00k x00k1 ) u.
k=1 k=1
It follows from Step One that lub(L) glb(U ). Now recall from Property 3
that for any > 0 there is some r N such that 1/r < . Thus it follows from
Proposition 16 that given > 0 there is some r N such that for all s, t [a, x],
xa
|f (s) f (t)| < if |s t| < .
xa r
Now divide [a, x] into r intervals of even length (x a)/r with endpoints
108
It follows that glb(U ) lub(L) < for all > 0, and so glb(U ) = lub(L).
q.e.d.
Exercise 24 Integrals
4. If f and g are continuous functions in an interval [a, b], and if f (t) g(t)
for all t [a, b], show that
Z b Z b
f (t)dt g(t)dt.
a a
If the two integrals are equal show that f (t) = g(t) for all t [a, b].
F (s) F (c)
lim = f (c),
sc sc
109
and we consider separately the cases where s approaches c from the right and
from the left. Consider first the case of an approach from the right.
For s > c let y(s) and w(s) be the maximum and minimum values assumed
by f in c, s]. By Exercise 22.2,
Z s Z c Z s
f (t)dt f (t)dt = f (t)dt.
a a c
F (s) F (c)
w(s) f (c) f (c) y(s) f (c).
sc
Now as s approaches c both w(s) f (c) and y(s) f (c) approach zero, and
so
F (s) F (c)
sc
approaches f (c). The same argument establishes this if s approaches C from
the left. q.e.d.
Now the right hand side defines a function g(x) which by Theorem 7 is
differentiable and satisfies
110
Thus the derivative of g f is identically zero, and so by Exercise 18.4 it follows
that g f is a constant function. But g(a) = 0 and so g(x) f (x) = f (a) for
all x [a, b]. In other words,
Remark: As you will recall from your calculus classes, while derivatives tend
to be computable it is Theorem 8 which makes it possible to find formulae for
integrals!
Recall the Mean Value theorem, which states that if f : [a, b] R is differ-
entiable then for x [a, b] then for some z [a, b],
(x a)k (x a)n+1
f 0 (x) = nk=0 f (k+1) + f (n+2) (z) .
k! (n + 1)!
111
Finally, the Intermediate Value Theorem for f (n+2) implies that for some
z [a, b],
(x a)k+1 (x a)n+2
f (x) f (a) nk=0 f (k+1) = f (n+2) (z) .
(k + 1)! (n + 2)!
Since
(x a)k+1 (x a)k
f (a) + nk=0 f (k+1) = f (a) + nk=1 f (k)
(k + 1)! (k)!
the formula is established for n + 1. q.e.d.
112