Differentiation Taylor
Differentiation Taylor
Differentiation Taylor
Denition 2.1.1. We say that lim f (x) = L if, for every real number > 0, there exists
xx0
a real number > 0 such that
Equivalently,
Remark 2.1. The above denition is equivalent to: for any sequence {xn } with xn x0 ,
we have f (xn ) L as n .
Proof. Suppose limxx0 f (x) exists. Take > 0 and let {xn } be a sequence converging
to x0 . Then there exists N such that |xn x0 | < for n N . Then by the denition
|f (xn ) L| < . i.e., f (xn ) L.
For the other side, assume that xn c = f (xn ) L. Suppose the limit does not
exist. i.e., 0 > 0 such that for any > 0, and all |x x0 | < , we have |f (x) L| 0 .
Then take = n1 and pick xn in |xn x0 | < n1 , then xn x0 but |f (xn ) L| 0 . Not
possible.
Theorem 2.1.2. If limit exists, then it is unique.
3 2
|x 1| < whenever |x 1| < := .
2 3
x2 x = 2
(ii) Prove that lim f (x) = 4, where f (x) =
x2 1 x=2
1
Problem: Show that lim sin( ) does not exist.
x0 x
1 1
Consider the sequences {xn } = { }, {yn } = { }. Then it is easy to see that
n
2n + 2
1 1
xn , yn 0 and sin 0, sin 1. In fact, for every c [1, 1], we can nd
xn yn
1
1
a sequence zn such that zn 0 and sin( ) c as n .
zn
By now we are familiar with limits and one can expect the following:
Proof. We give the proof of (iii). Proof of other assertions are easy to prove. Let > 0.
From the denition of limit, we have 1 , 2 , 3 > 0 such that
1
|x c| < 1 = |f (x) L| < = |f (x)| < N for some N > 0,
2
|x c| < 2 = |f (x) L| < , and
2M
|x c| < 3 = |g(x) M | < .
2N
Hence for |x c| < = min{1 , 2 , 3 }, we have
To prove the second part, note that there exists an interval (c , c + ) around c such
that g(x) = 0 in (c , c + ).
Examples: (i) lim xm = 0 (m > 0). (ii) lim x sin x = 0.
x0 x0
Remark: Suppose f (x) is bounded in an interval containing c and lim g(x) = 0. Then
xc
lim f (x)g(x) = 0.
xc
1
Examples: (i) lim |x| sin = 0. (ii) limx0 |x| ln |x| = 0.
x0 x
2
One sided limits: Let f (x) is dened on (c, b). The right hand limit of f (x) at c is L,
if given > 0, there exists > 0, such that
Notation: lim+ f (x) = L. Similarly, one can dene the left hand limit of f (x) at b and is
xc
denoted by lim f (x) = L.
xb
Both theorems above holds for right and left limits. Proof is easy.
1 1 1
sin < < tan
2 2 2
sin sin
dividing by sin , we get 1 > > cos . Now lim+ cos = 1 implies that lim+ = 1.
0 0
sin
Now use the fact that is even function.
At this stage, it is not dicult to prove the following:
Theorem 2.1.4. limxa f (x) = L exists limxa+ f (x) = limxa f (x) = L.
Denition 2.1.5. f (x) has limit L as x approaches +, if for any given > 0, there
exists M > 0 such that
x > M = |f (x) L| < .
Similarly, one can dene limit as x approaches .
1
Problem: (i) lim = 0, (ii) limx x1 = 0. (iii) lim sin x does not exist.
x x x
Solution: (i) and (ii) are easy. For (iii), Choose xn = n and yn = 2 + 2n. Then
xn , yn and sin xn = 0, sin yn = 1. Hence the limit does not exist.
3
Denition 2.1.6. (Horizontal Asymptote:) A line y = b is a horizontal asymptote of
y = f (x) if either lim f (x) = b or lim f (x) = b.
x x
1
Examples: (i) y = 1 is a horizontal asymptote for 1 + x+1
Similarly, one can dene for . Also one can dene one sided limit of f (x) approaching
or .
1
Examples (i) lim 2 = , (ii) limx0 x12 sin( x1 ) does not exist.
x0 x
For (i) given B > 0, we can choose 1 . For (ii), choose a sequence {xn } such
B
1
that sin x1n = 1, say 1
xn
=
2
+ 2n and 1
yn
= n. Then lim f (xn ) = 2 and
n xn
lim f (yn ) = 0, though xn , yn 0 as n .
n
4
Let > 0. Then |f (x) f (0)| |x2 |. So it is enough to choose = .
1
x
sin x1 x = 0
(ii) g(x) = is not continuous at 0.
0 x=0
1 1
Choose xn
= 2
+ 2n. Then lim xn = 0 and f (xn ) = xn
.
1 1
max(f, g) = (f + g) + |f g|
2 2
and the above theorems.
Types of discontinuities
5
1 x0
Example: f (x) = . Easy to see that left and right limits at 0 are dierent.
1 x 0
Innite discontinuity: Left or right limit of f (x) is or .
1
Example: f (x) = x
has innite discontinuity at x = 0.
Discontinuity of second kind: If either lim f (x) or lim+ f (x) does not exist, then c
xc xc
is called discontinuity of second kind.
Then f does not have left or right limit any point c. Indeed, f (c + n1 ) and f (c + n )
converges to dierent values.
Proof. Let f (x) be continuous on [a, b] and let {xn } [a, b] be a sequence such that
|f (xn )| > n. Then {xn } is a bounded sequence and hence there exists a subsequence
{xnk } which converges to c. Then f (xnk ) f (c), a contradiction to |f (xnk | > nk .
Theorem 2.2.7. Let f (x) be a continuous function on closed, bounded interval [a, b].
Then maximum and minimum of functions are achieved in [a, b].
Proof. Let {xn } be a sequence such that f (xn ) max f . Then {xn } is bounded and hence
by Bolzano-Weierstrass theorem, there exists a subsequence xnk such that xnk x0 for
some x0 . a xn b implies x0 [a, b]. Since f is continuous, f (xnk ) f (x0 ). Hence
f (x0 ) = max f . The attainment of minimum can be proved by noting that f is also
continuous and min f = max(f ).
Remark: Closed and boundedness of the interval is important in the above theorem.
Consider the examples (i) f (x) = x1 on (0, 1) (ii) f (x) = x on IR.
6
Theorem 2.2.8. Let f (x) be a continuous function on [a, b] and let f (c) > 0 for some
c (a, b), Then there exists > 0 such that f (x) > 0 in (c , c + ).
Proof. Let = 12 f (c) > 0. Since f (x) is continuous at c, there exists > 0 such that
1
|x c| < = |f (x) f (c)| < f (c)
2
i.e., 12 f (c) < f (x) f (c) < 12 f (c). Hence f (x) > 12 f (c) for all x (c , c + ).
b
Corollary: Suppose a continuous functions f (x) satises a
f (x)(x)dx = 0 for all con-
tinuous functions (x) on [a, b]. Then f (x) 0 on [a, b].
Proof. Suppose f (c) > 0. Then by above theorem f (x) > 0 in (c , c + ). Choose
b
(x) so that (x) > 0 in (c /2, c + /2) and is 0 otherwise. Then a f (x)(x) > 0. A
contradiction.
Alternatively, one can choose (x) = f (x).
Theorem 2.2.9. Let f (x) be a continuous function on IR and let f (a)f (b) < 0 for some
a, b. Then there exits c (a, b) such that f (c) = 0.
Proof. Assume that f (a) < 0 < f (b). Let S = {x [a, b] : f (x) < 0}. Then [a, a + ) S
for some > 0 and S is bounded. Let c = sup S. We claim that f (c) = 0. Take
xn = c + n1 , then xn S, xn c. Therefore, f (c) = lim f (xn ) 0. On the otherhand,
taking yn = c n1 , we see that yn S for n large and yn c, f (c) = lim f (yn ) 0.
Hence f (c) = 0.
Remark: A continuous function assumes all values between its maximum and minimum.
Problem: (xed point): Let f (x) be a continuous function from [0, 1] into [0, 1]. Then
show that there is a point c [0, 1] such that f (c) = c.
Dene the function g(x) = f (x) x. Then g(0) 0 and g(1) 0. Now Apply Interme-
diate value theorem.
Application: Root nding: To nd the solutions of f (x) = 0, one can think of dening
a new function g such that g(x) has a xed point, which in turn satises f (x) = 0.
10 1/2
Example: (1) f (x) = x3 + 4x2 10 in the interval [1, 2]. Dene g(x) = 4+x . We can
check that g maps [1, 2] into [1, 2]. So g has xed point in [1, 2] which is also solution
7
of f (x) = 0. Such xed points can be obtained as limit of the sequence {xn }, where
xn+1 = g(xn ), x0 (1, 2). Note that
10 1
g (x) = 3/2
< .
(4 + x) 2
Proof. Suppose not. Then there exists {xn }, {yn } such that |xn yn | 0 and |f (xn )
f (yn )| > for some > 0. Then it is clear that for = , there is no for which
|x y| < = |f (x) f (y)| < . Because the above sequence satises |x y| < , but
its image does not.
For converse, assume that for any two sequences {xn }, {yn } such that |xn yn | 0 we
have |f (xn ) f (yn )| 0. Suppose f is not uniformly continuous. Then by the denition
there exists 0 such that for any > 0, |x y| < = |f (x) f (y)| > 0 . Now
take = n1 and choose xn , yn such that |xn yn | < 1/n. Then |f (xn ) f (yn )| > 0 . A
contradiction.
8
(ii) f (x) = x1 is not uniformly continuous on (0, 1).
1
Take xn = n+1 , yn = n1 , then for n large |xn yn | 0 but |f (xn ) f (yn )| = 1.
Remarks:
1. It is easy to see from the denition that if f, g are uniformly continuous, then f g
is also uniformly continuous.
Proof. Suppose not. Then there exists > 0 and sequences {xn } and {yn } in [a, b] such
that |xn yn | < n1 and |f (xn ) f (yn )| > . But then by Bolzano-Weierstrass theorem,
there exists a subsequence {xnk } of {xn } that converges to x0 . Also ynk x0 . Now since
f is continuous, we have f (x0 ) = lim f (xnk ) = lim f (ynk ). Hence |f (xnk ) f (ynk )| 0,
a contradiction.
Corollary: Suppose f (x) has only removable discontinuities in [a, b]. Then f, the exten-
sion of f , is uniformly continuous.
Example: f (x) = sinx x for x = 0 and 0 for x = 0 on [0, 1].
Theorem 2.2.11. Let f be a uniformly continuous function and let {xn } be a cauchy
sequence. Then {f (xn )} is also a Cauchy sequence.
Proof. Let > 0. As f is uniformly continuous, there exists > 0 such that
9
1
Example: f (x) = x2
is not uniformly continuous on (0, 1).
1
The sequence xn = n
is cauchy but f (xn ) = n2 is not. Hence f cannot be uniformly
continuous.
2.3 Dierentiability
Denition 2.3.1. A real valued function f (x) is said to be dierentiable at x0 if
f (x0 + h) f (x0 )
lim exists.
h0 h
This limit is called the derivative of f at x0 , denoted by f (x0 ).
Example: f (x) = x2
2xh + h2
f (x) = lim = 2x.
h0 h
Theorem 2.3.2. If f (x) is dierentiable at a, then it is continuous at a.
f (x) f (a)
f (x) = (x a) + f (a).
(x a)
Now taking the limit x a and noting that lim(x a) = 0 and lim f (x)f (a)
(xa)
= f (a), we
get the result.
f
Theorem 2.3.3. Let f, g be dierentiable at c (a, b). Then f g, f g and (g(c) = 0)
g
is also dierentiable at c
Proof. We give the proof for product formula: First note that
10
Hence
(f /g)(x) (f /g)(c) f (x) f (c) g(x) g(c) 1
= g(c) f (c)
xc xc xc g(x)g(c)
Then the function h is continuous at y = f (c) and g(y) g(f (c)) = h(y)(y f (c)), so
Local extremum: A point x = c is called local maximum of f (x), if there exists > 0
such that
0 < |x c| < = f (c) f (x).
Similarly, one can dene local minimum: x = b is a local minimum of f (x) if there exists
> 0 such that
0 < |x b| < = f (b) f (x).
Theorem 2.3.5. Let f (x) be a dierentiable function on (a, b) and let c (a, b) is a local
maximum of f . Then f (c) = 0.
f (x) f (c)
x (c, c + ) = 0
xc
f (x) f (c)
x (c , c) = 0.
xc
11
Now taking the limit x c, we get f (c) = 0.
Theorem 2.3.6. Rolles Theorem: Let f (x) be a continuous function on [a, b] and dier-
entiable on (a, b) such that f (a) = f (b). Then there exists c (a, b) such that f (c) = 0.
Proof. If f (x) is constant, then it is trivial. Suppose f (x0 ) > f (a) for some x0 (a, b),
then f attains maximum at some c (a, b). Other possibilities can be worked out similarly.
Theorem 2.3.7. Mean-Value Theorem (MVT): Let f be a continuous function on [a, b]
and dierentiable on (a, b). Then there exists c (a, b) such that
Proof. Let l(x) be a straight line joining (a, f (a)) and (b, f (b)). Consider the function
g(x) = f (x) l(x). Then g(a) = g(b) = 0. Hence by Rolles theorem
f (b) f (a)
0 = g (c) = f (c)
ba
Proof. By mean value theorem f (x) f (y) = 0 for all x, y (a, b).
Problem: If f (x) is dierentiable and sup |f (x)| < C for some C. Then, f is uniformly
continuous.
Apply mean value theorem to get |f (x) f (y)| C|x y| for all x, y.
Proof. Choose x, y in (a, b) such x < y. Then by MVT, for some c (x, y)
f (x) f (y)
= f (c) > 0.
xy
12
2.4 Taylors theorem and Taylor Series
Let f be a k times dierentiable function on an interval I of IR. We want to approximate
this function by a polynomial Pn (x) such that Pn (a) = f (a) at a point a. Moreover, if
the derivatives of f and Pn also equal at a then we see that this approximation becomes
more accurate in a neighbourhood of a. So the best coecients of the polynomial can
(k)
be calculated using the relation f (k) (a) = Pn (a), k = 0, 1, 2, ..., n. The best is in the
sense that if f (x) itself is a polynomial of degree less than or equal to n, then both f
n
f (k) (a)
and Pn are equal. This implies that the polynomial is (x a)k . Then we write
k=0
k!
f (x) = Pn (x) + Rn (x) in a neighbourhood of a. From this, we also expect the Rn (x) 0
as x a. In fact, we have the following theorem known as Taylors theorem:
3 x
1
3 5
xx /3!+x /5!
sin(x)
0 sin(x)
3
2 xx /6
4
pi pi/2 0 pi/2 pi
x
Theorem 2.4.1. Let f (x) and its derivatives of order m are continuous and f (m+1) (x)
exists in a neighbourhood of x = a. Then there exists c (a, x)( or c (x, a)) such that
(x a)m
f (x) = f (a) + f (a)(x a) + ..... + f (m) (a) + Rm (x)
m!
f (m+1) (c)
where Rm (x) = (x a)m+1 .
(m + 1)!
13
Proof. Dene the functions F and g as
f (m) (y)
F (y) = f (x) f (y) f (y)(x y) .... (x y)m ,
m!
m+1
xy
g(y) = F (y) F (a).
xa
Then it is easy to check that g(a) = 0. Also g(x) = F (x) = f (x) f (x) = 0. Therefore,
by Rolles theorem, there exists some c (a, x) such that
(m + 1)(x c)m
g (c) = 0 = F (c) + F (a).
(x a)m+1
f (m+1) (c)
F (c) = (x c)m .
m!
(x a)m+1 (m+1)
Hence F (a) = f (c) and the result follows.
(m + 1)!
Examples:
x2 x3 xn
(i) ex = 1 + x + + + .... + ec , c (0, x) or (x, 0) depending on the sign of x.
2! 3! n!
x 3 x5 xn n
(ii) sin x = x + + .... + sin(c + ), c (0, x) or (x, 0).
3! 5! n! 2
x 2 x4 xn n
(iii) cos x = 1 + + .... + cos(c + ), c (0, x) or (x, 0).
2! 4! n! 2
Problem: Find the order n of Taylor Polynomial Pn , about x = 0 to approximate ex in
(1, 1) so that the error is not more than 0.005
xn
Solution: We know that pn (x) = 1 + x + .... + n!
. The maximum error in [-1,1] is
1 e
|Rn (x)| max |x|n+1 ex .
(n + 1)! [1,1] (n + 1)!
e
So n is such that (n+1)!
0.005 or n 5.
Problem: Find the interval of validity when we approximate cos x with 2nd order poly-
nomial with error tolerance 104 .
2 3
Solution: Taylor polynomial of degree 2 for cos x is 1 x2 . So the remainder is (sin c) x3! .
14
3
Since | sin c| 1, the error will be atmost 104 if | x3! | 104 . Solving this gives |x| < 0.084
Taylors Series
Suppose f is innitely dierentiable at a and if the remainder term in the Taylors formula,
Rn (x) 0 as n . Then we write
f (n) (a)
f (x) = (x a)n .
n=0
n!
0 as n thanks to q < 1.
Denition 2.4.2. A point x = a is called critical point of the function f (x) if f (a) = 0.
15
Second derivative test: A point x = a is a local maxima if f (a) = 0, f (a) < 0.
Similarly, one can show the following for local minima: x = a is a local minima if
f (a) = 0, f (a) > 0.
Also the above observations show that if f (a) = 0, f (a) = 0 and f (3) (a) = 0, then the
sign of f (x) f (a) depends on (x a)3 . i.e., it has no constant sign in any interval
containing a. Such point is called point of inection or saddle point.
We can also derive that if f (a) = f (a) = f (3) (a) = 0, then we again have x = a is a
local minima if f (4) (a) > 0 and is a local maxima if f (4) (a) < 0.
1. If f (k) (a) = 0 for k = 1, 2, ....2n 1 and f (2n) (a) > 0 then a is a point of local
minimum of f (x)
2. If f (k) (a) = 0 for k = 1, 2, ....2n1 and f (2n) (a) < 0 then a is a point local maximum
of f (x).
LHospitals Rule:
Suppose f (x) and g(x) are dierentiable n times, f (n) , g (n) are continuous at a and
f (k) (a) = g (k) (a) = 0 for k = 0, 1, 2, ...., n 1. Also if g (n) (a) = 0. Then by Taylors
16
theorem,
In the above, we used the fact that g (n) (x) = 0 near x = a and g (n) (c) g (n) (a) as
x a.
Similarly, we can derive a formula for limits as x approaches innity by taking x = y1 .
f (x) f (1/y)
lim = lim
x g(x) y0 g(1/y)
(1/y 2 )f (1/y)
= lim
y0 (1/y 2 )g (1/y)
f (x)
= lim
x g (x)
2. an xn diverges for |x| > R.
n=0
3. No conclusion if |x| = R.
17
Proof. Proof
of (i) follows from the root test. For a proof, take n (x) = an xn and
= lim sup n |n |. For (ii), one can show that if |x| > R, then there exists a subsequence
{an } such that an 0. Notice that = |x|. For (iii), observe as earlier that the series
with an = n1 and bn = n12 will have R = 1.
Similarly, we can prove:
an+1
Theorem 2.5.2. Consider the power series an x . Suppose = lim an and R = 1
n
n=0
(We dene R = 0 if = and R = if = 0). Then
1. an xn converges for |x| < R
n=0
2. an xn diverges for |x| > R.
n=0
3. No conclusion if |x| = R.
Denition 2.5.3. The real number R in the above theorems is called the Radius of con-
vergence of power series.
xn n n 3n
Examples: Find the interval of convergence of (i) n
(ii) xn! (iii) 2 x
1. = lim | an+1
an
| = 1, and we know that the series does not converge for x = 1, 1.
So the interval of convegence is (1, 1).
2. = lim | an+1
an
| = 0. Hence the series converges everywhere.
n n
3. To see the subsequent non-zero
terms, we write the series as 2n (x3 )n = 2 y .
1 1/3 1/3
For this series y = lim sup |an | = 2 . Therefore, x = 2
n
and R = 2 .
2n n is even
Example 2.5.4. Let an = . Then lim sup an+1
an
= 4 and the limit of
n1
2 n is odd
an+1
does not exist. But lim sup |an |1/n = 1/2. So the radius of convergence of the series
an
an xn is 1/2.
The following theorem is very useful in identifying the domain of convergence of some
Taylor series.
Theorem 2.5.5. (Term by term dierentiation and integration): Suppose f (x) = an x n
n=0
converges for |x| < R. Then
1. nan xn1 converges in |x| < R and is equal to f (x).
n=0
1
2. a xn+1
n+1 n
converges in |x| < R and is equal to f (x)dx.
n=0
18
From this theorem one concludes that a power series is innitely dierentiable with in
its radius of convergence. Now it is natural to ask weather this series coincides with the
Taylor series of the resultant function. The answer is yes and it is simple to prove that
(n)
if f (x) = an xn , then an = fn! . The above theorem is useful to nd the domain of
convergence of Taylor series of some functions.
Example: The Taylor series of f (x) = tan1 x and a domain of its convergence.
1 dx
tan x = = 1 x2 + x4 + ...
1 + x2
x3 x 5
=x + + ...
3 5
Taking x = 1 we get interesting sum
1 1 1
1 + + .... = tan1 (1) = .
3 5 7 4
Though the function tan1 x is dened on all of IR, we see that the power series converges
on (1, 1). We can apply Abels theorem on alternating series to show that the series
converges at x = 1, 1.
For approximation, we can use the error approximation of alternating series discussed
in the previous section. The total error if we approximate tan1 x by sn (x), then the
n+1
maximum error is |x|n+1 . ///
We note that the power series may converge to a function on small interval, even though
the function is dened on a much bigger interval. For example the function log(1 + x) has
power series that converges on (1, 1), but log(1 + x) is dened on (1, ). The domain
of convergence of power series is symmetric about the center but the domain of denition
of function. For instance, for a function dened on (1, 3) the radius of convergence of
its power series(about 0) cannot be more than 1.
Another interesting application is to integrate the functions for which we have no clue.
For example,
x x
t2 t2 t4 x3 x5
(1) erf (x) = e dt = (1 + + ... = x + + ...
0 0 1! 2! 3 10
x x
sin t t2 t4 x3 x5
(2) = 1 + =x + + ...
0 t 0 3! 5! 3! 3 5! 5
19