Newton Raphson Method
Newton Raphson Method
Newton’s (or the Newton-Raphson) method is one of the most powerful and well-
known numerical methods for solving a root-finding problem. There are many ways
of introducing Newton’s method.
If we only want an algorithm, we can consider the technique graphically, as is
often done in calculus. Another possibility is to derive Newton’s method as a
technique to obtain faster convergence than offered by other types of functional
iterations. A third means of introducing Newton’s method, which is discussed next,
is based on Taylor polynomials. We will see there that this particular derivation
produces not only the method, but also a bound for the error of the approximation.
Algorithm
Suppose that f ∈ C2[a, b]. Let p0 ∈ [a, b] be an approximation to p such that 𝑓 ′ (𝑝0 ) ≠
0 and | p - p0| is “small.” Consider the first Taylor polynomial for f (x) expanded
about p0 and evaluated at x = p.
𝑓 ′′ (𝜉(𝑝))
𝑓(𝑝) = 𝑓(𝑝0 ) + 𝑓 ′ (𝑝0 )(𝑝 − 𝑝0 ) + (𝑝 − 𝑝0 )2 ,
2!
Where 𝜉(𝑝) lies between p and p0 . Since 𝑓(𝑝) = 0, this equation gives
𝑓 ′′ (𝜉(𝑝))
0 = 𝑓(𝑝0 ) + 𝑓 ′ (𝑝0 )(𝑝
− 𝑝0 ) + (𝑝 − 𝑝0 )2
2!
Newton’s method is derived by assuming that since | p − p0| is small, the term
involving (p − p0)2 is much smaller, so
0 ≈ 𝑓(𝑝0 ) + 𝑓 ′ (𝑝0 )(𝑝 − 𝑝0 )
Solving for p gives
𝑓(𝑝0 )
𝑝 ≈ 𝑝0 − ≡ 𝑝1
𝑓 ′ (𝑝0 )
This sets the stage for Newton’s method, which starts with an initial approximation
𝑝0 and generates the sequence {𝑝𝑛 }∞
𝑛=0 by
𝑓(𝑝𝑛−1 )
𝑝𝑛 = 𝑝𝑛−1 − , for n ≥ 1.
𝑓′ (𝑝𝑛−1 )
Geometric Meaning
Example
Use Newton’s method to approximate a root of
𝑓(𝑥) = cos 𝑥 − 𝑥 = 0 with 𝑝0 = 𝜋⁄4.
𝑓(𝑝1 )
For n =2, 𝑝2 = 𝑝1 − =0.739085
𝑓′ (𝑝1 )
𝑓(𝑝2 )
and 𝑝3 = 𝑝2 − =0.739085.
𝑓′ (𝑝2 )
Advantage/Disadvantage
In a practical application, an initial approximation is selected and successive
approximations are generated by Newton’s method. These will generally either
converge quickly to the root, or it will be clear that convergence is unlikely.
Word Problem 1
The sum of two numbers is 20. If each number is added to its square root, the
product of the two sums is 155.55. Determine the two numbers to within 10−4 .
Word Problem 2
The accumulated value of a savings account based on regular periodic payments
can be determined from the annuity due equation,
Practice
Q2. Let 𝑓(𝑥) = −𝑥 3 − cos 𝑥 and 𝑝0 = −1. Use Newton’s method to find 𝑝2 .
Could 𝑝0 = 0 be used?
Solution: Putting 𝑓(𝑥) = −𝑥 3 − cos 𝑥 and 𝑓 ′ (𝑥) = −3𝑥 2 + sin 𝑥
𝑓(𝑝𝑛−1 )
in Newton’s formula 𝑝𝑛 = 𝑝𝑛−1 −
𝑓′ (𝑝𝑛−1 )
𝑓(𝑝0 )
for n=1, we get 𝑝1 = 𝑝0 − = −0.88033
𝑓′ (𝑝0 )
𝑓(𝑝1 )
For n=2, 𝑝2 = 𝑝1 − = −0.86568.
𝑓′ (𝑝1 )