Introduction To Orthogonal Polynomials PDF
Introduction To Orthogonal Polynomials PDF
H. Michael Möller
April 2006
Chapter 3
In this chapter, we study orthogonal systems (OS) {pn }∞ n=0 for given inner
product hf, gi := L(f g) where L is a square positive functional.
The orthogonal polynomials w.r.t. (the inner product induced by) L are called
Legendre polynomials.
A very elegant way of obtaining explicit expressions for the Legendre poly-
nomials is the use of higher order antiderivatives.
37
38 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
(n)
and pn = ϕ2n .
(n−1−ℓ)
0 = L(pn qℓ ) = (−1)ℓ ϕ2n (1), ℓ = 0, . . . , n − 1,
(ν)
since qℓ (1) = δℓν (biorthogonality!). Hence ϕ2n has in 1 an n-fold zero, too.
Being a degree 2n polynomial, it has no other zeros. Therefore
dn (x2 − 1)n
pn (x) = Kn . (3.1)
dxn
3.1. THE LEGENDRE POLYNOMIALS 39
The polynomial (x2 − 1)n has leading coefficient 1 and degree 2n. Hence the
dn (x2 − 1)n (2n)!
leading coefficient of is and
dxn n!
(2n)!
lc(pn ) = Kn .
n!
If we consider un , the n-th Legendre polynomial with leading coefficient 1,
then Kn = n! and
(2n)!
n! dn (x2 − 1)n
un (x) = . (3.2)
(2n)! dxn
This gives finally (using the trivial identity (2n)! = (2n)!!(2n − 1)!!)
(2n)!! 2
L(p2n ) = Kn2 (2n)! 2 = Kn2 (2n)!!2 . (3.3)
(2n + 1)!! 2n + 1
1 −n dn (x2 − 1)n
Pn (x) = 2 . (3.5)
n! dxn
These polynomials satisfy the three-term-recursion
Proof. (Exercises).
From (3.1) we can derive an explicit representation for the coefficient of the
Legendre polynomials. The binomial
n
2 n
X n
(x − 1) = (−1)k x2n−2k
k=0
k
3.1. THE LEGENDRE POLYNOMIALS 41
We will derive now the three-term recursion for the Legendre polynomials
using theorem 2.5. Therefore is is most convenient to consider the normal-
ization lc(pn ) = 1. We write hence un for pn .
βn = 0 since un+1 , xun , and un−1 are simultaneously even or odd and βn un
has the other parity. Hence βn un = 0. By thm. 2.5 γn = L(u2n )/L(u2n−1 ).
Using equation (3.3) and Kn = n!/(2n!), this gives
n!2 2
L(u2n ) = 2
(2n)!!2 ,
(2n)! 2n + 1
(n − 1)!2 2
L(u2n−1 ) = 2
(2n − 2)!!2 ,
(2n − 2)! 2n − 1
and hence
n2 2n − 1
γn = 2 2
(2n)2
(2n − 1) (2n) 2n + 1
n2
= .
(2n − 1)(2n + 1)
n2
un+1 (x) = xun (x) − un−1 (x), n ∈ N. (3.7)
(2n − 1)(2n + 1)
The first Legendre polynomials with leading coefficient 1 are easily computed
42 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
by this recursion.
u2 (x) = x2 − 31
u3 (x) = x3 − 53 x
u4 (x) = x4 − 76 x2 + 35
3
u5 (x) = x5 − 109
5
x3 + 21 x
6 15 4 5 2 5
u6 (x) = x − 11 x + 11 x − 231
21 5
u7 (x) = x7 − 13 x + 105
143
35
x3 − 429 x
cn+1 n2 cn+1
vn+1 (x) = xvn − vn−1 (x)
cn (2n − 1)(2n + 1) cn−1
= An xvn (x) − Cn vn−1 (x)
with
√ √ √
1 1 2n + 3 (2n + 1)(2n + 2) 2n + 3 2n + 1
An = √ =
n + 1 2 2n + 1 n+1 n+1
cn+1 cn+1 cn
and using cn−1
= cn cn−1
= An An−1
√ √ √ √
n2 2n + 3 2n + 1 2n + 1 2n − 1
Cn =
(2n − 1)(2n + 1) n+1 n
√
n 2n + 3
= √ .
n + 1 2n − 1
This gives the three term recursion
√ √ √
2n + 3 2n + 1 n 2n + 3
vn+1 = xvn (x) − √ vn−1 (x), n ∈ N, (3.8)
n+1 n + 1 2n − 1
√
v0 = √12 , v1 (x) = √32 x. (The initial polynomials v0 and v1 are calculated by
normalizing 1 and x resp.)
u′ (x)(x2 − 1) = 2n x u(x).
This means, that u(n) and its constant multiples Kn u(n) solve this differential
equation for y.
and by differentiation
′ ′
1 n+1 (2) 1 n−1
(n)
Pn+1 − Pn−1 = (q ) − q .
(2n + 2)!! (2n − 2)!!
Because of
′
n+1 (2) 2 n+1 ′′ 2 n
(q ) (x) = ((x − 1) ) = (n + 1)(x − 1) (x)2x
= (2n + 2) 2nx2 + x2 − 1 (x2 − 1)n−1
where 0!! := 1 and (−1)!! := 1. (In the following, we just need that the
coefficients of this power series are positive numbers.) Replacing t by 2zx−z 2
gives
X∞
R(z, x) = an (2zx − z 2 )n with an > 0.
n=0
series converges and has positive coefficients, if (x is fixed and) |z| is suffi-
ciently small. Hence we have a converging majorizing series. This ensures
the absolute convergence required for reordering,
∞
X
R(z, x) = αn (x)z n .
n=0
Because of
1
1= √ = R(0, x) = α0 (x)z 0 = α0 (x)
1 − 2 · 0x + 0 2
and
∂R −1
(0, x) = (1 − 2zx + z 2 )−3/2 (−2x + 2z)|z=0 = x
∂z 2
∞
X
= nαn (x)z n−1 |z=0 = α1 (z)
n=1
we already have α0 (x) = 1(= P0 (x)) and α1 (x) = x(= P1 (x)). Our goal is to
show
αn (x) = Pn (x) for all n ∈ N0 .
∂R equals
∂z ∞
x−z X
√ 3 = nαn (x)z n−1 .
1 − 2zx + z 2
n=1
Hence
∞
X ∞
X
n
x αn (x)z − αn (x)z n+1 =
n=0 n=0
∞
X ∞
X ∞
X
n−1 n
nαn (x)z − 2x nαn (x)z + nαn (x)z n+1
n=1 n=1 n=1
or by resummation
∞
X ∞
X
x αn (x)z n − αn−1 (x)z n =
n=0 n=1
∞
X ∞
X ∞
X
n n
(n + 1)αn+1(x)z − 2x nαn (x)z + (n − 1)αn−1 (x)z n
n=0 n=1 n=1
46 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
or reordered
This is exactly the three term recursion as for the Legendre polynomials Pn ,
given in Theorem 3.1. Since we already have α0 = P0 and α1 = P1 , the
(same) recursion gives thus αn = Pn for n = 2, 3, . . .
Proof. Since cos : [0, 2π] → [−1, 1] is surjective, there is for every
x ∈ [−1, 1] a ϕ ∈ [0, 2π] such that x = cos ϕ. Then
∞
1 X
R(z, cosϕ) = p = Pn (cos ϕ)z n .
1 − 2zcosϕ + z 2 n=0
Hence
1 1
R(z, cosϕ) = √ √
1 − zeiϕ 1 − ze−iϕ
∞ ∞
X (2k − 1)!! k iϕk X (2n − 1)!! n −iϕn
= z e z e
k=0
(2k)!! n=0
(2n)!!
3.1. THE LEGENDRE POLYNOMIALS 47
P∞
The Cauchy product of these two power series gives n=0 Pn (cos ϕ)z n . So
the coefficient of z n is
n
X (2k − 1)!! (2n − 2k − 1)!!
Pn (cosϕ) = ei(2k−n)ϕ .
k=0
(2k)!! (2n − 2k)!!
Finally, we derive some useful relations among the Pn and their derivatives
using the generating function. The partial derivatives of R are
∂R = √ 1 −1 (−2z) = √ z =
P∞ ′ n
∂x 3 2 3 n=1 Pn (x)z
1 − 2zx + x 2 1 − 2zx + z 2
∂R = √ x − z P∞ n−1
∂z 3 = n=1 Pn (x)nz
1 − 2zx + z 2
Hence (x − z) ∂R
∂x
= z ∂R
∂z
. Therefore
∞
X ∞
X ∞
X ∞
X
(x − z) Pn′ (x)z n =x Pn′ (x)z n − Pn′ (x)z n+1 = Pn (x)nz n .
n=1 n=1 n=1 n=1
and (replacing n + 1 by n)
If we add these two equations and dismantle for cos((n + 1)t), we obtain
Since cos : [0, 2π] → [−1, 1] is a bijection, we can substitute x for cos(t)
and get (t = arccos(x) and) for Tk (x) := cos(k arccos(x)) the three term
recursion
Tn+1 (x) = 2 x Tn (x) − Tn−1 (x) for x ∈ [−1, 1]. (3.13)
For n = 0 and n = 1 we can determine Tn directly,
We will derive now a representation for Tn (x), |x| > 1. Consider the linear
recursion with constant coefficients
A sequence {ak }∞ k=0 is called solution for this recursion, if any three consec-
utive elements ak−1 , ak , ak+1 satisfy ak+1 − 2xak + ak−1 = 0. Obviously, given
a0 and a1 , the solution of the recursion is uniquely determined.
1 √ 1 √
(x + x2 − 1)0 + (x − x2 − 1)0 = 1,
2 2
1 √ 1 √
(x + x2 − 1)1 + (x − x2 − 1)1 = x.
2 2
Then the sequence {an }n=0 coincides with {Tn (x)}∞
∞
n=0 . Hence
1 √ 1 √
Tn (x) = (x + x2 − 1)n + (x − x2 − 1)n for all n ∈ N0 (3.15)
2 2
and all x ∈ R, |x| > 1.
⌊n/2⌋
X n
= xn−2k (x2 − 1)k
k=0
2k
⌊n/2⌋ k
X n X k
n−2k
= x (−1)j x2k−2j
k=0
2k j=0
j
⌊n/2⌋
k
XX n k
= (−1)j x2n−2j .
k=0 j=0
2k j
π if m = 0
(
Z π
cos(mt) dt = 1 π
sin(mt) = 0 if m 6= 0
0
m 0
and {vn }∞
n=0 is an ONS for the same inner product where
r
1 2
v0 := √ , vn := Tn n ≥ 1.
π π
Remark. The representation (3.14) shows |Tn (x)| ≤ 1 for all x ∈ [−1, 1] and
allows to determine the n zeros ξk of Tn explicitely,
2k − 1 2k − 1
ξk = cos( π) ⇒ Tn (ξk ) = cos( π) = 0, k = 1, . . . , n,
2n 2
and also all extremal points η ∈ [−1, 1], i.e., those with |Tn (η)| = 1,
kπ
ηk = cos( ) ⇒ Tn (ηk ) = cos(kπ) = (−1)k , k = 0, . . . , n.
n
For obtaining a generating function for {Tn (x)}∞n=0 we need to reorder the
power series
X∞
Tk (x) − 2xTk−1 (x) + Tk−2 (x) z k
k=2
(although this series is 0). The power series converges absolutely for |x| ≤ 1
and |z| < 1 because for such values of x and z
∞
1 − xz X
= Tk (x)z k .
1 − 2xz + z 2 k=0
There are many interesting and even fascinating results on Chebyshev poly-
nomials (see the Exercises for examples). A good monograph devoted to
these polynomials and their properties is
Th. J. Rivlin: The Chebyshev Polynomials. John Wiley Sons, Toronto 1974.
We will just mention one property, which shows, that Chebyshev polynomi-
als play an important rôle in approximation theory.
This shows, that the function xn is approximated best in Pn−1 by the poly-
nomial xn − 21−n Tn (x) ∈ Pn−1 and the approximation error is then 21−n .
3.3. THE CHEBYSHEV POLYNOMIALS (SECOND KIND) 53
First of all, we have to show, that Un is a polynomial (of degree n). For
n = 0 we have by definition
sin(t)
U0 (x) = = 1 ( cos(t) = x ).
sin(t)
There are many connections between first and second kind polynomials. For
instance, if we dismantle xUn (x) in the three term recursion and make and
index transformation,
1 1
xUn−1 (x) = Un (x) + Un−2 (x),
2 2
then inserting into (3.17) and dismantling for Tn gives
1 1
Tn = Un − Un−2 . (3.18)
2 2
An other nice relation between the two systems is obtained by differentiating
Tn ,
Tn′ (x) = nUn−1 (x). (3.19)
Here we used x = cos(t) and
d cos(nt) dt 1 sin(nt)
= −nsin(nt) =n .
dt dx d cos(t) sin(t)
dt
We can estimate easily Un and obtain by (3.19) an estimate for Tn′ . If x =
cos(t), then
sin((n + 1)t) ei(n+1)t − e−i(n+1)t
Un (x) = =
sin(t) eit − e−it
Xn Xn
i(n−k)t −ikt
= e e = ei(n−2k)t .
k=0 k=0
3.3. THE CHEBYSHEV POLYNOMIALS (SECOND KIND) 55
Hence
n
X
|Un (x)| ≤ |ei(n−2k)t | ≤ n + 1 for all x ∈ [−1, 1]. (3.20)
k+0
|Tn′ (x)| = n|Un−1 (x)| ≤ |Tn′ (1)| = nUn−1 (1) = n2 ∀ x ∈ [−1, 1]. (3.21)
kf ′k∞ ≤ n2
For obtaining
P∞ the generating function for {Un (x)}∞ n=0 , we need to reorder the
series n=0 Un (x)z n , i.e., we need the absolute convergence of it for instance
for |x| ≤ 1 and |z| ≤ a < 1. This holds because
∞ ∞
X
n
X 1
|Un (x)||z | ≤ (n + 1)an = < ∞.
n=0 n=0
(1 − a)2
Hence
∞
1 X
= Un (x)z n . (3.22)
1 − 2xz + z 2 n=0
56 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
Proof. The statement for the Tn is already proved before. We have to show
only Z 1 √
2 0 if m 6= n
Un (x)Um (x) 1 − x dx = π
−1 2
if m = n
√
The substitution x = cos(t) ( ⇒ sin(t) = 1 − x2 ) and a trigonometric
identity gives
R1 √ R π sin((n + 1)t) sin((m + 1)t)
U (x)Um (x) 1 − x2 dx = 0
−1 n
sin(t)2 dt
Rπ Rπ sin(t) sin(t)
= 21 0 cos((n − m)t) dt − 21 0 cos((n + m + 2)t) dt.
Rπ
Because of 0 cos(at)dt = π if a = 0 and = a1 (sin(aπ) − sin(0) = 0 if
a ∈ Z \ {0}, we obtain
Z 1 √
2 0 if m 6= n,
Un (x)Um (x) 1 − x dx = π
−1 2
if m = n.
q
2
Hence {Un }∞n=0 is an orthogonal system and { U }∞ an ONS.
π n n=0
The zeros of Un are the inner extremal point of Tn+1 in [−1, 1] because of
′
Tn+1 = (n + 1)Un , i.e.,
kπ
Un (cos( )) = 0, k = 1, . . . , n,
n+1
3.4. THE JACOBI POLYNOMIALS 57
1
|Un (x)| ≤ √ . (3.23)
1 − x2
Here one requires α > −1 and β > −1, because otherwise the inner product
is not defined for all f, g ∈ P.
a
First we need here the binomial coefficients k
for noninteger a ∈ R.
we see that
n
X α+n β+n
Jn(α,β) (x) = n!Kn (−1) n
(−1)n−k (1 − x)n−k (1 + x)k
k n−k
k=0
(3.24)
and its leading coefficient is
n
X α+n β+n
lc(Jn(α,β) ) = n!Kn (−1) n
. (3.25)
k=0
k n − k
α + n − k ≥ α + n − m ≥ α + 1 > 0,
β + n − m + k ≥ β + n − m ≥ β + 1 > 0.
hq, Jn(α,β) i = 0.
Theorem 3.8. Every orthogonal polynomial of degree n for the inner product
Z 1
hf, gi := f (x)g(x) (1 − x)α (1 + x)β dx
−1
is of type
n
X α+n β+n
Jn(α,β) (x) = n!Kn (−1)n
(−1)n−k (1 − x)n−k (1 + x)k .
k=0
k n − k
α+β+2n −1 (α,β)
If Kn = (−1) (−1)n −n
n
n! n
then lc(J n ) = 1. If K n := n!
2 then
(α,β) α+n
Jn (1) = n . If
s
Γ(α + β + n + 1) 2−α−β−2n−1
Kn = (α + β + 2n + 1)
Γ(α + n + 1)Γ(β + n + 1) n!
60 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
(α,β)
then Jn is orthonormal.
(α,β)
Proof. A representation for lc(Jn ) is already shown in (3.25),
n
(α,β) n
X α β
lc(Jn ) = Kn n!(−1) .
k=0
k n−k
Therefore
∞ X n ∞
α+β
X α β n
X α+β n
(1 + x) = x = x .
n=0 k=0
k n − k n=0
n
Hence
α+β
lc(Jn(α,β) ) = Kn n!(−1) n
.
n
(α,β)
This gives the representation for lc(Jn ) = 1.
Finally, we summarize without proof the differential equation, the three term
recursion and the generating function for the Jacobi polynomials. (The proofs
are along the same scheme as the proofs shown in the preceding subsections.)
(α,β)
The Jacobi polynomial Jn solves the differential equation
(1 − x )y + β − α − (α + β + 2)x y ′ + n(n + α + β + 1)y = 0.
2 ′′
(3.26)
(α,β) n+α
Let Pn denote the Jacobi polynomial Jn normed by Pn (1) = n
. Then
Pn+1 (x) = (An x + Bn )Pn (x) − Cn Pn (x), n ∈ N, (3.27)
with
(2n + α + β + 1)(2n + α + β + 2)
An = ,
2(n + 1)(n + α + β + 1)
(2n + α + β + 1)(α2 − β 2 )
Bn = ,
2(n + 1)(n + α + β + 1)(2n + α + β)
(n + α)(n + β)(2n + α + β + 2)
Cn = ,
(n + 1)(n + α + β + 1)(2n + α + β)
α+β α−β
and P0 = 1, P1 (x) = (1 + 2
)x + 2
.
√
With the same normalization and with R(x, z) := 1 − 2xz + z 2
∞
2α+β X
= Pn (x)z n . (3.28)
R(x, z)(1 − z + R(x, z))α (1 + z + R(x, z))β
k=0
62 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
lc(Ln ) = Kn (−1)n .
ϕ(x) = xn e−x
Hence
hq, Ln i = 0 if q ∈ Pn−1 ,
i.e., Ln is orthogonal of degree n, and if q = Ln (= Kn (−1)n xn + lower order
terms) then
Z ∞
−1 n n
Kn hLn , Ln i = (−1) hx , Ln i = n!ϕ(x)dx = n!Γ(n + 1) = (n!)2 .
0
Consequently
Kn = (−1)n ⇒ lc(Ln ) = 1,
1
Kn = (−1)n ⇒ hLn , Ln i = 1, lc(Ln ) > 0.
n!
L0 = 1, L1 = −ex (xe−x )′ = x − 1.
Hence
L2 (x) = (x − 3)L1 (x) − L0 (x) = x2 − 4x + 2
L3 (x) = (x − 5)L2 (x) − 4L1 (x) = x3 − 9x2 + 18x − 6
L4 (x) = (x − 7)L3 (x) − 9L2 (x) = x4 − 16x3 + 72x2 − 96x + 24
L5 (x) = (x − 9)L4 − 16L3 = x5 − 25x4 + 200x3 − 600x2 + 600x − 120
etc.
xy ′′ + (1 − x)y ′ + ny = 0.
64 CHAPTER 3. SPECIAL ORTHOGONAL FAMILIES
(α)
then one obtains the so called generalized Laguerre polynomial Ln . This
polynomial satisfies the Rodrigues formula
dn n+α −x
L(α)
n (x) = Kn x −α x
e (x e ), (3.33)
dxn
and therefore
lc(L(α) n
n ) = Kn (−1) .
(α) (α)
The initial values are here L0 = 1 and L1 (x) = x − (1 + α).
(α)
If we choose Kn = (−1)n (n!Γ(n + α + 1))−1/2 , then Ln is, as computation
shows, orthonormal with positive leading coefficient.
The generating function for the generalized Laguerre polynomials with lead-
ing coefficient 1 is
1 α+1 ∞
xz X 1 (α)
exp(− )= Ln (x)z n (3.36)
1+z 1+z n=0
n!
(α)
and the second order differential equation solved by y = Ln is
xy ′′ + (α + 1 − x)y ′ + ny = 0. (3.37)
3.6. THE HERMITE POLYNOMIALS 65
n −x2 dn −x2
Hn (x) = (−1) e (e ) (3.38)
dxn
and have the explicit representation
⌊n/2⌋
X 1
Hn (x) = n! (−1)k (2x)n−2k . (3.39)
k=0
k!(n − 2k)!
They are orthogonal with respect to the given inner product and satisfy
lc(Hn ) = 2n .
Computation gives √
hHn , Hn i = π2n n!
p√ −1
Therefore the polynomials π2n n! Hn are orthonormal (with positive
leading coefficient).
y ′′ − 2xy ′ + 2ny = 0.