4.1. Convergence of Series
4.1. Convergence of Series
Series
59
60 4. Series
We also say a series diverges to ±∞ if its sequence of partial sums does. As for
sequences, we may start a series at other values of n than n = 1 without changing
its convergence properties. It is sometimes convenient
P to omit the limits on a series
when they aren’t important, and write it as an .
Example 4.2. If |a| < 1, then the geometric series with ratio a converges and its
sum is
∞
X 1
an = .
n=0
1−a
This series is simple enough that we can compute its partial sums explicitly,
n
X 1 − an+1
Sn = ak = .
1−a
k=0
A condition for the convergence of series with positive terms follows immedi-
ately from the condition for the convergence of monotone sequences.
P
Proposition 4.6. A series an with positive terms an ≥ 0 converges if and only
if its partial sums
Xn
ak ≤ M
k=1
are bounded from above, otherwise it diverges to ∞.
Pn
Proof. The partial sums Sn = k=1 ak of such a series form a monotone increasing
sequence, and the result follows immediately from Theorem 3.29
That is, we average the first n partial sums the series, and let n → ∞. One can
prove that if a series converges to S, then its Cesàro sum exists and is equal to S,
but a series may be Cesàro summable even if it is divergent.
Example 4.7. For the series (−1)n+1 in Example 4.4, we find that
P
n
(
1X 1/2 + 1/(2n) if n is odd,
Sk =
n 1/2 if n is even,
k=1
since the Sn ’s alternate between 0 and 1. It follows the Cesàro sum of the series is
C = 1/2. This is, in fact, what Grandi believed to be the “true” sum of the series.
Cesàro summation is important in the theory of Fourier series. There are also
many other ways to sum a divergent series or assign a meaning to it (for example,
as an asymptotic series), but we won’t discuss them further here.
Proof. The series converges if and only if the sequence (Sn ) of partial sums is
Cauchy, meaning that for every > 0 there exists N such that
n
X
|Sn − Sm | = ak < for all n > m > N ,
k=m+1
P n
Example 4.10. The geometric series a converges if |a| < 1 and in that case
an → 0 as n → ∞. If |a| ≥ 1, then an 6→ 0 as n → ∞, which implies that the series
diverges.
The condition that the terms of a series approach zero is not, however, sufficient
to imply convergence. The following series is a fundamental example.
Example 4.11. The harmonic series
∞
X 1 1 1 1
= 1 + + + + ...
n=1
n 2 3 4
diverges, even though 1/n → 0 as n → ∞. To see this, we collect the terms in
successive groups of powers of two,
∞
X 1 1 1 1 1 1 1 1 1 1 1
=1+ + + + + + + + + + ··· + + ...
n=1
n 2 3 4 5 6 7 8 9 10 16
1 1 1 1 1 1 1 1 1 1
>1+ + + + + + + + + + ··· + + ...
2 4 4 8 8 8 8 16 16 16
1 1 1 1
> 1 + + + + + ....
2 2 2 2
In general, for every n ≥ 1, we have
n+1 j+1
2X n 2
1 1 X X 1
=1+ +
k 2 j=1 j
k
k=1 k=2 +1
j+1
n
2X
1 X 1
>1+ + j+1
2 j=1 j
2
k=2 +1
n
1 X 1
>1+ +
2 j=1 2
n 3
> + ,
2 2
so the series diverges. We can similarly obtain an upper bound for the partial sums,
n+1 j+1
2X n 2
1 1 X X 1 3
<1+ + j
<n+ .
k 2 j=1 j
2 2
k=1 k=2 +1
These inequalities are rather crude, but they show that the series diverges at a
logarithmic rate, since the sum of 2n terms is of the order n. This rate of divergence
is very slow. It takes 12367 terms for the partial sums of harmonic series to exceed
10, and more than 1.5 × 1043 terms for the partial sums to exceed 100.
A more refined argument, using integration, shows that
" n #
X1
lim − log n = γ
n→∞ k
k=1
We will show in Proposition 4.17 below that every absolutely convergent series
converges. For series with positive terms, there is no difference between
P convergence
and absolute convergence. Also note from Pn Proposition 4.6 that an converges
absolutely if and only if the partial sums k=1 |ak | are bounded from above.
P n
Example 4.13. The geometric series a is absolutely convergent if |a| < 1.
Example 4.14. The alternating harmonic series,
∞
X (−1)n+1 1 1 1
= 1 − + − + ...
n=1
n 2 3 4
is not absolutely convergent since, as shown in Example 4.11, the harmonic series
diverges. It follows from Theorem 4.30 below that the alternating harmonic series
converges, so it is a conditionally convergent series. Its convergence is made possible
by the cancelation between terms of opposite signs.
Both of these series diverge to infinity, since the harmonic series diverges and
∞ ∞ ∞
X X 1X1
a+
n > a−
n = .
n=1 n=1
2 n=1 n
P P
Proof. If an is absolutely convergent, then |an | is convergent, so it satisfies
the Cauchy condition. Since
n n
X X
ak ≤ |ak |,
k=m+1 k=m+1
P
the series an also satisfies the Cauchy condition, and therefore it converges.
For the second part, note that
n
X n
X n
X
0≤ |ak | = a+
k + a−
k,
k=m+1 k=m+1 k=m+1
Xn Xn
0≤ a+
k ≤ |ak |,
k=m+1 k=m+1
Xn Xn
0≤ a−
k ≤ |ak |,
k=m+1 k=m+1
P P + P −
which shows that |an | is Cauchy if and only if both an , an are Cauchy.
a−
P P + P
It follows that |an | converges if and only if both an , n converge. In that
66 4. Series
case, we have
∞
X n
X
an = lim ak
n→∞
n=1 k=1
n n
!
X X
= lim a+
k − a−
k
n→∞
k=1 k=1
n
X n
X
= lim a+
k − lim a−
k
n→∞ n→∞
k=1 k=1
∞
X ∞
X
= a+
n − a−
n,
n=1 n=1
P
and similarly for |an |, which proves the proposition.
P P
the series |an | also satisfies the Cauchy condition. Therefore an converges
absolutely.
and
1 1
0≤ < .
(n + 1)2 n(n + 1)
We also get the explicit upper bound
∞ ∞
X 1 X 1
2
< 1 + = 2.
n=1
n n=1
n(n + 1)
Thus, the partial sums are bounded from above, so the series converges by Propo-
sition 4.6. An alternative proof of the convergence of the p-series for p > 1 and
divergence for 0 < p ≤ 1, using the integral test, is given in Example 12.44.
68 4. Series
For instance, as stated in Example 4.20, we have ζ(2) = π 2 /6. In fact, Euler
(1755) discovered a general formula for the value ζ(2n) of the ζ-function at even
natural numbers,
(2π)2n B2n
ζ(2n) = (−1)n+1 , n = 1, 2, 3, . . . ,
2(2n)!
where the coefficients B2n are the Bernoulli numbers (see Example 10.19). In
particular,
π4 π6 π8 π 10
ζ(4) = , ζ(6) = , ζ(8) = , ζ(10) = .
90 945 9450 93555
On the other hand, the values of the ζ-function at odd natural numbers are harder
to study. For instance,
∞
X 1
ζ(3) = = 1.2020569 . . .
n=1
n3
where the pj are primes and the exponents αj are positive integers. Using the
binomial expansion in Example 4.2, we have
−1
1 1 1 1 1
1− s = 1 + s + 2s + 3s + 4s + . . . .
p p p p p
By expanding the products and rearranging the resulting sums, one can see that
Y −1
1
ζ(s) = 1− s ,
p
p
where the product is taken over all primes p, since every possible prime factorization
of a positive integer appears exactly once in the sum on the right-hand side. The
infinite product here is defined as a limit of finite products,
Y −1 Y −1
1 1
1− s = lim 1− s .
p
p N →∞ p
p≤N
4.6. The ratio and root tests 69
Using complex analysis, one can show that the ζ-function may be extended
in a unique way to an analytic (i.e., differentiable) function of a complex variable
s = σ + it ∈ C
ζ : C \ {1} → C,
where σ = <s is the real part of s and t = =s is the imaginary part. The ζ-
function has a singularity at s = 1, called a simple pole, where it goes to infinity like
1/(1−s), and is equal to zero at the negative even integers s = −2, −4, . . . , −2n, . . . .
These zeros are called the trivial zeros of the ζ-function. Riemann (1859) made the
following conjecture.
Hypothesis 4.23 (Riemann hypothesis). Except for the trivial zeros, the only
zeros of the Riemann ζ-function occur on the line <s = 1/2.
If true, the Riemann hypothesis has significant consequences for the distribution
of primes (and many other things); roughly speaking, it implies that the prime
numbers are “randomly distributed” among the natural numbers (with density
1/ log n near a large integer n ∈ N). Despite enormous efforts, this conjecture has
neither been proved nor disproved, and it remains one of the most significant open
problems in mathematics (perhaps the most significant open problem).
Proof. If r < 1, choose s such that r < s < 1. Then there exists N ∈ N such that
an+1
an < s for all n > N .
It follows that
|an | ≤ M sn for all n > N
P
where M is a suitable constant. Therefore an converges absolutely by comparison
M sn .
P
with the convergent geometric series
If r > 1, choose s such that r > s > 1. There exists N ∈ N such that
an+1
an > s for all n > N ,
70 4. Series
so that |an | ≥ M sn for all n > N and some M > 0. It follows that (an ) does not
approach 0 as n → ∞, so the series diverges.
Example 4.25. Let a ∈ R, and consider the series
∞
X
nan = a + 2a2 + 3a3 + . . . .
n=1
Then
(n + 1)an+1
lim = |a| lim 1 + 1 = |a|.
n→∞ nan n→∞ n
By the ratio test, the series converges if |a| < 1 and diverges if |a| > 1; the series
also diverges if |a| = 1. The convergence of the series for |a| < 1 is explained by
the fact that the geometric decay of the factor an is more rapid than the algebraic
growth of the coefficient n.
Example 4.26. Let p > 0 and consider the p-series
∞
X 1
p
.
n=1
n
Then
1/(n + 1)p
1
lim = lim = 1,
n→∞ 1/np n→∞ (1 + 1/n)p
so the ratio test is inconclusive. In this case, the series diverges if 0 < p ≤ 1 and
converges if p > 1, which shows that either possibility may occur when the limit in
the ratio test is 1.
The root test provides a criterion for convergence of a series that is closely re-
lated to the ratio test, but it doesn’t require that the limit of the ratios of successive
terms exists.
Theorem 4.27 (Root test). Suppose that (an ) is a sequence of real numbers and
let
1/n
r = lim sup |an | .
n→∞
Then the series
∞
X
an
n=1
converges absolutely if 0 ≤ r < 1 and diverges if 1 < r ≤ ∞.
Proof. First suppose 0 ≤ r < 1. If 0 < r < 1, choose s such that r < s < 1, and
let
r
t= , r < t < 1.
s
If r = 0, choose any 0 < t < 1. Since t > lim sup |an |1/n , Theorem 3.41 implies
that there exists N ∈ N such that
|an |1/n < t for all n > N .
Therefore |an | < tn for all n > N , where t < 1, so it follows
P n that the series converges
by comparison with the convergent geometric series t .
4.7. Alternating series 71
Next suppose 1 < r ≤ ∞. If 1 < r < ∞, choose s such that 1 < s < r, and let
r
t= , 1 < t < r.
s
If r = ∞, choose any 1 < t < ∞. Since t < lim sup |an |1/n , Theorem 3.41 implies
that
|an |1/n > t for infinitely many n ∈ N.
n
Therefore |an | > t for infinitely many n ∈ N, where t > 1, so (an ) does not
approach zero as n → ∞, and the series diverges.
The root test may succeed where the ratio test fails.
Example 4.28. Consider the geometric series with ratio 1/2,
∞
X 1 1 1 1 1 1
an = + 2 + 3 + 4 + 5 + . . . , an = n .
n=1
2 2 2 2 2 2
Then (of course) both the ratio and root test imply convergence since
an+1
lim = lim sup |an |1/n = 1 < 1.
n→∞ an n→∞ 2
Now consider the series obtained by switching successive odd and even terms
∞
(
X 1 1 1 1 1 1/2n+1 if n is odd,
bn = 2 + + 4 + 3 + 6 + . . . , bn =
n=1
2 2 2 2 2 1/2n−1 if n is even
For this series,
(
bn+1 2 if n is odd,
bn = 1/8 if n is even,
and the ratio test doesn’t apply, since the required limit does not exist. (The series
still converges at a geometric rate, however, because the the decrease in the terms
by a factor of 1/8 for even n dominates the increase by a factor of 2 for odd n.) On
the other hand
1
lim sup |bn |1/n = ,
n→∞ 2
so the ratio test still works. In fact, as we discuss in Section 4.8, since the series is
absolutely convergent, every rearrangement of it converges to the same sum.
1.2
0.8
sn
0.6
0.4
0.2
0
0 5 10 15 20 25 30 35 40
n
Proof. Let
n
X
Sn = (−1)k+1 ak
k=1
denote the nth partial sum. If n = 2m − 1 is odd, then
S2m−1 = S2m−3 − a2m−2 + a2m−1 ≤ S2m−3 ,
since (an ) is decreasing, and
S2m−1 = (a1 − a2 ) + (a3 − a4 ) + · · · + (a2m−3 − a2m−2 ) + a2m−1 ≥ 0.
Thus, the sequence (S2m−1 ) of odd partial sums is decreasing and bounded from
below by 0, so S2m−1 ↓ S + as m → ∞ for some S + ≥ 0.
Similarly, if n = 2m is even, then
S2m = S2m−2 + a2m−1 − a2m ≥ S2m−2 ,
4.8. Rearrangements 73
and
S2m = a1 − (a2 − a3 ) − (a4 − a5 ) − · · · − (a2m−1 − a2m ) ≤ a1 .
Thus, (S2m ) is increasing and bounded from above by a1 , so S2m ↑ S − ≤ a1 as
m → ∞.
Finally, note that
lim (S2m−1 − S2m ) = lim a2m = 0,
m→∞ m→∞
The proof also shows that the sum S2m ≤ S ≤ S2n−1 is bounded from below
and above by all even and odd partial sums, respectively, and that the error |Sn −S|
is less than the first term an+1 in the series that is neglected.
Example 4.31. The alternating p-series
∞
X (−1)n+1
n=1
np
converges for every p > 0. The convergence is absolute for p > 1 and conditional
for 0 < p ≤ 1.
4.8. Rearrangements
A rearrangement of a series is a series that consists of the same terms in a different
order. The convergence of rearranged series may initially appear to be unconnected
with absolute convergence, but absolutely convergent series are exactly those series
whose sums remain the same under every rearrangement of their terms. On the
other hand, a conditionally convergent series can be rearranged to give any sum we
please, or to diverge.
Example 4.32. A rearrangement of the alternating harmonic series in Exam-
ple 4.14 is
1 1 1 1 1 1 1 1
1− − + − − + − − + ...,
2 4 3 6 8 5 10 12
where we put two negative even terms between each of the positive odd terms. The
behavior of its partial sums is shown in Figure 2. As proved in Example 12.47,
this series converges to one-half of the sum of the alternating harmonic series. The
sum of the alternating harmonic series can change under rearrangement because it
is conditionally convergent.
Note also that both the positive and negative parts of the alternating harmonic
series diverge to infinity, since
1 1 1 1 1 1 1
1 + + + + ... > + + + + ...
3 5 7 2 4 6 8
1 1 1 1
> 1 + + + + ... ,
2 2 3 4
1 1 1 1 1 1 1 1
+ + + + ... = 1 + + + + ... ,
2 4 6 8 2 2 3 4
and the harmonic series diverges. This is what allows us to change the sum by
rearranging the series.
74 4. Series
1.2
0.8
sn
0.6
0.4
0.2
0
0 5 10 15 20 25 30 35 40
n
is a rearrangement of a series
∞
X
an
n=1
be a rearrangement.
Given > 0, choose N ∈ N such that
∞
X N
X
0≤ ak − ak < .
k=1 k=1
1.8
1.6
1.4
1.2
Sn
0.8
0.6
0.4
0.2
0
0 5 10 15 20 25 30 35 40
n
series converge, then the series converges absolutely; andPif only one part diverges,
or −∞ if a−
P +
then the
P +series diverges
P − (to ∞ if an diverges, n diverges). Therefore
both an and an diverge. This means that we can make sums of successive
positive or negative terms in the series as large as we wish.
Suppose S ∈ R. Starting from the beginning of the series, we choose successive
positive or zero terms in the series until their partial sum is greater than or equal
to S. Then we choose successive strictly negative terms, starting again from the
beginning of the series, until the partial sum of all the terms is strictly less than
S. After that, we choose successive positive or zero terms until the partial sum is
greater than or equal S, followed by negative terms until the partial sum is strictly
less than S, and so on. The partial sums are greater than S by at most the value
of the last positive term retained, and are less than S by at most the value of the
last negative term retained. Since an → 0 as n → ∞, it follows that the rearranged
series converges to S.
A similar argument shows that we can rearrange a conditional convergent series
to diverge to ∞ or −∞, and that we can rearrange the series so that it diverges in
a finite or infinite oscillatory fashion.
TherePare no convergence issues about the individual terms in the Cauchy product,
n
since k=0 ak bn−k is a finite sum.
Theorem 4.38 (Cauchy product). If the series
∞
X ∞
X
an , bn
n=0 n=0
are absolutely convergent, then the Cauchy product is absolutely convergent and
∞ ∞
n
! ! ∞ !
X X X X
ak bn−k = an bn .
n=0 k=0 n=0 n=0
Thus, the Cauchy product is absolutely convergent, since the partial sums of its
absolute values are bounded from above.
Since the series for the Cauchy product is absolutely convergent, any rearrange-
ment of it converges to the same sum. In particular, the subsequence of partial sums
given by
N
! N ! N X N
X X X
an bn = an bm
n=0 n=0 n=0 m=0
corresponds to a rearrangement of the Cauchy product, so
∞ ∞
n
! N
! N ! ! ∞ !
X X X X X X
ak bn−k = lim an bn = an bn .
N →∞
n=0 k=0 n=0 n=0 n=0 n=0
where the terms amn are indexed by a pair of natural numbers m, n ∈ R. More
formally, the terms are defined by a function f : N × N → R where amn = f (m, n).
In this section, we consider sums of double series; this material is not used later on.
There are many different ways to define the sum of a double series since, unlike
the index set N of a series, the index set N × N of a double series does not come
with a natural linear order. Our main interest here is in giving a definition of the
sum of a double series that does not depend on the order of its terms. As for series,
this unordered sum exists if and only if the double series is absolutely convergent.
If F ⊂ N × N is a finite subset of pairs of natural numbers, then we denote by
X X
amn = amn
F (m,n)∈F
the partial sum of all terms amn whose indices (m, n) belong to F .
Definition 4.39. The unordered sum of nonnegative real numbers amn ≥ 0 is
( )
X X
amn = sup amn
F ∈F
N×N F
where the supremum is taken over the collection F of all finite subsets F ⊂ N × N.
The unordered sum converges if this supremum is finite and diverges to ∞ if this
supremum is ∞.
It follows that
N
X 1 X 1
p
≥
(m + n) k p−1
N×N k=2
80 4. Series
Note that this double p-series converges only if its terms approach zero at a faster
rate than the terms in a single p-series (of degree greater than 2 in (m, n) rather
than degree greater than 1 in n).
We define a general unordered sum of real numbers by summing its positive and
negative terms separately. (Recall the notation in Definition 4.15 for the positive
and negative parts of a real number.)
Definition 4.41. The unordered sum of a double series of real numbers is
X X X
amn = a+mn − a−mn
N×N N×N N×N
where amn = a+
mn − a−is the decompositionPof amn intoPits positive and negative
mn
parts. The unordered sum converges if both a+
mn and a−mnPare+finite; diverges
−
P + P
to
P −∞ if amn = ∞ and amn is finite;
P + diverges to
P − −∞ if amn is finite and
amn = ∞; and is undefined if both amn and amn diverge to ∞.
This definition does not require us to order the index set N × N in any way; in
fact, the same definition applies to any series of real numbers
X
ai
i∈I
whose terms are indexed by an arbitrary set I. A sum over a set of indices will
always denote an unordered sum.
Definition 4.42. A double series
∞
X
amn
m,n=1
converges.
P
Proposition 4.43. An unordered sum amn of real numbers converges if and
only if it converges absolutely, and in that case
X X X
|amn | = a+mn + a−
mn .
N×N N×N N×N
It follows that the finite partial sums of the positive and negative terms of the series
are bounded from above, so the unordered sum converges.
Conversely, suppose that the unordered sum converges. If F ⊂ N × N is any
finite subset, then
X X X X X
|amn | = a+
mn + a−
mn ≤ a+
mn + a−
mn .
F F F N×N N×N
It follows that the finite partial sums of the absolute values of the terms in the series
are bounded from above, so the unordered sum converges absolutely. Furthermore,
X X X
|amn | ≤ a+mn + a−
mn .
N×N N×N N×N
To prove the inequality in the other direction, let > 0. There exist finite sets
F+ , F− ⊂ N × N such that
X X X X
a+
mn > a+
mn − , a−
mn > a−mn − .
2 2
F+ N×N F− N×N
Next, we define rearrangements of a double series into single series and show
that every rearrangement of a convergent unordered sum converges to the same
sum.
82 4. Series
Theorem 4.46. If the unordered sum of a double series of real numbers converges,
then every rearrangement of the double series into a single series converges to the
unordered sum.
P
Proof. Suppose that the unordered sum amn converges with
X X
a+
mn = S+ , a−
mn = S− ,
N×N N×N
and let
∞
X
bk
k=1
be a rearrangement of the double series corresponding to a map σ : N → N × N.
For k ∈ N, let
Fk = {(m, n) ∈ N × N : (m, n) = σ(j) for some 1 ≤ j ≤ k} ,
so that
k
X X X X
bj = amn = a+
mn − a−
mn .
j=1 Fk Fk Fk
and define N ∈ N by
N = max {j ∈ N : σ(j) ∈ F+ ∪ F− } .
If k ≥ N , then Fk ⊃ F+ ∪ F− and, since a±
mn ≥ 0,
X X X X
a+mn ≤ a+
mn ≤ S+ , a−
mn ≤ a−
mn ≤ S− .
F+ Fk F− Fk
4.10. * Double series 83
It follows that
X X
S+ − < a+
mn ≤ S+ , S− − < a−
mn ≤ S− ,
Fk Fk
The rearrangement of a double series into a single series is one natural way to
interpret a double series in terms of single series. Another way is to use iterated
sums of single series.
P
Given a double series amn , one can define two iterated sums, obtained by
summing first over one index followed by the other:
∞ ∞
! M N
!
X X X X
amn = lim lim amn ;
M →∞ N →∞
m=1 n=1 m=1 n=1
∞ ∞
! N M
!
X X X X
amn = lim lim amn .
N →∞ M →∞
n=1 m=1 n=1 m=1
As the following example shows, these iterated sums may not equal, even if both
of them converge.
Example 4.47. Define amn by
1
if n = m + 1
amn = −1 if m = n + 1
0 otherwise
Then, by writing out the terms amn in a table, one can see that
∞ ∞
( (
X 1 if m = 1 X −1 if n = 1
amn = , amn = ,
n=1
0 otherwise m=1
0 otherwise
so that
∞ ∞ ∞ ∞
! !
X X X X
amn = 1, amn = −1.
m=1 n=1 n=1 m=1
Note that for this series X
|amn | = ∞,
N×N
so it is not absolutely convergent. Furthermore, both of the sums
X X
a+
mn , a−mn
N×N N×N
The following basic result, which is a special case of Fubini’s theorem, guaran-
tees that both of the iterated sums of an absolutely convergent double series exist
and are equal to the unordered sum. It also gives a criterion for the absolute con-
vergence of a double series in terms of the convergence of its iterated sums. The
key point of the proof is that a double sum over a “rectangular” set of indices is
equal to an iterated sum. We can then estimate sums over arbitrary finite subsets
of indices in terms of sums over rectangles.
P
Theorem 4.48 (Fubini for double series). A double series of real numbers amn
converges absolutely if and only if either one of the iterated series
∞ ∞ ∞ ∞
! !
X X X X
|amn | , |amn |
m=1 n=1 n=1 m=1
converges. In that case, both iterated series converge to the unordered sum of the
double series:
∞ ∞ ∞ ∞
! !
X X X X X
amn = amn = amn .
N×N m=1 n=1 n=1 m=1
Proof. First suppose that one of the iterated sums of the absolute values exists.
Without loss of generality, we suppose that
∞ ∞
!
X X
|amn | < ∞.
m=1 n=1
Thus, the iterated sums converge to the unordered sum. Moreover, we have simi-
larly that
∞ ∞ ∞ ∞
! !
X X X X X X
+
amn = +
aij , −
amn = a−ij ,
m=1 n=1 N×N m=1 n=1 N×N
The preceding results show that the sum of an absolutely convergent double
series is unambiguous; unordered sums, sums of rearrangements into single series,
and iterated sums all converge to the same value. On the other hand, the sum
of a conditionally convergent double series depends on how it is defined, e.g., on
how one chooses to rearrange the double series into a single series. We conclude by
describing one other way to define double sums.
Example 4.49. A natural way to generalize the sum of a single series to a double
series, going back to Cauchy (1821) and Pringsheim (1897), is to say that
∞
X
amn = S
m,n=1
That is, we sum over larger and larger “rectangles” of indices in the N × N-plane.
An absolutely convergent series converges in this sense to the same sum, but
some conditionally convergent series also converge. For example, using this defini-
tion of the sum, we have
∞
" M N #
X (−1)m+n X X (−1)m+n
= lim
m,n=1
mn M,N →∞
m=1 n=1
mn
" M # "N #
X (−1)m X (−1)n
= lim lim
M →∞
m=1
m N →∞
n=1
n
"∞ #2
X (−1)n
=
n=1
n
2
= (log 2) ,
86 4. Series
but the series is not absolutely convergent, since the sums of both its positive and
negative terms diverge to ∞.
This definition of a sum is not, however, as easy to use as the unordered sum of
an absolutely convergent series. For example, it does not satisfy Fubini’s theorem
(although one can show that if the sum of a double series exists in this sense and
the iterated sums also exist, then they are equal [16]).
Proof. Using the binomial theorem, as in the proof of Proposition 3.32, we find
that
n
1 1 1 1 1 2
1+ =2+ 1− + 1− 1−
n 2! n 3! n n
1 1 2 k−1
+ ··· + 1− 1− ... 1 −
k! n n n
1 1 2 2 1
+ ··· + 1− 1− ... ·
n! n n n n
1 1 1 1
< 2 + + + + ··· + .
2! 3! 4! n!
Taking the limit of this inequality as n → ∞, we get that
∞
X 1
e≤ .
n=0
n!
This series for e is very rapidly convergent. The next proposition gives an
explicit error estimate.
Proposition 4.51. For every n ∈ N,
n
X 1 1
0<e− < .
k! n · n!
k=0
Proof. The lower bound is obvious. For the upper bound, we estimate the tail of
the series by a geometric series:
n ∞
X 1 X 1
e− =
k! k!
k=0 k=n+1
1 1 1 1
= + + ··· + + ...
n! n + 1 (n + 1)(n + 2) (n + 1)(n + 2) . . . (n + k)
1 1 1 1
< + + · · · + + . . .
n! n + 1 (n + 1)2 (n + 1)k
1 1
< · .
n! n
Proof. Suppose for contradiction that e = p/q for some p, q ∈ N. From Proposi-
tion 4.51,
n
p X 1 1
0< − <
q k! n · n!
k=0
for every n ∈ N. Multiplying this inequality by n!, we get
n
p · n! X n! 1
0< − < .
q k! n
k=0