Textbook Extracts
Textbook Extracts
x(n+1)
x(n)
x0
x(n+1)
x(n)
x0 x*
The case where µ = 1 needs special attention, for we have F1" (0) = 1
and F "" (0) = −2 $= 0. By applying Theorem 1.15 we may conclude that
0 is unstable. This is certainly true if we consider negative as well as
positive initial points in the neighborhood of 0. Since negative initial
points are not in the domain of Fµ , we may discard them and consider
only positive initial points. Exercises 1.5, Problem 16 tells us that 0 is
semiasymptotically stable from the right, i.e., x∗ = 0 is asymptotically
stable in the domain [0, 1].
(b) The equilibrium point x* = (µ − 1)/µ, µ $= 1. (See Figures 1.32, 1.33.)
x(n+1)
x(n)
x0 x*
1.7.2 2-Cycles
To find the 2-cycles we solve the equation Fµ2 (x) = x (or we solve x2 =
µx1 (1 − x1 ), x1 = µx2 (1 − x2 )),
µ2 x(1 − x)[1 − µx(1 − x)] − x = 0. (1.7.3)
Discarding the equilibrium points 0 and x* = µ−1 µ , one may then divide
(1.7.3) by the factor x(x − (µ − 1)/µ) to obtain the quadratic equation
µ2 x2 − µ(µ + 1)x + µ + 1 = 0.
Solving this equation produces the 2-cycle
! " #$
x(0) = (1 + µ) − (µ − 3)(µ + 1) 2µ,
! " #$
x(1) = (1 + µ) + (µ − 3)(µ + 1) 2µ. (1.7.4)
Clearly, there are no periodic points of period 2 for 0 < µ ≤ 3, and there
is a 2-cycle for µ > 3. For our reference we let µ0 = 3.
1.7.3 22 -Cycles
To find the 4-cycles we solve Fµ4 (x) = x. The computation now becomes
unbearable, and one should resort to a computer √ to do the work. It turns
out √that there is a 22 -cycle when µ > 1 + 6, which is attracting for
1 + 6 < µ < 3.544090 . . . . This 22 -cycle becomes unstable at µ > µ2 =
3.544090 . . . .
When µ = µ2 , the 22 -cycle bifurcates into a 23 cycle. The new 23 cycle
is attracting for µ3 < µ ≤ µ4 for some number µ4 . This process of double
bifurcation continues indefinitely. Thus we have a sequence {µn }∞n=0 where
at µn there is a bifurcation from a 2n−1 -cycle to a 2n -cycle. (See Figures
1.34, 1.35.) Table 1.4 provides some astonishing patterns.
From Table 1.4 we bring forward the following observations:
(i) The sequence {µn } seems to converge to a number µ∞ = 3.57 . . . .
(ii) The quotient (µn − µn−1 )/(µn+1 − µn ) seems to tend to a number δ =
4.6692016 . . . . This number is called the Feigenbaum number after its
discoverer, the physicist Mitchell Feigenbaum [56]. In fact, Feigenbaum
made a much more remarkable discovery: The number δ is universal
and is independent of the form of the family of maps fµ . However, the
number µ∞ depends on the family of functions under consideration.
µ
1 3 1+ 6
µn − µn−1
n µn µn − µn−1
µn+1 − µn
0 3 — —
1 3.449499 ... 0.449499 . . . —
2 3.544090 ... 0.094591 . . . 4.752027 ...
3 3.564407 ... 0.020313 . . . 4.656673 ...
4 3.568759 ... 0.004352 . . . 4.667509 ...
5 3.569692 ... 0.00093219 . . . 4.668576 ...
6 3.569891 ... 0.00019964 . . . 4.669354 ...
1 1
a computer' for nx0' 1=((2 , taking increments of 500 for µ ∈ [0, 4] and plotting
all points µ, Fµ 2 for 200 ≤ n ≤ 500.
Question What happens when µ > µ∞ ?
Answer From Figure 1.35 we see that for µ∞ < µ ≤ 4 we have a large
number of small windows where the attracting set is an asymptotically sta-
ble cycle. The largest window appears at approximately µ = 3.828427 . . .,
where we have an attracting 3-cycle. Indeed, there are attracting k-cycles
for all positive integers k, but their windows are so small that they may
not be noticed without sufficient zooming. As in the situation where
µ < µ∞ , these k-cycles lose stability and then double bifurcate into at-
tracting 2n k-cycles. We observe that outside these windows the picture
looks chaotic!
Remarks: Our analysis of the logistic map Fµ may be repeated for any
quadratic map Q(x) = ax2 + bx + c. Indeed, the iteration of the quadratic
map Q (with suitably chosen parameters) is equivalent to the iteration of
the logistic map Fµ . In other words, the maps Q and Fµ possess the same
type of qualitative behavior. The reader is asked, in Exercises 1.7, Problem
11, to verify that one can transform the difference equation
y(n + 1) = y 2 (n) + c (1.7.7)
to
x(n + 1) = µx(n)[1 − x(n)] (1.7.8)
by letting
µ µ µ2
y(n) = −µx(n) + , c= − . (1.7.9)
2 2 4
Note here that µ = 2 corresponds to c = 0, µ = 3 corresponds to c = −3 4 ,
and µ = 4 corresponds to c = −2. Naturally, we expect to have the same
behavior of the iteration of (1.7.7) and (1.7.8) at these corresponding values
of µ and c.
Comments: We are still plagued by numerous unanswered questions in
connection with periodic orbits (cycles) of the difference equation
x(n + 1) = f (x(n)). (1.7.10)
a discrete-time analog of the logistic equation for population growth (Section 2.3).
Here x,, 2 0 is a dimensionless measure of the population in the nth generation
and r 2 0 is the intrinsic growth rate. As shown in Figure 10.2.1, the graph of ( I ) is
a parabola with a maximum value of 1-14 at x = i.We restrict the control parame-
ter r to the range 0 5 r <_ 4 so that (1) maps the interval 0 Ix <: 1 into itself. (The
behavior is much less interesting for other values of x and r-see Exercise
10.2. I.)
Figure 10.2.1
Period-Doubling
Suppose we fix r, choose some initial population I,,, and then use ( I ) to gener-
ate the subsequent x,, . What happens?
For small growth rate r < 1 , the population always goes extinct: x , + 0 as
n + . This gloomy result can be proven by cobwebbing (Exercise 10.2.2).
03
For 1 < r < 3 the population grows and eventually reaches a nonzero steady
state (Figure 10.2.2). The results are plotted here as a time series of x,, vs. n.
To make the sequence clearer, we have connected the discrete points (n,x,,) by
line segments, but remember that only the corners of the jagged curves are
meaningful.
10.2 L O G I S T I C M A P : N U M E R I C S 353
Figure 10.2.2
For larger r , say r = 3.3, the population builds up again but now oscillates
about the former steady state, alternating between a large population in one gener-
ation and a smaller population in the next (Figure 10.2.3). This type of oscillation,
in which x,,repeats every two iterations, is called aperiod-2 cycle.
Figure 10.2.3
At still larger r, say r = 3.5, the population approaches a cycle that now repeats
every four generations; the previous cycle has doubled its period to period-4 (Fig-
ure 10.2.4).
Figure 10.2.4
354 ONE-DIMENSIONAL M A P S
Further period-doublings to cycles of period 8, 16, 32, . . . , occur as r in-
creases. Specifically, let r, denote the value of r where a 2"-cycle first appears.
Then computer experiments reveal that
(period 2 is born)
4
8
16
32
Note that the successive bifurcations come faster and faster. Ultimately the r, con-
verge to a limiting value r_ . The convergence is essentially geometric: in the limit
of large n , the distance between successive transitions shrinks by a constant factor
j We'll have a lot more to say about this number in Section 10.6.
I
1
Chaos and Periodic Windows
I
I According to Gleick (1987, p. 69), May wrote the logistic map on a corridor
blackboard as a problem for his graduate students and asked, "What the Christ
i happens for r > r,?'The answer turns out to be complicated: For many values of
r , the sequence { x , , ) never settles down to a fined point or a periodic orbit-
instead the long-term behavior is aperiodic, as in Figure 10.2.5. This is a discrete-
time version of the chaos we encountered earlier in our study of the Lorenz
( equations (Chapter 9).
Figure 10.2.5
10.2 L O G I S T I C M A P : N U M E R I C S 355
xn
Figure 10.2.6
You might guess that the system would become more and more chaotic as r
increases, but in fact the dynamics are more subtle than that. To see the long-
term behavior for all values of r at once, we plot the orbit diagram, a magnifi-
cent picture that has become an icon of nonlinear dynamics (Figure 10.2.7).
Figure 10.2.7 plots the system's attractor as a function of r. T o generate the
orbit diagram for yourself, you'll need to write a computer program with
two "loops." First, choose a value of r. Then generate an orbit starting
from some random initial condition x , . Iterate for 300 cycles or so, to allow
the system to settle down to its eventual behavior. Once the transients have
decayed, plot many points, say x,,, , . . . , x,,, above that r. Then move to
an adjacent value of r and repeat, eventually sweeping across the whole pic-
ture.
Figure 10.2.7 shows the most interesting part of the diagram, in the region
3.4 I r 5 4 . At r = 3.4, the attractor is a period-2 cycle, as indicated by the two
branches. As r increases, both branches split simultaneously, yielding a period-4
cycle. This splitting is the period-doubling bifurcation mentioned earlier. A cas-
cade of further period-doublings occurs as r increases, yielding period-8, period-
16, and so on, until at r = r_ = 3.57, the map becomes chaotic and the attractor
changes from a finite to an infinite set of points.
For r > r_ the orbit diagram reveals an unexpected mixture of order and chaos,
with periodic windows interspersed between chaotic clouds of dots. The large win-
dow beginning near r = 3.83 contains a stable period-3 cycle. A blow-up of part of
the period-3 window is shown in the lower panel of Figure 10.2.7. Fantastically, a
copy of the orbit diagram reappears in miniature!
i EXAMPLE 10.3.1 :
Consider the logistic map x,,,, = rx,,(l- x,,)for 0 < x , I I and 0 I r 5 4 . Find
all the fixed points and determine their stability.
Solution: The fixed points satisfy .r2:= f (x*) = rx *(I - x*) . Hence .r* = 0 or
1 = r(l - x*), i.e., x* = 1 - j.The origin is a fixed point for all r, whereas
x* = 1 - $ is in the range of allowable x only if r 2 1 .
Stability depends on the multiplier f f ( x * )= r - 2r.r '*. Since f '(0) = r, the ori-
gin is stable for r < 1 and unstable for r > I. At the other fixed point,
10.3 L O G I S T I C M A P : A N A L Y S I S 357
f '(x*) = r - 2 r ( l - 5 ) = 2 - r. Hence x* = 1 - $ is stable for -I < (2 - r) < 1, i.e.,
for I < r < 3 . It isunstable for r > 3 .
The results of Example 10.3.1 are clarified by a graphical analysis (Figure
10.3.1). For r < 1 the parabola lies below the diagonal, and the origin is the only
fixed point. As r increases, the parabola gets taller, becoming tangent to the diag-
onal at r = 1 . For r > 1 the parabola intersects the diagonal in a second fixed point
x* = 1 - $, while the origin loses stability. Thus we see that x * bifurcates from the
origin in a transcritical bifurcation at r = 1 (borrowing a term used earlier for dif-
ferential equations).
Figure 10.3.1
Figure 10.3. I also suggests how x * itself loses stability. As r increases beyond
1, the slope at x * gets increasingly steep. Example 10.3.1 shows that the critical
slope f '(x*) = -1 is attained when r = 3. The resulting bifurcation is called aflip
bifurcation.
Flip bifurcations are often associated with period-doubling. In the logistic map,
the flip bifurcation at r = 3 does indeed spawn a 2-cycle, as shown in the next ex-
ample.
EXAMPLE 10.3.2:
Show that the logistic map has a 2-cycle for all r > 3.
Solution: A 2-cycle exists if and only if there are two points p and q such that
f (p) = q and f (q) = p. Equivalently, such a p must satisfy f (f (p)) = p, where
f ( x ) = rx(l -x). Hence p is a fixed point of the second-iterate map
Figure 10.3.2
To find p and q, we need to solve for the points where the graph intersects the
diagonal, i.e., we need to solve the fourth-degree equation f '(x) = x. That sounds
hard until you realize that the fixed points x* = 0 and x* = 1- f are trivial solu-
tions of this equation. (They satisfy f (x*) = x * , so f 2 (x*) = x * automatically.)
After factoring out the fixed points, the problem reduces to solving a quadratic
equation.
We outline the algebra involved in the rest of the solution. Expansion of the
equation f 2 ( ~-)x = 0 gives r2x(l - x)[l - rx(1- x)] - x = 0 . After factoring out
x and x - (I - +) by long division, and solving the resulting quadratic equation, we
obtain a pair of roots
which are real for r > 3. Thus a 2-cycle exists for all r > 3, as claimed. At r = 3, the
roots coincide and equal x* = 1- $ = 3, which shows that the 2-cycle bifurcates
continuously from x * . For r < 3 the roots are complex, which means that a 2-cy-
cle doesn't exist.
A cobweb diagram reveals how flip bifurcations can give rise to period-
doubling. Consider any map f , and look at the local picture near a fixed point
where f '(x*) = -1 (Figure 10.3.3).
xn
Figure 10.3.3
If the graph of f is concave down near x *, the cobweb tends to produce a small,
stable 2-cycle close to the fixed point. But like pitchfork bifurcations, flip bifurca-
tions can also be subcritical, in which case the 2-cycle exists below the bifurcation
and is unstable-see Exercise 10.3.1 1.
The next example shows how to determine the stability of a 2-cycle.
EXAMPLE 10.3.3:
Show that the 2-cycle of Example 10.3.2 is stable for 3 < r < 1+ & = 3.449.
(This explains the values of r, and r2 found numerically in Section 10.2.)
Solution: Our analysis follows a strategy that is worth remembering: To ana-
lyze the stability of a cycle, reduce the problem to a question about the stability of
afixedpoint, as follows. Both p and q are solutions of f 2(x) = x , as pointed out
in Example 10.3.2; hence p and q are fixed points of the second-iterate map
f 2 ( ~ )The
. original 2-cycle is stable precisely if p and q are stable fixed points
for f 2 .
Now we're on familiar ground. To determine whether p is a stable fixed point
of f 2, we compute the multiplier
(Note that the same A is obtained at x = q, by the symmetry of the final term
above. Hence, when the p and q branches bifurcate, they must do so simultane-
ously. We noticed such a simultaneous splitting in our numerical observations of
Section 10.2.)
Therefore the 2-cycle is linearly stable for 4 + 2 r - r' I < 1, i.e., for 3 < r < 1 + &.
rn
Figure 10.3.4 shows a partial bifurcation diagram for the logistic map, based
on our results so far. Bifurcation diagrams are different from orbit diagrams in that
unstable objects are shown as well; orbit diagrams show only the attractors.
Figure 10.3.4
Our analytical methods are becoming unwieldy. A few more exact results can
be obtained (see the exercises), but such results are hard to come by. To elucidate
the behavior in the interesting region where r > r _ , we are going to rely mainly on
graphical and numerical arguments.
Figure 10.4.1
Intersections between the graph and the diagonal line correspond to solutions
of f3(x) = X. There are eight solutions, six of interest to us and marked with
dots, and two imposters that are not genuine period-3; they are actually fixed
points, or period-1 points for which f (x*) = x *. The black dots in Figure 10.4.1
correspond to a stable period-3 cycle; note that the slope of f 3(x) is shallow at
these points, consistent with the stability of the cycle. In contrast, the slope
exceeds 1 at the cycle marked by the open dots; this 3-cycle is therefore unsta-
ble.
Now suppose we decrease r toward the chaotic regime. Then the graph in Fig-
ure 10.4.1 changes shape-the hills move down and the valleys rise up. The curve
therefore pulls away from the diagonal. Figure 10.4.2 shows that when r = 3.8 , the
six marked intersections have vanished. Hence, for some intermediate value be-
tween r = 3.8 and r = 3.835, the graph of f 3(x) must have become tangent to the
diagonal. At this critical value of r, the stable and unstable period-3 cycles coa-
lesce and annihilate in a tangent biJurcation. This transition defines the beginning
of the periodic window.
One can show analytically that the value of r at the tangent bifurcation is
1 + & = 3.8284. . . (Myrberg 1958). This beautiful result is often mentioned in
1 textbooks and articles-but always without proof. Given the resemblance of this
I result to the 1 + & encountered in Example 10.3.3, I'd always assumed it should
be comparably easy to derive, and once assigned it as a routine homework prob-
lem. Oops! It turns out to be a bear. See Exercise 10.4.10 for hints, and Saha and
Strogatz (1994) for Partha Saha's solution, the most elementary one my class
For r just below the period-3 window, the system exhibits an interesting kind
of chaos. Figure 10.4.3 shows a typical orbit for r = 3.8282.
nearly
period-3 chaos
0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
0 50 100 150
n
Figure 10.4.3
Part of the orbit looks like a stable 3-cycle, as indicated by the black dots. But this
is spooky since the 3-cycle no longer exists! We're seeing theghost of the 3-cycle.
Figure 10.4.4
In Figure 10.4.4a, notice the three narrow channels between the diagonal and the
graph of f 3(x). These channels were formed in the aftermath of the tangent bifur-
cation, as the hills and valleys of f (x) pulled away from the diagonal. Now focus
on the channel in the small box of Figure 10.4.4a, enlarged in Figure 10.4.4b. The
orbit takes many iterations to squeeze through the channel. Hence f 3(x,) = x, dur-
ing the passage, and so the orbit looks like a 3-cycle; this explains why we see a
ghost.
Eventually, the orbit escapes from the channel. Then it bounces around chaoti-
cally until fate sends it back into a channel at some unpredictable later time and
place.
Intermittency is not just a curiosity of the logistic map. It arises commonly in
systems where the transition from periodic to chaotic behavior takes place by a
saddle-node bifurcation of cycles. For instance, Exercise 10.4.8 shows that inter-
mittency can occur in the Lorenz equations. (In fact, it was discovered there; see
Pomeau and Manneville 1980).
In experimental systems, intermittency appears as nearly periodic motion inter-
rupted by occasional irregular bursts. The time between bursts is statistically dis-
tributed, much like a random variable, even though the system is completely
deterministic. As the control parameter is moved farther away from the periodic
window, the bursts become more frequent until the system is fully chaotic. This
progression is known as the intermittency route to chaos.
364 ONE-DIMENSIONAL M A P S
Figure 10.4.5 shows an experimental example of the intermittency route to
chaos in a laser.
Time ( p s )
The intensity of the emitted laser light is plotted as a function of time. In the lowest
panel of Figure 10.4.5, the laser is pulsing periodically. A bifurcation to intermit-
tency occurs as the system's control parameter (the tilt of the mirror in the laser
cavity) is varied. Moving from bottom to top of Figure 10.4.5, we see that the
chaotic bursts occur increasingly often.
For a nice review of intermittency in fluids and chemical reactions, see Berg6 et
al. (1984). Those authors also review two other types of intermittency (the kind
considered here is Type I intermittency) and give a much more detailed treatment
of intermittency in general.
where we've taken the limit 6, -+ 0 in the last step. The term inside the logarithm
can be expanded by the chain rule:
(We've already seen this formula in Example 9.4.1, where it was derived by heuristic
reasoning about multipliers, and in Example 10.3.3, for the special case n = 2.) Hence