32 LevyStableDistributions
32 LevyStableDistributions
1 Introduction
Stable distributions are a fascinating and fruitful area of research in probability
theory; furthermore, nowadays, they provide valuable models in physics,
astronomy, economics, and communication theory, see e.g. .......
The general class of stable distributions was introduced and given this
name by the French mathematician Paul Lévy in the early 1920’s, see Lévy
(1923,1924,1925).
Formerly, the topic attracted only moderate attention from the leading
experts, though there were also enthusiasts, of whom the Russian mathemati-
cian Alexander Yakovlevich Khintchine should be mentioned first of all. The
inspiration for Lévy was the desire to generalize the celebrated Central Limit
Theorem, according to which any probability distribution with finite variance
belongs to the domain of attraction of the Gaussian distribution. The concept
of stable distributions took full shape in 1937 with the appearance of Lévy’s
monograph [63], soon followed by Khintchine’s monograph [46]2 .
1
LaTeX file fm− stable-new.tex
2
Nowadays F. Mainardi and S. Rogosin, with the aim of reevaluating the work of
Khintchine on limit theorems of sums of independent variables (not necessarily identically
distributed), are planning to translate into English (from the Russian, Italian, German and
French) the relevant papers by Khintchine and also a number of related papers by De Finetti,
2
general, the sum of i.i.d. random variables becomes a random variable with
a distribution of different form. However, for independent random variables
with a common stable distribution, the sum obeys to a distribution of the same
type, which differs from the original one only for a scaling (cn ) and possibly
for a shift (dn ). When in (A.1) the dn = 0 the distribution is called strictly
stable.
It is known, see [20], that the norming constants in (2.1) are of the form
and !
1 1 x
PC (x; γ, 0) = + arctan , x ∈ R. (2.5b)
2 π γ
3 Domain of attraction
Another (equivalent) definition states that stable distributions are the only
distributions that can be obtained as limits of normalized sums of i.i.d. random
variables. A random variable X is said to have a domain of attraction,i.e.
if there is a sequence of i.i.d. random variables Y1 , Y2 , . . . and sequences of
positive numbers {γn } and real numbers {δn }, such that
Y1 + Y2 + . . . Yn d
+ δn ⇒X . (3.1)
γn
d
The notation ⇒ denotes convergence in distribution.
If the random variable X has a stable distribution and all Yi are taken to
be independent and distributed like X , then clearly (2.1) implies (3.1), and
so trivially every random variable with a stable probability distribution has a
domain of attraction. The converse is also true, namely that every random
variable with a domain of attraction has a stable probability distribution, see
[26]. Therefore we can alternatively state that a random variable X is said to
have a stable distribution if it has a domain of attraction.
When X is Gaussian and the Yi′ s are i.i.d. with finite variance, then (3.1)
is the statement of the ordinary Central Limit Theorem. The domain of
attraction of X is said normal when γn = n1/α ; in general, γn = n1/α h(n)
where h(x) , x > 0 , is a slow varying function at infinity3 The function
h(x) = ln x , for example, is slowly varying at infinity: it enters in a general
3
Definition: We call a (measurable) positive function a(y), defined in a right
neighbourhood of zero, slowly varying at zero if a(cy)/a(y) → 1 with y → 0 for every
c > 0. We call a (measurable) positive function b(y), defined in a neighbourhood of infinity,
slowly varying at infinity if b(cy)/a(y) → 1 with y → ∞ for every c > 0. Examples: (log y)γ
with γ ∈ R and exp (log y/log log y).
5
theorem on the domain of attraction of the Gaussian law for distributions with
infinite variance (in particular densities decaying as |x|−3 ), as formerly shown
independently by Khintchine, Lévy and Feller, see e.g. [46, 26, 20].
1
θ
0.5
0 2
0.5 1 1.5
−0.5
α
−1
points (0, 0) , (1, 1) , (2, 0) , (1, −1) , that was formerly depicted in Takayasu’s
book, see Fig. 1. Honouring both Feller and Takayasu, we call the described
region the Feller-Takayasu diamond.
We note that in his original and pioneering paper [19], Feller used a
skewness parameter δ different from our θ ; in fact his characteristic function
turns out to be
α
2 π θ
p̂Fα (κ; δ) := exp − |κ| e −i (sign κ) δ , so δ = −
θ = − αδ . ,
π 2 α
(4.5)
In his two books [92, 90] Zolotarev used a notation which is confusing and
misleading due to irritating misprints: as matter of fact one can recognizes that
two different canonic forms are used for strictly stable distributions, namely
exp −|κ| e −i(sign κ) δ1 α π/2 ,
α
A quick check shows that θ∗ falls within the prescribed range, |θ∗ | ≤ α ,
provided that |θ| ≤ 2 − 1/α .
Stable distributions with extremal values of the skewness parameter are
called extremal. One can prove that all the extremal stable distributions with
0 < α < 1 are one-sided, the support being R+ −
0 if θ = −α , and R0 if θ = +α .
For 0 < α < 2 the stable distributions exhibit heavy tails in such a way
that their absolute moment of order ν is finite only if ν < α . In fact one can
show that for non-Gaussian, not extremal, stable distributions the asymptotic
decay of the tails is
pα (x; θ) = O |x|−(α+1) , x → ±∞ . (4.8)
For the extremal distributions this is valid only for one tail, the other being
of exponential order. For 0 < α < 1 we have one-sided distributions which
exhibit an exponential left tail (as x → 0+ ) if θ = −α , or an exponential right
tail (as x → 0− ) if θ = +α . For 1 < α < 2 the extremal distributions are
two-sided and exhibit an exponential left tail (as x → −∞) if θ = +(2 − α) ,
or an exponential right tail (as x → +∞) if θ = −(2 − α) .
Consequently, the Gaussian distribution is the unique stable distribution
with finite variance. Furthermore, when α ≤ 1 , the first absolute moment
h|X|i is infinite as well, so we need to use the median to characterize the
expected value.
However, there is a fundamental property shared by all the stable
distributions that we like to point out: for any α the corresponding stable
pdf is unimodal and indeed bell-shaped, i.e. its n-th derivative has exactly n
zeros, see Gawronski (1984).
From Lévy’s times it is usual to adopt a more general canonical form for
stable distributions that takes into account of a scale parameter γ > 0, of a
shift parameter δ ∈ R in addition to a skewness parameter β ∈ R restricted to
be |β| ≤ 1. For this class of stable distributions, partly following the notation
of Samorodnitsky & Taqqu (1994) and denoting by Y the random variable, we
write Y ∼ Qα (y; β, γ, δ) with characteristic function
where
tan (α π/2) , if α 6= 1 ,
ω(|κ|, α) = (4.10)
−(2/π) ln |κ| , if α = 1.
Consequently a random variable Y is said to have a stable distribution if there
are four real parameters α, β, γ, δ with 0 < α ≤ 2 , −1 ≤ β ≤ +1 , γ > 0 , such
8
that its characteristic function has the canonical form (4.9)-(4.11). We note
that the parameter β appears with different signs for α 6= 1 and α = 1 . This
minor point has been the source of great confusion in the literature, see Hall
(1980) for a discussion. The presence of the logarithm for α = 1 is the source
of many difficulties, so this case has often to be treated separately.
An interesting problem is related to the inclusion of the canonical form
(4.3)-(4.4), which is valid only for strictly stable distributions in the more
general canonical form (4.9)-(4.10) We first note that the two parameters γ and
δ in (4.9), being related to a scale transformation and a translation respectively,
are not so essential since they do not change the shape of the distribution. If
we take γ = 1 and δ = 0 , we obtain the so-called standardized form of the
stable distribution and the corresponding random variable Y ∼ Pα (y; β, 1, 0) is
referred to as the α-stable standardized random variable. On the other hand,
keeping δ = 0, we can choose the scale parameter γ in such a way to get the
simplified canonical form for strictly stable distributions. As a matter of fact
the relation between the two classes X and Y for stable random variables can
be explored if we compare the corresponding canonical forms not only keeping
δ = 0 but also assuming α 6= 1, as shown below.
We easily recognize
π π π
γ α = cos θ , tan θ = β tan α , (4.11)
2 2 2
so the case α = 1 must be excluded. Thus, the Feller-Takayasu canonical
form for strictly stable distributions with index α 6= 1 and skewness θ , can
be obtained from the Lévy canonical form if we (implicitly) select the shift
parameter δ = 0, and the scale parameter γ and the skewness parameter β
related to α and θ according to (4.11). We note that necessarily 0 < γ ≤ 1. We
also note that for α = 1 we have identity between the two canonical forms in
the limiting case θ = β = 0 corresponding to the (symmetric) Cauchy-Lorentz
pdf . By the way for α = 1 with δ = 0 and β 6= 0 the general Lévy canonical
form yields not strictly stable distributions.
Specifically, the random variable X ∼ Pα (x; θ) turns out to be related to
the standardized random variable Y ∼ Qα (y; β, 1, 0) by the relations:
X = Y /γ , qα (y; β, 1, 0) = γ pα (x = γy; θ) , (4.12)
with
γ = [cos (θπ/2)]1/α , (4.13)
and
tan (θπ/2)
θ = (2/π) arctan [β tan (απ/2)] , β= . (4.14)
tan (απ/2)
9
We note that for the symmetric stable distributions we get the identity between
the standardized and the Lévy canonical forms, since in (4.14) β = θ = 0
implies in (4.13) γ = 1 . A particular but noteworthy case is provided
by p2 (x; 0) = q2 (y; 0, 1, 0) corresponding to the Gaussian distribution with
variance σ 2 = 2 . The identity is valid also in the limit for α = 1, for which
p1 (x; 0) = q1 (y; 0, 1, 0) corresponding to the Cauchy-Lorentz distribution with
semi-interquartile γ = 1 .
The extremal stable distributions corresponding to β = ±1 and α 6= 1 are
obtained in the Feller-Takayasu representation for θ = ±α if 0 < α < 1 , and
for θ = ∓(2 − α) if 1 < α < 2 . For these cases, the scaling parameter turns
out to be γ = [cos (|α| π/2)]1/α .
It may be an instructive exercise to carry out the inversion of the Fourier
transform when α = 1/2 and θ = −1/2 . In this case we obtain the analytical
expression for the corresponding extremal stable pdf , known as the (one-sided)
Lévy-Smirnov density,
1
p1/2 (x; −1/2) = √ x−3/2 e−1/(4x) , x ≥ 0. (4.15)
2 π
References
[1] R. Bartels, Generating non-normal stable variates using limit theorems
properties, J. Stat. Comp. Simulation 7 (1978) 199–212.
[2] J.-P. Bouchaud and M. Potters, Theory of Financial Risk: from Statistical
Physics to Risk Management, (Cambridge Univ. Press, Cambridge, 2000.
[English enlarged version of Théories des Risques Financiers, CEA, Aléa, Saclay, 1997.]
[10] A.R. Dabrowski and A. Jakubowski, Stable limits for associated random
variables, The Annals of Probability ?? (1993-94) to appear?
[Quoted by Samorodnitsky-Taqqu book (1994)]
[11] R.A. Davis, Stable limits for partial sums of dependent random variables,
The Annals of Probability 11 (1983) 262-269.
[Quoted by Samorodnitsky-Taqqu book (1994)]
[12] G.C. De Vries, On the relation between GARCH and stable processes, J.
Econometrics 48 No 3 (1991) 313–324.
[Quoted by SHIRYAEV]
11
[21] Y. Fujita, Cauchy problems of fractional order and stable processes, Japan
J. Appl. Math. 7 No 3 (1990) 459-476.
[26] B.V. Gnedenko and A.N. Kolmogorov, Limit Distributions for Sums of
Independent Random Variables, Addison-Wesley, Cambridge Mass., 1954.
[English Transl. from the Russian edition (1949), with notes by K.L.
Chung, revised (1968)]
[38] P. Hall, A comedy of errors: the canonical form for a stable characteristic
function, Bull. London Math. Soc. 13 (1980), 23-27.
[41] D.R. Holt and E.L Crow,. : Tables and graphs of the stable probability
density functions, J. Res. Nat. Bureau Standards 77B (1973) 143-198.
[42] I. Ibragimov and K.E. Cernin, On the unimodality of stable laws, Theor.
Prob. and its Appl. 4 No. 4 (1961) 417-419
[Quoted in Shiryaev’s book on Stochastic Finance]
[45] J-P. Kahane, Definition of stable laws, infinitely divisible laws, and Lévy
processes, in: M.F. Shlesinger, G.M. Zaslavsky and U. Frisch (Editors),
Lévy Flights and Related Topics in Physics, (Springer Verlag, Berlin,
1995), pp. 99-109 [Lecture Notes in Physics, No 450]
[47] A. Ya. Khintchine and P. Lévy, Sur le lois stables, C.R. Acad. Sci Paris
202 (1937) 374-376.
[48] L.B. Klebanov, G.M. Maniya and I.A. Melamed, A problem of Zolotarev
and analogs of infinitely divisible and stable distributions in a scheme or
summing a random number of random variables, Theory Prob. Appl. 29
(1984) 791–794. [quoted by Erdogan, 1999 and Pillai, 1990]
[52] R.G. Laha. and V.K. Rohatgi, Probability Theory, Wiley, New York, 1979.
[53] J.W. Lamperti, Semi-stable stochastic processes, Trans. Amer. Math. Soc.
104 (1962) 62-78.
[57] P. Lévy, Sur le rôle de la loi de Gauss dans la théorie des erreurs,
C.R. Acad. Sci. Paris, 174 (1922), 855-857. (Séance du 27 mars 1922).
[Reprinted in Oeuvres de Paul Lévy edited by D. Dugué, Vol 3 (Eléments
aléatoires) No 88 pp. 9-11, Gauthier-Villars, Paris, 1976).
[58] P. Lévy, Sur une application de la la dérivée d’ordre non entier au calcul
des probabilités, C.R. Acad. Sci. Paris, 176 (1923) 1118-1120 (Séance du
23 avril 1923). [Reprinted in Oeuvres de Paul Lévy edited by D. Dugué
Vol 3 (Eléments aléatoires) No 115 pp. 339-341, Gauthier-Villars, Paris,
1976.]
[59] P. Lévy, Sur les lois stables en calcul des probabilités, Compt. Rendus
Acad. Sci. Paris 176 (1923), 1284-1286. (Séance du ?? ??l 1923).
[Reprinted in Oeuvres de Paul Lévy edited by D. Dugué, Vol 3 (Eléments
aléatoires) No 116 pp. 342-344, Gauthier-Villars, Paris, 1976.]
[60] P. Lévy, Théorie des erreurs. La Loi de Gauss et les lois exceptionelles,
Bull. Soc. Math. France 52 (1924) 49-85. [Premiere Partie: La loi de
Gauss, pp. 49-68, §1-9] [Seconde Partie: Les lois exceptionnelles, pp. 68-
84, §10-15] [Reprinted in Oeuvres de Paul Lévy edited by D. Dugué, Vol
3 (Eléments aléatoires) No 90 pp. 14-49, Gauthier-Villars, Paris, 1976.]
[63] P. Lévy, Théorie de l’addition des variables aléatoires, 2nd Edn, Gauthier-
Villars, Paris, 1954. [1st Edn (1937)] [Reprinted in 2003 by Editions
Jaques Gabay (Les Grands Classiques Gauthier-Villars)]
16
[64] P. Lévy, Remarques sur un probleme relatif aux lois stables, Studies
in Math. Anal. and Related Topics (Essays in Honor of George
Pólya) Stanford Univ. Press, Stanford, California (1962), pp. 211-218.
[Reprinted in Oeuvres de Paul Lévy edited by D. Dugué, Vol 4 (Processus
stochastiques) No 170bis pp.410-???. Gauthier-Villars, Paris, 1980.]
[quoted by ZOLOTAREV’s book on Stable Distributions, ref 52]
[65] E. Lukacs, Characteristic Functions, 2nd edn, Griffin, London 1970. [1st
edn, 1960]
[66] S. Lung and F.J. Molz, How well are hydraulic conductivity variations
approximated by additive stable processes? Advances in Environmental
research 5 (2001) 39-45. [X]
[67] E. Lutz, Fractional transport equations for Lévy stable processes, Phys.
Rev. Lett. 86 No 11 (2001) 2208-2211
[74] B.B. Mandelbrot. and F. Zarnfaller Five place tables of certain stable
distributions, Technical Report RC-421, IBM Thomas J. Watson Research
Center, Yorktown Heights, New York, Dec 31, 1959.
[75] R.N. Mantegna, Fast, accurate algorithm for numerical simulation of Lévy
stable stochastic processes, Phys. Rev. E 49 (1994) 4677–4683.
[80] E.W. Montroll and M.F. Shlesinger, On the wonderful world of random
walks, in: J. Leibowitz and E.W. Montroll, eds., Nonequilibrium
Phenomena II: from Stochastics to Hydrodynamics (North-Holland,
Amsterdam, 1984), pp. 1-121.