EISTI - Departement of Mathematics Q.F.R.M. M1 2014-15 An Introduction To Measure and Integration
EISTI - Departement of Mathematics Q.F.R.M. M1 2014-15 An Introduction To Measure and Integration
Q.F.R.M. M1 2014-15
An Introduction to
MEASURE and INTEGRATION
by Marietta Manolessou
1 Measures 1
1 σ-fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1 Algebra . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
2 σ-Field (or σ-Algebra) . . . . . . . . . . . . . . . . . . . . . 1
2 Measurable sets - Measurable mappings - Measures . . . . . . . . . . 2
1 Measurable sets and functions . . . . . . . . . . . . . . . . . 2
2 Properties of measurable functions . . . . . . . . . . . . . . . 3
3 Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
4 Subsets of zero measure . . . . . . . . . . . . . . . . . . . . 6
5 Measure absolutely continuous with respect to another one . . 7
4 Product spaces
Product measures
Fubini theorem 21
iii
5 Probability Spaces L1 , L2 23
1 L1 , L2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
1 L2 Hilbert space . . . . . . . . . . . . . . . . . . . . . . . . 23
2 The theorem of Orthogonal Projection . . . . . . . . . . . . . 24
2 How to define a measure from the integral of a measurable function
(Reciprocal of the Radon-Nicodym theorem.) . . . . . . . . . . . . . 25
3 Theorem of Radon - Nikodym . . . . . . . . . . . . . . . . . . . . . 25
List of Figures
k
k2 −1
X j j j+1
2.1 For k = 3 (shaded): Vn x| ≤ f (x) ≤ . . . . . . 10
j=0
2k 2k 2k
2.2 Even if f (x) is piecewise continuous, the Lebesgue integral can be defined
(an impossible operation in the sense of Riemann). . . . . . . . . . . . . . 11
v
Chapter 1
Measures
1 σ-fields
1 Algebra
Definition 1.1 Let Ω be a set. An Algebra A on Ω is a family of subsets of Ω that
verify the following properties:
i) Ω and the empty set ∅ belong to A
ii) If A ∈ A then AC ∈ A (stability by complementarity)
iii) If A and B ∈ A then (A ∩ B) ∈ A
Example of algebra on R
We define the algebra A(R) on Ω = R, by the family of finite unions of intervals (of
all types) of R :
[a, b], ]a, b[, [a, b[, ]a, b], ] − ∞, a[, [b, +∞[, ]b, +∞[.
1
2 EISTI - QFRM M1 (2014-15) a course by M.Manolessou
Exercise 1.1
Show that F is stable by a countable intersection.
Example 1.1
The set P of all subsets of Ω is obviously an example of σ-algebra.
b) Let (Ω, F) be a measurable space and (Y, TY ) a topological space (cf. the first
chapter of Topology). A mapping f : Ω → Y is measurable if the inverse image
by f of every open set A ∈ OY of Y (where OY ≡ the family of open sets of TY )
is a measurable set, i.e.
if ∀ A ∈ OY ⇒ f −1 (A) ∈ F
3.1 Let F = P be the example 1.1 (the set of all subsets of Ω), and let (Y, TY ) be a
topological space.
Every function f : Ω → Y is a measurable function with respect to P.
σ-fields (algebras)- Measurable sets and mappings - Measures 3
Remark 1.1
We verify (in a way analogous to that used for B(R)) that the corresponding Borel
σ-algebras of R2 , R3 etc., may be generated by the associated open sets: rectangles,
parallelepipeds etc.
i) Let X, Y and Z be three measurable spaces and let f and g be two measurable
f g
mappings from X to Y and from Y to Z : X −
→Y −
→Z
ii) Let (Ω, F) be a measurable space, and let us consider two numerical measurable
functions u and v.
Ω → R×R
⇒ the mapping f : is a measurable function
x → (u(x), v(x))
3 Measures
In the following we use the notation R̄ for the “completed interval”: [−∞, +∞] and
R̄+ for the interval [0, +∞].
Definition 1.4
Let (Ω, F ) be a measurable space. We say that the following mapping:
µ : F → R̄+
Remarks 1.1
One can show that these measures verify the following properties:
i) µ(∅) = 0
σ-fields (algebras)- Measurable sets and mappings - Measures 5
N
P
ii) µ(A1 ∪ A2 ∪ . . . AN ) = µ(Ai ) (with: (Ai ∩ Aj = ∅ ∀i 6= j))
i=1
v) If A1 ⊇ A2 ⊇ . . .⊇ An and
µ(A1 ) 6= ∞ (Ai are measurable sets)
∞
T
lim µ(An ) = µ An (decreasing intersection continuity)
n→∞ n=1
Moreover:
µ(A1 − A) = µ(A1 ) − µ(A) (1.5)
and again from the property ii) : (A1 ∩ Ac ) ∩ A = ∅ and(A1 ∩ Ac ) ∪ A = A1 so,
µ(A1 ) = µ(A1 − A) + µ(A).
6 EISTI - QFRM M1 (2014-15) a course by M.Manolessou
µ(A) = 0.
σ-fields (algebras)- Measurable sets and mappings - Measures 7
One easily verifies that the countable union of zero measure sets is also a zero
measure set.
⇔ f =g a.e.
µ(A) = 0 ⇒ ν(A) = 0
⇔ ν is dominated by µ ⇔ ν ≺≺ µ.
Lemma
If ν is finite then ν ≺≺ µ iff ∀ > 0 ∃ a δ which verifies
ν ≺≺ µ
{ }
µ ≺≺ ν
8 EISTI - QFRM M1 (2014-15) a course by M.Manolessou
Chapter 2
1 Motivation
When the Riemann integral is applied in a more general context than physics, for ex-
ample in the theory of Probabilities and Stochastic Processes, we very often encounter
some technical difficulties due to different reasons, for instance:
• The convergence of some types of integrals having as upper or lower bounds “ill
defined ” points for the integrand function (example: −∞, +∞).
• The integral itself is not well defined in the sense of Riemann or
• we cannot define it if the integrated function has some discontinuities.
f : Rn → R
9
10 EISTI - QFRM M1 (2014-15) a course by M.Manolessou
by:
k
Z k2 −1
X j j j+1
f (x)dx = lim Vn x| k ≤ f (x) ≤ k (2.1)
Rn k→+∞
j=0
2k 2 2
k
k2 −1
X j j j+1
Figure 2.1: For k = 3 (shaded): Vn x| ≤ f (x) ≤
j=0
2k 2k 2k
For n = 1 and k = 3, we give the figures 2.1 and 2.2 adapted from [5] (cf. for a
concrete representation of this definition).
Remark 2.1
The Lebesgue Integral 11
Figure 2.2: Even if f (x) is piecewise continuous, the Lebesgue integral can be defined (an
impossible operation in the sense of Riemann).
In the case of the Riemann integral we had to realize an infinite partition on the
Ox axis; but in the present case of the Lebesgue integral, we consider an infinite
subdivision of the Oy axis.
When the function is continuous on the considered interval (thus with the Rie-
mann integral being well defined), the two integrals are identical.
Definition 2.3
Let (X, F) be a mesurable space and let g be a step function.
We consider the following subsets of X:
Ei = {x ∈ X : g(x) = αi } .
Here αi , ∀i = 1, 2, . . . , .n are the different discrete values of the step function g. We
then can write:
X n
g= αi χEi
i=1
χEi is the index function corresponding to the subset Ei
We can easily prove the following:
Proposition 2.1
A step function g defined on (X, F) is measurable iff the subsets Ei are measur-
able:
⇔ iff Ei ∈ F ∀i = 1, 2, . . . , n
2
Theorem 2.1 (Approximation of a measurable function by a increasing sequence of step functions)
(i) 0 ≤ g1 ≤ g2 . . . ≤ gn · · · ≤ f
(ii) ∀x ∈ X, lim gn (x) = f (x)
n→∞
The Lebesgue Integral 13
Remark 2.2
(Attention !) Reminder of the convention: 0 × ∞ = 0; , Because it could happen
for example that αi = 0 for some i, but µ(Ei ∩ A) = ∞ .
• 1’. If f (x) = 0 ∀x ∈ E,
Z
⇒ f dµ = 0 even if µ(E) = ∞
E
• 2. If µ(E) = 0 Z
⇒ gdµ = 0
E
• 2’. If µ(E) = 0
Z
⇒ f dµ = 0, even if f (x) = ∞ ∀x ∈ E
E
(b) Monotonicity
• 3. If 0 ≤ g1 ≤ g2 on E
Z Z
⇒ g1 dµ ≤ g2 dµ
E E
• 3’. If 0 ≤ f1 ≤ f2 on E
Z Z
⇒ f1 dµ ≤ f2 dµ
E E
• 4’. If A ⊆ B Z Z
⇒ f dµ ≤ f dµ
A B
• 5. If A ∩ B = ∅
Z Z Z
⇒ gdµ = gdµ + gdµ
A∪B A B
• 5’. If A ∩ B = ∅
Z Z Z
⇒ f dµ = f dµ + f dµ
A∪B A B
The Lebesgue Integral 15
• 6. ∀E ∈ F Z Z
⇒ gdµ = g χE dµ
E X
• 6’. ∀E ∈ F Z Z
⇒ f dµ = f χE dµ
E X
• 8’. If c ∈ R̄+
Z Z
⇒ cf dµ = c f dµ
E E
• 9 Z Z Z
(g1 + g2 )dµ = g1 dµ + g2 dµ
E E E
4 The Lp spaces
Definition 2.6
Let us consider the measured space (endowed with the Lebesgue measure µ = dx),
(Rn , B(Rn ), µ). We say that a function f : Rn → R is integrable with respect to
Lebesgue or that it is a Lebesgue integrable function, if the integral of |f | in the sense
of the previous definition 2.5 is well defined:
Z
⇔ |f (x)|dx < ∞ (2.2)
Rn
More generally for 1 ≤ p < ∞, the vector space of all p-Lebesgue integrable
functions is denoted by Lp ;
Z
p
i.e. f ∈ L means that: |f |p dx < ∞
Rn
We present here three of the most important theorems relative to Lebesgue integration.
One of the most important applications of Fatou’s Lemma is the proof of Lebesgue
Dominated Convergence, that we present below for the case X = Rn .
17
18 EISTI - QFRM M1 (2014-15) a course by M.Manolessou
⇒
the function f defined by: f (x) = lim fn (x) is measurable and we have:
n→+∞
Z Z
lim fn dx = f dx (3.1)
n→+∞ E E
∀ n = 1, 2, . . . |fn | ≤ g,
∀ n = 1, 2, . . . |fn | ≤ g, µ − a.e.
⇒
the functions fn and f belong to Lp and the sequence {fn }n=1,2... converges to f
µ-a.e.
The Lebesgue theorems 19
Theorem 3.6
∀ p : 1 ≤ p < ∞, Lp is a Banach space in the topology induced by the norm of
definition 2.3 .
1
kfn − fni kp ≤ (3.3)
2i
We show that the subsequence {fni }i≥0 converges µ-a.e. in Lp to the function f .
Reminder: for a Cauchy sequence to be convergent inside a metric space it is
sufficient for one of its subsequences to converge inside this space. We write:
k
X
fnk = fn0 + (fni − fni−1 ) (3.4)
i=1
but
k
X
f nk − f n0 = (fni+1 − fni ) = Sk (partial sum of a series)
i=0
Let us define:
k
X
gk = |fni − fni−1 |. (3.5)
i=1
⇒ kgkp ≤ 2
⇒ g finite (µ-a.e.) and,
lim Sk = g (absolutely)
k→∞
For n ≥ ni we have
1
kf − fn kp ≤ kf − fni kp + kfni − fn kp ≤ kf − fni kp +
2i
1
⇒ ∀ i, lim sup kf − fn kp ≤ kf − fni kp +
n→∞ 2i
(3.8)
1
and with i → ∞ →0
2i
⇒ lim sup kf − fn kp = 0
n→∞
Chapter 4
Product spaces
Product measures
Fubini theorem
µ(E) = µ(A)
Definition 4.2
Let (X, F, µ) and (Y, F, ν) be two measured spaces endowed with complete mea-
sures µ and nu respectively.
On the product space X × Y , we consider the family of subsets of the form A × B
with A ∈ FX , B ∈ FY (called measurable pavers) and we define a function of subsets
on this family by:
λ(A × B) = µ(A)ν(B)
We can show that λ can be extended to a “complete measure” denoted by µ × ν on the
“completed” σ-algebra generated in X × Y by the “measurable pavers” A × B and
denoted by FX × FY .
21
22 EISTI- QFRM.M1-(2014-15)- Measures Integration- by M.Manolessou
Proposition 4.1
Let (X × Y, FX × FY ) be a measurable product space and let E ∈ FX × FY of
finite measure, then:
• a)
is integrable on Y (resp. on X)
c) Z Z Z Z Z
fy dµ dν = f d(µ × ν) = fx dν dµ
Y X X×Y X Y
Usual notation:
Z Z
f dµdν instead of f d(µ × ν).
X×Y X×Y
Chapter 5
1 L1 , L2
L1 ≡ Vector space of random variables which are integrable in the sense of Lebesgue:
Z
E[|X|] = |xf (x)|dx < +∞
X : (Ω, A, P ) → R
Z
E[X 2 ] = x2 fX (x)dx < +∞
1 L2 Hilbert space
Scalar Product
Definition 5.1 Let (Ω, A, P ) a probability space
Let (X, Y ) ∈ L2 × L2 (couple of random variables defined on (Ω, A, P )2 ). We in-
troduce the scalar product on L2 ×L2 by the following positive definite non degenerate
symmetrical bilinear form:
(moment of order 2)
Remark 5.1 A random variable X which has a finite norm is called of order 2.
23
24 EISTI- QFRM.M1-(2014-15)- Measures Integration- by M.Manolessou
Proposition 5.1
Let (Ω, A, P ) be a probability space.
(i) L2 endowed with the distance associated with the norm (N.O) is complete.
⇔
it is a Hilbert space (and Banach space).
(ii) The set of all centered random variables (⇔ E[X] = 0) on Ω is a subset of L2
denoted by H0
⇐⇒ ∀ X ∈ H0 , E[X] = 0
(iii)
∀ (X, Y ) ∈ H0 × H0 , Cov(X, Y ) = hX, Y i = E[X · Y ]
and
hX, Y i
Corr. (X, Y ) =
kXkkY k
⇒
E[E[X|F ]|F ] = E[E[X|F 00 ]|F 0 ] = E[X|F 0 ]
0 00
Theorem 5.3
Let (X, F, µ) be a measured space (with µ the Lebesgue measure),
and f : (X, F, µ) → [0, +∞]
R a measurable function such that:
∀ E ∈ F, φ(E) = E f dµ
⇒ φ is a measure on F and
Remarks 5.1
• The function f is called the density of the measure φ with respect to the measure
µ.
• The equation (5.1) is usually written in the symbolic form dφ = f dµ
• For the probability spaces (Ω, F, P ), f is identified with the probability density
distribution function with respect to the probability measure P .
27