04 Exponential Poisson
04 Exponential Poisson
S in t a R S u lis t yo
s in t a .s ulis tyo @ugm.a c.id
Last Lecture
o Unconditional Probability
o Classification of States
o Long Run Behavior of DTMC
Outline
o Cost Calculation
o Exponential Distribution
o Poisson Process
Cost Calculation
Example
=
0 0.7
1 0.4
0
1
0.3
0.6
0 = 4/7
1 = 3/7
= 0,1
Assume is a DTMC with transition probability matrix
When up, machine makes nothing w.p 0.1, 1 item w.p 0.3, and 2
items w.p 0.6. Each item can be sold for $ 200. Operating cost per
day $50 only if the machine is up. When down, repair costs $ 100
per day. Expected cost per repair is $ 80.
How much is the L-R average daily profit?
Exponential Distribution
Exponential Distribution
~()
~()
is a continuous RV
Probability Density Function (PDF)
=
0
0
<0
= =
= 1/
= 1/2
0
otherwise
Properties of Exponential
Property 1: memoryless property
~ ()
, 0
> + , >
> + > } =
== >
>
Example
The amount of time a person spends in a bank is exponentially
distributed with mean 10 minutes.
a.
Properties of Exponential
Property 2: minimum of some exponential RVs
1 , 2 , are independent
~ ( )
= min
~ (
=1 )
= 1,2, ,
Properties of Exponential
Property 3: sum of some exponential RVs
1 , 2 , independent
~ ()
=
= 1,2, ,
=1
~ ,
Erlang Distribution
~ Erlang (, )
1
=
1 !
0
1
=1
=0
= /
= /2
0
<0
0
Example
The lifetime of an electronic tube is exponentially distributed with
mean 1,000 hours. There are three of these tubes (original and 2
spares). When one burns out, it is replaced by a spare.
What is the expected amount of time Y until the last spare burns
out?
Properties of Exponential
Property 4: between two exponential RVs
~
~ ()
< =
+
= =0
> =
+
Example
Suppose a stereo system consists of two main parts, a radio and a
speaker. If the lifetime of the radio is exponential with mean 1000
hours and the lifetime of the speaker is exponential with mean
500 hours, independent of the radios lifetime, then
What is the probability that the systems failure (when it occurs)
will be caused by the radio failing?
Counting Process
Counting Process
{ } is a counting process if () is the number of events by time
>
= increment from to
= number of events in (, ]
0 =0
Poisson Distribution
A Poisson () RV is discrete with PMF
= =
=
=
0,1,2,
otherwise
Example
The arrival of customers at a caf is a Poisson process with rate 4
per minute. Find the probability that there is no less than 3 arrivals
between time (0,2] (the first two minutes)!
Inter-arrival Time
()
=1
~ (, )
Note that,
=
= = 1 < = 1
=1
1
=0
= = 1
1
=0 {
=0 !
= }
Example
Suppose that people immigrate into a territory at a Poisson rate
=1 per day.
a.
Next Lecture
o a little bit more on Poisson Process
o Semi Markov Processes
o Continuous Time Markov Chain
Question?
thankyou
Acknowledgement:
Prof. Sigrn Andradttir