Business Statistics

Probability Distributions
 Random Variables
• Random variable is a
function that maps every
outcome in the sample
space to a real number.

• A function that assigns a

real number to each sample
point in the sample space S.

• Random variable is a robust

and convenient way of
representing the outcome
of a random experiment
 Discrete Random Variables
• If the random variable X can assume only a finite or countably infinite set of
values, then it is called a discrete random variable.
• Examples of discrete random variables are:
• Credit rating (usually classified into different categories such as low,
medium and high or using labels such as AAA, AA, A, BBB, etc.).
• Number of orders received at an e-commerce retailer which can be
countably infinite.
• Customer churn (the random variables take binary values, 1. Churn and 2.
Do not churn).
• Fraud (the random variables take binary values, 1. Fraudulent transaction
and 2. Genuine transaction).
• Any experiment that involves counting (for example, number of returns in
a day from customers of e-commerce portals such as Amazon, Flipkart;
number of customers not accepting job offers from an organization).
 Probability mass function
• For a discrete random variable,
the probability that a random
variable X taking a specific value
xi, P(X = xi), is called the
probability mass function P(xi).

• That is, a probability mass

function is a function that maps
each outcome of a random
experiment to a probability
Expected Value
• Expected value (or mean) of a discrete random
variable is given by
n
E ( X ) =  xi P( xi )
i =1

• Where xi is the specific value taken by a discrete

random variable X and P(xi) is the corresponding
probability, that is, P(X = xi).
 Variance and Standard Deviation
Variance of a discrete random variable is given by
n
Var( X ) =   xi − E ( X )  P( xi )
2

i =1

Standard deviation of a discrete random variable is given by

 = VAR (X )
Probability Density Function (pdf)
• The probability density function, f(xi), is defined as
probability that the value of random variable X lies
between an infinitesimally small interval defined by xi
and xi + x

P( xi  X  xi + x)
f ( x) = lim
x →0 x
Cumulative Distribution Function (CDF)
• The cumulative distribution function (CDF) of a
continuous random variable is defined by
a
F (a) = P( X  a) = 
−
f ( x)dx

Cumulative distribution function

Probability density function The probability between two
and cumulative distribution values a and b, P(a  X  b), is the
function of a continuous area between the values a and b
random variable satisfy the under the probability density
following properties function
f(x)  0

+
F () =  f ( x ) dx = 1
−

b
P(a  X  b) =  f ( x)dx = F (b) − F (a)
a
• The expected value of a continuous random variable,
E(X), is given by
+
E( X ) =  xf ( x)dx
−

• The variance of a continuous random variable,Var(X),

is given by

Var( X ) =   x − E ( x) 
2
f ( x)dx
−
Binomial Distribution
• A random variable X is said to follow a Binomial
distribution when
• The random variable can have only two outcomes success
and failure (also known as Bernoulli trials).
• The objective is to find the probability of getting k
successes out of n trials.
• The probability of success is p and thus the probability of
failure is (1 − p).
• The probability p is constant and does not change between
trials.
Probability Mass Function (PMF) of Binomial
Distribution
• The PMF of the Binomial distribution (probability that the
number of success will be exactly x out of n trials) is given by
n x
PMF ( x) = P ( X = x) =   p (1 − p ) n − x , 0 xn
 x
Where n
 
 x =
n!
  x!( n − x)!
Mean and Variance of Binomial Distribution
The Mean of a binomial distribution is given by:
n
n x n
Mean = E ( X ) =  x  PMF( x) =  x    p (1 − p ) n − x = np
x =0 x =0  x

The variance of a binomial distribution is given by

n n
n
Var( X ) =  ( x − E ( X ))  PMF( x) =  ( x − E ( X )) 2    p x (1 − p) n − x = np(1 − p)
2

x =0 x =0  x

If the number of trials (n) in a binomial distribution is large, then it can be approximated
by normal distribution with mean np and variance npq.
Example

Fashion Trends Online (FTO) is an e-commerce company that sells women

apparel. It is observed that about 10% of their customers return the items
purchased by them for many reasons (such as size, color, and material
mismatch). On a particular day, 20 customers purchased items from FTO.
Calculate:
(a) Probability that exactly 5 customers will return the items.
(b) Probability that a maximum of 5 customers will return the items.
(c) Probability that more than 5 customers will return the items
purchased by them.
(d) Average number of customers who are likely to return the items.
(e) The variance and the standard deviation of the number of
returns.
Solution
In this case, the value of n = 20 and p = 0.1.
(a)Probability that exactly 5 customers will return the items purchased is
 20 
P( X = 5) =    (0.1)5  (0.9)15 = 0.03192
5 
(b)Probability that a maximum of 5 customers will return the items purchased is
5  20 
P( X  5) =     (0.1) k  (0.9) 20 − k = 0.9887
k =0  k 

(c)Probability that more than 5 customers will return the product is

5  20 
P( X  5) = 1 − P( X  5) = 1 −     (0.1)k  (0.9)20− k = 1 − 0.9887 = 0.0113
k =0  k 

(d)The average number of customers who are likely to return the items is
E(X) = n × p = 20 × 0.1 = 2
(e) Variance of a binomial distribution is given by
Var(X) = n × p × (1 − p) = 20 × 0.1 × 0.9 = 1.8
and the corresponding standard deviation is 1.3416
Poisson Distribution
• Poisson distribution is used when we have to find the
probability of number of events
• The probability mass function of a Poisson distribution is given
by
e−   k
P( X = k ) = , k = 0, 1, 2, ...
k!
• where  is the rate of occurrence of the events per unit of
measurement
• Cumulative distribution function of a Poisson distribution is
given by
e−   k
k
P[ X  k ] = 
i =0 k!
• The mean and variance of a Poisson random variable are given by E( X ) = 
and Var( X ) = 

Probability mass function of a Cumulative distribution function of

Poisson random variable ( = 4). a Poisson random variable ( = 4).
Example
On average, about 20 customers per day cancel their order placed at Fashion
Trends Online. Calculate the probability that the number of cancellations on
a day is exactly 20 and the probability that the maximum number of
cancellations is 25

Solution

The probability that the number of cancellations is exactly 20 is given by

e −20 2020
P( X = 20) = = 0.0888
20!
Probability that the maximum number of cancellation will be 25 is given by
25 e−20 20k
P( X  25) =  = 0.8878
k =0 k!
Geometric Distribution
• Geometric distribution represents a random experiment in which the
random variable predicts the number of failures before the success

• The probability density function of a geometric distribution is given by

P( X = x) = P(success at xth trial) = (1 − p) x −1 p, where x = 1, 2, 3, ...

• The cumulative distribution function is given by:

F ( x) = P( X  x) = 1 − (1 − p) x
1
E( X ) =
p
• Mean and variance of a geometric distribution are given by
(1 − p)
Var( X ) =
p2
and
Probability mass function of a geometric Cumulative distribution function of a
distribution (p = 0.3). geometric distribution (p = 0.3).
Memoryless Property of Geometric Distribution
• Memoryless property is a special property of a geometric distribution in
which the conditional probability, P( X  i + j | X  i), depends only on the
value j, not on the value i. We know that

P( X  i) = 1 − P( X  i) = 1 − [1 − (1 − p)i ] = (1 − p)i
P( X  i + j  X  i) P( X  i + j ) (1 − p)i + j
P( X  i + j | X  i ) = = = = (1 − p ) j

P( X  i ) P( X  i ) (1 − p)i

• Note that, P( X  j ) = (1 − p) j Thus, P( X  i + j | X  i) = P( X  j ).

• Memoryless property is an important property that simplifies calculations

associated with conditional probabilities
Example
Local Dhaniawala (LD) is an online grocery store and has an innovative
feature which predicts whether the customer has forgotten to buy an
item which is very common among customers of grocery items. The
probability that a customer buys milk in each shopping visit is 0.2.

(a) Calculate the probability that the customer’s first purchase of milk
happens during the 5th visit.
(b) Calculate the average time between purchases of milk.
(c) If a customer has not purchased milk during the past 3 shopping
visits, what is the probability that the customer will not buy milk for
another 2 visits?
Solution
(a) Probability that the customer’s first purchase of milk happens
on 5th trip is given by
P( X = 5) = (1 − 0.2) 4  0.2 = 0.08192
(b) The average time between purchase of milk is
1 1
E( X ) = = =5
p 0.2
(c) Given that a customer has not purchased milk for the past 3
shopping visits, the probability that the customer will not buy
for another 2 visits is given by

P( X  3 + 2 | X  3) = P( X  2) = (1 − p)2 = (1 − 0.2)2 = 0.64

Parameters of Continuous Distributions
• Scale parameter: Scale parameter defines the range of the
continuous distribution. The larger the scale parameter value,
larger is the spread of the distribution.

• Shape parameter: Shape parameter defines the shape of

the probability distribution. The changes to the value of shape
parameter will change the shape of the distribution.

• Location parameter: Location parameter locates (or shifts)

the distribution on the horizontal axis.
 Uniform Distribution
Probability density function Cumulative distribution functions
0, xa
 1 x −a
 , x  [ a, b] 
f ( x) =  b − a F ( x) =  , a xb
b − a

0, otherwise 
1, xb

Mean and variance of uniform distribution are

1
E ( X ) = ( a + b) and Var( X ) = 1 (b − a)2
2 12
 Exponential Distribution
• Exponential distribution is a single parameter continuous distribution that is
traditionally used for modelling time to failure of electronic components

• The probability density function and cumulative distribution of exponential

distribution are given by

f ( x) = e−x , 0
− x
F ( x) = 1 − e

• The parameter  is the scale parameter and represents the rate of occurrence
of the event, (1/) is the mean time between events.
Probability density function of an exponential
distribution

The mean and variance of an exponential distribution are given by

1 1
E( X ) =
 and Var( X ) =
2
The expected value (1/) is the mean time between events.
Memoryless Property of Exponential Distribution
• Exponential distribution is the only continuous probability
distribution that has the memoryless property. That is ,

P( X  t + s | X  t ) = P( X  s )

P ( X  t + s  X  t ) P ( X  t + s ) e −  (t + s ) − s
P( X  t + s | X  t ) = = = − t = e
P( X  t ) P( X  t ) e
Example
The time to failure of an avionic system follows an exponential
distribution with a mean time between failures (MTBF) of 1000
hours.

(a) Calculate the probability that the system will fail before 1000
hours.
(b) Calculate the probability that it will not fail up to 2000 hours.
(c) Calculate the time by which 10% of the systems will fail (that is
calculate P10 life)
Solution
(a) The probability that the system will fail by 1000 hours is
F (1000) = 1 − et 1
− 1000
In this case  = 1/ 1000, t = 1000 so , F (1000) = 1 − e 1000 = 1 − e−1 = 0.6321

(b) The probability that the system will not 1

fail up to 2000 hours
is P( X  2000) = 1 − P( X  2000) = 1 − F (t ) = e−t = e−10002000 = e−2 = 0.1353

(c) The time by which 10% of the systems will fail is

F (t ) = 0.10  1 − e−t = 0.1 e−t = 0.9
So ,
1
t = −   ln(0.9) = −1000  ln(0.9) = 105.61

hours

That is, by 105.61 hours, 10% of items will fail.

Normal Distribution
• Normal distribution, also known as Gaussian distribution, is
one of the most popular continuous distribution in the field of
analytics especially due to its use in multiple contexts
• The probability density function and the cumulative
distribution function are given by
2
1  x − 
1 −  
f ( x) = e 2  
, −   x  +
 2
2
x 1  t − 
1 −  
F ( x) =  −   x  +
2  
e dt ,
− 2
• Here  and  are the mean and standard deviation of the
normal distribution
NORM.DIST(x, , , true) can be used for calculating the probability density
function and cumulative distribution function of a normal distribution with
mean  and standard deviation .

Probability density function of a normal Cumulative distribution function of a

distribution normal distribution.
Properties of Normal Distribution
1. Theoretical normal density functions are defined between
− and +.

2. It is a two parameter distribution, where the parameter  is

the mean (location parameter) and the parameter  is the
standard deviation (scale parameter).

3. All normal distributions have symmetrical bell shape around

mean  (thus it is also median).  is also the mode of the
normal distribution, that is,  is the mean, median as well as
the mode.
4. For any normal distribution, the areas between specific values
measured in terms of  and  are given by:
Value of Random Variable Area under the Normal Distribution (CDF)

 −   X   +  (area between one 0.6828

sigma from the mean)

 − 2  X   + 2 (area between 0.9545

two sigma from the mean)

 − 3  X   + 3 (area between 0.9973

three sigma from the mean)

5. Any linear transformation of a normal random variable is also

normal random variable. That is, if X is a normal random
variable, then the linear transformation AX + B (where A and B
are two constants) is also a normal random variable.
• If X1 and X2 are two independent normal random variables
with mean 1 and 2 and variance  2 and  22 respectively, then
X1 + X2 is also a normal distribution with mean 1 + 2 and
1

variance  2 +  2
1 2

• Sampling distribution of mean values a large sample drawn

form a population of any distribution is likely to follow a
normal distribution, this result is known as the central limit
theorem
Standard Normal Variable

• A normal random variable with mean  = 0 and  = 1 is called

the standard normal variable and usually represented by Z
• The probability density function and cumulative distribution
function of a standard normal variable are given by

z2
1 −
f ( z) = e 2
2

x2
z 1 −
F ( z) =  e 2 dz
−  2
• By using the following transformation, any normal random
variable X can be converted into a standard normal variable

X −
Z=

• The random variable X can be written in the form of a standard
normal random variable using the relationship
X=+Z
• A simple approximation of standard normal CDF is given by
Tocher (1963)
e2 kz
P( Z  z ) = F ( z ) 
1 + e 2 kz

where k = 2/

Another more accurate approximation is provided by Byrc

(2002):

 z 2
+ A z + A  −z2 / 2
P( Z  z ) = F ( z ) = 1 −  1 2 e
 2  z 3 + B z 2 + B z + 2 A 
 1 2 2
Example

According to a survey on use of smart phones in India, the smart

phone users spend 68 minutes in a day on average in sending
messages and the corresponding standard deviation is 12
minutes. Assume that the time spent in sending messages
follows a normal distribution.

(a) What proportion of the smart phone users are spending

more than 90 minutes in sending messages daily?
(b) What proportion of customers are spending less than 20
minutes?
(c) What proportion of customers are spending between 50
minutes and 100 minutes?
Solution
It is given that  = 68 minutes and  = 12 minutes.
(a) Proportion of customers spending more than 90 minutes is given by P(X
 90) = 1 − P(X  90) = 1 − F(90)
The standard normal random variable value for X = 120 is given by

x− 90 − 68
Z= = = 1.8333
 12
That is, F(X = 90) = F(Z = 1.8333). From standard normal distribution table,
we get for Z = 1.8333. The area under the standard normal distribution curve
is 0.9666. Thus , P(X  90) = 1− P(X  90) = 1 − F(90) = 1 – 0.9666 = 0.0334

Alternatively, using Excel, we get

P(X  90) = 1 − P(X  90) = 1 – Normdist (90, 68, 12, true) = 0.0334
(b) Proportion of customers spending less than 20 minutes is
P(X  20) = F(20)
Using Excel function, we have Normdist(20, 68, 12, true) =
3.1671 × 10−5

(c) Proportion of customers spending between 50 and 100

minutes is given by
P(50  X  100) = F (100) − F (50)
= Normdist(1 00,68,12, true) − Normdist(5 0,68,12, true)
= 0.9293