Machine Learning for Signal Processing
EHB 328E
Ibraheem Shayea
Electronics and Communication Engineering Department,
Faculty of Electrical and Electronics Engineering
İstanbul Teknik Üniversitesi - İTÜ
Syllabus 2
Distribution Functions
(1) Distribution Functions (Introduction)
(2) Probability Density Functions(PDF)
(3) Probability Mass Functions (PMF)
(4) Cumulative Distribution Function(CDF)
Syllabus 2
Distribution Functions
(1)
Distribution Functions (Introduction)
Lecture Objectives
What you should Learn from this Lecturer ?
❑ Understanding :
o Concept of Distribution Functions
o Expression of Distribution Functions
o Classification of Distribution Functions
Outline
❑ Functions
❑ Distribution Functions
❑ Graphing of Distribution Function
❑ Types of Distribution Functions
A. Continuous Distribution Functions
B. Discrete Distribution Functions
❑ Distribution Functions
Functions
Functions
What is a Function?
A function can be defined as a mathematical expression that relates an
input to an output.
A function is defined as a relation that is either one to one or many to one
Function
Input Output
Function is similar as a machine that has an input and an output, and the
output is related somehow to the input.
Functions
What is a Function?
A function relates an input to an output.
Function
Input Output
f(x) "f(x) = ... “ this is the most classic way used of expressing a function, but also
there are other ways used to represent the function
8
Functions
What is a Function?
Let’s say that this function takes in a number as input, adds 2 to the input
number, and returns the new number as output.
Graphically our function (as a box)
Function 𝒇(𝒙)
𝒙 𝒙+𝟐
Input +2 Output
𝒇(𝒙) = 𝒙 + 𝟐.
9
Functions
What is a Function?
Representation of a Function
Example
𝒇(𝒙) = 𝒙 + 𝟐
10
Functions
What is a Function?
Graphical Representation of a Function
Example
𝑓(𝑥) = 𝑥 + 2.
ℎ 𝑥 = 𝑥 + 3.
11
Functions
What is a Function?
Graphical Representation of a Function
Example
𝑓 𝑥 = 𝑥 2. 𝑓 𝑥 = 𝑥 2.
12
Functions
What is a Function?
Representation of a Function
𝑓 𝑥 = 𝑥2
Function Name Input Variable Output from the Function
13
Functions
What is a Function?
𝑓 𝑥 = 𝑥 2.
Functions
What is a Function?
𝑓 𝑥 = 𝑥2 + 2
Functions
What is a Function?
𝑓 𝑥 = 𝑥2 − 2
Functions
What is a Function?
Representation of a Function
𝑓 𝑥 = 𝑥2
Examples
𝑓 𝑞 = 1 − 𝑞 + 𝑞2
ℎ 𝐴 = 1 − 𝐴 + 𝐴2
𝑤 𝜃 = 1 − 𝜃 + 𝜃2
17
Functions
Multivariate Function
❖ A multivariate function is the function that has several input
variables
❖ It is a function that depends on several arguments.
𝑓 𝑥, 𝑦 = 𝑦2 + 𝑥 + 6
Example
The position of a car on a road is a function of the movement time and
average car movement speed.
18
Distribution Functions
Distribution Functions
What is a Probability Distribution?
❑ Probability Distribution is a statistical function that describes all the possible
values and likelihoods that a random variable can take within a given range.
❑ Probability Distribution depicts the expected outcomes of possible values for
a given data generating process.
❑ This range will be bounded between the minimum and maximum possible values,
but exactly where the possible value is likely to be plotted on the Probability
Distribution depends on a number of factors.
❑ The factors include :
o the distribution's mean (average)
o standard deviation,
o skewness, and
o kurtosis.
Distribution Functions
What is a Distribution Function?
❑ Distribution Function is a mathematical expression that describes the
probability that a system will take on a specific value or set of values.
❑ Probability Distribution is a list of all possible outcomes of a random
variable along with their corresponding probability values.
❑ Probability Distribution or simply distribution of a random variable
𝑋 is a description of the set of the probabilities associated with the
possible values for 𝑋.
❑ Probability Distribution is the mathematical function that provides
the occurrence probabilities of different possible outcomes for an
experiment. 21
Distribution Functions
What is a Distribution Function?
❑ Probability Distribution is a mathematical expression that describing the
probabilities of events, subsets of the sample space.
❑ Sample Space is the set of all possible outcomes of a random experiment being
performed
o Sample Space can be:
▪ A set of random non-numerical values
▪ A set of vectors
▪ A set of real numbers
❑ Distribution Function is used to describe continuous, discrete, and mixed random
variables.
22
Distribution Functions
What is a Distribution Function?
Note:
Distribution Function is also called the probability
distribution function.
Distribution Function is sometimes also called Cumulative
Density Function (CDF) but we will not use this definition in order
to avoid the confuse with the probability density function (PDF) and
Probability Mass Functions (PMF).
23
Distribution Functions
What is a Distribution Function?
Example 1:
The probability distribution of a fair 6-sided die.
The probability distribution for a fair six-sided die
24
Graphing of Distribution Function
Graphing of Distribution Function
Example for Graphing Distribution Function
26
Graphing of Distribution Function
Example for Graphing Distribution Function
27
Graphing of Distribution Function
Example for Graphing Distribution Function
28
Graphing of Distribution Function
Example for Graphing Distribution Function
29
Graphing of Distribution Function
Example for Graphing Distribution Function
30
Types of Distribution Functions
Types of Distribution Functions
What are the Types of Distribution Functions ??
Probability Distributions are either continuous probability distributions
or discrete probability distributions, depending on whether they have
finite or infinite random variables.
Types of Distribution Functions has two main types:
A. Continuous Distribution Functions
B. Discrete Distribution Functions
Types of Distribution Functions
A. Continuous Distribution Functions
Continuous Probability Distribution Functions is a probability
distribution whose support is an uncountable set, such as:
o height, in inches
o an interval in the real line.
o thickness of an item
o temperature of a solution
Types of Distribution Functions
B. Discrete Distribution Functions
Discrete Distribution is a statistical distribution that shows the
probabilities of discrete outcomes that can be countable.
Types of Distribution Functions
Example :
Types of Distribution Functions
Main Types of Distributions:
Discrete Distribution
Types of Distribution Functions
Continuous and Discrete Distribution Functions
Continuous
Discrete
Distribution Functions
Distribution Functions
Probability
Mass Function
(𝑃𝑀𝐹)
Cumulative Generalized
Discrete and Mixed Probability
Distribution
Function Density
Random Variable
(𝐶𝐷𝐹) Function
Probability
Density
Function
(𝑃𝐷𝐹)
39
Distribution Functions
Distribution Function
Continuous Distribution Discrete
Function Distribution Function
PDF CDF PMF CDF
Distribution Functions
A. Continuous Distribution Functions
Examples of a Continuous Distribution Functions:
1. Uniform Distribution
2. Exponential Distribution
3. Gaussian Distribution
4. Gamma Distribution
5. Erlang Distribution
6. Cauchy Distribution
7. Laplace Distribution
… ..….
Distribution Functions
B. Discrete Distribution Functions
Examples of a Discrete Distribution Functions is a
1. Bernoulli Distributions
2. Binomial Distributions
3. Negative Binomial Distributions
4. Geometric Distributions
5. Hypergeometric Distributions
6. Poisson Distributions
… ..….
The End
Thank You
References
• https://online.stat.psu.edu/stat504/node/209/
•
• https://support.minitab.com/en-us/minitab-express/1/help-and-how-to/basic-
statistics/probability-distributions/supporting-topics/basics/continuous-and-discrete-probability-
distributions/
• https://www.investopedia.com/terms/p/probabilitydistribution.asp
• https://opentextbc.ca/introbusinessstatopenstax/chapter/properties-of-continuous-probability-
density-functions/
