Scribd
Upload
21 views14 pages

Expectation Maximization

EM

Uploaded by

sajidha azim
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
21 views14 pages

Expectation Maximization

EM

Uploaded by

sajidha azim
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 14

Expectation maximization

EM Introduction

• Expectation maximization (EM) is an approach that is used in many ways to find maximum
likihood estimateseters in probabilistic models.
• EM is an iterative optimization method to estimate some unknown parameters given
measurement data. Most commonly used to estimate parameters of a probabilistic model (e.g.,
Gaussian mixture distributions).
• Can also be used to discover hidden variables or estimate missing data.
• The intuition behind EM is an old one: alternate between estimating the unknowns and the
hidden variables. This idea has been around for a long time. However, in 1977, Dempster, et al.,
proved convergence and explained the relationship to maximum likelihood estimation.
• EM alternates between performing an expectation (E) step, which computes an expectation of the
likelihood by including the latent variables as if they were observed, and a maximization (M) step,
which computes the maximum likelihood estimates of the parameters by maximizing the
expected likelihood found on the E step. The parameters found on the M step are then used to
begin another E step, and the process is repeated.
• Cornerstone of important algorithms such as hidden Markov modeling; used in many fields
including human language technology and image processing.
Steps
Algorithm
Flow Diagram
Example
Example
EM
Binomial
uses
Advantages
Disadvantages
Thank You !

You might also like