Scribd
Upload
9 views2 pages

AML - Unit - 3

The document discusses Bayes' theorem, a fundamental concept in probability theory and machine learning, particularly in Bayesian inference. It explains the theorem's components, including prior probability, likelihood, evidence probability, and posterior probability, and their roles in updating beliefs about a hypothesis based on new evidence. The document emphasizes the importance of Bayes' theorem in probabilistic modeling and machine learning algorithms, such as Naive Bayes.

Uploaded by

rishit.kantariya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
9 views2 pages

AML - Unit - 3

The document discusses Bayes' theorem, a fundamental concept in probability theory and machine learning, particularly in Bayesian inference. It explains the theorem's components, including prior probability, likelihood, evidence probability, and posterior probability, and their roles in updating beliefs about a hypothesis based on new evidence. The document emphasizes the importance of Bayes' theorem in probabilistic modeling and machine learning algorithms, such as Naive Bayes.

Uploaded by

rishit.kantariya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

DR.

SUBHASH UNIVERSITY
School of Engineering & Technology
Department of Information Technology

Unit No 3: - Bayesian Concept Learnin

Bayes’ theorem is fundamental in machine learning, especially in the context of


Bayesian inference. It provides a way to update our beliefs about a hypothesis based
on new evidence.

What is Bayes theorem?

Bayes’ theorem is a fundamental concept in probability theory that plays a crucial role
in various machine learning algorithms, especially in the fields of Bayesian statistics
and probabilistic modelling. It provides a way to update probabilities based on new
evidence or information. In the context of machine learning, Bayes’ theorem is often
used in Bayesian inference and probabilistic models.

𝑃(𝐴∣𝐵)=𝑃(𝐵∣𝐴)⋅𝑃(𝐴)𝑃(𝐵)P(A∣B)=P(B)P(B∣A)⋅P(A)
The theorem can be mathematically expressed as:

Where

P(A∣B) is the posterior probability of event A given event B.


(B∣A) is the likelihood of event B given event A.


 P(A) is the prior probability of event A.
 P(B) is the total probability of event B.

In the context of modeling hypotheses, Bayes’ theorem allows us to infer our belief in
a hypothesis based on new data. We start with a prior belief in the hypothesis,
represented by P(A), and then update this belief based on how likely the data are to
be observed under the hypothesis, represented by P(B∣A). The posterior
probability P(A∣B) represents our updated belief in the hypothesis after considering the
data.

Key Terms Related to Bayes Theorem


1. Likelihood(P(B∣A)):
 Represents the probability of observing the given evidence (features) given that
the class is true.
 In the Naive Bayes algorithm, a key assumption is that features are conditionally
independent given the class label. In other words, Naive Bayes works best with
discrete features.
2. Prior Probability (P(A)):
 In machine learning, this represents the probability of a particular class before
considering any features.

2DECO304 1
DR. SUBHASH UNIVERSITY
School of Engineering & Technology
Department of Information Technology

 It is estimated from the training data.


3. Evidence Probability( P(B) ):
 This is the probability of observing the given evidence (features).
 It serves as a normalization factor and is often calculated as the sum of the joint
probabilities over all possible classes.
4. Posterior Probability( P(A∣B) ):
 This is the updated probability of the class given the observed features.
 It is what we are trying to predict or infer in a classification task.

2DECO304 2

You might also like