Scribd
Upload
12 views9 pages

MLPPT

The document discusses inductive bias in decision tree learning, emphasizing its role in guiding algorithms to predict outputs for unseen inputs. It outlines the preferences of decision tree algorithms like ID3 and Candidate Elimination, and introduces concepts such as Occam's razor. The conclusion highlights the importance of inductive bias for improving generalization, interpretability, and efficiency in machine learning applications.

Uploaded by

chmaheshkumar98
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
12 views9 pages

MLPPT

The document discusses inductive bias in decision tree learning, emphasizing its role in guiding algorithms to predict outputs for unseen inputs. It outlines the preferences of decision tree algorithms like ID3 and Candidate Elimination, and introduces concepts such as Occam's razor. The conclusion highlights the importance of inductive bias for improving generalization, interpretability, and efficiency in machine learning applications.

Uploaded by

chmaheshkumar98
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 9

Joginpally B.R.

Engineering College

Topic : Machine Learning:


- inductive bias in decision tree learning
By:
Ch.Rajeshwari
21J21A0512
III B.tech Cse - A
Inductive Bias In
Decision Tree Learning
INDUCTIVE BIAS:
• inductive bias of learning algorithm is set of assumptions that
learner uses to predict outputs of given inputs that has not
encountered. inductive bias is anything which makes algorithm learn
one pattern instead of another pattern
• In general inductive bias if ID3 therefore consists of describing the
basis by which it chooses one of these consistent hypothesis over the
others
Decision Tree Learning :
• Decision Tree Learning is a supervised Learning approach used in
machine learning , statistics and data mining
• Method for approximating discrete –valued target function
• The learned function is represented by a decision tree
• Re-represented as if-then rules to improve human readability.
Inductive Bias In Decision Tree
Learning:
• Inductive bias in ID3:
 Shorter Trees are preferred over longer trees
 Trees that place high information gain attributes close to the
root are preferred over those do not

• Inductive bias in Candidate Elimination:


Restricts the set of hypothesis considered
Types Of Inductive Bias

Restriction Bias Preference bias


o ID3 o Candidate –Elimination
o Preference for certain o Categorical restriction on the set
hypothesis over others of hypothesis considered
o Work within a complete o Possibility of excluding the
hypothesis space unknown target function
Occam’s razor:
• Prefer the simplest hypothesis that fits data
• There are many ways to define small set of hypotheses
• Fewer short hypothesis than long hypothesis
• Occam’s razor will produce to different hypotheses from the same
training examples when it is applied by two learners that perceive
these examples in terms of different internal representations
Advantages: Dis-advantages:
• Improved Generalization • Overlooking Complexities
• Interpretability • Bias towards Dominant Classes
• Efficiency • Limited Flexibility
Conclusion:
• Inductive bias is a necessary part of decision tree learning , offering
benefits in terms of generalization, interpretability, and efficiency
• By considering this factors and techniques like pruning we can
leverage the strengths of decision trees while mitigating their
limitations for effective machine learning applications

You might also like