0% found this document useful (0 votes)
34 views3 pages

(MXML-2-03) Decision Trees - ID3 - C4.5, IGR, Pruning, Coding Practice

Uploaded by

RunningMan Haha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
34 views3 pages

(MXML-2-03) Decision Trees - ID3 - C4.5, IGR, Pruning, Coding Practice

Uploaded by

RunningMan Haha
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

1.

Introduction

 This video is about ID3 and C4.5 decision tree method.

2. Information Gain Ratio

 Information has its problem when the number of categories increases.


 So Information Gain Ratio is used instead to compensate for that.
3. Pruning based on confidence intervals

 If the upper bound value after splitting is greater than the upper bound value before
splitting, it is better prune the tree / not split the tree.

 If the upper bound value after splitting is lower than the upper bound value before
splitting, it is better not to prune the tree / split the tree.
4. Python Code Example

 Prune = True means that pruning is allowed.

You might also like