Decision Tree Rules Study Notes
Decision Tree Rules Study Notes
The decision tree method is a popular and relatively simple supervised classification method. It
involves:
3. Paths: Each path from the root to a leaf of the decision tree consists of attribute tests, finally
The popularity of decision trees is due to the ease of understanding the rules specified by the
nodes. These rules can even be used to retrieve data from a relational database satisfying the rules
using SQL.
2. Better Understanding:
- Rules remove the distinction between attribute tests near the root and those near the leaves.
IF-THEN Rules:
- Derived Rules: Rules are derived from the paths from the root to the leaf nodes.
Simplification of Rules:
1. Simplifying Rules:
- Rules with only one antecedent (e.g., "If Gender = 'Male' then class = B") cannot be simplified.
- Only rules with two or more antecedents are considered for simplification.
- Unnecessary rule antecedents that do not affect the conclusion may be removed.
3. Combining Rules:
- The quality of the decision tree and the derived rules depends on the training sample.
- If the training sample does not represent the population well, the derived rules may not be reliable.