Scribd
Upload
153 views3 pages

Lab 02: Decision Tree With Scikit-Learn: About The Mushroom Data Set

This document describes a lab assignment to build decision tree classifiers on a mushroom dataset using scikit-learn. The tasks are to: 1) Prepare training and test datasets by splitting the mushroom data; 2) Build decision tree classifiers on different train/test splits; 3) Evaluate the classifiers using classification reports and confusion matrices; 4) Analyze how decision tree depth affects accuracy on an 80/20 split. Graphs and tables must be used to visualize the decision trees and report accuracy scores for trees of varying depths.

Uploaded by

trung le
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
153 views3 pages

Lab 02: Decision Tree With Scikit-Learn: About The Mushroom Data Set

This document describes a lab assignment to build decision tree classifiers on a mushroom dataset using scikit-learn. The tasks are to: 1) Prepare training and test datasets by splitting the mushroom data; 2) Build decision tree classifiers on different train/test splits; 3) Evaluate the classifiers using classification reports and confusion matrices; 4) Analyze how decision tree depth affects accuracy on an 80/20 split. Graphs and tables must be used to visualize the decision trees and report accuracy scores for trees of varying depths.

Uploaded by

trung le
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Class 20CLC – Term III/2021-2022

Course: CSC14003 – Artificial Intelligence

Lab 02: Decision Tree with scikit-learn

In this assignment, you are going to build a decision tree on the Mushroom dataset, with the support
from scikit-learn library.

About the Mushroom data set


This data set includes descriptions of hypothetical samples corresponding to 23 species of gilled
mushrooms. Each species is identified as either edible or poisonous. There are 8124 samples, each of
which is characterized by 22 attributes and a target attribute.
The data file is provided along this assignment, and it is posted on Moodle. Note that
• The target attribute is located at the first column.
• The original data comes from the UCI Machine learning repository. You may refer to this page
for more information.

Assignment requirements
You are asked to write a Python program, with appropriate calls of scikit-learn functions, to fulfill the
following tasks. Although there is no strict rule on how to organize the code, each task should be
noted carefully.

Preparing the data sets


This task prepares the training sets and test sets for the incoming experiments.
You need to organize the original Mushroom dataset into four subsets:
• feature_train: a set of training examples, each of which is a tuple of 22 attribute values
(target attribute excluded).
• label_train: a set of labels corresponding to the examples in feature_train.
• feature_test: a set of test examples, it is of similar structure to feature_train
• label_test: a set of labels corresponding to the examples in feature_test.
You need to shuffle the data before splitting and the data is split in a stratified fashion. Other
parameters (if there is any) are left by default.
There will be experiments on training sets and test sets of different proportions, including
(train/test) 40/60, 60/40, 80/20, and 90/10, and thus you need 16 subsets.

1
Building the decision tree classifiers
This task conducts experiments on the designated train/test proportions listed above.
You need to fit an instance of sklearn.tree.DecisionTreeClassifier (with information
gain) to each training set and visualize the resulting decision tree using graphviz.

The aside figure gives an example of a decision tree


built on the Iris dataset (3 classes).

Evaluating the decision tree classifiers


For each of the above decision tree classifiers, predict the examples in the corresponding test set,
and make a report using classification_report and confusion_matrix.
The following figure gives an example of classification report and confusion matrix for a classifier
on the Iris dataset (3 classes).

How do you interpret the classification report and the confusion matrix? From that, make your
own comments on the performances of those decision tree classifiers.

The depth and accuracy of a decision tree


This task works on the 80/20 training set and test set. You need to consider how the decision
tree’s depth affects the classification accuracy.
You can specify the maximum depth of a decision tree by varying the parameter max_depth of
sklearn.tree.DecisionTreeClassifier.
You need to try the following values for parameter max_depth: None, 2, 3, 4, 5, 6, and 7.
And then,
• Provide the decision tree drawn by graphviz for each max_depth value
• Report to the following table the accuracy_score (on the test set) of the decision tree
classifier when changing the value of parameter max_depth.
2
max_depth None 2 3 4 5 6 7
Accuracy
• Make your own comment on the above statistics.

References

[1] Scikit-learn decision trees: https://scikit-learn.org/stable/modules/tree.html


[2] Analysis and classification of Mushrooms:
https://www.kaggle.com/haimfeld87/analysis-and-classification-of-mushrooms

Grading

No. Specifications Scores (%)


1 Preparing the data sets 20
2 Building the decision tree classifiers 20
3 Evaluating the decision tree classifiers
Classification report and confusion matrix 20
Comments 10
4 The depth and accuracy of a decision tree
Trees, tables, and charts 20
Comments 10
Total 100

Notice

• This is an INDIVIDUAL assignment.


• Your program should be programmed in Python. Write down your report on a PDF File.
• A program with syntax/runtime error(s) will not be accepted.

You might also like