Scribd
Upload
31 views6 pages

Machine Learning - Random Forest

Uploaded by

A Sekar CSE KIOT
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
31 views6 pages

Machine Learning - Random Forest

Uploaded by

A Sekar CSE KIOT
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 6

7/1/24, 10:56 AM Machine Learning - Random Forest

Machine Learning - Random Forest


Random Forest is a machine learning algorithm that uses an ensemble of decision trees to
make predictions. The algorithm was first introduced by Leo Breiman in 2001. The key
idea behind the algorithm is to create a large number of decision trees, each of which is
trained on a different subset of the data. The predictions of these individual trees are then
combined to produce a final prediction.

Working of Random Forest Algorithm


We can understand the working of Random Forest algorithm with the help of following
steps −

Step 1 − First, start with the selection of random samples from a given dataset.
Step 2 − Next, this algorithm will construct a decision tree for every sample. Then
it will get the prediction result from every decision tree.

Step 3 − In this step, voting will be performed for every predicted result.

Step 4 − At last, select the most voted prediction result as the final prediction
result.

The following diagram illustrates how the Random Forest Algorithm works −

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 1/6
7/1/24, 10:56 AM Machine Learning - Random Forest

Random Forest is a flexible algorithm that can be used for both classification and
regression tasks. In classification tasks, the algorithm uses the mode of the predictions of
the individual trees to make the final prediction. In regression tasks, the algorithm uses
the mean of the predictions of the individual trees.

Advantages of Random Forest Algorithm


Random Forest algorithm has several advantages over other machine learning algorithms.
Some of the key advantages are −

Robustness to Overfitting − Random Forest algorithm is known for its


robustness to overfitting. This is because the algorithm uses an ensemble of
decision trees, which helps to reduce the impact of outliers and noise in the data.
High Accuracy − Random Forest algorithm is known for its high accuracy. This is
because the algorithm combines the predictions of multiple decision trees, which
helps to reduce the impact of individual decision trees that may be biased or
inaccurate.

Handles Missing Data − Random Forest algorithm can handle missing data
without the need for imputation. This is because the algorithm only considers the
features that are available for each data point and does not require all features to
be present for all data points.

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 2/6
7/1/24, 10:56 AM Machine Learning - Random Forest

Non-Linear Relationships − Random Forest algorithm can handle non-linear


relationships between the features and the target variable. This is because the
algorithm uses decision trees, which can model non-linear relationships.

Feature Importance − Random Forest algorithm can provide information about


the importance of each feature in the model. This information can be used to
identify the most important features in the data and can be used for feature
selection and feature engineering.

Implementation of Random Forest Algorithm in Python


Let's take a look at the implementation of Random Forest Algorithm in Python. We will be
using the scikit-learn library to implement the algorithm. The scikit-learn library is a
popular machine learning library that provides a wide range of algorithms and tools for
machine learning.

Step 1 − Importing the Libraries

We will begin by importing the necessary libraries. We will be using the pandas library for
data manipulation, and the scikit-learn library for implementing the Random Forest
algorithm.

import pandas as pd
from sklearn.ensemble import RandomForestClassifier

Step 2 − Loading the Data


Next, we will load the data into a pandas dataframe. For this tutorial, we will be using the
famous Iris dataset, which is a classic dataset for classification tasks.

# Loading the iris dataset

iris = pd.read_csv('https://archive.ics.uci.edu/ml/machine-learningdatabases/iris/

iris.columns = ['sepal_length', 'sepal_width', 'petal_length','petal_width', 'spec

Step 3 − Data Preprocessing

Before we can use the data to train our model, we need to preprocess it. This involves
separating the features and the target variable and splitting the data into training and
testing sets.

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 3/6
7/1/24, 10:56 AM Machine Learning - Random Forest

# Separating the features and target variable


X = iris.iloc[:, :-1]
y = iris.iloc[:, -1]

# Splitting the data into training and testing sets


from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.35, random_s

Step 4 − Training the Model

Next, we will train our Random Forest classifier on the training data.

# Creating the Random Forest classifier object


rfc = RandomForestClassifier(n_estimators=100)

# Training the model on the training data


rfc.fit(X_train, y_train)

Step 5 − Making Predictions

Once we have trained our model, we can use it to make predictions on the test data.

# Making predictions on the test data


y_pred = rfc.predict(X_test)

Step 6 − Evaluating the Model

Finally, we will evaluate the performance of our model using various metrics such as
accuracy, precision, recall, and F1-score.

# Importing the metrics library


from sklearn.metrics import accuracy_score, precision_score,
recall_score, f1_score

# Calculating the accuracy, precision, recall, and F1-score


accuracy = accuracy_score(y_test, y_pred)
precision = precision_score(y_test, y_pred, average='weighted')
recall = recall_score(y_test, y_pred, average='weighted')
f1 = f1_score(y_test, y_pred, average='weighted')

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 4/6
7/1/24, 10:56 AM Machine Learning - Random Forest

print("Accuracy:", accuracy)
print("Precision:", precision)
print("Recall:", recall)
print("F1-score:", f1)

Complete Implementation Example


Below is the complete implementation example of Random Forest Algorithm in python
using the iris dataset −

import pandas as pd
from sklearn.ensemble import RandomForestClassifier

# Loading the iris dataset


iris = pd.read_csv('https://archive.ics.uci.edu/ml/machine-learningdatabases/iris/

iris.columns = ['sepal_length', 'sepal_width', 'petal_length', 'petal_width', 'spe

# Separating the features and target variable


X = iris.iloc[:, :-1]
y = iris.iloc[:, -1]

# Splitting the data into training and testing sets


from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X, y,


test_size=0.35, random_state=42)

# Creating the Random Forest classifier object


rfc = RandomForestClassifier(n_estimators=100)

# Training the model on the training data


rfc.fit(X_train, y_train)
# Making predictions on the test data
y_pred = rfc.predict(X_test)
# Importing the metrics library
from sklearn.metrics import accuracy_score, precision_score,
recall_score, f1_score

# Calculating the accuracy, precision, recall, and F1-score


accuracy = accuracy_score(y_test, y_pred)
precision = precision_score(y_test, y_pred, average='weighted')

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 5/6
7/1/24, 10:56 AM Machine Learning - Random Forest

recall = recall_score(y_test, y_pred, average='weighted')


f1 = f1_score(y_test, y_pred, average='weighted')

print("Accuracy:", accuracy)
print("Precision:", precision)
print("Recall:", recall)
print("F1-score:", f1)

Output

This will give us the performance metrics of our Random Forest classifier as follows −

Accuracy: 0.9811320754716981
Precision: 0.9821802935010483
Recall: 0.9811320754716981
F1-score: 0.9811157396063056

https://www.tutorialspoint.com/machine_learning/machine_learning_random_forest_classification.htm 6/6

You might also like