Scribd
Upload
30 views3 pages

Lab 07

Uploaded by

Rafi Ullah
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
30 views3 pages

Lab 07

Uploaded by

Rafi Ullah
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

LAB 7

Implementation of K-nearest Neighbor Classification Model

Background

Installing Panda, numpy, scipy, sklearn libraries

 Go to terminal in Pycharm
 Type pip install pandas
 Or you can install all by going to Settings  Project Interpreter  +  sklearn  Install
Package

KNN- Classifier

In pattern recognition and machine learning, k-nearest neighbors (KNN) is a simple algorithm
that stores all available cases and classifies new cases based on a similarity measure (e.g.
distance). KNN is a non-parametric method where the input consists of the k closest training
examples in the feature space. The output is a class membership. An object is classified by a
majority vote of its neighbors, with the object being assigned to the class most common among
its k nearest neighbors (k is a positive integer, typically small). If k = 1, then the object is simply
assigned to the class of that single nearest neighbor.
KNN Classification Model

The algorithm for KNN classification model is given below:

Algorithm: KNearestNeighbors
Input: Training data X
Training data labels Y
Sample x to classify
Output: Decision y p about sample x

for i ← 1 to m do
Compute distance between training sample X i and unlabeled sample x i.e. d( X i , x)
end for

Compute set I containing the indices for the k smallest distances d( X i , x)

Compute the decision class y pby measuring the majority label Y from I

return y p

Example
Fit does training on Training Data (X_train, Y_Train)

Predict does testing on Test data (X_test) and predicts outputs

You might also like