Scribd
Upload
32 views

Kmeans Clustering Implementation Using Python

This document outlines the k-means clustering algorithm on a sample dataset containing x and y coordinates. It initializes k random centroids, assigns all points to the closest centroid, updates the centroid positions based on the mean of assigned points, and repeats this process until cluster assignments stop changing. The algorithm is implemented using Python with Pandas and Matplotlib. Key steps include initializing centroids, assigning points to clusters, updating centroids, and repeating until convergence.

Uploaded by

Poornima Ghodke
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
32 views

Kmeans Clustering Implementation Using Python

This document outlines the k-means clustering algorithm on a sample dataset containing x and y coordinates. It initializes k random centroids, assigns all points to the closest centroid, updates the centroid positions based on the mean of assigned points, and repeats this process until cluster assignments stop changing. The algorithm is implemented using Python with Pandas and Matplotlib. Key steps include initializing centroids, assigning points to clusters, updating centroids, and repeating until convergence.

Uploaded by

Poornima Ghodke
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

1/22/2021 Untitled9

In [1]: ## Initialisation

import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
%matplotlib inline

df = pd.DataFrame({
'x': [12, 20, 28, 18, 29, 33, 24, 45, 45, 52, 51, 52, 55, 53, 55, 61, 64,
69, 72],
'y': [39, 36, 30, 52, 54, 46, 55, 59, 63, 70, 66, 63, 58, 23, 14, 8, 19, 7
, 24]
})

np.random.seed(200)
k = 3
# centroids[i] = [x, y]
centroids = {
i+1: [np.random.randint(0, 80), np.random.randint(0, 80)]
for i in range(k)
}

fig = plt.figure(figsize=(5, 5))


plt.scatter(df['x'], df['y'], color='k')
colmap = {1: 'r', 2: 'g', 3: 'b'}
for i in centroids.keys():
plt.scatter(*centroids[i], color=colmap[i])
plt.xlim(0, 80)
plt.ylim(0, 80)
plt.show()

localhost:8888/nbconvert/html/Untitled9.ipynb?download=false 1/5
1/22/2021 Untitled9

In [3]: #Assignment Stage

def assignment(df, centroids):


for i in centroids.keys():
# sqrt((x1 - x2)^2 - (y1 - y2)^2)
df['distance_from_{}'.format(i)] = (
np.sqrt(
(df['x'] - centroids[i][0]) ** 2
+ (df['y'] - centroids[i][1]) ** 2
)
)
centroid_distance_cols = ['distance_from_{}'.format(i) for i in centroids.
keys()]
df['closest'] = df.loc[:, centroid_distance_cols].idxmin(axis=1)
df['closest'] = df['closest'].map(lambda x: int(x.lstrip('distance_from_'
)))
df['color'] = df['closest'].map(lambda x: colmap[x])
return df

df = assignment(df, centroids)
print(df.head())

fig = plt.figure(figsize=(5, 5))


plt.scatter(df['x'], df['y'], color=df['color'], alpha=0.5, edgecolor='k')
for i in centroids.keys():
plt.scatter(*centroids[i], color=colmap[i])
plt.xlim(0, 80)
plt.ylim(0, 80)
plt.show()

x y distance_from_1 distance_from_2 distance_from_3 closest color


0 12 39 26.925824 56.080300 56.727418 1 r
1 20 36 20.880613 48.373546 53.150729 1 r
2 28 30 14.142136 41.761226 53.338541 1 r
3 18 52 36.878178 50.990195 44.102154 1 r
4 29 54 38.118237 40.804412 34.058773 3 b

localhost:8888/nbconvert/html/Untitled9.ipynb?download=false 2/5
1/22/2021 Untitled9

In [4]: ##Update Stage

import copy

old_centroids = copy.deepcopy(centroids)

def update(k):
for i in centroids.keys():
centroids[i][0] = np.mean(df[df['closest'] == i]['x'])
centroids[i][1] = np.mean(df[df['closest'] == i]['y'])
return k

centroids = update(centroids)

fig = plt.figure(figsize=(5, 5))


ax = plt.axes()
plt.scatter(df['x'], df['y'], color=df['color'], alpha=0.5, edgecolor='k')
for i in centroids.keys():
plt.scatter(*centroids[i], color=colmap[i])
plt.xlim(0, 80)
plt.ylim(0, 80)
for i in old_centroids.keys():
old_x = old_centroids[i][0]
old_y = old_centroids[i][1]
dx = (centroids[i][0] - old_centroids[i][0]) * 0.75
dy = (centroids[i][1] - old_centroids[i][1]) * 0.75
ax.arrow(old_x, old_y, dx, dy, head_width=2, head_length=3, fc=colmap[i],
ec=colmap[i])
plt.show()

localhost:8888/nbconvert/html/Untitled9.ipynb?download=false 3/5
1/22/2021 Untitled9

In [5]: ##Repeat Assigment Stage

df = assignment(df, centroids)

# Plot results
fig = plt.figure(figsize=(5, 5))
plt.scatter(df['x'], df['y'], color=df['color'], alpha=0.5, edgecolor='k')
for i in centroids.keys():
plt.scatter(*centroids[i], color=colmap[i])
plt.xlim(0, 80)
plt.ylim(0, 80)
plt.show()

localhost:8888/nbconvert/html/Untitled9.ipynb?download=false 4/5
1/22/2021 Untitled9

In [6]: #Continue until all assigned categories don't change any more
while True:
closest_centroids = df['closest'].copy(deep=True)
centroids = update(centroids)
df = assignment(df, centroids)
if closest_centroids.equals(df['closest']):
break

fig = plt.figure(figsize=(5, 5))


plt.scatter(df['x'], df['y'], color=df['color'], alpha=0.5, edgecolor='k')
for i in centroids.keys():
plt.scatter(*centroids[i], color=colmap[i])
plt.xlim(0, 80)
plt.ylim(0, 80)
plt.show()

In [ ]:

localhost:8888/nbconvert/html/Untitled9.ipynb?download=false 5/5

You might also like