Scribd
Upload
192 views17 pages

Lecture 18 - Kohonen SOM

The document discusses Kohonen self-organizing maps (SOM), an unsupervised neural network technique where the weights of the winning neuron and its neighbors are updated based on the input to preserve topological properties. SOMs are used for clustering by having output neurons represent clusters and updating their weights based on the input vector closest to each weight vector. The algorithm finds the winning neuron, updates its weights and those of its neighbors, and decreases the learning rate and neighborhood size over time.

Uploaded by

Danh Bui Cong
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
192 views17 pages

Lecture 18 - Kohonen SOM

The document discusses Kohonen self-organizing maps (SOM), an unsupervised neural network technique where the weights of the winning neuron and its neighbors are updated based on the input to preserve topological properties. SOMs are used for clustering by having output neurons represent clusters and updating their weights based on the input vector closest to each weight vector. The algorithm finds the winning neuron, updates its weights and those of its neighbors, and decreases the learning rate and neighborhood size over time.

Uploaded by

Danh Bui Cong
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 17

Artificial Neural Networks

Dr. Abdul Basit Siddiqui


Assistant Professor
FURC

Kohonen SOM (Learning Unsupervised Environment)

NEURAL NETWORKS BASED


ON COMPETITION

Unsupervised Learning

We can include additional structure in the network so


that the net is forced to make a decision as to which
one unit will respond.
The mechanism by which it is achieved is called
competition.
It can be used in unsupervised learning.
A common use for unsupervised learning is clustering
based neural networks.

Unsupervised Learning

In a clustering net, there are as many units as the


input vector has components.
Every output unit represents a cluster and the
number of output units limit the number of clusters.
During the training, the network finds the best
matching output unit to the input vector.
The weight vector of the winner is then updated
according to learning algorithm.

Kohonen Learning

A variety of nets use Kohonen Learning


New weight vector is the linear combination of old
weight vector and the current input vector.
The weight update for cluster unit (output unit) j
can be calculated as:

the learning rate alpha decreases as the learning


process proceeds.

Kohonen SOM (Self Organizing Maps)

Since it is unsupervised environment, so the name is


Self Organizing Maps.
Self Organizing NNs are also called Topology
Preserving Maps which leads to the idea of
neighborhood of the clustering unit.
During the self-organizing process, the weight
vectors of winning unit and its neighbors are updated.

Kohonen SOM (Self Organizing Maps)

Normally, Euclidean distance measure is used to find


the cluster unit whose weight vector matches most
closely to the input vector.
For a linear array of cluster units, the neighborhood
of radius R around cluster unit J consists of all units j
such that:

Kohonen SOM (Self Organizing Maps)

Architecture of SOM

Kohonen SOM (Self Organizing Maps)

Structure of Neighborhoods

Kohonen SOM (Self Organizing Maps)

Structure of Neighborhoods

Kohonen SOM (Self Organizing Maps)

Structure of Neighborhoods

Kohonen SOM (Self Organizing Maps)


Neighborhoods do not wrap around from one side
of the grid to other side which means missing units
are simply ignored.

Algorithm:

Kohonen SOM (Self Organizing Maps)

Algorithm:

Radius and learning rates may be decreased after


each epoch.
Learning rate decrease may be either linear or
geometric.

KOHONEN SELF ORGANIZING MAPS


Architecture
neuron i

Kohonen layer

wi
Winning neuron

Input vector X

X=[x1,x2,xn] Rn
wi=[wi1,wi2,,win] Rn

Kohonen SOM (Self Organizing Maps)

Example

Kohonen SOM (Self Organizing Maps)

Kohonen SOM (Self Organizing Maps)

You might also like