Subject Code:317531 Subject Name: Artificial Neural Network (ANN) SEM-II
4.9. Experiment No. B-4
Aim:
Write a python program to design a Hopfield Network which stores 4 vectors
Theory:
Hopfield neural network was invented by Dr. John J. Hopfield in 1982. It consists of a single layer
which contains one or more fully connected recurrent neurons. The Hopfield network is commonly
used for auto-association and optimization tasks. Hopfield network is a special kind of neural
network whose response is different from other neural networks. It is calculated by converging
iterative process. It has just one layer of neurons relating to the size of the input and output, which
must be the same. When such a network recognizes, for example, digits, we present a list of
correctly rendered digits to the network. Subsequently, the network can transform a noise input to
the relating perfect output.
Discrete Hopfield network: A Hopfield network which operates in a discrete line fashion or in other
words, it can be said the input and output patterns are discrete vector, which can be either binary
0,1 or bipolar +1,—1 in nature. The network has symmetrical weights with no self-connections i.e.,
wij = wji and wii = 0.
Architecture: Following are some important points to keep in mind about discrete Hopfield
network:
• This model consists of neurons with one inverting and one non-inverting output.
• The output of each neuron should be the input of other neurons but not the input of self.
• Weight/connection strength is represented by wij.
• Connections can be excitatory as well as inhibitory. It would be excitatory, if the output of
the neuron is same as the input, otherwise inhibitory.
Department of Artificial Intelligence and Data Science Engineering, ADYPSOE 1
Subject Code:317531 Subject Name: Artificial Neural Network (ANN) SEM-II
• Weights should be symmetrical, i.e. wij = wji
The output from Y1 going to Y2, Yi and Yn have the weights w12, w1i and win respectively.
Similarly, other arcs have the weights on them.
Training Algorithm:
Department of Artificial Intelligence and Data Science Engineering, ADYPSOE 2
Subject Code:317531 Subject Name: Artificial Neural Network (ANN) SEM-II
Input:
[ x1 , x2 , ... , xn ] -> Input to the n given neurons.
[ y1 , y2 , ... , yn ] -> Output obtained from the n given neurons
Wij -> weight associated with the connection between the ith and the jth neuron.
Output:
Finite distinct Output generally of two types: Binary (0/1) Bipolar (-1/1)
Conclusion: Thus We have successfully design a Hopfield Network which stores 4 vectors.
Questions:
1. What is the storage capacity of the Hopfield network?
2. What are the different types of Hopfield neural networks?
3. What is the output of a Hopfield network?
4. What is the structure of the Hopfield network?
5. How many patterns can a Hopfield network of N neurons store?
Department of Artificial Intelligence and Data Science Engineering, ADYPSOE 3
