Professional Documents
Culture Documents
Hopfield Model of Neural Network
Hopfield Model of Neural Network
Introduction:
Human beings are constantly thinking since ages about the reasons
for human capabilities and incapabilities. Successful attempts have
been made to design and develop systems that emulate human
capabilities or help overcome human incapabilities. The human
brain, which has taken millions of years to evolve to its present
architecture, excels at tasks such as vision, speech, information
retrieval, complex pattern recognition, all of which are extremely
difficult tasks for conventional computers. A number of mechanisms
have been developed which seems to enable human brain to handle
various
problems.
These
mechanisms
include
association,
network
models.
Search
for
better
performance
and
Properties
of
Hopfield
model
of
neural
network
Many researchers consider the Hopfield network as a model which
has extensively influenced the field of neural networks. This section
gives some relevant details of Hopfield network.
as
an undirected
graph)
and
feed-forward
neural
(0,1)
and
bipolar
(-1,1)
neuron
representations
are
equivalent.
of
the
synaptic
matrix
and
threshold
vector.
Strategies for learning are broadly divided into two classes. These
are supervised learning and unsupervised learning.
In supervised
The net is a fully interconnected neural net, in the sense that each
unit is connected to every other unit.
version
of
the
same.
The
terms
discrete
or
W ji
and
W ii
=0
Update equations
Application Algorithm:
There are several versions of the discrete Hopfield net.
w ij= [ 2 si ( p )1 ] [ 2 s j ( p )1 ] for i j
p
w ii=0
and
and
w ii=0
easily
to
Algorithm:
Step 1 Initialize weights to store patterns. (Use Hebb rule.)
Yi = xi
, ( i=1,2n)
Step 4 Do Steps 4-6 for each unit (Units should be updated in random
order.)
y _ ini xi y j w ji
j
activation vector.)
Step 8 Test for convergence.
Example:
Consider a vector (1 0 1 1) to be stored in a net. Test a discrete
Hopfield net with mistakes in the first and fourth components (0 0 1
0) of the stored vector
Solution:
Step1. Initialize weight to store patterns, convert binary into bipolar
to find weight,
Step7. y = (1 0 1 0)
Step4. Choose unit y4 to update its activation.
Step5.
Step6.
Step7. y = (1 0 1 1)
Hence, the net can store a vector with mistakes in two components
10