Professional Documents
Culture Documents
Ai 7
Ai 7
Ai 7
Neural Networks
Examples:
Speech phoneme recognition
Image classification
Financial prediction
A Neuron (= a perceptron)
- t
x0 w0
x1 w1
f
output y
xn wn
For Example
n
Input weight weighted Activation y sign( wi xi t )
vector x vector w sum function i 0
output units
Feedforward networks
These compute a series of
transformations hidden units
Typically, the first layer is the
input and the last layer is the
input units
output.
Recurrent networks
These have directed cycles in their
connection graph. They can have
complicated dynamics.
More biologically realistic.
Different Network Topologies
Single layer feed-forward networks
Input layer projecting into the output layer
Single layer
network
Input Output
layer layer
Different Network Topologies
Multi-layer feed-forward networks
One or more hidden layers. Input projects only
from previous layers onto a layer.
2-layer or
1-hidden layer
fully connected
network
Input Hidden Output
layer layer layer
Different Network Topologies
Multi-layer feed-forward networks
Recurrent
network
Input Output
layer layer
Algorithm for learning ANN
Initialize the weights (w0, w1, …, wk)
Y I ( 0 .3 X 1 0 .3 X 2 0 .3 X 3 0 .4 0 )
1 if z is true
where I ( z )
0 otherwise
Learning Perceptrons
A Multi-Layer Feed-Forward Neural Network
Output vector
w(jk 1) w(jk ) ( yi yˆ i( k ) ) xij
Output layer
Hidden layer
wij
Input layer
Input vector: X
March 7, 2024 Data Mining: Concepts and Techniques 40
General Structure of ANN
x1 x2 x3 x4 x5
Input
Layer Input Neuron i Output
I1 wi1
wi2 Activation
I2
wi3
Si function Oi Oi
Hidden g(Si )
Layer I3
threshold, t