Professional Documents
Culture Documents
(ANN) - Neural Network Dictionary (Frohlich) PDF
(ANN) - Neural Network Dictionary (Frohlich) PDF
(ANN) - Neural Network Dictionary (Frohlich) PDF
a
activation area refers to: Kohonen Feature Map
A value that indicates the area of influence of the most
activated neuron (the center of activation) on other map
neurons. The activation is spread out around this center
(maximum activation) and decreases the greater the distance to
this center is.
activation function refers to: neuron
A mathematical function that a neuron uses to produce an
output refering to its input value. Usually this input value has
to exceed a specified threshold value that determines, if an
output to other neurons should be generated.
see also: hard limiter, signum activation, sigmoid activation
b
backpropagation refers to: learning algorithm
A learning algorithm used by neural nets with supervised
learning. Special form of the delta learning rule.
see also: forwardpropagation
d
delta learning rule refers to: learning algorithm
A learning algorithm used by neural nets with supervised
learning. Effects the changing of weights by multiplying a
neuron's input with the difference of its output and the desired
output and the net's learning rate.
e
error refers to: neural net, output
A value that indicates the "quality" of a neural net's learning
process. Used by neural nets with supervised learning, by
comparing the current output values with the desired output
values of the net. The smaller the net's error is, the better the
net had been trained. Usually the error is always a value greater
than zero.
f
feedback type refers to: neural net
A specific connection structure of a neural net, where neurons
of one neuron layer may have connections to neurons of other
layers and also to neurons of the same layer. An example of
such a net type is the Hopfield Net.
see also: feedforward type
g
GUI refers to: general term, abbreviation
Graphical User Interface.
The graphical environment of a software application.
h
hard limiter refers to: neuron, activation function
A specific type of a neuron's activation function.
see also: activation function
i
input refers to: neuron, input layer
A set of values, called "pattern", that is passed to a neural net's
input neuron layer. The elements of those patterns are usually
binary values.
see also: input layer, output
j
JDK refers to: general term, abbreviation
Java Developers Kit.
An extensive set of Java classes, suitable for different
purposes. The classes are enclosed in "packages", each
covering a certain topic (networking, user interface,...).
see also: API
k
Kohonen Feature refers to: neural net
Map A feedforward / feedback type neural net. Built of an input
layer thats neurons are connected with each neuron of another
layer, called "feature map". The feature map can be one- or two-
dimensional and each of its neurons is connected to all other
neurons on the map. Mainly used for classification.
see also: selforganization
l
learning algorithm refers to: neural net
A mathematical algorithm that a neural net uses to learn
specific problems.
see also: backpropagation, delta learning rule,
forwardpropagation, Hebb learning rule, simulated annealing
m
Multi-Layer- refers to: neural net
Perceptron A feedforward type neural net. Built of an input layer, at least
one hidden layer and one output layer. Mainly used for pattern
association.
see also: backpropagation, hidden layer, Perceptron
n
neuron refers to: neuron layer, neural net
An element of a neural net's neuron layer.
see also: activation function, threshold
neuron layer refers to: neural net
A layer of a neural net. The different layers of a neural net are
connected by weight matrices.
see also: input layer, hidden layer, output layer, weight matrix
o
object orientation refers to: general term
(OO) A method of software-engineering. The main goal of object
orientation is to develope reusable software components.
output refers to: neuron, output layer
A value or a set of values (pattern), generated by the neurons
of a neural net's output layer. Used to calculate the current
error value of the net.
see also: output layer, input, error, supervised learning
p
Perceptron refers to: neural net
A feedforward type neural net. Built of one input layer and one
output layer. Mainly used for pattern association.
see also: Multi-Layer-Perceptron
s
selforganization refers to: Kohonen Feature Map, learning algorithm
A learning algorithm used by the Kohonen Feature Map neural
net. During its learning process, the neurons on the net's
feature map are organizing themselves depending on given
input values. This will result in a clustered neuron structure,
where neurons with similar properties (values) are arranged in
related areas on the map.
see also: Kohonen Feature Map, learning algorithm
t
TCP refers to: general term, abbreviation
Transmission Control Protocol.
A protocol used to transport data across the Internet.
thermodynamical refers to: neural net
model Another expression for feedback type neural nets. Called
"thermodynamical", because the term energy is used instead of
error.
see also: Hopfield Net
u
UDP refers to: general term, abbreviation
User Datagram Protocol.
A protocol used to transport data across the Internet in form of
datagrams (small packets that are sent independently).
unsupervised refers to: neural net, learning algorithm
learning A specific type of a learning algorithm, especially for
selforganizing neural nets like the Kohonen Feature Map.
Unlike supervised learning, no target patterns exist.
see also: supervised learning, selforganization
w
weight refers to: neural net, weight matrix
An element of a weight matrix. A connection between two
neurons with a value that is dynamically changed during a
neural net's learning process.
see also: weight matrix, learning algorithm
weight matrix refers to: neural net
The connection structure between two neuron layers of a
neural net. Its elements, the weights, are changed during the
net's learning process. Each neural net has at least one weight
matrix.
see also: neuron layer, weight
x
xor problem refers to: general term
A logical operation with the following values:
x y XOR
false false false
false true true
true false true
true true false