EEGE 529 | ASSIGNMENT 1

1. Give one example for each of the following topics:

 A book on neural networks, neuroinformatics, or neurodynamics

NEURAL NETWORKS:

Neural networks: A Comprehensive Foundation by Simon Haykin

NEUROINFORMATICS:

Computing the brain by Michael A. Arib and Jeffrey S. Greth

NEURODYNAMICS:

Neuronal Dynamics by Wulfram Gerstner, Werner M. Kistler, Richard Naud and Liam
Paninski

 A collaborative group of a university working with neural networks

Rice University funded by the National Science Foundation as a part of the Brain
Initiative

 A software tool realizing neural networks (“simulator”)

ANNSiS (A circuit level simulator for Analog Neural Networks)

 A company using neural networks

Google

 A product or service being realized by means of neural networks

NeuralTools for Microsoft Excel

2. Show at least four applications of technical neural networks: two from the field of pattern
recognition and two from the field of function approximation.
PATTERN RECOGNITION:
a. Interactive Voice Response (IVR) with pattern recognition in which user records his
voice. Voice pattern recognition adds security
b. Electrocardiogram (ECG) pattern recognition
FUNCTION APPROXIMATION:
a. Windows crash reporting
b. Implementation of projection theorem

1
EEGE 529 | ASSIGNMENT 1

3. Briefly characterize the four development phases of neural networks and give expressive
examples for each phase.
DEVELOPMENT PHASES ARE:
1. Input layer

Examples:
-Voice input for a voice recognition system
- Heart beats for a ECG systems
- Data from various computers for a Google crash system

2. Hidden layer

3. Old output layer

4. New output layer

4. It is estimated that a human brain consists of approx. 1011 nerve cells, each of which has
about 103 to 104 synapses. For this exercise, we assume 103 synapses per neuron. Let us
further assume that a single synapse could save one byte of information. Simply calculated,
how much storage capacity does the brain have?

Answer:
1 synapse = 1 byte
⸫ 103 synapse = 103 bytes
So,
1 neuron = 103 bytes
⸫ 1011 neurons = 1011 ∗ 103 bytes
= 1014 bytes
Hence, storage capacity of the brain is 𝟏𝟎𝟏𝟒 𝐛𝐲𝐭𝐞𝐬