Neurocomputing Chap9 2 PDF

Neurocomputing
Optical NNHW
Neurocomputing
Prof. Dr.-Ing. Andreas König
Institute of Integrated Sensor Systems ISE
Dept. of Electrical Engineering and Information Technology

Technische Universität Kaiserslautern
Fall Semester 2007
© Andreas König Slide 9-1
Neurocomputing
Optical NNHW
Course Contents:
1. Introduction
2. Rehearsal of Artificial Neural Network models relevant for
implementation and analysis of the required computational steps
3. Analysis of typical ANN-applications with regard to computational
requirements
4. Aspects of simulation of ANNs and systems
5. Efficient VLSI-implementation by simplification of the original
algorithms
6. Derivation of a taxonomy of neural hardware
7. Digital neural network hardware
8. Analog and mixed-signal neural network hardware
9. Principles of optical neural network hardware implementation
10. Evolvable hardware overview
11. Summary and Outlook
1
Neurocomputing
Chapter Contents Optical NNHW
9. Principles of optical neural network hardware

implementation
9.1 Basic building blocks for optical NN-HW
9.2 Holographic AM by Psaltis et al.
9.3 Optoelectronic Hopfield network by Farhat et al.
9.4 Optoelectronic Boltzmann Machine by Farhat et al.
9.5 Optoelectronic Hopfield network by Noguchi et al.
9.6 TDM Hopfield network by Oita et al.
9.7 Optical synaptic chip by Ohta et al.
9.8 Optical feed-forward chip by Ohta et al.
9.9 Artificial retina chip by Kyuma et al.
9.10 Summary
Neurocomputing
¾ Principle of optical Neurocomputing arrangement:
2
Neurocomputing
Basic Building Blocks Optical NNHW
¾ Implementation options of NN computational steps by optical means:
• Summation: Photodetector-arrays, CRT-cameras, CCDs/CMOS-imagers
• Multiplication (synapses): Spatial Light Modulators (SLM), pin hole

masks, exposed foto plates, LCDs, holograms, Variable sensitivity PDs
• Nonlinearities: SLMs or electronic circuit property exploitation
• Storage (weights): SLM, hologram; optical or electronic SLM addressing
• Miscellaneous Funtional Units: Polarizers, phase-conjugated mirrors

(PCM), optical lenses, lenslet-arrays, TV-CRT noise pattern as random
generator, beam splitter, limiter, auxiliary electronics for signal processing
Neurocomputing
¾ Synaptic inputs:
¾ LED row or matrix
¾ Extension to LED stripes for matrix-vector multiplication
¾ Signed processing capability by duplicated inputs for positive/negative

channel and extended summation node
3
Neurocomputing
¾ Also signed processing

capability by duplicate channels
¾ Electically & optically addressed

SLMs
¾ SLM functionality as transducer,

amplifier, mul/add/sub, memory
linear/nonlinear proc.
Thresholding, hysteretic proc.,
optical limiting
¾ Application with coherent or

incoherent light (Laser/LED)
¾ Bottleneck: reprogramming time
Neurocomputing
¾ SLM types: Optically & electrically adressed SLMs
¾ Microchannel Plate Device (MSLM):
200 Hz framing speed

Up to several months
storage time possible
¾ Liquid-Crystal-Devices (LCD), optically & electrically adressed

¾ Thermoplast modulators (for holograms)
¾ Crystals for holography, require minimum intensity for write and
reference images
¾ Semiconductor-O-SLMS, Variable-Sensititvity-Photo-Detector (VSPD)
4
Neurocomputing
¾ Acousto-optical SLM (Bragg

cell)
¾ Elastooptic material
¾ 1D - modulator
¾ 2D SLM bei linear modulator

array
¾ Light modulation achieved by

transducting of acoustical signal
Neurocomputing
¾ Magneto-optical SLM
¾ Film with square fields of programmable

(binary) magnetization orientation
¾ In setup, light is
polarized corresponding
to magnetization
orientation
5
Neurocomputing
¾ Summation and nonlinearity:
¾ Electronic summation employing differential amplifiers for signed input

¾ Electronically generated nonlinearity and/or thresholding
¾ Self-modulating SLMs
Neurocomputing
Basic Building Blocks
6
Neurocomputing
¾ Storage (of weights) in SLMs:
¾ Fixed masks (pin hole masks, exposed photo plates)
¾ Optically or electronically addressable SLMs for weight storage
¾ Adaptation, if applicable, commonly Hebb‘s learning rule
Neurocomputing
¾ Principle optical architectures:
¾ Electrically addressed 2D-weights
¾ N optically fed-in signals, N2 electrically addressed weights !
7
Neurocomputing
¾ Optically addressed 2D-weights
¾ N electrically addressed signals, N2 optically fed-in weights !
Neurocomputing
¾ Example of a 2D network with 2D neuron layers:
¾ Common situation for image processing applications

¾ Matrix of matrices
8
Neurocomputing
Holographic AM Optical NNHW
¾ Holographic Associative Memory (Psaltis et al. 1987):
Neurocomputing
Optoelectronic Hopfield Net Optical NNHW
¾ Optoelectronic Hopfield Network with 32 neurons (Farhat et al. 1985):
¾ approx. 60ms response

time for electronic
feedback
¾ Optimized for
simplicity, not speed
¾ Input vectors recognized

with up to 37,5 %
distortion
¾ Results comparable to
digital simulations Laboratory set-up
9
Neurocomputing
Optoelectronic Hopfield Net Optical NNHW
Memory submask/PD block
Input LED-column
-
+
Value-entry & display box
Neurocomputing
¾ Optoelectronic Boltzmann machine (Farhat et al. 1987):

¾ Structured (multi-layered) network by partial matrix exploitation
¾ Simulated Annealing by TV noise pattern with variable intensity
¾ Ternary weights by magneto-optic SLM (MO-SLM) application

¾ Dedicated BM-learning algorithm for this quantization
¾ For sufficient no. Of neurons, very good learning results reported
10
Neurocomputing
¾ Optoelectronic 5x5 Hopfield Network (Noguchi et al. 1990):
Neurocomputing
¾ Application to (tiny) OCR problems

¾ Two patterns ´´A´´ and ´´C´´ have been digitized in 5x5 resolution and
stored
¾ Reconstruction was reported to be possible also from fragements, i.e.,
partial or distorted patterns
¾ Instead of employing polarizers, simple pin-hole masks can be applied

11
Neurocomputing
¾ Time-Division-Multiplexing (TDM) Hopfield Network (Oita et al.

1990):
¾ Reloadable or reprogrammable MO-SLM

¾ Larger networks are processed in time-multiplex of partial matrices
Neurocomputing
¾ A frame rate of 20 ms was reported, allowing the processing of 2000
neurons and 250 dimensions in 1 s
¾ Quality reported to simulations slightly worse, due to matching problems

12
Neurocomputing
¾ Network with optical weight configuration (Neugebauer et al.

1990):
¾ Volume holograme allows the storage of multiple weight sets

¾ Illumination (angle !) projects chosen weight set on PD array
¾ Matrix-vector multiplication with electrically adressed input vector
¾ 32 neurons, 3 µm MOSIS p-well, 5-6 bit accuracy, 100 MCPS
¾ Learning by SLM change/reprogramming
Neurocomputing
¾ Circuit diagram of the 3mm2 chip:
13
Neurocomputing
¾ GaAs/AlGaAS Optical Synaptic Chip (Ohta et al. 1989):
¾ The first really integrated optoelectronic neural network chip

¾ 32 neurons and a quadratic weigth matrix
¾ Chip consists of three layers (LED, fixed-SLM, PD)
¾ Hopfield function with two required chips for sign representation and
external threshold computation
¾ Alignment of different layers adn other matching challenges
Neurocomputing
¾ GaAs/AlGaAS Optical Synaptic Chip (Ohta et al. 1989):
¾ 35/29/26 neurons in two layers

¾ 66 LED, 110 PD (signed weights)
¾ Fixed ternary weights
¾ OCR application for 26 patterns employing a resolution of 5x7 pixels

¾ ´´Learning by manufacturing´´
14
Neurocomputing
¾ Difference amplifiers and external thresholding between optical layer

processing, about 1 µs response time, related to more than one 1 GCPS
¾ Of the 26 patterns the recognition of only ten has been reported

¾ The reasons are the severe problems with process related variations and
alignment problems in the flip-chip bonding
¾ No optical cascading possible
Neurocomputing
¾ Different optical VSPD-based Neurochips (Mitsubishi)
Optical learning neurochip

with analog memory
Optically adressed Artificial retina chip

neurochip
15
Neurocomputing
¾ Artificial retina chip (Kyuma et al. 1994):
¾ GaAs-based optoelectronic implementation

¾ On-chip image processing capability
¾ 128x128 pixels (larger sensors followed)
¾ Variable-Sensitivity PhotoDetector
(VSPD)
9 Photodetector
9 SLM
9 Analog memory
Neurocomputing
¾ Artificial retina chip in Silicon

¾ Basic processing capabilities:
9 Image sensing & compression
9 Edge detection
9 Pattern matching & OCR
9 Fourier transform
9 Reported processing time less
than 300 µs
16
Neurocomputing
¾ Artificial retina system concept:

9 Replacement of CCD
9 Integration of preprocessing
9 Alleviated digital processing
9 Compact embedded (integrated)
vision system
Neurocomputing
¾ Misubishi´s AR integrated vision system and applications I:
17
Neurocomputing
¾ Misubishi´s AR integrated vision system and applications I:

Automotive (driver assistance system) application: 3D human motion detection & reconstruction
(Iizuka1998):
Interactive game application:
Neurocomputing
¾ Misubishi´s vision of AR chips´ potential applications:
... also valid for CMOS

imagers & vision chips in
general ...
18
Neurocomputing
Summary Optical NNHW
¾ This chapter gave a summary of interesting optical concepts for

alternative neurocomputer implementations
¾ Optical computing and technologies have an enormous potential (space-

time-bandwidth, 3D processing/integration), that most intensively is
exploited in communications
¾ The examples presented in this chapter were not too recent, as neuro-
inspired activity is currenly not so feverish in the field
¾ Technological problems, e.g., alignment, cost, flexibility, toxicity,

showed a nearly analog CMOS imager concept as commercial success
¾ Advances in optical technology related to holography, MEMS

integration technology, fibres, (O)LEDs, micro mirror arrays, color
LCD, general SLM options, photonic crystals, have the potential to
revitalize the interest in optical neurocomputing
19

Neurocomputing Chap9 2 PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Neurocomputing Chap9 2 PDF

Uploaded by

Copyright:

Available Formats

Neurocomputing

Dept. of Electrical Engineering and Information Technology

Fall Semester 2007

© Andreas König Slide 9-1

© Andreas König Slide 9-2

9. Principles of optical neural network hardware

© Andreas König Slide 9-3

¾ Principle of optical Neurocomputing arrangement:

© Andreas König Slide 9-4

¾ Implementation options of NN computational steps by optical means:

• Summation: Photodetector-arrays, CRT-cameras, CCDs/CMOS-imagers

• Multiplication (synapses): Spatial Light Modulators (SLM), pin hole

• Nonlinearities: SLMs or electronic circuit property exploitation

• Storage (weights): SLM, hologram; optical or electronic SLM addressing

• Miscellaneous Funtional Units: Polarizers, phase-conjugated mirrors

© Andreas König Slide 9-5

¾ LED row or matrix

¾ Extension to LED stripes for matrix-vector multiplication

¾ Signed processing capability by duplicated inputs for positive/negative

© Andreas König Slide 9-6

¾ Also signed processing

¾ Electically & optically addressed

¾ SLM functionality as transducer,

¾ Application with coherent or

¾ Bottleneck: reprogramming time

© Andreas König Slide 9-7

¾ SLM types: Optically & electrically adressed SLMs

¾ Microchannel Plate Device (MSLM):

200 Hz framing speed

¾ Liquid-Crystal-Devices (LCD), optically & electrically adressed

¾ Acousto-optical SLM (Bragg

¾ 2D SLM bei linear modulator

¾ Light modulation achieved by

© Andreas König Slide 9-9

¾ Film with square fields of programmable

© Andreas König Slide 9-10

¾ Summation and nonlinearity:

¾ Electronic summation employing differential amplifiers for signed input

© Andreas König Slide 9-11

Basic Building Blocks

© Andreas König Slide 9-12

¾ Storage (of weights) in SLMs:

¾ Fixed masks (pin hole masks, exposed photo plates)

¾ Optically or electronically addressable SLMs for weight storage

¾ Adaptation, if applicable, commonly Hebb‘s learning rule

© Andreas König Slide 9-13

¾ Principle optical architectures:

¾ Electrically addressed 2D-weights

¾ N optically fed-in signals, N2 electrically addressed weights !

© Andreas König Slide 9-14

¾ Optically addressed 2D-weights

¾ N electrically addressed signals, N2 optically fed-in weights !

© Andreas König Slide 9-15

¾ Example of a 2D network with 2D neuron layers:

¾ Common situation for image processing applications

© Andreas König Slide 9-16

¾ Holographic Associative Memory (Psaltis et al. 1987):

© Andreas König Slide 9-17

¾ Optoelectronic Hopfield Network with 32 neurons (Farhat et al. 1985):

¾ approx. 60ms response

¾ Input vectors recognized

Memory submask/PD block

Value-entry & display box