Backfed Input (ell

N e u r a l Networks Oeep Feed Forward (OFF)

()2016 Ftodor ViWl Veen - asimovinstitute.org

lnput(ell

Noisy Input (ell

Perceptron (P) Feed Forward (FF) Radial Basis Network (RBF)

Hidden (ell

Probablistic Hidden Cell

Spiking Hidden Cell

Recurrent Neural Network (RNN) Long/ Short Term Memory (LSTM) Gated Recurrent Unit (GRU)

Output (ell

Match Input Output (ell

Recurrent (ell

Memory (ell
Auto Encocler (AE) VariationalAE (VAE) Oenoising AE (OAE) Sparse AE (SAE)

Oifferent Memory Cell

Kernel

O (onvolution or Pool

Markov Chain (MC) Hopfield Network (HN) Boltzmann Machine (BM) Restricted BM (RBM) Oeep Belief Network (OBN)

<"1D
o o

o o
Q

Oeep Convolutional Network (D(N) Deconvolutional Network (DN) Deep Convolutional lnverse Graphics Network (DCIGN)

Generative Adversarial Network (GAN) Uquid Sta te Machi ne (LSM) Extreme Learning Machi ne (ELM) Echo State Network (ESN)

Oeep Residual Network (ORN) Kohonen Network (KN) Support Vector Machine(SVM) Neural Turing Machine (NTM)