Professional Documents
Culture Documents
Convolutional Neural Networks: Riddhiman Dasgupta & Ayushi Dalmia Cse577 Tutorial, Iiit Hyderabad, Monsoon 2015
Convolutional Neural Networks: Riddhiman Dasgupta & Ayushi Dalmia Cse577 Tutorial, Iiit Hyderabad, Monsoon 2015
NEURAL NETWORKS
RIDDHIMAN DASGUPTA & AYUSHI DALMIA
CSE577 TUTORIAL, IIIT HYDERABAD, MONSOON 2015
CONVNETS: HISTORY
Cognitron/Neocognitron
Fukushima, 1971
Hubel-Wiesel Architecture
Hubel & Wiesel, 1962
Simple cells for local features
Complex cells for pooling
CONVNETS: OVERVIEW
Input Image
Feed forward
Convolution (Filtering)
Non linearity (Activation)
Pooling (Dimension reduction)
Convolution (Learned)
Non Linearity
Back propagation
Supervised classification error
Update weights of convolutional filters
Pooling
Feature Maps
Sigmoid
1
= 1+
ReLU
= max 0,
Preferred choice
Fast to compute
Simplifies back propagation
Max
pooling
Average
pooling
L2
pooling
BEFORE
AFTER
Non Linearity
Pooling
Convolution
Normalisation
Features
Convolution
Normalisation
Features
Convolution
Non Linearity
Normalisation
Pooling
Input image
Stage 1
Stage 2
Stage 3
Fully
connected
layers
Classifier
+ 1
CONVNETS: AUGMENTATION
Crops
Random perturbations
Corners & centres
Translation
Reflections
Rotation
Horizontal & vertical
Jitter / Noise
CONVNETS: DROPOUT
REFERENCES
Slides:
Yann Lecun, CVPR 2014 Workshop on Deep Learning in Vision
Marc Ranzato, CVPR 2014 Workshop on Deep Learning in Vision
Rob Fergus, NIPS 2013
Girshick, Donahue, Darrell and Malick: Rich feature hierarchies for accurate object
detection and semantic segmentation
Razavian, Azizpour, Sullivan and Carlsson: CNN features off-the-shelf: and astounding
baseline for recognition
THANK YOU