DEEP LEARNING

Prerequisite
Course  To know about of CNN and RNN to model for real world applications.
Objectives
 To Understand the various challenges involved in designing deep
learning algorithms for varied applications

 To know the basics concepts of deep learning.

 To Emphasize the knowledge on various deep learning algorithms

Course Upon completion of this course, Students should be able

Outcomes
 Understanding the basics concepts of deep learning.

 Emphasizing knowledge on various deep learning algorithms.

 Understanding of CNN and RNN to model for real world applications.

 Understanding the various challenges involved in designing deep learning

algorithms for varied applications

UNIT I INTRODUCTON TO DEEP LEARNING

Introducton to Deep Learning: Basics: Biological Neuron, Idea of computational units,
McCulloch– Pitts unit and Thresholding logic, Linear Perceptron, Perceptron Learning
Algorithm, Linear separability. Convergence theorem for Perceptron Learning Algorithm.
UNIT II FEEDFORWARD NETWORKS
Feedforward Networks: Multilayer Perceptron, Gradient Descent, Backpropagation, Empirical
Risk Minimization, regularization, autoencoders.
UNIT III CONVOLUTIONAL NETWORKS
Convolutional Networks: The Convolution Operation - Variants of the Basic Convolution
Function - Structured Outputs - Data Types - Efficient Convolution Algorithms - Random or
Unsupervised Features- LeNet, AlexNet
UNIT IV RECURRENT NEURAL NETWORKS
Recurrent Neural Networks: Bidirectional RNNs - Deep Recurrent Networks Recursive Neural
Networks - The Long Short-Term Memory and Other Gated RNNs
UNIT V DEEP GENERATIVE MODELS & APPLICATIONS
Deep Generative Models: Boltzmann Machines - Restricted Boltzmann Machines - Introduction
to MCMC and Gibbs Sampling- gradient computations in RBMs - Deep Belief Networks- Deep
Boltzmann Machines Applications: Large-Scale Deep Learning - Computer - Speech
Recognition - Natural Language Processing - Other Applications
Text Books
1. N.D.Lewis, “Deep Learning Made Easy with R: A Gentle Introduction for Data Science”,
January 2016.

References
1. Ian Goodfellow, Yoshua Bengio, Aaron Courville, “Deep Learning”, MIT Press, 2016.
2. Bengio, Yoshua. "Learning deep architectures for AI." Foundations and trends in Machine
Learning 2.1 (2009): 1127.
3. Nikhil Buduma, “Fundamentals of Deep Learning: Designing Next-Generation Machine
Intelligence Algorithms”, O’Reilly publications.
4. Tariq Rashid, “Make your own neural network