VISVESVARAYA TECHNOLOGICAL UNIVERSITY BELAGAVI

PhD Coursework Courses-2020 (ELECTRONICS & COMMUNICATION)

As per the regulation 2020

Group no. 4 Subject Code 20ESP332 Exam Duration 03 Hours

Exam Marks 100
Subject Title Pattern Recognition & Machine Learning

Module-01
Introduction: Probability Theory, Model Selection, The Curse of Dimensionality, Decision Theory,
Information Theory
Distributions: Binary and Multinomial Variables, The Gaussian Distribution, The Exponential
Family, Nonparametric Methods (Ch. 1, 2).

Module-02
Supervised Learning
Linear Regression Models: Linear Basis Function Models, The Bias-Variance Decomposition,
Bayesian Linear Regression, Bayesian Model Comparison
Classification & Linear Discriminant Analysis: Discriminant Functions, Probabilistic Generative
Models, Probabilistic Discriminative Mode (Ch. 3, 4).

Module-03
Supervised Learning
Kernels: Dual Representations, Constructing Kernels, Radial Basis Function Network, Gaussian
Processes
Support Vector Machines: Maximum Margin Classifiers, Relevance Vector Machines
Neural Networks: Feed-forward Network, Network Training, Error Backpropagation (Ch. 5, 6, 7).

Module-04
Unsupervised Learning
Mixture Models: K-means Clustering, Mixtures of Gaussians, Maximum likelihood, EM for Gaussian
mixtures, Alternative View of EM.
Dimensionality Reduction: Principal Component Analysis, Factor/Component Analysis,
Probabilistic PCA, Kernel PCA, Nonlinear Latent Variable Models (Ch. 9, 12).

Module-05
Probabilistic Graphical Models: Bayesian Networks, Conditional Independence, Markov Random
Fields, Inference in Graphical Models, Markov Model, Hidden Markov Models (Ch.8,13).

Text Book:
‘Pattern Recognition and Machine Learning’, Christopher Bishop, Springer, 2006.