B.Tech.

in Electronics and Communication Engineering, V/VI/VII/VIII Semester

PATTERN RECOGNITION
(PROFESSIONAL ELECTIVE-VI)

Course Code:19EC1170 L T P C
3 0 0 3
Prerequisites:Calculus and linear Algebra & Numerical Methods,Random variables and Stochastic
Process
Course Outcomes: At the end of the course the student will be able to
CO1: Understand the concept of a pattern and the basic approach to the development of pattern
recognition using probability and linear algebra concepts.
CO2: Determine feature extraction, feature evaluation, and data mining methods.
CO3: Apply Bayes classifier models on patterns.
CO4: Understand the concepts of neural network designs for classification.
CO5: Implement decision trees and nearest neighbor classifier.  

UNIT-I 10 Lectures
BASICS OF LINEAR ALGEBRA AND PROBABILITY:
Linear Algebra: Vectors, Inner product, Outer product, Inverse of a matrix, Eigen analysis (Eigen
Decomposition), Singular value decomposition. 
Probability: Probability distributions – Discrete distributions and Continuous distributions;
Independence of events, Conditional probability distribution and Joint probability distribution,
Bayes theorem.

Learning outcomes: At the end of this unit, the student will be able to
1. understand the basics of linear algebra (L2)
2. describe probability basics (L2)
3. interpret the relation between conditional probability and Bayes theorem (L2)

UNIT-II 10 Lectures
INTRODUCTION TO PATTERN RECOGNITION:
Machine Perception and an example, Design cycle of pattern recognition system: Data collection,
feature extraction, noise, overfitting, model selection, prior knowledge, missing features,
mereology, segmentation, context, training, evaluation and computational complexity, Learning
and Adaptation: Supervised Learning, Unsupervised Learning, Reinforcement Learning.

Learning outcomes: At the end of this unit, the student will be able to
1. understand the rationale behind pattern recognition (L2)
2. summarize different learning approaches (L2)
3. illustrate the design flow of the pattern recognition system (L3)

87 (R-2019) 
 B.Tech. in Electronics and Communication Engineering, V/VI/VII/VIII Semester

UNIT-III 12 Lectures
PROBABILISTIC MODELS FOR CLASSIFICATION: BAYESIAN DECISION THEORY
Introduction, Bayesian Decision Theory – Continuous Features: Two class classification,
Minimum-Error-Rate Classification: Minimax criterion, Classifiers, discriminants and Decision
Surfaces: Two-class and multi-class, Univariate and multivariate density functions, Discriminant
functions for the normal density, applications.

Learning outcomes: At the end of this unit, the student will be able to
1. understand the importance of probabilistic models for classification (L2)
2. apply the concept of Bayesian decision theory for real time classification problems (L3)
3. illustrate the construction of decision surfaces for two-class and multi-class. (L3)

UNIT-IV 08 Lectures
DISCRIMINATIVE LEARNING BASED MODELS FOR CLASSIFICATION
Logistic regression, Perceptron, Multilayer feed forward neural network – Gradient descent
method, Error backpropagation method, Applications of logistic regression. Support vector
machine- a brief introduction.

Learning outcomes:At the end of this unit, the student will be able to
1. describe the basics of the Neural network (L2)
2. discuss the role of optimization in neural network design (L2)
3. understand the concept of support vector machine for classification (L2)

UNIT-V 10 Lectures
TREE CLASSIFIERS:
Decision trees, CART, Random Forest- a brief introduction, applications. 
NON-PARAMETRIC TECHNIQUES FOR CLASSIFICATION:
Non-Parametric techniques for classification: Kernel Density Estimators, Parzen Window, Nearest
Neighbor Methods, applications.

Learning outcomes: At the end of this unit, the student will be able to
1. illustrate the construction of basic tree architectures. (L3)
2. understand the concept Random Forest(L2)
3. apply the concept of nearest neighbor classifiers(L3)

Text Books:
1. C.M. Bishop, Pattern Recognition and Machine Learning. Springer, 2006.
2. R.O. Duda, P.E.Hart and D.G.Stork, Pattern Classification. 2nd Edition, John Wiley, 2001. 

References:

1. Jack M. Zurada, Introduction to Artificial Neural Systems. PWS Publishing Co., Boston,
2002.
2. Klir G.J. and Folger T.A., Fuzzy sets, Uncertainty and Information. PHI, New Delhi, 2008.
3. S. Theodoridis and K. Koutroumbas, Pattern Recognition. Academic Press, 2009.
4. E. Alpaydin, Introduction to Machine Learning. 4th Edition, PHI, 2010.

88 (R-2019) 
 B.Tech. in Electronics and Communication Engineering, V/VI/VII/VIII Semester

5. G. James, D. Witten, T. Hastie and R. Tibshirani, Introduction to Statistical Learning. 2nd

Edition, Springer, 2013.
6. https://nptel.ac.in/courses/117/105/117105101/

***

89 (R-2019)