Course Title: INFORMATION THEORY & CODING L T P/S SW/F TOTAL

W No. of PSDA CREDIT

UNITS
Credit Units: 2 2 - - - 0 2

Course Level: UG Course Code: TELE311

Course Objectives: This course introduces the concept of information theory in communication systems. The objective of the course is to provide thorough
understandings of different types of codes are used in modern communication systems

Pre-requisites: Communication Systems

Course Contents/Syllabus:
Weightage (%)
Module I Introduction 15

Communication Process, Model for Communication System. A Quantitative Measure of Information, A Binary
Unit of Information, An Outline of Information Theory

Module II Basic Concepts of Information Theory 30

A Measure of Uncertainty, H function as a Measure of Uncertainty, Source and Binary Sources, Measure of
Information for Two Dimensional discrete Finite Probability Scheme, Conditional Entropy, Some Basic
Relationships Among Different Entropies, A Measure of mutual information, Redundancy, Efficiency and channel
capacity, BSC and BEC, capacity of Binary Channel.

Module III Elements of Encoding 20

Purpose of encoding, separable binary codes, Shannon-Fano encoding, necessary and sufficient conditions for
noiseless coding, average length of encoded messages, Shannon’s binary encoding, Huffman’s minimum
 redundancy codes, Lossy and Lossless data compression techniques.

Module IV Introduction of different types of coding schemes 35

Linear Blocks Codes: Basic Definition, general properties of Linear Block Codes, decoding of linear block codes
Cyclic Codes: Definition and basic properties, systematic cyclic codes, Encoders for cyclic codes, decoding
for cyclic codes
Convolutional Codes: The structure of convolutional codes, decoding of convolutional codes, Turbo Codes
and Iterative decoding.

Course Learning Outcomes:

At the end of the course the student will:
• Be able to define and outline the basic concepts of information
theory (entropy, uncertainty, compression and coding etc.)
• Be able to classify data compression techniques into lossy and
lossless methods
• Be able to design an efficient data compression scheme for a
given information source.
• Be able to define channel capacities and properties using Shannon’s Theorems regarding the limits of error-free communication.
• Be able to explain the impact of feedback and/or many senders or receivers in the
communication process and
• Be able to Illustrate the implications of coding theory in modern
technology.
Pedagogy for Course Delivery:
Teaching the course using information and communications technology (ICT) to assist and enhance learning throughout the curriculum. Interactive
classroom learning lectures, discussions through forums, assessment via quiz, and application of gained knowledge through assignments, and case studies
that will help the student to interpret as well as apply the concepts of the course.

List of Professional Skill Development Activities (PSDA):NA

Lab/ Practical details, if applicable: NA

Assessment/ Examination Scheme:

Theory L/T (%) Lab/Practical/Studio (%) Total

100 NA 100

Theory Assessment (L&T):

Continuous Assessment/Internal Assessment End Term Examination

Components (Drop down) Attendance Mid Term Exam (CT) HA Class Quiz EE
Weightage (%) 5% 15 10 10 60

Lab/ Practical/ Studio Assessment: NA

Continuous Assessment/Internal Assessment End Term Examination

Components (Drop down)

Weightage (%)

Mapping Continuous Evaluation components/PSDA with CLOs

Bloom’s Level > Remembering Understanding Applying Analyzing Evaluating Creating

 Course CLO1 CLO2 CLO3 CLO4 CLO5 CLO 6
Learning Be able to Be able to Be able Be able to Be able to Be able to
Outcomes define and classify data to design an define channel explain the Illustrate
outline the compression efficient capacities and impact of the
basic techniques data properties using feedback implications
Assessment concepts of into lossy and compression Shannon’s and/or many of coding
type/PSDA information lossless scheme for Theorems senders or theory in
theory methods a given regarding the receivers in the modern
(entropy, information limits of error- communication
uncertainty, source. free process technology.
compression communication.
and coding
etc.)
 Home
Assignme
nt
 Class
Quiz
 Mid
Term
Exam
 Viva
Voce

Text Reading:
An Introduction to information theory by Fazlollah M. Reza.
Digital Communications by John G. Proakis & Masoud Salehi
Modern Digital and Analog Communication Systems by B.P. Lathi
Communication systems by R.P. Singh and S.D. Sapre

References:
An Introduction to Information Theory by John Robinson Information Theory by Robert Ash.