NITTE MEENAKSHI INSTITUTE OF TECHNOLOGY

(An Autonomous Institution)

Approved and Accredited by AICTE, Affiliated to Visvesvaraya
Technological University, Yelahanka, Bangalore - 560 064.
Department of Electronics and Communication Engineering

MID SEMESTER EXAMINATION-II ONLINE

MSE: II
Subject Name : Information Theory and Coding Duration : 1Hr
Faculty : Dr.Rajesh.N, Ayesha Siddiqua, Marks : 30
Ms. Shreshta Shetty Date : 15-12-2020
Subject code : 17EC72
Instructions: Ans any 2 full questions from PART B

Mar CO BT
Questions
ks

PART A
1 MCQ’s through Google form
PART B (Answer any 2 full questions)
2 a Determine different entries for the JPM given below and verify their 6 2 2
relationships.
0.4 0 0.02 0
0.2 0.02 0.01 0.06
𝑃 (𝑋, 𝑌) = 0.1 0.01 0.04 0
0 0.04 0.2 0.01
[ 0 0.06 0.02 0.2 ]

b A black and white television picture may be viewed as consisting of 4 2 2

approximately 5×105 elements, each one of which may occupy one of 10 distinct
brightness levels with equal probability. Calculate the channel capacity. Assume
a) the rate of transmission is 40 picture frames per second and b) the signal to
noise ratio is 50dB.
3 a Find the channel capacity and the corresponding source probabilities for the 6 2 3
channel matrix

0.6 0.2 0.2

P(Y|X) = [0.5 0.2 0.3]
0 0.6 0.4

b The parity check bits of a (7,4) hamming code are generated by 4 3 3

c5= d1 + d3 + d4, c6= d1+ d2 + d3 and c7 = d2 + d3 + d4

where d1, d2, d3 and d4 are the message bits.

Find the generative matrix and parity check matrix for this code.
4 a Consider a (7,4) linear block code whose generator matrix is 6 3 3
 1 0 0 0 |1 0 1
0 1 0 0 |1 1 1
𝐺=[ ]
0 0 1 0 |1 1 0
0 0 0 1 |0 1 1

(i) Find all the code vectors of this code

(ii) Find the parity check matrix of this code
(iii) Find the minimum weight of this code
b A binary channel has the following noise characteristic. 4 2 2

2/3 1/3
[ ]
1/3 2/3

If the input symbols are transmitted with probabilities 3/4 & 1/4 respectively,
find H(X), H(Y), H(X,Y), H(Y|X) and I(X,Y)