Department of Physics:

HETT210: Digital Communication Systems

Continuous Assessment 1:

1.  From your knowledge of a digital communication system, answer the following questions:

(a) What is source coding ? [2]

(b) What is the purpose of the channel encoder and channel decoder ? [2]

(c) What is the purpose of the digital modulator and digital demodulator ? [2]

(d)  Describe how the performance of a digital communication system can be measured and explain the parameters
that can limit the performance of such a system [4]

2. Define Mutual Information. Explain how it is related to entropy for a lossless channel, prove that
H(X/Y) = 0. [10]

3. Find the generator and parity check matrices of a (7, 4) cyclic code with generator polynomial
g( X )  1 X  X 3 . [10]

4. From channel capacity theorem, find the capacity of a channel with infinite bandwidth and explain. [5]

5. Consider that two sources emit messages xl, x2, x3 and y1, y2, y3 with the joint probabilities
p (X, Y) as shown in the matrix form:

3 1 1
 40 40 40 
1 3 1
 
 20 20 20 
1 1 3
 8 8 20 

a) Calculate the entropies of X and Y. [6]

b) Calculate the joint and conditional entropies, H (X,Y), H (X/Y), H(Y/X) between X and Y [9]

c) Calculate the average mutual information I(X;Y). [4]

6. Construct the Huffman code with minimum code variance for the following probabilities and also
determine the code variance and code efficiency: {0.25, 0.25. 0.125, 0.125, 0.125, 0.0625, 0.0625} [10]