Professional Documents
Culture Documents
Pdcs-Assignment 1
Pdcs-Assignment 1
1) The following table shows the joint probability distribution of two random
variables X and Y with respective values and
. Calculate H(X), H(Y), H(X,Y), H(X/Y) and H(Y/X) and I(X;Y).
1/3
1/3
1/3
1/4
1/2
1/4
1/4
1/4
1/2
4) A DMS has three output symbols with probabilities {0.5, 0.4, and 0.1}
i) Determine the Huffman code for this source and find the efficiency .
ii) Determine the Huffman code for this source taking two symbols at a time and
find the efficiency .
iii) Determine the Huffman code for this source taking three symbols at a time
and find the efficiency .
Compare the above three efficiencies and comment.
5) Consider a DMS with source probabilities {0.20, 0.20, 0.15, 0.15, 0.10, 0.10,
0.05, 0.05}.
i) Determine an efficient fixed length code for the source.
ii) Determine the Huffman code for this source.
iii) Compare the two codes and comment.