Professional Documents
Culture Documents
Quiz 4 - Model Answer - Information Theory and Coding
Quiz 4 - Model Answer - Information Theory and Coding
Quiz 4 - Model Answer - Information Theory and Coding
Quiz 4
Model Answer
Question (10 Marks)
a. Discuss average information carried by an individual bit
b. Assume M equally likely to occur messages and each message is coded into N bits
such that M = 2N ; calculate average information carried by an individual bit ^
H bit