Assignment 1 MET 1413 Advanced Digital Communication

Semester 2 2011/2012

ASSIGNMENT 1: INFORMATION THEORY

Due date Description : 22rd March 2012 (Thursday), 3 pm : Each project is to be group effort. Please write all your answers in white A4 paper. Marks will be deducted if you use other type of paper. : Answer all questions and show clearly how you get the answer for each question.

Instruction

1. Find the entropy of X, provided that X represents the outcome of a single roll of a fair dice.

2. Lempel-Ziv algorithm is a data compaction algorithm that is adaptive and simpler to implement than Huffman coding. Using Lempel-Ziv, encode the following binary sequence. 11101001100010110100 Assume that the binary symbols 0 and 1 are already in the codebook. Your answer MUST include illustration on step by step during the encoding process. The final answer should be in binary encoded blocks.

3. The transition probability diagram of a binary symmetric channel is being considered, assuming that the input binary symbols 0 and 1 occur with probabilities and , respectively. Find the probabilities of the binary symbols 0 and 1 appearing at the channel output.

NMAL, FKE-UTM