BAHIR DAR INSTITUTE OF TECHNOLOGY (BiT)

FACULTY OF ELECTRICAL AND COMPUTER ENGINEERING

Digital Communication Systems (EEng4111)
Individual Assignment- I
Due date: 27-08-15

1. A WSS process 𝑋(𝑡) has autocorrelation function

𝑠𝑖𝑛(2000𝜋τ) + sin⁡(1000⁡𝜋τ)
𝑅𝑥 (τ) = 10
2000𝜋τ
The process 𝑋(𝑡) passed through an ideal low pass filter with frequency response
1, |𝑓| ≤ 750
𝐻 (𝑓 ) = {
0, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
Let 𝑌(𝑡) be the output of random process.

a) Find the average power of 𝑋(𝑡)

b) Find the power spectrum density of 𝑌(𝑡)
c) Find the autocorrelation function of the filter output, 𝑅𝑌 (τ)
d) Calculate the average power of 𝑌(𝑡)
2. Consider a Binary symmetric channel shown in figure below

a) Find the channel matrix of the channel

b) Calculate the mutual information 𝐼(𝑋; 𝑌) when the channel input probability⁡𝑝(𝑥1 ) = 𝑝(𝑥2 ) = 0.5 and
𝑃 = 0.5, comment on the result
c) Find the channel capacity of BSC

d) Plot the capacity versus 𝑃

3. Consider the codes listed in the table below. Determine whether or not each of these codes satisfies the
Kraft inequality, and if a code does, determine whether or not the code is instantaneous, and if a code does,
construct their individual decision tree.

4. A source has an alphabet {𝑎1 , ⁡𝑎2 , ⁡𝑎3, ⁡𝑎4 } with corresponding probabilities {0.1, 0.2, 0.3, 0.4}.

a) Find the entropy of the source.

b) What is the minimum required average code word length to represent this source for error-free
reconstruction?

c) Design a Huffman code for the source and comment on the average length of the Huffman code

d) Design a Huffman code for the second order extension of the source. What is the average code word
length?

e) Which one is a more efficient coding Scheme, Huffman coding of the original source or Huffman coding
of the second extension of the source?