Professional Documents
Culture Documents
Assignment 1
Assignment 1
Information Theory
In the year 1948, Claude Shannon came up his model of
communication system which remains the foundation of
communication system till date.
He proved that amount of information that can be transferred is
1. directly proportional to bandwidth, B
2. a logarithmic function.
So, N=B∗log 2 ( M ),
(
Rb ≤ C=B∗log 2 1+
PS
PN )
where, Rb = Data Rate
P N = Noise Power
From the above equatioin, we can conclude that the data rate of message transfer cannot
exceed Channel Capacity, it is also known as Shannon’s Limit.
1|Page
CT111 Lab Report
PS
Here, the ratio is also known as Signal to Noise Ratio (SNR). The greater the ratio, the
PN
better the signal.
SNR can also be written in the following form,
PS ES
SNR= =
PN N0
Another quantity is E B which is energy per bit, and is related to E S as given below,
RB
∗EB
ES B
=
N0 N0
Efficiency
There are two kinds of efficiencies associated with communication systems i.e., Bandwidth
Efficiency and Power Efficiency
1. Bandwidth Efficiency : As the name suggests, it measures how proficiently is the
bandwidth for the signal utilized and is given by,
η B=
RB
B (
=log 2 1+
PS
PN )
2. Power Efficiency : This is used to know how accurately is the power of signal is used
and is usually inversely proportional to power of signal.
1
ηP∝
PS
1
From the above equation it can be seen that η B ∝ , which shows that the signal can be
ηP
either power efficient or bandwidth efficient, but not both.
Lab Exercises
EB
1. For this exercise, a range of is given and their respective bandwidth efficiencies
N0
E
η Bneeds to be calculated. A final plot is to be made between B and η B . Here, is the
N0
MATLAB code for the same.
2|Page
CT111 Lab Report
(P.T.O)
%%Below 2 statements clears all variables from workspace and %
%close all other running MATLAB program.
clear vars
close all
Results :
ES
This graph shows that as the signal to noise ratio ( ¿increases, the spectral efficiency also
N0
increases, resulting in an increase in the data rate.
From this exercise I learned the following in MATLAB :
1. Working with MATLAB editor.
3|Page
CT111 Lab Report
EB
2. Creating vectors (here, for and η B)
N0
3. Various functions related to plotting graphs :
a. plot() : plots a graph for given 2 vectors, with some customizations like
adjusting linewidth of the graph.
b. xlabel() : adds a label to the X-axis.
c. ylabel() : adds a label to the Y-axis.
d. grid : adds grid to the plot.
2. In this exercise, for given range of Bandwidth B, 0 – 10Hz, resultant Channel capacity
was to be found for Signal Power PS = 0dBW and 12dBW.
For this problem, P N was taken equal to B, because P N is often given by the area
under the graph of B vs . N 0 , so its value can be written as P N =B∗N 0, assuming N 0
=1, then P N =B .
Following is the MATLAB code for this exercise:
%%Clearing variables and closing running MATLAB programs.
clear vars
close all
%%Creating a vector with same no. of rows as PsdB and no. of column as
%%B with all elements initialized with zeros.
C = zeros(length(PsdB), length(B));
Results :
4|Page
CT111 Lab Report
3. In this exercise, I had to vary PS from -5 to 10dBW and calculate C for bandwidth values
of 1, 2, and 10 Hz. Here also, P N is assumed to be equal to B.
clear vars
close all
%%Creating Ps vector and converting it from dBW to W.
PsdB = -5:0.1:10;
PsW = 10.^(0.1*PsdB);
5|Page
CT111 Lab Report
Results :
4. Here, the range of bandwidth is given as 0-10Hz. I have to find values of PS for C values
of 1 and 5 bps.
clear vars
close all
6|Page
CT111 Lab Report
ylim([0 10])
grid
Results :
5. Method 1 : In this method, for given range of η B, from 0-6 bps/Hz, I had to find
Eb
corresponding values of .
N0
Eb
Method 2 : In this method, for each given value of , from -2-10 dB, I had to search for
N0
possible values of η B satisfying the below equation.
(
η B=log 2 1+
η B Eb
N0 )
%%Method 1
Nb1 = 0:0.01:6;
%%Finding values of EbNoW in W and then converting it to dBW.
EbNoW1 = (2.^Nb1-1)./Nb1;
EbNodB1 = 10.*log10(EbNoW1);
%%Method 2
EbNodB2 = -2:0.1:10;
EbNoW2 = 10.^(0.1*EbNodB2);
hold on
plot(EbNodB1, Nb1,'linewidth',2);
plot(EbNodB2, Nb2, 'linewidth', 2);
xlabel('Bit SNR Eb/No in dB')
ylabel('Spectral Efficiency in bps/Hz');
legend('Method 1', 'Method 2');
ylim([0 6])
hold off
grid
Result :
Eb
Ques. At what value of does η B become zero?
N0
Eb
Ans. There exist no value of for which η B becomes zero, because in the formula
N0
E b 2η −1
B
Eb
= , the value of reaches infinity as η B tends to zero.
N0 ηB N0
8|Page
CT111 Lab Report
Conclusion
1. How would you define the information?
A. Information can be defined as a way of communicating ideas to one another in a
language known by both sender and receiver. Information cannot be restricted to any
particular topics; it can vary from the size of atoms to the size of the universe.
10 | P a g e