Lziciencaj Ledundanu

R hee Y e 7 traceien
REXIDO ; eh -

Bina SUmmesic Chunnel W =1-w

PY)=
PCXo)=w
oOIP mbols. (=o; x-1) ;
Twe olP mbel CMo0 1 )

PC1l0) PCO1) p nme me ie

Tyawsttubn dicRam
P

-P

Channes Matix P
1-P
PC%) Cl 1-P
TCY) C%/2) PClx)

Ehhop Eauuvocaticn

pgu). check
PCy
I Cx)

3 2
PYobab iky
TO t a l
TheoreM
a = Pw+Pw

P C % / z ) P C Z )

HCY/ P6) Pw
w++PPü
PCo/xo) PCi/z). PCx =

PCY)
PC91/2).
PCTo)+
PCy
(
Pw+Pw
HCY)
 k-1
HCY/) Channe
K 0 0 Crond
o Pbse
ol1) 0 PCz0) and e:1A
PCo)

P dog, CV
w log, ( ) uw
g,(v,).o t l o g ,
C).w
P
ko9, () + P
log, CYp)
Numeri Cal
nel a PCz)-2/3 P7) - y
A nar sumehic
bi han

and pY|)=N3 / 4
H CY); HCY/R); HCX/Y); 1 Cx )
fud a)H(), HY);
b) hannel Capoy
Cc) Channel Gicenty &Hadiondancy CGiridharj

[x.y ) - HCy)-HCY/k)

Hanne Capaciy
memiC CmaneA ipmbellsc

C marI[x:v
RCPCK)=N

HCY) wiube MaOuum when ast mbets aoe qu pebable

Fta
Pw+P w P w

fu-/4 22 1
 enen P tm bets oo
ecuu oropaie
(1.e) w =w

Pw P PP)w
PC Pu+Pw (P)w: w =
aWkowen yP mbots ane uiprepabe
Hc-4 H) Max

H )
LC )mar C)s m a thu wuu e a lenkt ant

t mméi c Chan nek

HCmcL
-
H (9) 1-|loe)+F*e)
ChaonelCagaity o BSc
to Block (odes B C .
Channe Codu e Aem
Locks
vided uto equueutial
MARAAR uen Ce

2aven
00 10 o
K 2
AAA D
n k bit bleck E
66SE
E
loeled sn to
adn ow u
B BB
BBB
BBB
BBB
ccc
CCc
AAA
AAA

n-k3-2=
1
=

Redundant
added

Y K/n nade
Code ate
o Vey lew vaie lan
oduaA (i) 7Rt C yef Codun
Ch a n n e t

Tc see
Tc $ec
avulable
f edey
nannel
Qnd ue
 ScwLe emut
NCaU equaliyuka bngou m of

bit 80AW tnbot

tbtcend t bue Tw.msOM1ate

Th
Pawed to a nCodgo w n at
Lot Qnlode Produce t m bet 2n yeruy Te Sec
Qnannel atau h C
T1msmuD a (V m betc
Channel u n NEY Te
En Codu
tue ownt mho Cassind by d4
nd eNem n
hanuel Cap a hy'c bit e
Chane
In ene
Becend ne

Qud tue atuannel Capa cu hy iu

JheorNm Rt C
B Cngnne codnq

cke
bunaa mbe 1
nit 2Aual
seunte

eend
HS) biF twve e equauy kaly bqmlia)
usae tmbo

bi |gecend
HC) )
bute n eveny
t o Auce Bimhets
E n Codea
mas
lnou

Code ete =
Ts
Jheovem talis ue le e [ero when

codung
CnanneR

R C

YE
 uut
CaTyansmsie

utp HcG) nied

R

ue Buqe ung
Capai Am 1
3be TynimiHed

Yate bitu .
Cnuodsd mbet
Channel Mce Ci cbiu

chann in e ecend
twmes

ue Channe20
tve SeLond
us C/c) Cafacahy

heoyem 4 Te

Y4C

(eno but to) tohave a Code vate

aCheir e e

Difeeutal Ensopy Muulual bnko , Cetnuou Ensem bles

be ConttnuaWs Rondenm Voui able wuctn Pas fC

Curter o u H C)
hc) Centinubuk

hcx Sfc)lo32 (co dz dffeeutal eukepyq x

hen CAw efhe n marimun, o r a auirialau

wuicn hCx)
Paf feT
Vaiante
as
tuticM

nd e Pf fca
Ci
Cestauat Cewst Pove)

Ond
Provid ho ma

Y2
 multpus LE anag aslnpa Rak o molbi bea

hCa)
1- fa) d1

hC) wa wintn
alon
Tdhtx)

ft) 2 -o
fce le, fcz)
4A2(7-4
-o
+
e c .

-io2
Log. ln e

(Y-u) - Jed
+m
A 2 1

c e
Cons e o u t s

uoO

J o , noa) 2

ausian Rv
(z-42

dog, (2ed).

w
w un
Ond R.V.
RV.
Y
Y n

d , forauy
uwan
ebsex vatien RV
Guss ian
ovt
OCe AuKhy

h Cx) hCy) y 2
detu ruuwad
unique Vasianced
b c y ) when x7
x 7hG
au k
au ii
b aan
n

YE

Ps) 1 Chetk
Simlaa
Mal
2 dd
1x:y) S fez) e,
fhus
1Cxy)1 [Y:xJ
hCY%)
h ) - h C/y) = hCY) -
y
whee c)Aog, da dy
Cayaiy 1heovem
Channel
Cenve
te encOdeA bi
evaa
CoaA
uauieå iP e b e TzeA
Sowce enteded lkit
heu mo tume
Y eve roY va
Chaune Coou Channel
xed oveA hanhel hen
Can he
Chanyel coa 7 'neuo man ous
Peuse imiled
ptem
Avaloy a ist wwas nedad h tha
whep 34owma ocbua, {hoPa
Rubim
on The end YaMon laru
eCom b
2 boxes a d i n , i a a d
Caoo Anuas
A
hou o falk e m
whntn k needad
Qmd ecu t
- . R a c Ke
enu a owun hand baq Coveig 8
in me
fove aND wo to1)
KeoP C o n , Nyap
Ar Jm
a t t y Peuckod box
Place i
haN nel todug
O i u eve
YLuuw,ae aa
val ows ham y
tocwe td a
NO e Know unmi um Sfaco
widun hann md
tond eed
0un beal We tLeny au tnar fowea
napemte
Nove eent
ThiNs
hadon le fhe Vetde, he maN umg Car Casy
 ac
une wsemce .
To
Cenki de the
bewice Loidan
ci) mean
Aften sam plma stationa Pvocess band imied to
hane e ate
nomPles e heuate. sncn thaj
26bamlas|ke
X K 1,2, n
aLe the
sam ples
Sounpw
Contnaeus andm Vauable 2 G
Ciin 3 56 | z
Cotide
Cnrnel c s alo
and Del
Bandumited to S0
2 u|2e
K X 2
The bamples 26 hee
Ynsmi Hed n T ecends n
(e) C
CnaesrPles 28
2 S u m Ples
28T 6am l e s
T ec7
2 BTSamplas
C an he hannel, i s
Trasmi ed Bqal eatunbed y AWaN
amd .sd No Band im l d to B lz
ci.e) Na
Nose 6an Plee
7Nk The no: no* emple
EC o K 2 ampts
a n haye Powei
ation
otPoure
0TKem pus- N
Each bample nas Pewen C.e)asiante
Psd= Ptue
=
W les
Psdx B.wNox 2B No0B blen Pfsdx Bw
2 No P
NB
Lek 9tecet
ed qval be Y k= , 2, h
vi) The bamples e
hen +K
Ye
 he Samples QL ksumed Ao be tatsti ally indlePende

The depion abeul ne kud Chnnel

DuCWe tme MOuOle Gauslan Chann

Aamples ae 7 Recewed sampleg
Cowsideed oe ndetendent

ii) o usllus alt Cuannel, Censiden the T

undestaud

ewer Simited
Cie) E C - P Nenaae Ted fouves
Thws
Channel
apaity
Max
CX:y) E[)=P
a max Muulual
Samples
Ci.e) mun sAue to BUL Sam ple N
wherh
ohen The
s iqnal Power/Tedfope Sampe
P
Cent RV

3 Nk ae
Y Xk+Nk and independent
h

h CX XK /o
hN/ C)
fCf9)
FCx)
h-aveaq aus we lan wo le
fx)
+hA
wna ,a
T vuiney hakwyl um
 , / a n L. .. .

Nete (YA) ht

h -[/

tN

C,y)
e ndependeut
N k

h[nelx h[nk] Check

hx] E Cx O ftND,
fcN-0=
Vx+N Y noie N 9
duumuned
and NY- lp

an
tdep

h - htn) * N
3 [ 7 S e ) tye] and ma
maxh
Posen
fmax1
['yd gawsian Rv
Y A h o u d d

saussi a
a K u m e d

mauumum,
h e

aunan
Gaussian

For YK
ausian
and E [xEJ=P
8uch t h a F X
1[x:k P
E [xKJ=
dussian,
?k
9eJ: f+d
I E[xe]+ E[NEJ:
=

xN) as en er
E
Sechon
EY
i e(P+d)
lo9,
h[y
tog, e
hN
YE

LCheck
Ps)
 Channe Capati y

C 1
h [yhnJ
Ae, 2P+oJ
2 e2Te &2
-
og, + bk (ehannel uswe
n &amples ane TLed Ves ccends
wun banple at a tne OVes e ahah n el
en Umit time Cn)Samples ou wsed
Oe t Txed
2 &ample3
m

2B ttmes uo Channel
Ci-e) 9e Bamples Muual

Thansmt log
eNeay tume

tume
Channel apaci ny wnt P%)i/gec
2 x og, (14
C
2B
C14 P/62) bi 7
C tog,

Lo, C1 NoB
b i (see.

ahannel Capace hy
Shannen
Shanon Hanlcly
B w bHz, Pestube
heorem net
Chan
led m B ven bi
Capaci y4 o nu
Cud
he
by AwGN Psd
No2 nere2
C1P bib/s
No B
C' bps
yale
0
rea Powe ine
Teed
at
Can e tuan t ' aud
aNenaRL 3no
not
i Jhe
B w B but
Power P, thu ,
XCH 8heuld be
a 3tven
foY m
Pe wwa CpoK encoduq slem appre alh
tD
da s in
 Dota Tote =Rb biz la
Chann Capatth c R blsec
Averase
vera Tzd Power
P
E Energy ftit=Eb
Capati y Theoern
ie sec

tog, ( NEp"C)aluc

I+

E b/NO
noise P ratio
Yatio.
noise P
bit to
Energy PT
SNR
6w. iciency

Eb foY
nfini e B.

Ele)-1
cle
te)+B (
le1
C2

B7
cle

YE
 an infinte

B-Y No An (2)-I-6de
Shanen imit
B- (C) =
2 78
No

Capaity bound a Ty the TVe

fUY Chih cal bit
KC
Cii) FoY an 1dcal Sustem

Pe EbNo n 2)
TUTORIAL Eb/No&DenC2)
Numen cal
Problerm epicBSC
. A PC2)= /s3
Binayy smmesic Channe
Ond PC|)= «9/
Deemine ti) HC) tn)Hcg) (ii) H(X
,99Civ) H (x] (w ACur
Cvi) I ( y )

w1SN
15 `15Pa % P V
-R() e3, NA) 213, w-
w= /s P
HCY) P- 3/4
HCx)2Pai)loa2 2 los, (%) +o4, O.4185 b'k/membo

5
Os9199 a Motmot
CY/)
ua = H *
HCX, 9) (+H (y/)HY) (Wy)| H CxY) .4183 +O 813
HCY/4) H(1)tg) = 61 2q -o q 19q 129 b mesk aqsmbe
3t1,)
0HA bfm
B/mas km be
Power

foY a
ven enlodu
fer aT mcul
wa CpUx
w wma
le Cpu enCoo Dappie
Mianing with
 hannel
CaaiC - HC
Plog, Yp) +P lo, Ye))
- 0 SA3
133 byms
Channee
I(x,9) Olb8
o 18 81

2
or aoove Cee
incoder Li.e) anput mbcs
roduced hinl)t sm|Rc Ci) 22 mbet| se c
mmbet5ec
what
T l e rate ?
Rt
1(7 s =o.169. biz [gec
0.3372 i t sec
Tate Povevides Bmeul
Re Re 4c
Rto:lb%b o|sec
m bot faec Pevis
SmallAANo1
ean o Seunte
bpm bel s o be en co ded
Tuon
hbld be
Coderal
YY 1884 bi

4o1881
3. oPie Dt feeutual

Y'e e Veikaqe . Pphed Omplu fum

d t beJe P Fmd e
vettage oduffenenial &ulaep
X and . x
wuformu dusw huled n me Auluvel O, 4

H) og, 4) .d1 4 ) [1

4 ) - 2 bi samtle
J

-T
 Sdea
ST. L aund ay 1mphcallen
(EDND )o mCo)
nC) L log, e
No

bpauly hovem e- 6 P
le, ( NoB
Apg, ( No
+ P E'C
N

B . (2b_1)
No

J
B7 No

Put C/e
70

70
No

tho
(-1) J y-1) An
J 9-71 ncy)

y- in nCa)
3,
Jn C2)

B7 No

3 ,( P No
N
N B
No
og, (1 P
Nb
 Nob
t C P dg, (1+ P
870 N, B
No B

Put
NB
dg, (1+ PN%B drng, C x ) /
NeP 2

tlo NB
76

(H)

Aun C1+x) l,e L

t ( nHZ) n t)
E Cl+x)
Ct+x) (ww 4espital ule)
No m

Imilcatiey
t Loos like l7o et So
OThean B BAo
No afecks m ucn way aat and t u B Ppyoa he

a cntant 6
Vaue m h equal too
To obtaun a i ulc han nel tapaci y w
ona x Kmst w.*m
S.(= 8has To e increayad malo
(o)Ka@p eons and
mcéase

KO J
 -7
C/s) ] 1 tx
4 o12AW
hdoa oaymo)
haou mapra
(h'x)H
bar ! x )
y 9 m
bdmm IAO
6&]"borh4 (1
naermng
. ''x
 S

(
O

N
-N

O -00
T Os