Save trees use e-Question Paper Go green DOWNLOAD THIS FREE AT www.viuresource.com Ges Sehsile USN | ‘ifth Semester B.E. Degree Examination, June/July 2018 Information Theory and Coding Time: 3 hrs. sks: 80 Note: Answer any FIVE full questions, choosing one full questiog 1a. Withnca sketch, expan the block dtprame an informa (04 Marks) "Define entropy. State various properties ofthe entropy. (04 Marks) i So1 3 b. BAU is composed of dots and dashes. Assuming gh Wjyimes slong asa dst and has 2 the probability of occurrence. Calculate: 5 3) the information ma dot anda dash. ig ih The entropy of dot dah od eS iii) The average rate of information if a dot last#4@g, lOmjff Seconds and the same time is & llowed between sino (oe Mars) $ Ba . EE 2 a. Derive anenprssion forthe entonyo zero memory source, _(0sntarks) BE 78. The ist oder Markott model sh Find te state probabtes entony ot i ‘each state and entropy of the sour (10 Marks) i zr om pete: 3 gf 02 Be 3 : i Fig.026) a BS 3 a. Apply inary JRoding algorithm to the following set of symbols given in table a below. choy. : (os as) 2 Symbols] A] B | © [DT E ; Pfieinetane fiat 3a a3 bb. Consider Rgource 8 = {5-3 with probabilities 3/4 and 1/3 respectively. Obtain Shannon- a P source Sand it 2" extension Calculate efficiencies for each case. Comment - onthe orn 83 ds i 1sitMPa source with & alphabets A to H with cespective probabilities of 0.22. 020, 018, ; 008005 and 0.02 Construct Haitnan's code and detonmine ts fice. & (10 Marks) : vith an iastarive example, expin arithmetic coding techigue ‘onan Fof3 BRANCHES | ALL SEMESTERS | NOTES | QUESTON PAPERS | LAB MANUALS A Viuresource Go Green initiativeSave trees use e-Question Paper Go green DOWNLOAD THIS FREE AT www.viuresource.com seg Module-3 5s, Define: i) Input entropy ii) Output entropy ii) Equivecation iv) Joint e ans ¥v) Mutual information with the aid of respective equations. b. Ina communication system, a transmitter has 3 input symbols A= (ay, a:, a3) aM@hgeceiv alse has 3 output symbols B = {by, ba, bs). The matrix given below shows JPM. @ ji) Find missing probabilities (+) in the table, hs rae) . A transmitter has $ symbols with probabil 1 and 0.2. Given the channel shat PIA as shown below, clue ‘canny 0 ° I 0 v3 23 a Jon oe forts. 4(/N) rato bs 10, cle the chanel igiormeion mi ‘eannay pra ava 8 tas cant manic wer ce and POX) = Ti) VX) an WOK.) (coma . Fagite Ngee capaci ott channel shown i Fi. 0.6(0) using Marogs's mein a e By ec = ot Fig.Q.6(c) 2ot3 BRANCHES | ALL SEMESTERS | NOTES | QUESTON PAPERS | LAB MANUALS A Viuresource Go Green initiativeSave trees use e-Question Paper Go green DOWNLOAD THIS FREE AT www.vturesource.com 7a, Distinguish between “block codes" mvolution codes” + ° | . sethantes seas Dig ooeee erences b. Consider the (3, 1, 2) convolutional encoder yyiting’ ‘g'= (101) and g = (111), [oe 10 a. For a (2, 1, 3) convolutional enc * = (1101), g” = (1011), draw the encoder Seo bl oer i iene ae ww. ~ 30f3 BRANCHES | ALL SEMESTERS | NOTES | QUESTON PAPERS | LAB MANUALS A Viuresource Go Green initiative