Lufermatzon THeory ian Ope Conte (BECSY ee (Time: oS Feb/may. 2020. a Mont, Marts | (00)) Solutrons a Sdreme Prepatred by Se pref, RAGHAVENDRT NAGARALLE a or Head of the Department Qeptat Eleni Conmuniaion 699 HLS VOLT. HALAL (U: K)1gecsy amen aie aotovmadror Theery and Coding. Fels/hiewn0n1 : Man.Mordisslog Module-4 La). Deke Sal. rrlermadtron Why loqarittmre emgvescron ws chosen for wreosurm'g * mon A. Avs -ay) Le Su bea Symbol chosen: for dorms ron ab omy fame wok a probability Eyal to Py. then the SU — nfowmration a mrcsane Su fs gen by. 6 oto t TH bore A loys 2 trem Unis ig * TA Bae a bogs LO, Hen units ce are Ph bare of tog fs €, Mren units is "Wate, — IM Logporittemre. emprentn rs Chaser ‘Lecase af follewinrg eveatond Y Sett mtomaton ee cumnot be negative, DS lrwat possible sutmomatey rs Devo 2) Mint Phermaton ts camrd bya Cas Lucky message. By When Padependet” Sombols are romulthed tie Hotel + Satmtemabm nod be equal to the sam 4 ndwrdual Bubt-indormatmn . } a 3m Ly, () Fad vetabonshap Leehveen -Hattays Nak ond bits (9) A disewede Source emits Oat at tue tou symbols Se, Soa and oy with probable Ys tle, Vy and Ya vupedvedy, The -Suncessve Symbols embed bey tHe BOUNCE OWE Stak Healy, independent Colewdale tue enchrog Source. Pu. Brs'' Wsead : xe) AO): Tologt Howkley $ ae aes Te tog. nats = olution & S D= tog, bits. Solution & hence Prepored by, Dot. Rrolavendora.Y wm,2 P= 109.4 nats 04, Vp toa tp = —loy.P nots tog? = log, to: naks LHemtey ‘= 2.303 nats —_ 2M " Samitoey * Uttow tte = tog to bits - : oc ont brs pare re tog 2 Op Hatley = B.8cbibs —,.2M Pear nal =,tog.€ bits (Alike =A ere MUSES bits —2m toga ' Bimad E ee aria a, ; (SHREDS BR t = pelea + hing Lt Rig ele ed st ; aes) Filesé ALtog +1 t09 4» Ue) = LACAth bits/me Cree ee 4 foag Sime’ ig G) State tee properties of enchropy 2 GS Arsounet chomevilts tue independent nreggages “00 HA probes ef p amd Cp stapectively. Prore tak tte entropy Te manimum oven boty dhe mesages are eqpolly Ubely. Plot due Vowrahon of entropy (41) 8 & ieee of proboaboiity “Poh the mategy . ; 5 = py @ waArs, \chns, C1) popunra k ebory Y The tntvopy tumetton fs corurnuons dor wey | rndependemt yowtable Pu m the atewvod (, y 2) The, evdropy tumutrom ma Sgramedvrea! dometron ah ie owgumerts. “ae fay (pS) = H{UPu) , Pid} 2) The entropy attams @ momrmum value When a She gouvte symbolS become equipvobab le « BU) pontidronma, of -gymbels nto gubsymbols eomnot decrease tHe ecbvorty: S) Some ebfrrenus TS gvenby Q= He omd Bounce B =|- © evredundonuy, gaen by Rag I eee = Bote = plot +I) ea bet °F; P a-*) tA Peo) | HE)= 0,464 bds/sym P02 HE) = 0.172 bits/s PROS HE) = 0-381 brs/syny Peo H6) = 0-971 bit Je sn p08 HOS 1 bAS Gn, pe ob HE = O19Ut bits/oym pao, U®) = 0°89 bits/gym poo d te@) = or? bits /o gm PE Or4 HB) = Or bop bits /eym. = —I2M H® aig ob 0 0-6 oS ow od o NN « a)9.2) Coastden the kc rceeete Bounte Shroom m dry O20, Find te 1) State probaloruttrel Ny etete erdrogres mn) Source endbopy W) a" 74a v) Show tak Q>'G SH Cle pe ee Fj +4 gre® pos) PW = POD= Yr a2 a Wo he E hy logit 5 es Fy Fov eae 3D = Py log 1 thr log , Ay Ae ne A P H= 0410 bits /oymbools SHES th Peilog Lit Pylogl By ?. . a é Hee 0.9418 bis Joymbsy — __o yy Ne) t= Ep = PHH, TPO AL Yh = O48 bits /eymbote, 2 M Gee we) = Z pen toy eat es si c 1 VY toatl. = (bits a= aCe al ry pleas : eee Gr = 0.169 bits/sym. ol. Hoe 6) 2G. 7H — mm pe2b) (Considewma_ 20 memory Soule tance symbols Ujyand 2D wt, vregpeeve probabllitres fo<¢, ox 03 Calewlast 1) Entropy of tre’ soume. i GY AU symbols and due Comvese ond ma, probob ites of tue Second ovdev encengrn ok Me Souvce , o Fmd dhe fuemnivey entoyy of 2"4 ove. CH) stow that H(Sooxatigy < - eae ee B geen by Hoed= 2 pi tog t zo \ o 2tos | +o-l log 1 = Obes 1 tostes Ly eae AG) = (2464 bits/eyy4 — 3M. 1) Hs") = E Putoa Sts Bum bent Pe S$. = O86 . SS. = 018 $($3 = 0.06 a Bt (32) = 2.8109 binf ay S282 = 0-04 $283 = 0-03 6M Ss S$. < 6-06 S3S2= 9.03 saS3=0.01 PD SY = DacHES) 2 2 x LDASH © 26904 bie gn, comme Te Module =2._ Ba) The table 3-1 below provides Codes toy dive Atereint syurbols tenths voluch of due follosng codes ove Prt codes. Ate doa the decision diagram toy Cue pred code Code ® — Code-h_ Code-& code“ Oo a Oo to lo ot to uy tlo Vt Ito to tuo to ool ol te oo etl. oo 72> w®éAMS Code AK, Code B , code-C ane not prefix codes wlule code O ta erctu code ax ne codeword rs a Prefix of othev code wovds eI Decismn Avee Sy 3H Apply Shannos encodmg atgovittr, to tre totlowmg Se of messages and obtain code ttterenty & wdundaney. MA Mr M3 Me We yeoMe Ye Yu Ye = GA) Avs Step = Ms Ma Ms My Ma Che Vw Yue Me Ve shepch. 20 , Q,F ONS Ay = 0-626 a= 0.86 ay = 0.9395 , age! te p= i seep ait Ave2 , Joe2, dye3, 4q53, dee step =o O=(0-375),0= (o.or), O3= 0-624),,= (0-1), Bu= Co. Bas) = (Oslo), Os = (0.9575). =(Onn), SHS Some Ps Codey =m Ms 3/e oo 2 q,2 Ho Me Ya ©} 2 ees 3 \ 3 = 0-865 ms a cs 5 4 SABE. my fe Ra = 13-7 ma) Wig etl q am. & hii = CES wih — 1M " dysys EPiload = 2108s bibfoger —(m3O constr a bmany code by applymg Hutton encoding Proeduve toy the Arllowsang, Massages whn vespecive Proballlitve, of 84, 0.2, 0.10.1, 0.07 amd 0.03. Aso Dedtewmrine the code etticrmey and wedundaney of tre codes ' hee, Sore Sa | SomrSe | Soume Se} Sourte Sf i Cede [Pr feade | 0: icode * 04 'tode i | code PCT EEE ke ees oy lo 50g) 5 pa aC] anol oot aera Us 0-2 900 0.2 920 16.0: booger, O14: Xe lot ©0l6) 0-1! OO Oo.2! oo} Us (007: male ! cout : ; | Ue jo-03 oot} i i ' { : ) un ; ! ; : ae ' | } i ae | I | | | a i | | i | Le 2.3 bonis mag. ey HOS) = 2.209 bits (nog) —syma Te 2 HB) = ag oyy, 2 mM Rape v-467. aca & oR ua) Dasran a Trmony Sour'e code fey tic Soume Shown name Hettwnan's coding aco S296, $2, S3 $4 Se Sek p= 25a Va,/a. rth =o fons raver Nd da gey = 6-522 | 1 gome = 3 2 mcrae CUR io eam ° ea (eee Pa) I __ Pr il Code a htt © VY 2 “V2 5. HG ©0 Vqjow '/g} ol i | VB) on | i > 10m pe ' | Discard. |4.) Consider a Some $ =]5, S23} wit, probobllitics 3/y & I/y mregpeetvy. Obtain Shannon-Fano tode tev Soumte $ and tes a"? LS udenstan | talialare affrreneres fey each Coase amd justty tue vegults, Com Ans Py Code hy 2 eens) 1 1 Etim = Ubmntts /rnagayen " S on "lq Co HH) =F; logl = ORB bitsy Me Ql.37 wet Pi on 3M Fer 2% euuknsion Ps Code Ay 6.5 [hel ! } : $ySr Sie ]o Ble) \ a a Sec leals (el Sle oie S$2So Ye fe | Hele 6 Loe [6875 bits fussy sym H(S*) = 2tt(s) = 6226 bHS Jaag-sym ENE GEMS 98 > 3M Bx 8? enceniion Godse Ar Od $515) q alt Yeu] | at $15, So eae oto 3 S251 yt ce ool 8 S25, 51 008) y ( Sect z\o foes cecum 3les\o -apeaye BGs)! ., ove! Sa Sa Sq Vey 2 | FE eee 000000 6 Vou) of Yeu/e Lx = 2-4 8437S bmits/imsa sym tt (83) = ZB AtIS) = 2.4339 bis /mag-sym mea ilar IN Proper ayroug MS sh symdball will marcarc tee eFyerene ta with TACYEME TA Cubetyron. 7. 10SModule - 3 $0) whar is mutual internradion ? Metron Ans : Fs propevsres : > —~ when en axorage mtesmadron of +t) 1s tromentthd over tre Clhround, on cue oae amount of mbo, equal cto equivocaten H(A] ay TS losk ™ the channed duc to tntevombe} tonversron due do nore. “The botamee of mformadion vecerred ad the meceivey i the nuctrol Mbarmriateon. DAB) = HA) — HH(F78) - Rcopevaites > 2M J mutual mhvmadion of a channel symmebic 2) Mukuad Sndormadron Ts odwor4s Non-neqative 3) Muruod mr wodey da channel may le empreased » Fors of the enctvory ob tne ehanned output u) Mutual mtn mason 5 vel oh tee channel. ated to the jomt entropy =a umM E%) A tromsmittey rag an olpllotth tonsatm4 ot © letters $ ay 00 ,A3,04,05° ond tue vecene Wor an alphabet of 4 Letts Ft, b2 ba but “Tee FEM are gore bdow. p(a,8)> [eas 0 00 ~\ tompute ditternt CCRC Enea entrprea ot the thonnel, © oof O1 © ° 6 o0¢ O-] oO oO °0f O fe p(lo\) eos Mead 2036 P(ba) =0-2 Pibu) =0.} Rtas= 0-2 Play= o4 — Pasy= art Play OLE pt = 0-0S oe i Hi) 2.066 biIS/maq-symn > 1M HH) = & Se eae) 1857 WAS (nas tym S314 ae te y He a -£ fai, bs) toa 1 = = 2.66 biS/muoaym Gs, b3) oSr H(B/A) = 1 A,8) — He = 2.666 -2.066 = a 0-6 Bis (/nusgsy 5 1M &+a = H@,) —H@) = 9-66-1857 = 0-309 bits /maq—s4ym ive Tap) = 4A - H/o) = 2066 - 0-809 = 12ST LAS(mgq gym 3 1m. 5.0.) Ferthe channd matin shoom, dud tie cei Pea) = Ve Ys Ve Vs Yeo Vo Vcien (oman = 6) Aes (Bra) = he Zt loo Srl i te [04 bits (rgg-84m 23™. C= tog gh C. = log 8 tural = OL LBLAS [oes © aD SIN o : (ele 6) Tra Commumtcahoo Sysco a domino tty log 3 Vinge Symbols ta Fao, as and receenrn also hos % % symbol Be Sb, babat The matin gven beled shows Jame STM witty Some Moramod probabil hy wy Emd tue missma Can . ) Ford (634) and PCt/ds THY Dare the, ore a and. by grarcrrteadly independant? 4 why? aac ees > i aly. x» Sse Arb seo Ya S736 as} xe Ye # Pes) ts “Yoo * YN Ate = Ky) + Plea tPby = | ca ples) = SN Ps) = a -Ya7 See = 74 Pla, ba= MY/se“Va-VYe = 9 p(as,63) = 57a - Sse- Hc 70 | eo. yOU) Ples/a,) = PGi bs) = S/ac = Se peau / ea.) 73 s[oxy = Pla,,b3) = S786 a 1 “SON Plbsy eR ile Hn) Plo, bi) F Play Plo) arn “7 @, and 6, are not Statrstreally ReneS 6b Fad Ate capacity ch tre channel shown Mm tra. 96 b) blows UMA = Muvogo's meted le eka =e) Be ES te P&S Au) = (o-2 a =| :0-] 0-8 © o 0-2 0-3 0-% o2 0 eg, 0-2 [090.2 0-2 (030-2 ee 81 ok ot |] Gr]H| 2% SBF xo. fogol | =] _ 4a ©. 02 0.8/| Og 0-2 (09 0.2-t0.2109 0.2, 0.72 3M 0-89,¢t 0-29, > ~9 722 1G 40.3G,TO1Gs= —O-422 O2LOr.t 0.893 = ~OT? Q.= -O6ss3 Qr= -0.488T > 3M Qs 2-0-6553 C= tos (81 384 4295] C= 0.8269 vits/iugg-sum. C2 (08264) Is = L2Eq bits (eee. om Discuss Binoy Ensure chomnel 4 devive channd capasity 6°) Cy nroHton « a ) Aas The ehomned diagram cla bmory tvasure hand a shoum below . y® ®whenorenn an evroy ofcuns, the symbol will be vecened As ond no decir wilt be made about tic mtrmadion, bakan mediate meguert wll be made dmougl a nenense Bromncel, toy vedronamess ron, Atl a Cowreet Sumbol iS secenred at tie ofp. Z om The disadventage A tus rs the oeguivement of mrenenge channel . Gee Ce ere ee e (a) Ar 2 $30) Pe{-p Chamnd diaaraur + BEC- BEC 1s alto a symmebvic channd cutose Chamne) medvin emstrurted fon tue chownel ad- PU/X) = PUS/uy= | PF + e | Fe Oars B(x) = he Eyles a epee ete 2 a P e HOO = wll + Blog = P(X. Y) = (Pw pw a } po FH PG) = Pw CS) ican (eee Pry =P Py) = ee &) twp o } ) o PA)/p (PRYFS ae w Oo wo BONY) = pws yy + bles Ys) 5 ow p@®GY) os tou woo. of suits Tapuk » Sirbe veepstes paneer ec oo ° a 1 1 ° oo- oe? is Lz \ 3 © 1 " \ nO) The qenevosed Code-we oy = OR ee Dd tum and show tat atit= time G and’ tt Matwrm amd shoo atn0 ED 30) bt QT ws called as qenevasoy prodin of ordew (len) gam toy {a9 = (Tet el &xn) WCC emprased 0 cad=L[P itu) pith (GD 1S amotiey modynn called Pssocraked “ bowtky cheale wrakern th Qe by, Cad = [pr \Ja-ic\ CHD mateme FO (Wg KN wat amd tars mada 1S Ree ara coNcoue (ade 9 oe ey Pee ao Puy pte © t 0-7-8} Pa tor — Pape ee ee on eco reo l) Pua Pum Uda teh = (te Papo fur bt hears Pur Prac Pe Ka 4 i" 1 5 " . weed Re inte Papa? Thee Oo cai on, 4th vous ob wen WS 1 we G\ 5 £ iS © Pn te 7s Pina] etl need fie vow ed 5 ane by n= (Ry Payot Pigs © o-—t-- 2] Concrdor 3) Wy 2Ayhs = PrytPis = 0. fis Ths equaton truce fer al Values 5 wy amd 5 , henee ! C43 LHI" = 0 Mubttelyans botr odes by [D9 e (pd (attH I =[p3° =e =>. BP pesMHT J =0 Bb) Tre ponidy check bits ofa (B,u) blak code ove genoveted by (s+ Ar tdetdu Co-dtdtde Cy=d.tdatdy Cre drtdstdu 1) Emd tue Cod LCHI for tars code hn) Fmd menrmunr wergt Mi) Show that Hts Capable of. Covrecdong all sonale exvers and copable of detutmg ay doable envoys by prepowmg Syndvome fable tey mw. Ans nv Gj-fl ooo 1110 He( ll oly toed re Us orco tet 1 LCO {otoo oofo ott Lotl ,ooto oocot tot) O1ll (oOo! NN => i) By mgeshng tee He maby , we obsove, that not lets thos 4 cofumng of H will addup to 24° There fre we en tomelude that dun 2 . Henee mmr were = Amin 4. ; > 3mE(x) = Hw) — HX/y) LEY) = PHO “The thamad cogatity fa BE RH gum by C= Mex(2cxy) = mame CH) J 2 F mem (HOO) C = Ploa2? = DP iM Meodwe- \ qa). For a syremosic (TU) Imeay_bloue code, the potty motym P 1S given by pe Pu 1) Fad ath possible ‘Code ae wreetors TN) Draw tae ontoding over LO tt MN) Dyes the syndvome cobeuladrn circuit Con) Aes oy oe a (2 (O14) ae Oy LO | POFl i or Masase Codeveetor mMasaae codevrettor 0000 0 000 060 i) [ooo tT ooolt] ©00)} © 001 Ol! Loot Looltoo OoLo ©eorol,o) Loos toto Clo ool} Oot Lo Lotl VOL) ol Bloo oloo (16 \Loo tl °O eo) ©fol -otel tol ‘Wor {lol elo ©O1ld 6110 ot! Lilo {l1o too Ol ALI 000 ut @) du | da | do 3; *)() =00706) = fad ds du (Art tds),@,tdetds) 3 7 dijd OBR HTL Cr a vavure Ve) ue +d atdu)) tto go(@ttyatye) to) (tera t%), Cas 2 { 00 (mr 4ra HYG 47) J Olo oo | —= 3M. Ss Sr $1 1.8) Design an entoder tw a (7,4) bor uy cre code generated by aN = HE and verity its ofevadten wamg the masage veetors (Loot) & (eI) =D Ay a ah = tnt Gal message F mM @) 1001 oefchitts Sapa Ra ae aoe Ro Re a aero ao) 1 ee { ° z o.- Oo 1 ! 3 Ome oer 4 fase o \ ( The code vertoy TS OL L001Ss caesar Syndrome LOOOCEOO “Ss _. (Ue 01000000 omen) colo poem — Olt) cool o0eo = - (ell 00001 000 -— [00° 00000100 — 0100 oooo old — O10 poo0000! — ooo} Tee erg Syrdvomes listed tor ent smale evvoy pacttons osre ad distort. These syndvomes are unre to Smale -evver paxtevns . Hennes the code Can defuk amd covrent” sugle twors The Syndvonn tev dlouble- envoy pattevny ave Nok enrque Fov ewample s the double ever patterns (11 000000) amd (b0011000) trove the Same Syndrome O01. tHemee the Code com detat tre double evvors bur comnot Covect them . >3M. 3-c) Oesran a Imeov block code with minimum Anstemce dimin= 3 amd massage tengin of 4 bits. se") Ass ke code Cemgtta now] newt By Wal ong OEY nad 2. (A, =(.4) Hf =| Le} cPpy= etl (oo Loy M .O (0 Lio a Oo} Ue oll . refi aca Olt on (to He\tolroto)] 2m acces LiLo) oo0? [oe o\ oO 00(a d= (tu ieJ n looo ote CMP OmOne etom) ool © }\10 CKOYRO Pe eal hala! fed =(014 4 ea Code Mersage Code o000 — ©006000 l0eo - lo ceoll ooo! — Coolll) (oo; — [1 001!00 oolto — Ooloito (Oat =O VOLE ©Ot!l — oottecs) Lot) — 1otleoto ea = Ol ooto (loo — tlootlo eae UEC {lo} ~— tlolool Otlo — ottoor) SUC) ater neal) ae ee) ALLLCLO ttrr = eta > 3m Modele - © aa) itty a need block draqvam, draw a qenuad Secod ong ewelt tera imesy lok code. Also daw the complete owe cored urcuit For 0 (7,4) Imerr block code tt tre eweyv bits ot gnen mM toms 4 the gmdvome bits ag Bren ™ eqpatron below. 62 (5.5 =(é. +1 4%4 + 46) (ia rate), FV3 Vat) Bes. (% va ty 2) | 6m& * AE) Considev a (7,4) cyeic code with gh) = LtUtW, obtam dhe code Polynomi at mM NON systemabtre and systematic torm tex the Input sequence, (om). 1) (010 N) Woo Pas Aw Sastevmathte form ‘y toto uv vey = 060 gq = OW) 30d vee) = 111 0010 eae Wr) (loo »* 3 vey es OOo G's FW Gtarw) se I v= loltloo Syste matte term ty 1010 Rea = Koon +9 & aw [v}-loonemy 322m yy Daltile m =(rowrod) eS) 2s Q.c) write a shot vott om Bett coda. > tos act cod toma loarqe clay of power ful vondom ereey- Correia cod. For any positive migas MES amd £ (22) there enists a wey BCH code Wit the folloams fovamelen Block length: n= aM-l ne no. of povity - neue drat ,n-k amt minimum, dstece t dum = 2t +) This code tS capable of coweetg ooy feww won Ma block of iy! deity. The Code % hence cabled “£-evvrov cowvedmg Bot code”. >2mM @ ® YPov 10) Foy a (21,2) vmvelutronal emeodey with 4’ 101) ond A? iii, Fad the outpub Sequence usmg tre two totlowmsg oppvoar~er. 1) Tme domam aypyoa oh 1) Tromifom domam approauk. Atso dvaw the encodw Aragvam. AGE) Aas 0 — e@ (es >a 7UM Fakivg 0-101) A(L+m) = 2(843) = 16 G- fit ol 11 tt 00 00 00 06 oe I! ol wit oo oo 96 oo oO 1) Ol tt 1] 00 00 00 Oooo \Lor W tl oo ClCHeCORRCC ICOM | BC liga ET C=D4 c= Cu,et, oo, ©1,01,01,00,11)) 3 ene auM A 2, cy) by = Fee gw = Lenenten? Pm = dh gto Om = wut Cm = dw g’ev Poy = tent Ee Cc) = CPemry + % & OC) Co = tet 8 pT ee bat! ea pa © c= (tl, ot, 00, ol, ot, o1, 00, uJ] ae y®r : 10%) Fov a(2,1,2) comvolutranal entedev wit S2a01 19: P-L ot} MH) Dvow code tee 1) Draw tromutron tedble MM) State Sragvaw h) sma Code tree, dmg the encoded Sequence ty the musage 1011) Aas VY) Draw Treblrs drogvam, a i 5 eo Lm tg) eet , fee} FA oa seme ao oe eta State SoS S2- $3) mee | Danyten [oo to et itl aa S 2M, erate tromiition table Present = Bmovy 4 : output at New , F State Desewiptom cee ii dds dyn & @ Se 0° Oo $e oo ° © 0 oO | \ Sy to loo } eee S ° Se ol en) Lo $3 ia) to ol Si ol ° Se 0° Oe) ! to ' Si i @ to t oo $3 ul oO 52 ol » i 4 ©)s Ss i] ; ; ! a _ 00,01, : , 3d Sequen oe dc Eno & Wy) v)