Tolat No of Pages: [3] 510401 B. Tech. V - Sem. (Main) Exam., December - 2020 Computer & Science Engineering - 01 Information Theory and Coding 510401 ‘Time: 2 Hours ~ Maximum Marks: 80 Min. Passing Marks: Instructions to C ‘andidates: Part— A: Short answer questions (up tw 25 words) 5 x 2 marks = 10 marks. All five questions are compulsory, Part ~ B: Analytical/Problem solving questions 4x 10 marks = 40 marks Candidates have to answer four questions out of six. Part — C: Descriptive/Analytical/Problem Solving questions 2 x15 marks = 30 marks, Candidates have to answer two questions out of three. Schematic diagrams must be shown wherever necessary. Any data you feel missing may suitably be assumed and stated clearly. used/calculated must be stated clearly. Units of quantities Use of following supporting material is permitted during examination. (Mentioned in form No. 205) 1 NIL 2. NIL PART-A Q.L What is Entropy? Explain its properties? (2) 7 1 I J .2 An event has 6 possible outcomes with the probability py =>, p=. x Find the entropy of the system, 12] Q.3) What are the convolutional codes? How are they different from block-codes? (2) ’ F) 2 Q.4 What is Galois Field (GF)? 121 , 2 QS State Shannon ~ Hartley theorem. 121 1510401] Page 1 of 3 [1200]QJ Given 6 messages mi, m2, m3, ma, ms, mo with p(m, Q6 PART-B p(m,) é olan) =E. pl, . Find the Shannon Fano code, Evaluate the coding 12 redundancy. (10) A distance source transmits messages x1, x2 and x) with the probabilities 0.3, 0.4 and 0.3. The source is connected to the channel given in fig. (1). Calculate all the entropies - https://www.btubikaner.com 10) 0-8 x) % 0:2 xe t ye 0-3 xy O72 vy fig. (1) For the (6, 3) Hamming Code, the parity check matrix H is given by - {10} 1o1:;100 H=|0 11: 010 rir:oo01 (a) Construct the generator matrix. (b) Determine the code word that begin with [1 1 0]. (c) If the received vector y is {0 1 1 0 1 O]. Then calculate the Syndrome. With the help of suitable example, explain the Viterbi algorithm for the decoding of convolutional code? {10} Apply Hoffman's encoding procedure to the following message ensemble — 10] (X] = [x1 x2 x3 x4 X5 Xo X97] {P] = [0.4 0.2 0.12 0.08 0.08 0.08 0.04] Take M = , Calculate: (i) Entropy (ii) Average Length (iii) Efficiency Write short notes on - (10) (a) Code Tree (b) Code algebra and cyclic code [510401] Page 2 of 3 [1200]PART-C Q.1 For a (6, 3) systematic linear block code the three parity-check bits Ca, Cs and Cs are formed from the following equations - (15) C,=4,@d, C,=d, @d, @d, C.=4, @d, (a) Write down the generator matrix G. (b) Construct all possible code words. (c) Suppose that the received word is 010111, Decode this received word by finding the location of the error and the transmitted data bits. https://www.btubikaner.com Q.2 (a) Prove that the channel capacity of a white band limited Gaussian channel is- [10] s C= Wlog| 1+— m5) Where W = Channel Bandwidth < = Signal to Noise Ratio (>) A Gaussian Channel has 1 MHz bandwidth, Calculate the channel capacity if its signal power to noise spectral density ratio is 5 x 10* (Hz). Also find the maximum information rate. (5) Q3 Write short note on - (15) (a) Trellis diagram (6) ARQ methods of Error control coding (©) BCH code https:/www.btubikaner.com Whatsapp @ 9300930012 Send your old paper & get 10/- aad gue dade a athe 10 era oT, {510403} Paytm or Google Pay [1200]