Ect306 Information Theory and Coding, June 2023

c 1200ECT306052301
Reg No.:
APJ ABDUL KALAM TECHNOLOGICAL UNIVERS

B.Tech Degree 56 (R, S) / 56 (PT) (R) Examination June 2023 (201
Course Code: ECT306

Course Name: INFORMATION THEORY AND CODING
Max. Marks: 100 Duration: 3 Hours
PART A
Answer all questions, each carries 3 marks. Marks
I Consider a source S : {Sr, Sz, Sl} with P = {l/2,1/4,1/4)}. Find self-information (3)
of each message and entropy of source S?
2 Define coding and explain the necessity of coding? (g)
a
J State the positive and negative statements of Shannon's channel coding theorem. (3)
4 Explain BSC with its channel diagram. (3)
5 Distinguish between block codes and convolutional codes. (3)
6 Explain how generator matrix is obtained for a linear block code. (3)
7 What is BCH code? (3)
8 List any three properties of cyclic code. (3)
9 For a (2,1,2) convolutional encoder with impulse response g(l)=[lll] and (3)
g(2):I0l], find the output sequence forthe message D =l 0 0 r l by time domain
approach.
l0 Explain trellis diagram. (3)

PART B
Answer onefull questionfrom eoch module, each corries 14 marks.
Medgg | ,
I I a) Show that H (X, Y) = H(X/y) + H(y). e)
b) Given the messages X1, X2, X3,X+Xs and Xo with respective probabilities of 0.4, (7)
0.2, 0.2, 0.1, 0.07 and 0.03. construct a binary code by applying Huffman
encoding procedure. Also determine its efficiency and redundancy.
OR
12 a) Construct an instantaneous binary code for a source producing 5 symbols Sr to 55 (7)
with respective probabilities of {1/2, 1/6,116,1/9,l/18}. Also find the code
efficiency and rgdund ancy?
Page lof3
1200ECT306052301
b) The joint probability of a pair of random variable is given below. Determine H(X)' (7)
H(y), H(X,Y), H(X/Y), f{(Y/X) and I(X,Y) .Verifu the relation between joint,
conditional and marginal entropies? P(X,Y): [t{' :'rt]

Module ll
13 a) Explain Bandwidth-efficiency relation and Shannon's Limit of a continuous (7)

Gaussian channel.
b) A message source produces two independent symbols A and B with probabilities (7)
p(A):0.4 and P(B):0.6 and transmitted through a BSC. Calculate the Information
transmission rate of the system if the symbols are received in average with 4 in
every 100 symbols in error.

OR
14 a) Calculate the capacity of a Gaussian channel with a bandwidth of lMHz and SA"l (7)
ratio of 30dB.
b) Explain Binary Erasure Channel and derive its channel capacity. Q)
Module lll
15 a) Construct the encoding circuit of a systematic (6,3) LBC with the parity matrix (7)
[101.|
givenby P: l0 1 1l
l-r 1 ol
Also find all possible code vectors.
t b) Explain the error detection and correction capabilities of linear block code. (7)
OR
16 a) Explain the prbcedure to prepare the standard array of LBC. Also construct the (7)
,tandard array of (4,2) LBC whose parity matrix is given by, P =

ti ll
u
b) For a system atic (7,4) linear block codede parity matrix P is given by, (7)
L 1 1
^P: 110
101
011
. A single error has occurred in the received vectors [0111110] and [1011100].
Detect and correct the error?
Also draw the svndrome calculation circuit?
Page 2of3
1200ECT306052301
Module lV
17 a) Draw the general encdding circuit for (n,k) cyclic code and explain its operation. (7)
b) Find the generator and parity check matrices of (7,4) cyclic code where (7)
xn+l: x7+l : (l+x+x3) (l+x+x2+;4;.
OR
l8 For a (7,4) cyclic code, the received vector Z(x) is lll0l01 and the generator (14)
polynomial is g(x):l*xfx3. Draw the syndrome calculation circuit and explain the
procedure with the register contents. Also correct the single error in the received
vector.
Module V
19 Consider a(3,1,2) convolutionalcode with gttxll I 0), g(2t(l 0 l) and g(3)<t t t). (14)
i) Draw the encoder block diagram.
ii) Find the generator matrix.
iii) Find the code vector coffesponding to the information sequence (l I I 0 l)
using time domain and transfer domain approach.
OR
20 Explain Viterbi algorithm for decoding of convolutional code with example with the (14)
help of figure.
rf:t * *
Page 3of3

Ect306 Information Theory and Coding, June 2023

Uploaded by

Copyright:

Available Formats

Ect306 Information Theory and Coding, June 2023

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Ect306 Information Theory and Coding, June 2023

Uploaded by

Copyright:

Available Formats

c 1200ECT306052301

APJ ABDUL KALAM TECHNOLOGICAL UNIVERS

Course Code: ECT306

l0 Explain trellis diagram. (3)

conditional and marginal entropies? P(X,Y): [t{' :'rt]

13 a) Explain Bandwidth-efficiency relation and Shannon's Limit of a continuous (7)

every 100 symbols in error.

,tandard array of (4,2) LBC whose parity matrix is given by, P =

You might also like