ARYA GROUP OF COLLEGES

RD
B. TECH 3 Year V Sem Computer Science & Engineering
5CS3-01: Information Theory & Coding (BRANCH: CSE)
Model Guess Paper 2024-2025 (V SEM)

UNIT I

SECTION-I
Q. 1 (a) What is Information? Explain Discrete Memory less Source.

(b) What is Probability Mass Function?

(c) What is Probability Density Function?

(d) What is Uncertainty?

(e) What is Mutual Information?

SECTION-II
Q. 2 (a) What is mean by Entropy? Explain its Properties.
(b) What are Random Variables? How Mean, Variance, Standard deviation of Random
Variables?
(c) What is Channel? Explain the Types of Channel.
(d) What are Rectangular Probability function and Gaussian Probability Function?
(e) Explain Conditional and Joint Probability?

(f) A source is transmitting four possible symbols with the probabilities ¼ , 1/2, 1/4,
1/3 respectively. Find Information associated with each symbol.

SECTION-III
Q. 3 (i) Explain Information Rate in Detail.
(a) (ii) A source is transmitting four symbols with probability 1/8, 1/4, 1/8, 1/2 respectively.
What is Information Rate in Bits/sec? If the source is transmitting 2 symbols per micro
second?
(b) What is Entropy for DMS if there are three symbols with probability p1=
½ and p2 = p3
What is Probability mass Function and Probability Distribution Function
(c) of Random variable X which specifies the Number of Heads Coming in
the Experiment of tossing a coin Twice.
 UNIT II

SECTION-I
Q. 1 (a) What is Source Coding Theorem?

(b) What is Data Compression? What is Aim of Source Coding?

(c) What is Classification of Codes? What is UDC (Unique Decodable codes)

(d) What is Channel capacity per symbol (Cs)?

(e) What is Additive white Gaussian Noise (AWGN)?

SECTION-II
Q. 2 State and Prove the Kraft Inequality Theorem. Write the Application of Kraft
(a)
Inequality Theorem.
(b) Explain Shannon limit in Detail?
(c) Write the Advantages of Source Coding

(d) What is Lempel zip coding? What is Lempel zip code of

AABABBBABAABABBBABBABB
(e) Explain Channel Capacity. Compare Channel Capacity and channel capacity per symbol.
(f) What is Entropy Coding?

SECTION-III
Q. 3 (a) What is Huffman Coding? Alphabet with probability {0.4, 0.2, 0.2, 0.1, and 0.1} for
symbols (s1, s2…..s5). Find Huffman Codes and also Efficiency and Variance.
What is Shannon Fano coding? Using Shannon fanno coding find the code words
(b) occurring in the probability (0.30, 025, 0.15, 0.12, 0.08, and 0.10) for the symbols
(S1, S2, S3, S4, S5, S6). Find Efficiency and Redundancy.
For the Following Binary Symmetric Symbol. Show that
(c) (i) I(X, Y) = H(Y) + Plog 2 P + (1-P) log 2 (1-P)
(ii) Find channel capacity per symbol.

UNIT III

SECTION-I
Q. 1 (a) What is Linear Block Code? Explain with its Property.

(b) What is Matrix representation of Linear Block Chain?

(c) What is Hamming Code?

(d) What is Generator Matrix? Explain the Significance of Generator Matrix in LBC.

(e) What is Syndrome?

 SECTION-II
Q. 2 What are Hamming Code, Hamming Weight and hamming Distance? What is
(a) Hamming Code for Message Signal 1110 for Even Parity?

(b) Explain the Architecture Diagram of Encoder and Decoder of Hamming Code (7, 4).
(c) What is Syndrome Decoding? Prove the S= eHT

(d) What is Relation Between Syndrome Vector and Error Vector e. Explain with
suitable Diagram?
(e) What is Hamming Bound? For LBC having 11 Data Bits. Show that (7, 4) Linear Block
Code with dmin. = 3 is a Hamming Code.
(f) For a Linear Block Code having dmin. = 3. How many Bits it can be detected and
How many Error bits can be corrected?

SECTION-III
Q. 3 For a (6, 3) code, the Generator Matrix G is given below.

1 0 0 1 0 1
0 1 0 0 1 1
0 0 1 1 1 0
(a)
(i) Find all corresponding code vectors.
(ii) Minimum Hamming Distance.
(iii) Error Detection & Error Correction Capability.
(iv) Parity Check Matrix.
(v) Find error if received code is 100011
For a (5,2) LBC, the Generator Matrix is form [Ik, P } Where [P] is given by P =
1 1 1
1 1 0
(b) Find
(i) Generating Matrix.
(ii) Parity Check Matrix.
(iii) Corresponding Code Matrix.
For a Linear Block Code Having 11 Data Bits find Number of Parity Check Bits
(c) required to Correct upto 1 error.

UNIT IV

SECTION-I
Q. 1 (a) What is Cyclic Code? What are the Properties of Cyclic Code?

(b) What is Primitive Elements?

(c) What is Golay code?

(d) Check whether the Given code C= [0000, 0101, 1010, 1111] is cyclic code or not?

(e) What is Syndrome in cyclic Code?

 SECTION-II
Q. 2 What are the Differences between Source Coding, Line Coding, and Channel
(a)
Coding?
(b) Explain the term Generator Polynomial. Derive Generator Polynomial for (7,4)

(c) What is Primitive Polynomial of Cyclic Code? Find the Primitive Polynomial for the
Degree m = 3,4,5,6.
(d) What is Addition and Multiplication of Golois Field GF (q) =2 and GF (q) = (3).
(e) Explain Cyclic Redundancy Check (CRC)?
(f) Explain Bose Chaudhri Hocquenghem (BCH) Codes.

SECTION-III
Q. 3 (a) What is Error Coding Cyclic Codes? Explain the Types of Encoding Cyclic Code
(b) Explain in detail Decoding Cyclic Codes.
What is Syndrome for (7, 4) cyclic code. Derive the Syndrome Table for (7, 4)
(c) cyclic code. Decode the Code word C = (1010011) belonging to the (7, 4) cyclic
code, incur the error e = (1000000).

UNIT V

SECTION-I
Q. 1 (a) What is Code rate?

(b) What is Code Strain?

(c) What are the Advantage of Convolution Code

(d) What is Encoder of Convolution code?

(e) What is Decoder of Convolution Code?

SECTION-II
Q. 2 (a) Explain Tree in Convolution Code.
(b) What is Trellis in Convolution Code?
(c) What are the Difference between Tree and Trellis?
(d) What is State Diagram in convolution Diagram

(e) Explain Metric Diversion Effect

(f) Write the Short note on Time Domain Approach in Convolution.

SECTION-III
Q. 3 (a) Explain Viterbi Algorithm in Detail with suitable Example
(b) Explain Convolution Code in Detail with a suitable Example.
(c) Explain Graphical representation of Convolution Code in Detail.