Scribd
Upload
38 views

Itc Information Theory and Coding Dec 2020

The document is an exam paper for the course EC-702(B)-CBGS Information Theory and Coding. It contains 8 questions to test students' knowledge of information theory, channel capacity, error correction codes, and related topics. Students are instructed to attempt any 5 of the 8 questions. The questions cover concepts like entropy, mutual information, channel models, linear block codes, cyclic codes, Viterbi algorithm, and error correction capabilities of different coding schemes.

Uploaded by

Margoob Tanweer
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
38 views

Itc Information Theory and Coding Dec 2020

The document is an exam paper for the course EC-702(B)-CBGS Information Theory and Coding. It contains 8 questions to test students' knowledge of information theory, channel capacity, error correction codes, and related topics. Students are instructed to attempt any 5 of the 8 questions. The questions cover concepts like entropy, mutual information, channel models, linear block codes, cyclic codes, Viterbi algorithm, and error correction capabilities of different coding schemes.

Uploaded by

Margoob Tanweer
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

Total No. of Questions : 8] [1] [Total No.

of Printed Pages : 2

Roll No ..................................
EC-702(B)-CBGS
B.Tech., VII Semester
Examination, December 2020
Choice Based Grading System (CBGS)
Information Theory and Coding
Time : Three Hours
Maximum Marks : 70
Note: i) Attempt any five questions.
ii) All questions carry equal marks.

1. a) Discuss uncertainty, entropy with its properties as per


theory of information.
b) Derive the Channel Capacity of Binary Erasure Channel.

2. A very noisy symmetric binary channel is able to transmit 1000


bits per second, but has a 25% probability of introducing error
into each bit transmitted. What is the channel capacity in bits
per second?

3. a) Show that the mutual information I(X; Y) ≤ 0. Under what


condition does the equality hold?
b) Show that mutual information is symmetric.

4. a) Prove that the average code-word length E(w) of a binary


instantaneous code for discrete memory less source with
entropy H(X) satisfies the inequality
H(X) ≤ E(W ) < H(X) + 1.
b) Derive the channel capacity of band limited Gaussian
channels.

EC-702(B)-CBGS PTO

https://www.rgpvonline.com
[2]

5. a) State and prove Kraft inequality.


b) Give example for a Hamming code. Write down generator
matrix and parity check matrix of that code. Comment on
the error correction capability of the Hamming Code.

6. a) Explain generation of systematic cyclic code.


b) The Viterbi algorithm used for decoding of convolution
codes is an example of Maximum likelihood decoding.
Explain.

7. a) Obtain the standard array of the linear block code with


code words C = {0000, 1001, 0110, 1111}.
b) What are different types of errors? Explain them with
suitable examples.

8. a) Write brief notes on


i) Trellis and state diagrams
ii) Channel Models and its Matrix
b) Comment on the following: Lempel-Ziv Coding , Error
correction capabilities of linear block codes.

******

EC-702(B)-CBGS PTO

https://www.rgpvonline.com

You might also like