The document outlines the structure and content of a paper on Information Theory and Coding, specifying that Question No. 1 is compulsory and covers the entire syllabus. It details the course outcomes, including understanding data compression and channel capacity, and provides an overview of topics such as entropy, channel models, source coding, and channel coding. Additionally, it lists recommended textbooks and references for further study.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
0 ratings0% found this document useful (0 votes)
8 views
information theory and coding
The document outlines the structure and content of a paper on Information Theory and Coding, specifying that Question No. 1 is compulsory and covers the entire syllabus. It details the course outcomes, including understanding data compression and channel capacity, and provides an overview of topics such as entropy, channel models, source coding, and channel coding. Additionally, it lists recommended textbooks and references for further study.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
You are on page 1/ 2
Paper 1D: torrie
Code: 1CT'512 Paper: Information Theory and Coding (fess de i
INSTRUCTIONS TO PAPER SETTERS: 2
(co 'No. 1 should be compulsory and cover the entire syllabus, This question should have objective or
short answer type questions. t should be of 25 marks. Sa amaneece|
‘Apart from Question No, 1, rest ofthe paper shall consist of four units as per the syllabus. Every unit should
have two questions. However, student may be asked to attempt only 1 question from each unit. Each
question should be 12.5 marks
course Outcome a
F'co1 | comprehend the quanative theory of formation In conceptaling 9 relable and efient |
| | communication sytem.
TeX] Understand the principles of data compression, channel capacly of common communication |
3 ;prehending the relevance of having a channel encoder and decoder in @ communication
system
oa Understand the implementation of practical coding schemes for data compression and
transmission over noisy channels
cows Po:
Por [P02 [P03 | Poa
cor [3 = 3 2
coz [3 3 =
cos 3 3 E
cos 13 E 3 5
uN
Introduction: Uncertainty and information, measure of information, Entropy, properties of entropy,
information rate, entropy of binary memory less source, extension of DMS, conditional and joint entropy,
information measure for continuous random variables, mutual information, properties af mutual information,
sources with finite memory, Markov sources.
uNtri
Channel models: channel matrix, loss less, noise less, deterministic, binary symmetric channels, channel
capacity, channel coding theorem, channel coding theorem to 8SC, Channel capacity theorem, Shannon limit.
Source coding: source coding theorem, prefix coding, Kraft McMillan inequality, Huffman coding, Shannon:
Fano coding, Arithmetic coding, Lempel-Ziv algorithm, run length encoding and PCX format
uNiri
Channel coding: Linear block codes, generator and party check matrix, perfect codes, Hamming codes,
repetition codes, decoding of linear block codes, syndrome decoding, Properties of syndrome, minimum
distance consideration, error detection & correction capabilities
Cyclic codes, polynomial, division algorithm, matrix description, encoder for cyclic code, syndrome calculator,
cyclic redundancy check codes, Maximum length codes, Golay codes, BCH codes, Reed Solomon codes.
unr
Convolution codes, convolution code encoder, code tree, trellis and state diagram, Impulse response and
‘polynomial description of convolution codes, maximum likellhood decoding, Viterbi algorithm, distance
‘properties of convolution code, sequential decoding, turbo codes, turbo decoding, Trelis coded modulation,
Testbook{s}:
4. Bose, Ranjan “Information theory, coding and cryptography, Tata McGraw-Hill Education, 2008,
2.5. Gravano, “introduction to Error Control Codes, Oxford University Press (India), 2007
Scanned with CamScannerReferences:
1. Cover, Thomas M., and Joy A. Thomas,"Elements of information theory”, John Wiley & Sons, 2012.
2. Jones, Gareth A., and J. Mary Jones. “information and coding theory”. Springer Science & Business Media,
2012.
3. Pless, Vera. , “introduction to the theory of error-correcting codes”, Vol. 48. John Wiley & Sons, 2011.
| 4. Van Lint, Jacobus Hendricus, “Introduction to coding theory’, Vol. 86. Springer Science & Business Media,
2012.
5. KS. Shivaprakasha Murlidhar Kulkarni, “Information Theory and Coding”, Wiley 2014
Scanned with CamScanner