Scribd
Upload
38 views3 pages

Course Title: Credit Units: 2 Course Code: TELE306: L T P/S SW/F W Total Credit Units

This course introduces students to information theory and coding. The course objectives are to provide an understanding of information theory concepts and different coding schemes used in modern communication systems. The course is worth 2 credit units and has prerequisites in communication systems. It covers topics like information measures, source coding, channel capacity, and linear, cyclic, and convolutional codes over 4 modules weighted between 15-35%. Student learning outcomes include applying information theory concepts, understanding lossy and lossless compression, calculating channel capacity, and encoding/decoding data using error correcting codes. The course will be taught theoretically with classroom interaction, tutorials, assignments and possible student projects. Assessment is solely based on a final exam.

Uploaded by

Ritesh Kumar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
38 views3 pages

Course Title: Credit Units: 2 Course Code: TELE306: L T P/S SW/F W Total Credit Units

This course introduces students to information theory and coding. The course objectives are to provide an understanding of information theory concepts and different coding schemes used in modern communication systems. The course is worth 2 credit units and has prerequisites in communication systems. It covers topics like information measures, source coding, channel capacity, and linear, cyclic, and convolutional codes over 4 modules weighted between 15-35%. Student learning outcomes include applying information theory concepts, understanding lossy and lossless compression, calculating channel capacity, and encoding/decoding data using error correcting codes. The course will be taught theoretically with classroom interaction, tutorials, assignments and possible student projects. Assessment is solely based on a final exam.

Uploaded by

Ritesh Kumar
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Course Title: INFORMATION THEORY & CODING L T P/S SW/F TOTAL

W CREDIT
UNITS
Credit Units: 2 2 - - - 2

Course Level: UG Course Code: TELE306


Course Objectives: This course introduces the concept of information theory in communication systems. The objective of the course is to provide thorough
understandings of different types of codes are used in modern communication systems

Pre-requisites: Communication Systems

Course Contents/Syllabus:
Weightage (%)
Module I Introduction 15

Communication Process, Model for Communication System. A Quantitative Measure of Information, A Binary
Unit of Information, An Outline of Information Theory

Module II Basic Concepts of Information Theory 30

A Measure of Uncertainty, H function as a Measure of Uncertainty, Source and Binary Sources, Measure of
Information for Two Dimensional discrete Finite Probability Scheme, Conditional Entropy, Some Basic
Relationships Among Different Entropies, A Measure of mutual information, Redundancy, Efficiency and channel
capacity, BSC and BEC, capacity of Binary Channel.

Module III Elements of Encoding 20

Purpose of encoding, separable binary codes, Shannon-fano encoding, necessary and sufficient conditions for
noiseless coding, average length of encoded messages, Shannon’s binary encoding, Huffman’s minimum
redundancy codes.Lossy and Loseless data compression techniques.

Module IV Introduction of different types of coding schemes 35

Linear Blocks Codes: Basic Definition, general properties of Linear Block Codes, decoding of linear block codes
Cyclic Codes: Definition and basic properties, systematic cyclic codes, Encoders for cyclic codes, decoding for
cyclic codes
Convolutional Codes: The structure of convolutional codes, decoding of convolutional codes, Turbo Codes and
Iterative decoding.

Student Learning Outcomes:


At the end of the course the student will be able to:
Define and apply the basic concepts of information theory (entropy, etc.);
Differentiate between lossy and lossless data compression methods,
Identify the most common such methods;
Design an efficient data compression scheme for a given information source;
Calculate the capacity of communication channels;
Sketch Shannon’s proof regarding the limits of error-free communication;
Explain the impact of feedback and/or many senders or receivers on the communication problem.
Encode and decode data by means of efficient error correcting code
Apply the implications of coding theory in modern technology
Interpret the various models of communication channels
Summarize the ultimate limits of data transmission

Pedagogy for Course Delivery:


The course will be a theoretical teaching. Classroom interaction will definitely have to be an integral part of the learning experience. Tutorial and assignment
will be discussed and analyzed in class.Students shall also create projects based on application of the subject.

Lab/ Practicals details, if applicable: NA

Assessment/ Examination Scheme:

Theory L/T (%) Lab/Practical/Studio (%) Total

100% NA 100
Theory Assessment (L&T):
Continuous Assessment/Internal Assessment End Term Examination

Components (Drop down) Attendance Class Test Seminar/Viva/Quiz Home Assignment

Weightage (%) 5% 10% 5% 10% 70%

Lab/ Practical/ Studio Assessment:NA

Continuous Assessment/Internal Assessment End Term Examination

Components (Drop down

Weightage (%)

Text Reading:
An Introduction to information theory by Fazlollah M. Reza.
Digital Communications by john G. Proakis&MasoudSalehi
Modern Digital and Analog Communication Systems by B.P. Lathi
Communication systems by R.P. Singh and S.D. Sapre

References:
An introduction to information theory by John Robinson Information Theory by Robert Ash.

You might also like