Fall Semester 2021: Coding and Modulation Theory - ECTS
5, Sept-Nov
Description
Comprehensive course on coding techniques, including non binary constructions based on higher
level Galois Fields, codes based on graphs and new applications with brief sections of Information
theory. The course will start on Galois field constructions based on integer rings and continue with
detailed Berlekamp-Massey Algorithm, Lattice Codes based on David Forney papers, Turbo, LDPC
and Polar Codes as applied in 4G and 5G. In addition all relevant journal papers in these areas will
be considered and discussed in the class.
Pre-requisites
Elements of Information theory 521321S, Probability and statistics
Learning outcomes
• Student is fully conversant with commonly used error control coding techniques: code con-
struction and decoding algorithms.
• Student is able to evaluate the performance of a given code by analytical or computational-
simulation methods.
• Student is able to read and understand peer reviewed publications in Coding.
• Student is fully familiar with the novel applications in Coding and directions
Contents
1. Introduction
• Groups, Rings, Fields
• Construction of higher level Galois Fields, Factoring
2. Linear, Cyclic and Convolutional codes
• Golay code, Reed Muller, Non binary BCH, Reed Solomon (RS) Codes and Decoding
with Berlekamp Massey (BM) Algorithm
• Tail Biting Codes, Sequential decoding, Soft-output Viterbi Algorithm (SOVA), Error
Performance, latency and Capacity considerations
3. Lattice Codes
• Introduction to Coded Modulation, Ungerboeck and Forney Constructions
• Packing, Covering, Vornoi Constellations
4. Turbo Codes
FALL SEMESTER 2021: CODING AND MODULATION THEORY - ECTS
5, SEPT-NOV
• BCJR Algorithm, Extrinsic Information, EXIT Chart
• Soft-input Soft-output (SISO) Decoding, Serial and Prallel concatenated codes, Appli-
cation in 3G and 4G systems
5. LDPC Codes
• Low density parity check matrices, encoding
• Decoding in a graph, QC-LDPC
• Application in WiFi and enhanced mobile broadband (eMBB) in 5G
6. Polar Codes
• Information Theory background and construction-Capacity considerations
• Successive Cancellation decoding, List decoding
• Short frame codes, Control channel in 5G
7. Applications and Developments
• Satisfying latency and reliability in 5G through coding
• Application of coding in Distributed Computing, Storage
• Application of learning methods in coding and information theory
• New developments: Graphical signal processing, Gossip algorithms
Assignments − Grading
There will be Mandatory Assignments and Final exam. It is expected that the student is able
to demonstrate through assignments and other means that the total time spent on the course sat-
isfies the time required for credit units specified.
Texts and References
1. Error Control Codes, Shu Lin and Costello, Pearson, 2005, 2nd Edition
2. Theory and Practice of Error Control Codes, Richard Blahut, Addison-Wesley, ISBN-13: 978-
0201101027.
3. Fundamentals of Convolutional Coding, 2nd Edition, Rolf Johannesson, Kamil Sh. Zigangirov
ISBN: 978-0-470-27683-9, 688 pages, June 2015, Wiley-IEEE Press
4. Information Theory and Reliable Communication, Robert G. Gallager, ISBN: 978-0-471-
29048-3, 608 pages, January 1969.
5. Elements of Information Theory, 2nd Edition, Thomas M. Cover, Joy A. Thomas, ISBN:
978-0-471-24195-9, 792 pages, September 2006.
6. Information Theory, Inference, and Learning Algorithms, David. J. MacKay, Cambridge
University Press, Published September 2003, http://www.inference.org.uk/itprnn/book.html
Video Lectures at https://www.youtube.com/watch?v=BCiZc0n6COY&t=4s
2
FALL SEMESTER 2021: CODING AND MODULATION THEORY - ECTS
5, SEPT-NOV
7. The Emerging Field of Signal Processing on Graphs, 2013, David I Shuman,Sunil K. Narang,
Pascal Frossard, Antonio Ortega, Pierre Vandergheynst https://arxiv.org/pdf/1211.0053.pdf
8. Speeding Up Distributed Machine Learning Using Codes,2015, Kangwook Lee, Maximilian
Lam, Ramtin Pedarsani, Dimitris Papailiopoulos, Kannan Ramchandran
9. Gossip Algorithms, Devavrat Shah, 2008, http://web.mit.edu/devavrat/www/GossipBook.pdf
Journals and Conferences
1. IEEE Transactions in Information Theory, IEEE Communication Letters
2. IEEE Transactions in Communications, IEE Electronics Letters
3. Conference papers from ISIT
Instructor : Prof. Nandana Rajatheva, CWC, TS 422, [email protected]
