Module 1 - Information Theory
Module 1 - Information Theory
MODULATION AND
CODING TECHNIQUES
A Modular Approach
MODULE 1
INFORMATION THEORY
OBJECTIVES:
KEY TERMS
• DIGITAL TRANSMISSION – It is the transmittal of digital pulses between two or more points
in a communication system.
• DIGITAL RADIO – It is the transmittal of digitally modulated analog carrier between two or
more points in a communication system.
1. Ease of processing
2. Ease of multiplexing
3. Noise immunity
1. Higher cost
2. Circuit complexity
1. In digital radio the modulating and demodulating signals are digital pulses rather than analog
waveforms.
2. Digital radios used digital modulation schemes.
Disclaimer: The professor does not own some contents and all pictures of this module. Full credits are given to all sources especially
to the book “Advanced Electronic Communication Systems” by Wayne Tomasi
1
INFORMATION THEORY
It is the study of the efficient use of bandwidth to propagate information through an electronic
communication system.
INFORMATION CAPACITY
It represents the number of independent symbols that can be carried through the system in a
given unit of time (bit rate)
Hartley’s Law
For a given time, the information capacity is directly proportional to the bandwidth”. I n symbol,
It states that the higher the signal to noise ratio, the better the performance and the higher the
information capacity of a system.
SAMPLE PROBLEMS
1. Solve the information capacity for a standard voice band communications channel with a
signal to noise ratio of 30 dB and a bandwidth of 3KHz.
Solution:
(dB) = 10log So: I= 3.32Blog (1+ )
= 1000
M-ary Encoding
Where:
N= number of bits necessary
M= number of conditions, levels, or combination possible with N bits
Disclaimer: The professor does not own some contents and all pictures of this module. Full credits are given to all sources especially
to the book “Advanced Electronic Communication Systems” by Wayne Tomasi
2
Key Terms:
Bit Rate – it is the rate of change of a digital information signal before processing (bps)
Baud Rate - it is the rate of change of a digital information signal after processing (baud)
Where:
Disclaimer: The professor does not own some contents and all pictures of this module. Full credits are given to all sources especially
to the book “Advanced Electronic Communication Systems” by Wayne Tomasi
3
EXERCISE NO. 1
INFORMATION THEORY
1. What is the bandwidth needed to support a capacity of 20,000bps when the ratio of power to
noise is 200? Solve the information density (bps/Hz)
2. What is the channel capacity for a signal power of 200W, noise power of 10W and a
bandwidth of 2KHz of a digital system?
Required Readings:
Disclaimer: The professor does not own some contents and all pictures of this module. Full credits are given to all sources especially
to the book “Advanced Electronic Communication Systems” by Wayne Tomasi
4
Disclaimer: The professor does not own some contents and all pictures of this module. Full credits are given to all sources especially
to the book “Advanced Electronic Communication Systems” by Wayne Tomasi
5