Scribd
Upload
5 views25 pages

DCOM - Module 1 - Mrunalini Pimpale

The document discusses the block diagram and subsystem description of a digital communication system, highlighting the advantages and disadvantages of DCOM, such as better noise immunity and higher bandwidth requirements. It also covers concepts related to information theory, including entropy, source coding, and Shannon-Fano coding, along with numerical examples. Additionally, it addresses joint, conditional, and marginal probabilities, as well as the Shannon Hartley theorem.

Uploaded by

hardikmachhi1484
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
5 views25 pages

DCOM - Module 1 - Mrunalini Pimpale

The document discusses the block diagram and subsystem description of a digital communication system, highlighting the advantages and disadvantages of DCOM, such as better noise immunity and higher bandwidth requirements. It also covers concepts related to information theory, including entropy, source coding, and Shannon-Fano coding, along with numerical examples. Additionally, it addresses joint, conditional, and marginal probabilities, as well as the Shannon Hartley theorem.

Uploaded by

hardikmachhi1484
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 25

Block Diagram and Sub-system description of a digital

communication system
10 August 2020 10:13

Module 2 Page 1
Advantages and disadvantages of DCOM
10 August 2020 10:14

Advantages
1) DCOM has a better noise immunity
2) Due to channel coding techniques used in DCOM , it is possible to detect and correct the
errors introduced during the data transmission.
3) Repeaters can be used between Transmitter and receiver to regenerate the digital signal. This
improves the noise immunity further.
4) TDM (Time division Multiplexing ) technique can be used to transmit many voice channels over
a single common transmission channel.
5) DCOM is becoming simpler and cheaper as compared to the analog communication due to the
invention of high speed computers and IC's

Disadvantages
1) The bit rates of digital systems are high therefore they require a larger channel BW as
compared to analog systems
2) Digital modulation needs synchronization in case of synchronous modulation .

Module 2 Page 2
Definition of Information (Measure of Information) &
Properties
11 August 2020 08:56

Module 2 Page 3
Numerical based on Information Theory
11 August 2020 08:57

1) A message signal mk is transmitted by a transmitter . The probability of occurrence of this signal is (1/4) .
Calculate the information conveyed by it in terms of bits, nats, and decit.

2) In a binary PCM system the binary 0 and 1 are transmitted . If they have the probabilities of 3/4
and 1/4 respectively then calculate the information conveyed by each one of them and comment
on the result.

Module 2 Page 4
Entropy
11 August 2020 09:02

Properties of Entropy

Module 2 Page 5
Module 2 Page 6
Information Rate and numerical based on numerical
13 August 2020 11:11

1) An analog signal is bandlimited to 4KHz, sampled at the Nyquist rate, and the samples are quantized into 4
levels. The quantization levels are Q1, Q2, Q3 and Q4 (messages) are assumed independent and occur with
probabilities. P1=P4=1/8 and P2=P3=3/8. Find the information rate of the source.

Module 2 Page 7
Source Coding
13 August 2020 11:41

Source coding: The source encoder converts information waveforms to bits, while the decoder converts bits back to
waveforms. ... Channel coding: The channel encoder converts bits to signal waveform, while the decoder converts received
waveform back to bits.

Module 2 Page 8
Shannon Fano Coding
13 August 2020 11:45

2) A discrete memoryless source has five symbols X1,X2,X3,X4 and X5 with probabilities P(X1)=0.4, P(X2)=0.19,P(X3)=0.16, P(X4)=0.14 and P(X5)=
0.11. Construct the Shannon Fano code for this source. Calculate the average codeword length and efficiency of the source.

Module 2 Page 9
Module 2 Page 10
Huffman Source Coding
17 August 2020 11:04

ADVANTAGES: • uniquely decodable code


• smallest average codeword length

Steps to be follow
1) Arrange all the messages in the order of decreasing probabilities.
2) Assign number 0 & 1 to the two messages having lowest probability.
3) Combine these two message into a new message and place this probability in the probability list
as per its value.
4) Repeat this procedure.
5) Write the code-word for each message by tracking back from last stage to first stage.

Module 2 Page 11
Module 2 Page 12
Module 2 Page 13
Module 2 Page 14
Module 2 Page 15
Module 2 Page 16
Differential Entropy
18 August 2020 08:37

Module 2 Page 17
Joint , Conditional and Marginal Probabilities
18 August 2020 08:40

Module 2 Page 18
Module 2 Page 19
Joint Entropy, Conditional Entropy and Mutual
Information
19 August 2020 07:38

Module 2 Page 20
Module 2 Page 21
Numericals
19 August 2020 08:36

Module 2 Page 22
Module 2 Page 23
Module 2 Page 24
Shannon Hartley Theorem
20 August 2020 11:59

Module 2 Page 25

You might also like