Fundamentals of Digital Communications and Data Transmission
Fundamentals of Digital Communications and Data Transmission
Channel
• Ease of multiplexing
– Transmitting several signals simultaneously
• Use of modern technology
– Less cost !
• Ease of encryption
– Security and privacy guarantee
– Handles most of the encryption techniques
Disadvantage !
• The major disadvantage of digital transmission
is that it requires a greater transmission
bandwidth or channel bandwidth to
communicate the same information in digital
format as compared to analog format.
• Another disadvantage of digital transmission is
that digital detection requires system
synchronization, whereas analog signals
generally have no such requirement.
Chapter 2: Analog to Digital
Conversion (A/D)
14th March 2014
Channel
Amp. Amp.
1- Sampling
2- Quantization
3- Coding
Sampling
• Process of converting the continuous time
signal to a discrete time signal.
• Sampling is done by taking “Samples” at
specific times spaced regularly.
– V(t) is an analog signal
– V(nTs) is the sampled signal
• Ts = positive real number that represent the spacing of
the sampling time
• n = sample number integer
Sampling
• Example:
– Suppose we have an analog signal with the values
between [0, 10]. If we divide the signal into four
levels. We have
• m1 [ 0, 2.5 ]
• m2 [ 2.5, 5 ]
• m3 [ 5 , 7.5]
• m4 [ 7.5, 10]
Quantization
• For every level, we assign a value for the signal
if it falls within the same level.
• Pulse means 1
• No pulse means 0
1 [ Bits ]
Ij log 2 ( )
pj
Example 1
• Find the information content of a message
that takes on one of four possible outcomes
equally likely
• Solution
The probability of each outcome = P = 1
Therefore, 0.25
1
1 log( )
I log 2 ( ) 0.25 2 bits
0.25 log(2)
Example 2
m
1
H(s) p j log 2 ( ) b[ its]
j 1
pj
• m = number of possible outcomes
• Pj = probability of the jth message
Importance of Entropy
• Entropy is considered one of the most
important quantities in information theory.
12 52 8 52 32 52
H(s) log 2 ( ) log 2 ( ) log 2 ( ) 1.335 bits
52 12 52 8 52 32
Source Coding Theorem
• First discovered by Claude Shannon.
• Source coding theorem
“A discrete source with entropy rate H can be
encoded with arbitrarily small error probability at
any rate L bits per source output as long as L > H”
Where
H = Entropy rate
L = codeword length
If we encode the source with L > H Trivial Amount of errors
If we encode the source with L < H we’re certain that an error will
occur
3.4 Lossless data compression
• Data compression
– Encoding information in a relatively smaller size than their original size
• Like ZIP files (WinZIP), RAR files (WinRAR),TAR files etc..
• Data compression:
– Lossless: the compressed data are an exact copy of the original data
– Lossy: the compressed data may be different than the original data
• Loseless data compression techniques:
– Huffman coding algorithm
– Lempel-Ziv Source coding algorithm
Chapter 4: Channel Encoding
• Channel encoding
– Techniques used to protect the transmitted signal
from the noise effect
• Two basic approaches of channel encoding
– Automatic Repeat Request (ARQ)
– Forward Error Correction (FEC)
Automatic Repeat Request (ARQ)
• Whenever the receiver detects an error in the
transmitted block of data, it requests the
transmitter to send the block again to
overcome the error.
• The request continue “repeats” until the block
is received correctly
• ARQ is used in two-way communication
systems
– Transmitter Receiver
Automatic Repeat Request (ARQ)
• Advantages:
– Error detection is simple and requires much
simpler decoding equipments than the other
techniques
• Disadvantages:
– If we have a channel with high error rate, the
information must be sent too frequently.
– This results in sending less information thus
producing a less efficient system
Forward Error Correction (FEC)
• The transmitted data are encoded so that the
receiver can detect AND correct any errors.
• Commonly known as Channel Encoding
• Can be Used in both two-way or one-way
transmission.
• FEC is the most common technique used in
the digital communication because of its
improved performance in correcting the
errors.
Forward Error Correction (FEC)
• Error Detection
– We basically check if we have an error in the
received data or not.
• There are many techniques for the detection
stage
• Parity Check
• Cyclic Redundancy Check (CRC)
Error Control Coding
• Error Correction
– If we have detected an error “or more” in the
received data and we can correct them, then we
proceed in the correction phase
• There are many techniques for error
correction as well:
• Repetition Code
• Hamming Code
Error Detection Techniques
• Parity Check
– Very simple technique used to detect errors
• In Parity check, a parity bit is added to the
data block
– Assume a data block of size k bits
– Adding a parity bit will result in a block of size k+1
bits
• The value of the parity bit depends on the
number of “1”s in the k bits data block
Parity Check
• Suppose we want to make the number of 1’s in the
transmitted data block odd, in this case the value of the parity
bit depends on the number of 1’s in the original data
– if we transmit a message = 1010111
• k = 7 bits
– Adding a parity check so that the number of 1’s is even
• The message would be : 10101111
• k+1 = 8 bits
• At the reciever ,if one bit changes its values, then an error can
be detected
Example - 1
• At the transmitter, we need to send the
message M= 1011100.
– We need to make the number of one’s odd
• Transmitter:
– k=7 bits , M =1011100
– k+1=8 bits , M’=10111001
• Receiver:
– If we receive M’ = 10111001 no error is
detected
– If we receive M’= 10111000 an Error is
Parity Check
• If an odd number of errors occurred, then the
error still can be detected “assuming a parity
bit that makes an odd number of 1’s”
• Disadvantage:
– If an even number of errors occurred, the the
error can NOT be detected “assuming a parity bit
that makes an odd number of 1’s”
Chapter 5:
Modulation Techniques
14th March 2014
1
Rb bits/sec
Tb
Example – Bit rate calculation
• Suppose that we have a binary data source
that generates bits. Each bit is represented by
a pulse of width Tb = 0.1 mSec
• Calculate the bit rate for the source
• Solution
1 1
Rb 3
10000 bits/sec
Tb 0.1 10
Example – Bit rate calculation
• Suppose we have an image frame of size
200x200 pixels. Each pixel is represented by
three primary colors red, green and blue
(RGB). Each one of these colors is represented
by 8 bits, if we transmit 1000 frames in 5
seconds what is the bit rate for this image?
Example – Bit rate calculation
• We have a total size of 200x200 = 40000 pixels
• Each pixel has three colors, RGB that each of them has 8
bits.
– 3 x 8 = 24 bits ( for each pixel with RGB)
• Therefore, for the whole image we have a total size of 24
x 40000 = 960000 bits
• Since we have 1000 frames in 5 seconds, then the total
number of bits transmitted will be 1000 x 960000 =
960000000 bits in 5 seconds
• Bit rate = 96000000/5 = 192000000 bits/second
Baud rate (Symbol rate)
• The number of symbols transmitted per second
through the communication channel.
• The symbol rate is related to the bit rate by the
following equation:
• Rb = bit rate Rb
Rs
• Rs = symbol rate N
• N = Number of bits per symbol
Baud rate (Symbol rate)
• We usually use symbols to transmit data when the
transmission bandwidth is limited
• For example, we need to transmit a data at high rate and the
bit duration Tb is very small; to overcome this problem we
take a group of more than one bit, say 2, therefore :
1
Tb fo
Tb
1 1
2Tb f fo
2Tb 2
1 1
4Tb f fo
4Tb 4
Baud rate (Symbol rate)
• We notice that by transmitting symbols rather
than bits we can reduce the spectrum of the
transmitted signal.
• Hence, we can use symbol transmission rather
than bit transmission when the transmission
bandwidth is limited
Example
• A binary data source transmits binary data,
the bit duration is 1µsec, Suppose we want to
transmit symbols rather than bits, if each
symbol is represented by four bits. what is the
symbol rate?
• Each bit is represented by a pulse of duration
1µ second, hence the bit rate
1
Rb 6
1000000 bits/sec
1 10
Example (Continue)
• Therefore, the symbol rate will be
Rb 1000000
Rs 250000 symbols/sec
N 4
Chapter 6:
Modulation Techniques (Part II)
14th March 2014