Unit I Lect 8 Onwards
Unit I Lect 8 Onwards
Course Outcomes
Books
1. Understand random variables and random processes. 1. Simon Haykin, Communication Systems, 4th Edition, John Wiley
& Sons, 2001.
Principles of Communication 2. Analyse different amplitude modulation schemes. 2. G R Cooper and C D McGillem, Probabilistic Methods of Signals
Engineering I 3. Analyse different angle modulation schemes. and Systems Analysis, Oxford University Press, 1998.
3. H Taub, D L Schilling and G Saha, Principles of Communication
4. Explain sampling processes and reconstruction. Systems, 3rd Edition, Tata McGraw Hill, 2008.
5. Analyse the behaviour of communication system in the 4. A B Carlson, Communication Systems, McGraw Hills, 2002.
presence of noise. 5. J G Proakis and M Salehi, Communication Systems Engineering,
2nd Edition, Pearson Education, 2006.
Syllabus
Principles of Communication
Engineering I Unit I: Random Variables and Stochastic Processes
• Review of Random Variables; Probability Distribution and Probability Density Functions;
Uniform, Gaussian, Exponential and Poisson Random Variables; Statistical Averages;
Random Processes; Correlation; Power Spectral Density; Analysis of Linear Time
Invariant Systems With Random Input; Noise and Its Representations
Unit II: Amplitude Modulation
• Course No : ELC2420
• Introduction to Modulation; Amplitude Modulation Systems (AM, DSBSC, SSBSC, VSB Unit I
• Credits : 4 Modulation/Demodulations); Frequency Division Multiplexing; Superhetrodyne Radio
• Course Category : Departmental Core Receiver; Equivalent Receiver Model, Noise in CW Receivers Using Coherent Detection, Random Variables and Processes
Noise in CW Receivers Using Envelope Detector
• Pre‐requisite(s) : ELC2410 (Signals and Systems)
Unit III: Angle Modulation
• Contact Hours (L‐T‐P) : 3‐1‐0 • Angle Modulation: Frequency and Phase Modulation; Generation and Demodulation of
• Type of Course : Theory Narrowband and Wideband FM; FM Broadcasting; Non‐linear Effects in FM Systems;
Noise in FM Receivers, FM Threshold Effect
Unit IV: Sampling and Pulse Modulation
• Sampling Theorem; Various Sampling Techniques; Sampling of Low Pass and Bandpass
Signals; Time Division Multiplexing; Generation and Recovery of PAM, PWM and PPM
Signals
14‐02‐2021
𝜇 𝑥𝑓 𝑥 𝑑𝑥 𝑥𝑓 𝑥 𝑑𝑥
Autocorrelation Function
Second Order Stationary Process Autocorrelation Function Properties
• Consider sampling the random process 𝑋 𝑡 at two points in time • We define the autocorrelation function of the process 𝑋 𝑡 as the
𝑡 and 𝑡 with the corresponding joint distribution function expectation of the product of two random variables 𝑋 𝑡 and 𝑋 𝑡 .
• Power of a Wide‐Sense Stationary Process: The second
𝐹 𝑥 ,𝑥 . 𝑅 𝑡 ,𝑡 𝐸𝑋 𝑡 𝑋 𝑡
, moment or mean‐square value of a real‐valued random
• Suppose a second set of observations are made at times 𝑡 𝜏 and process is given by
𝑥 𝑥 𝑓 , 𝑥 , 𝑥 𝑑𝑥 𝑑𝑥
𝑡 𝜏 and the corresponding joint distribution is 𝑅 0 𝐸𝑋 𝑡 𝑋 𝑡 𝐸 𝑋2 𝑡 equivalent to the average power
𝐹 , 𝑥 , 𝑥 . Then if, for all 𝑡 , 𝑡 and 𝜏 we find that
• We say a random process 𝑋 𝑡 is stationary to second order if the joint • Symmetry: The autocorrelation of a real‐valued wide‐sense
𝐹 , 𝑥 ,𝑥 𝐹 , 𝑥 ,𝑥 distribution 𝐹 , 𝑥 , 𝑥 depends on the difference between the stationary process has even symmetry.
we say the process is stationary to the second order. observation time 𝑡 and 𝑡 . 𝑅 τ 𝑅 τ
• It implies that statistical quantities like covariance and correlation, 𝑅 𝑡 ,𝑡 𝑅 𝑡 𝑡 for all 𝑡 and 𝑡 • Maximum Value: The autocorrelation function of a wide‐
do not depend upon absolute time. • The auto covariance function of a stationary random process 𝑋 𝑡 is sense stationary random process is a maximum at the origin.
written as: (Prove it !!!)
𝐶 𝑡 ,𝑡 𝐸 𝑋 𝑡 𝜇 𝑋 𝑡 𝜇 𝑅 𝑡 𝑡 𝜇
14‐02‐2021
Proof
• t=0.001:.001:1;
Proof • x1=sin(2*pi*50*t)+1.1*randn(1,length(t));%;
• x2=sin(2*pi*50*t)+0.1*randn(1,length(t));%;
𝑅 τ 𝐸𝑋 𝑡 𝜏 𝑋 𝑡 𝐸𝑋 𝑡 𝑋 𝑡 𝜏
• plot(x1)
𝑅 τ
• ac1=autocorr(x1,'NumLags',floor((length(x1))/2));
• ac2=autocorr(x2,'NumLags',floor((length(x2))/2));
0 𝐸 𝑋 𝑡 𝜏 𝑋 𝑡
• hold on; %figure
0 𝐸𝑋 𝑡 𝜏 2𝐸 𝑋 𝑡 𝜏 𝑋 𝑡 𝐸𝑋 𝑡 • plot(x2,'m')
• plot(ac1,'k');
0 2𝑅 0 2𝑅 τ • plot(ac2,'r')
𝑅 τ 𝑅 0
𝜀𝑥 lim
1
𝑥 𝑡 𝑑𝑡
X t1 T X t1
→ 2𝑇
RX (t1 T,t2 T) RX (t1,t2)
and the time‐autocorrelation of the sample function is given by:
𝜇 𝑡 𝜇 ℎ 𝜏 𝑑𝜏 𝜇 𝐻 0 𝑆 𝑓 𝑅 τ 𝑒𝑥𝑝 𝑗2𝜋𝑓𝜏 𝑑𝜏
𝑅 𝑡,𝑢 𝐸 Y t Y u 𝐸 ℎ 𝜏 𝑋 𝑡 𝜏 𝑑𝜏 ℎ 𝜏 𝑋 𝑢 𝜏 𝑑𝜏
• These Equations are basic relationship in the theory of spectral analysis
of random processes, and together are usually called the Einstein‐
𝑑𝜏 ℎ 𝜏 𝑑𝜏 ℎ 𝜏 𝐸 𝑋 𝑡 𝜏 𝑋 𝑢 𝜏 Wiener‐Khintchine relations.
𝑑𝜏 ℎ 𝜏 𝑑𝜏 ℎ 𝜏 𝑅 𝑡 𝜏 ,𝑢 𝜏
• Property 1: 𝑆 0 𝑅 τ 𝑑𝜏
• Suppose that a random process 𝑋 𝑡 is applied as input to linear • When the input 𝑋 𝑡 is a wide‐sense stationary random
time‐invariant filter of impulse response ℎ 𝑡 , producing a new process, the autocorrelation function of 𝑋 𝑡 is only a • Property 2:𝐸 𝑋 𝑡 𝑆 𝑓 𝑑𝑓
random process 𝑌 𝑡 at the filter output. function of the difference between the observation times:
• Property 3: 𝑆 𝑓 0 for all 𝑓
• Assume that 𝑋 𝑡 is a wide‐sense stationary random process. 𝑅 τ ℎ 𝜏 ℎ 𝜏 𝑅 τ 𝜏 𝜏 𝑑𝜏 𝑑𝜏
• The mean of the output random process 𝑌 𝑡 is given by: • Property 4: 𝑆 𝑓 𝑆 𝑓
• Property 5: If a stationary random process 𝑋 𝑡 with spectrum
• If the input to a stable linear time‐invariant filter is a wide‐
𝜇 𝑡 𝐸𝑌 𝑡 𝐸 ℎ 𝜏 𝑋 𝑡 𝜏 𝑑𝜏 𝑆 𝑓 is passed through a linear filter with frequency response
sense stationary random process, then the output of the
filter is also a wide‐sense stationary random process. 𝐻 𝑓 the spectrum of the stationary output random process
𝑌 𝑡 is given by:
ℎ 𝜏 𝐸𝑋 𝑡 𝜏 𝑑𝜏 ℎ 𝜏 𝜇 𝑡 𝜏 𝑑𝜏
𝑆 𝑓 𝑆 𝑓 𝐻 𝑓 (Prove it)
14‐02‐2021
• Suppose we let 𝐻 𝑓 1 for any arbitrarily small interval 𝑓 𝑓 𝑓 • Determining the power spectral density of the random process
and 𝐻 𝑓 0 outside this interval. Then, we have: Y t defined by:
Y t X t cos 2𝜋𝑓 𝑡 Θ
𝑆 𝑓 𝑑𝑓 0 • We note that random variable Θ is independent of X t .
Noise
Gaussian Process Shot Noise
• The sources of noise may be external to the system (e.g.,
atmospheric noise, galactic noise, man‐made noise), or internal
• A random process 𝑋 𝑡 , with 𝑡 taking values in the set 𝑇, is • The number of electrons, N(t), emitted in the time interval (0, t)
to the system.
constitutes a discrete stochastic process, the value of which increase by
said to be a Gaussian process if, for any integer k and any • The second category includes an important type of noise that one each time an electron is emitted.
subset 𝑡 , 𝑡 , … , 𝑡 of 𝑇 , the k random variables arises from spontaneous fluctuations of current or voltage in • Let the mean value of the number of electrons, v, emitted between times
𝑋 𝑡 ,𝑋 𝑡 ,…,𝑋 𝑡 is jointly Gaussian distributed. electrical circuits. This type of noise represents a basic limitation
t and t+t0 be E t0
on the transmission or detection of signals in communication
• Gaussian process has the following properties: systems involving the use of electronic devices. λ: a constant called the rate of the process
• The total number of electrons emitted in the interval (t, t+t0) is
• Property 1: If a Gaussian process X(t) is applied to a stable linear • The two most common examples of spontaneous fluctuations N t t0 N t
filter, then the output of Y(t) is also Gaussian. in electrical circuits are:
• It follows a Poisson distribution with a mean value equal to λt0.
• Shot noise • The probability that k electrons are emitted in the interval (t, t+t0) is
• Thermal noise
t0 k e k
P k k 0, 1,
k!
14‐02‐2021
N0 kTe
• The dimensions of N0 are in watts per Hertz, k is Boltzmanns
constant and Te is the equivalent noise temperature of the receiver. Fig. (a). Extraction of in‐phase and quadrature components of a narrowband process. (b).
Generation of a narrowband process from its in‐phase and quadrature components.
14‐02‐2021
Representation of Narrowband Noise in Terms Ideal Band‐Pass Filtered White Noise Representation of Narrowband Noise in Terms of
of In‐phase and Quadrature Components In‐phase and Quadrature Components
• Consider a white Gaussian noise of zero mean and power spectral density
N0/2, which is passed through an ideal band‐pass filter of passband
• 𝑛 𝑡 and 𝑛 𝑡 of a narrowband noise 𝑛 𝑡 have some magnitude response equal to one, mid‐band frequency fc, and bandwidth 2B. • The narrowband noise 𝑛 𝑡 can be represented in terms of its envelope and
important properties: phase components:
• The power spectral density characteristic of the filtered noise 𝑛 𝑡 is shown
𝑛 𝑡 𝑟 𝑡 𝑐𝑜𝑠 2𝜋𝑓 𝑡 Ψ 𝑡
1) The 𝑛 𝑡 and 𝑛 𝑡 of 𝑛 𝑡 have zero mean. in Fig. (a). The power spectral density characteristic of 𝑛 𝑡 and 𝑛 𝑡 are /
shown in Fig. 𝑟 𝑡 𝑛 𝑡 𝑛 𝑡
2) If 𝑛 𝑡 is Gaussian, then 𝑛 𝑡 and 𝑛 𝑡 are jointly Gaussian. 𝑟 𝑡 : envelope of 𝑛 𝑡 ;
3) If 𝑛 𝑡 is stationary, then 𝑛 𝑡 and 𝑛 𝑡 are jointly stationary. Ψ 𝑡 : phase of 𝑛 𝑡
4) Both 𝑛 𝑡 and 𝑛 𝑡 have the same power spectral density, which is
related to the power spectral density 𝑆 𝑓 of 𝑛 𝑡 as: • Both 𝑟 𝑡 and Ψ 𝑡 are sample functions of low‐pass random processes.
𝑆 𝑓 𝑓 𝑆 𝑓 𝑓 , 𝐵 𝑓 𝐵 • The probability distributions of 𝑟 𝑡 and Ψ 𝑡 may be obtained from those of
𝑆 𝑓 𝑆 𝑓 𝑛 𝑡 and 𝑛 𝑡 .
0, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒