Spectral Density
Spectral Density
[ ]
Auto correlation functions (ACF)
Auto correlation
The auto correlation of a random process { } is defined by
(iii) [ ]
[ ]
Put , [ ]
[ ]
Property 2:
Time Average Approach
(i) If is a stationary process and it has no periodic components,
∫ then ̅̅̅̅ | | where ̅ [ ]
(ii) If is a stationary process and it has no periodic component then
Properties of ACF will have aperiodic component with the same period.
Property 1: If { } is W.S.S process, then (iii) If is a ergodic, zero mean and has no periodic component, then
(i) | | | |
(ii) (iv) cannot have an arbitrary shape.
(iii) [ ]
Proof: ILLUSTRATIVE EXAMPLES
(i) Consider [ ] Example 1: Prove that if is a W.S.S process, [ ]
[ ] [ ] where is the auto correlation of .
[ ] [ ] [ ] Solution: [ ] [ ]
But [ ] [ ] [ ] [ ]
[ ]
But [ ] [ ] { [ ]}
| | | |
| |
Further | | | |
Example 3:A stationary random process { } has an ACF given by
Hence | | is a valid ACF.
. Find the mean and variance of { }.
(ii)
Solution:Given
By a property, ̅̅̅̅ | |
is not an ACF.
But [ ] [ ] { [ ]}
[ ] [ ] ACF of { }.
Solution: [ ]
[ ]
[{ }{ }]
[ ] [ ] [ ]
[
[ ]
]
Since { } is WSS, [ ]
[ ]
Solution: ∫
{ [ ] }
∫
[ ]
∫ ∫
[ ]
∫ [ ( ) ]
* +
{ }]
* ∫ ∫ +
[ { } { }
* ( ∫ ) { } + { }]
[ { } { }
( )
{ }]
( )
[ ( )∫ ( )∫
* { }, -+
[ ( )∫ ( )∫
[{ }{ }]
{ }]
[
]
Department of Mathematics AnjalaiAmmalMahalingam Engineering College, Kovilvenni – 614 403. Page 4
Independence of Random Processes
( )∫ ( )∫
Two Random Processes and are statistically independent if
[ ] [ ]
( )∫ { } If and are WSS processes then for independence of the processes
and , we have [ ] [ ]
( ), - ( ), -
Properties of Cross Correlation Function
If and are WSS processes, then
, - (1)
(2) | | √
(3) | | [ ]
Proof:(i)By definition
[ ]
[ ]
Put , then we obtain
Cross Correlation Function
[ ]
The cross correlation function of two random processes and is
[ ]
defined by
[ ] (or)
[ ]
(ii) From the Cauchy-Schwarz inequality, it follows that
If and are atleast WSS processes, then
{ [ ]} [ ] [ ]
[ ]
[ ]
[ ]
Thus | | √
Orthogonal Processes (iii) [ ]
If [ ] , ie., , then and are calledOrthogonal [ ]
Processes. [ ] [ ] [ ]
[ ] [ ] [ ]
* +
Similarly
[ ] Example 3 : If where
[ ]
[ ] [ { }]
[ ] [ ] [
]
∫ [ ]
{ }
[ ]
is WSS process. , which is not a function of
[ ] [{ }{ }] are not jointly WSS processes.
[
Example 4 : Random processes are defined by
]
where are constants while
[ ] [ ]
is a uniform random variable on . Find the cross correlation function
[ ] [ ]
and show that are jointly WSS.
[ ] [ ][ ]
Solution:Given
[ ]
Given Since is uniformly distributed R.V, the p.d.f of is ,
Also are independent, [ ]
[ ]
[ ]
[ ]
{ } [ ]
[ ]
[ ]
is WSS process.
[ ] [ { }]
[ [ ]
]
[ ]
∫ [ ]
[{ }{ }]
[ ] [ ] [ ] [ ]
∫
* + | |
[ ]
* +
[{ }{ }]
[ ]
* +
[ ] [ ] [ ] [ ]
[ ]
, a function of only. | |
Find the cross correlation function of . and is uniformly distributed random variable over [ ], the p.d.f of is
Solution:Given are zero mean and stochastically independent
,
random processes, then .
[ ] [{ }{ }] [ ]
[ ] [ ]
[ ] [ ] [ ] [ ] [ ]
[ ]
∫
[ ]
[ ]
∫ [ ]
* + [ ]
[ ]
* + [ ] [ ] [ ]
[ ]
* +
| | | | | |
[ ]
| | √
( )
Example 7 : The jointly WSS random processes have sample functions
( ) where is uniformly
distributed R.V in [ ] and are constants. Find the cross
correlation function for . Also find the value of when
[ ]
are orthogonal.
[ { }]
Solution: [ ]
[ { } ]
[ ]
Department of Mathematics AnjalaiAmmalMahalingam Engineering College, Kovilvenni – 614 403. Page 10
[ ]
[
Example 8 : Given two random processes . Find expressions for
]
Auto Correlation Function of if (i) are
[ ] correlated (ii) are uncorrelated with zero means.
Solution : ACF of
[ ]
[{ }{ }]
[ ] [ ] [ ] [ ] [ ]
[ ]
∫
This is the ACF when are correlated.
Since is uniformly distributed random variable over [ ], the p.d.f of is Suppose that are uncorrelated.
[ ] [ ]
,
Similarly
∫
ACF of is given by
* + ∫
[ ] ∫
1
Power Density Spectrum of a WSS process
Let { } be a WSS process. Then the ACF and the power spectral 2
Thus ∫ 5 [ ]
6 [ ]
Wiener-Khinchin Relations
If { } is a WSS process with ACF then the power spectral density is 7
given by
8
∫ ∫
9
The above relations are known as Wiener-Khinchine relations.
| |
10
* + { [ ]} ∫* +
∫ ∫ ∫
,
[ ] [ ]
[ ] [ ]
∫
{ [ ]}
* + [ ]
[ ]
[ ]
[ ] ∫
, [ ] ∫[ ]
∫ Since by a property, ∫
[ ]
∫
[ ] [ ]
* +
Hence [ ]
* +
[ ]
Example 3 : Find the power density of a stationary random process for which
* +
| |
the ACF is
[ ] Solution : ∫
| |
∫
[ ]
[ ]
( )
[ ]
∫ ∫
| | | | Here, ( )
∫( ) ∫( )
( )
∫
The second integral vanishes because the integrand is an odd function of .
| |
∫( ) ( )
∫
| | Put
*( )( ) ( )( )+
{ ∫ } ∫
[ ]
∫ √
[ ]
∫{ | | }
∫
Example 7 : A random process { } is given by
where are independent random variables such that { }
Solution : ∫ *( )( ) ( )( )+
∫
*( )( ) ( )( )+
* + *( )( ) ( )( )+
[ ] *( )( ) ( )( )+
* , - { } { }+
Example 10 : Find the power spectrum of the random process whose ACF is
[ { } { } { }] ,
| |
* + and [ | |
] Example 12 : Find the PSD of the random process whose ACF is
| |
Solution : ∫
Solution : ∫
∫ ∫
∫ * +
{ ∫ }
* +, ( )-
Example 13 : Find the ACF of the process{ } for which the PSD is given [ ]
| |
by {
| | [ ( ) ] ( )
Solution : ACF ∫
Since [ ] * ( ) +
∫ [ ( ) ] [ ( )] [ ]
( )are uncorrelated.
∫
∫ | |
{ | | . Find the power spectral density of the
( ) | |
{ }
process.
[ ( ) ( ) ( )]
∫
[ ] [ ]
| |
∫, ( )- ∫ ∫
( )
∫ ( ) where is the Fourier transform of .
*( ) +
∫
∫( )
( ) ( )
∫ ∫
∫( )
Put √ ( ), Then √ √
[( )( ) ( )( )]
[ ∫ ]
[ ] √
( )
{ ( ) }
∫
√
From the table of Fourier transforms,
( ) Put , Then
√
[ ]
( )
∫
√ √
Example 16 : Find the power spectral density of a WSS process with ACF
∫ [ ( )]
√ √
∫
[√ ]
√
∫
√
* +
∫
∫ ∫
∫
∫ ∫
∫
Since is an even function of , i.e., , the second
integral vanishes.
∫
∫
Since ,We obtain where
Also ∫ Remark
∫
Cross Spectral Density
If are jointly WSS, we define the cross correlation functions Also if are two random processes then the time average cross
∫ *( )( ) ( )( )+
*,( )( ) ( )( )-
Properties of Cross-Power Density Spectrum
1. ,( )( ) ( )( )-+
2. [ ] [ ]are even functions of .
3. [ ] [ ]are odd functions of . * ( ) ( ) ( )( ) ( )( )+
4. , if are orthogonal.
* ( ) ( ) ( ){ }+
5. If are uncorrelated and have constant means ̅ ̅,
̅̅ . [ { } { } ( ){ }]
6. [ ] [ ] ie., the cross
[ { } { } ( ){ }]
power density spectrum and the time average of the cross correlation
function are a Fourier transform pair. ( )
[ { } { } ( ){ }]
(i) Find the ACF & the power spectrum of if are jointly WSS. are real constants and are jointly WSS processes.
(ii) Find the power spectrum of if are orthogonal. (a) Find the power spectrum of .
(iii) Show that if are orthogonal, then the mean square of is (b) Find if are uncorrelated.
equal to the sum of the mean squares of . (c) .
[ ] [{ }{ }]
[{ }{ }] [ { } { } { }
[{ }] { }]
[ ] [ ] [ ] [ ] [ ] [ ] [ ]
[ ]
(c) [ ]
And the Fourier Transform of the above gives,
[ { }]
WIENER-KHINCHINE THEOREM
| |
Statement : If is the Fourier Transform of the truncated random
The limits of t are : when
process is defined as { , Where { } is a real WSS The limits of are : when
process with power density spectrum then
{| | ∫ ∫
[ {| | }]
Proof : {| | *∫ + *∫ +
Given that { }
[ ] *∫ +
∫
*∫ +
∫ { }
| | [ ][ ] { | | ̅} [ {| | }] *∫ +
*∫ + *∫ +
*∫ +
∫ ∫
∫
∫ ∫
[ {| | }]
Hence proved.
Department of Mathematics AnjalaiAmmalMahalingam Engineering College, Kovilvenni – 614 403. Page 23
3. State and prove Weiner-Khintchine Theorem.
2. Find the Power spectral density of a random binary transmission process . Is { } mean ergodic?
where autocorrelation function is 2. Find the power spectral density of a WSS process with autocorrelation
| | function .
, | |
3. A random process { } is given by , where
3. If the power spectral density of a continuous process is are independent random variables such that
find the mean square value of the process. and . Find the power spectral density of the process.
4. A stationary process has an auto correlation function given by 4. If the power spectral density of a WSS process is given by
| | | |
Find the mean value, mean square value and variance of the , . Find the autocorrelation function of the process.
| |
process.
correlation function. 2. Find the power spectral density of the random process whose
autocorrelation function is .
PART-A DEC 2013
3. The cross-correlation function of two processes { } { } is given
1. Define power spectral density function.
by { } where are
2. State Wiener-Khintchine theorem.
constants. Fine the cross-power spectrum
PART-B
4. Let be both zero-mean and WSS random processes.
1. The autocorrelation function of the random telegraph signal process is
√| |
Consider the random process defined by . Find (i)
given by . Determine the power density spectrum of the
The Autocorrelation function and the power spectrum of
random telegraph signal.
if are jointly WSS. (ii) The power spectrum of
2. The autocorrelation function of the Poisson increment process is given by
if are orthogonal.
2. The Autocorrelation function of a WSS process is given by 2. Find the power spectral density function of the stationary process whose
| |
| |
determine the power spectral density of the process. autocorrelation function is given by
4. The cross-power spectrum of real random processes { } { } is 1. Find the autocorrelation function of the periodic time function of the
| | period time function { }
given by { . Find the cross-correlation
2. The autocorrelation function of the random binary transmission { } is
function. | |
given by for | | and for | | . Find the power
*****