CH 06
CH 06
Stochastic Processes
Problem 6.2
a. For case (a) of problem 6.1, since the sample functions are constant with time and
are less than or equal 2A, the probability is one. For case (b) of problem 6.1, since
the sample functions are constant with time and 5 out of 6 are less than or equal to
2A, the probability is 5/6. For case (c) of problem 6.1, the probability is 5/6 because
5 out of 6 of the sample functions will be less than 2A at t = 2.
Problem 6.3
1
2 CHAPTER 6. STOCHASTIC PROCESSES
b. X (t) takes on only two values A and A, and these are equally likely. Thus
1 1
fX (x) = (x A) + (x + A)
2 2
Problem 6.4
jsin (! 0 t0 )j
Y = a
!0
c. Not stationary (the second moment, for example, depends on time) and not ergodic.
Problem 6.5
a. By inspection of the sample functions, the mean is zero. Considering the time average
correlation function, de…ned as
Z T Z
1 1
R ( ) = lim x (t) x (t + ) dt = x (t) x (t + ) dt
T !1 2T T T0 T0
where the last expression follows because of the periodicity of x (t), it follows from a
sketch of the integrand that
A2 (1 4 =T0 ) , 0 T0 =2
R( ) =
A2 (1 + 4 =T0 ) , T0 =2 0
b. Yes, it is wide sense stationary. The random delay, , being over a full period, means
that no untypical sample functions occur.
6.1. PROBLEM SOLUTIONS 3
Problem 6.6
b. Again, the mean is zero because the mean of A is zero. The ensemble-average auto-
correlation function is
R ( ) = E [Y (t; A) Y (t + ; A)]
Z 1
a 2 exp a2 =2 2
a
= sin (! 0 t) sin [! 0 (t + )] p da
1 !0 2 2a
2
a
= sin (! 0 t) sin [! 0 (t + )]
! 20
2
a
= fcos (! 0 ) cos [! 0 (2t + )]g
2! 20
c. No, it is not wide sense stationary because the ensemble-average autocorrelation func-
tion is time dependent (not a function only of time di¤erence).
Problem 6.7
The time average variance is A2 =2. The statistical average second moment is
Z
2 d
E X (t) = A2 cos2 (2 f0 t + )
=2 =2
"Z Z # " #
A2 A2 1
= d + cos (4 f0 t + 2 ) d = + sin (4 f0 t + 2 )
=2 =2 2 2 =2
A2 A2
= + [sin (4 f0 t + 2 ) sin (4 f0 t + )]
2 2
A2 A2 A2 A2
= + [sin (4 f0 t) + sin (4 f0 t)] = + sin (4 f0 t)
2 2 2
The statistical average variance is this expression minus E 2 [X (t)].
A2
hx (t) x (t + )i = cos (2 f0 )
2
The statistical average autocorrelation function is
Z
d
R( ) = A2 cos (2 f0 t + ) cos (2 f0 (t + ) + )
=2 =2
2 Z
A
= [cos (2 f0 ) + cos (2 f0 (2t + ) + 2 )] d
=2
A2 A2
= cos (2 f0 ) + sin (2 f0 (2t + ) + 2 )
2 2 =2
A2 A2
= cos (2 f0 ) + [sin (2 f0 (2t + ) + 2 ) sin (2 f0 (2t + ) + )]
2 2
A2 A2
= cos (2 f0 ) + [sin 2 f0 (2t + ) + sin 2 f0 (2t + )]
2
A2 2A2
= cos (2 f0 ) + sin 2 f0 (2t + )
2
c. No. The random phase, not being uniform over (0; 2 ), means that for a given time,
t, certain phases will be favored over others.
Problem 6.8
From the measurements given, assuming ergodicity, we can infer that the mean is 6 V and
the second moment is 49 V2 (we assume that the true-rms meter is DC coupled). Thus
6.1. PROBLEM SOLUTIONS 5
e (x 6)2 =26
fX (x) = p
26
Problem 6.9
Use the Fourier transform pair
N0
N0 W sinc (2W ) $ (f =2W )
2
N0
with W = 103 Hz and 2 =2 10 5 V2 /Hz to get the autocorrelation function as
5
RX ( ) = N0 W sinc (2W ) = 4 10 103 sinc 2 103
= 0:04 sinc 2 103
Problem 6.10
a. Suitable;
b. Suitable;
e. Suitable;
f. Suitable.
6 CHAPTER 6. STOCHASTIC PROCESSES
Problem 6.11
Rb ( ) = A2 [2r ( ) + r ( + T ) + r ( T )]
Problem 6.12
a. By de…nition
RZ ( ) = E [Z (t) Z (t + )]
= E [X (t) X (t + ) Y (t) Y (t + )]
= E [X (t) X (t + )]E[Y (t) Y (t + )]
= RX ( ) RY ( )
6.1. PROBLEM SOLUTIONS 7
b. Since a product in the time domain is convolution in the frequency domain, it follows
that
SZ (f ) = SX (f ) SY (f )
and
1 1
cos (2 f0 ) ! (f f0 ) + (f + f0 )
2 2
Also,
RY ( ) = E f4 cos (50 t + ) cos [50 (t + ) + ]g = 2 cos (50 )
This gives
and
Y f 25 Y f + 25
SZ (f ) = 5 103 +
200 200
Problem 6.13
and
Problem 6.14
a. The student should carry out the sketch.
R 0+
b. DC power = 0 S (f ) df = 10 W.
R1
c. Total power = 1 S (f ) df = 10 + 25=5 + 5 + 5 = 25 W
d. Power for jf j 0:2 Hz = 10 + 0:9 (25=5) = 14:5 W. Fraction of total power =
14:5=25 = 0:58 = 58%.
Problem 6.15
a. The autocorrelation function is
RX ( ) = E [Y (t) Y (t + )]
= E f[X (t) + X (t T )][X (t + ) + X (t + T )]g
= E [X (t) X (t + )] + E[X (t) X (t + + )]
+E [X (t T ) X (t + )] + E[X (t T ) X (t + T )]
= 2RX ( ) + RX ( T ) + RX ( + T )
Problem 6.16
2 = E X 2 (t) E 2 [X (t)] = 12 9 = 3 W.
X
b. DC power = E 2 [X (t)] = 9 W.
d. S (f ) = 9 (f ) + 15 sinc2 (5f ).
Problem 6.17
b. Using the Fourier transform of a two-sided decaying exponential and the modulation
theorem, the Fourier transform of the …rst is
4 4
SX1 (f ) = 2 +
2 + [2 (f 1)] 2 + [2 (f + 1)]2
Using the Fourier transform of the Gaussian pulse, the Fourier transform of the third is
5p 2
2
SX3 (f ) = exp
2 4
d. Evaluate the correlation function at = 0 to get total power. The results are 4, 6,
and 5 W, respectively, for (a)-(c).
Problem 6.18
a. By assuming a unit impulse at the input, the impulse response (i.e., the response to
a unit impulse) is
1
h (t) = [u (t) u (t T )]
T
b. Use the time delay theorem of Fourier transforms and the Fourier transform of a
rectangular pulse to get
H (f ) = sinc (f T ) e j f T
d. Use F [ ( = 0 )] = 2(
0 sinc 0f ) to get
N0
R0 ( ) = ( =T )
2T
E Y 2 = Hmax
2
BN N0
The output power is also R0 (0) = N0 =2T . Equating the two results and noting that
Hmax = 1, gives BN = 1= (2T ) Hz.
f. Evaluate the integral of the power spectral density over all frequency:
Z 1 Z
N0 N0 1 N0
E Y2 = sinc2 (f T ) df = sinc2 (u) du = = R0 (0)
1 2 2T 1 2T
Problem 6.19
Note that the rectangular pulse function does not need to be squared because its
amplitude squared is unity.
6.1. PROBLEM SOLUTIONS 11
Rout ( ) = 5 105 10 6
sinc 5 105 = 0:5 sinc 5 105
c. The output power is 0:5 W, which can be found from Rout (0) or the integral of
Sout (f ).
Problem 6.20
b. The autocorrelation function of the output, by inverse Fourier transforming the output
power spectral density, is (a table of de…nite integrals is necessary)
Z 1
N0 =2
R0 ( ) = F 1 [S0 (f )] = 4e
j2 f
df
1 1 + (f =f3 )
Z 1 Z 1
cos (2 f ) cos (2 f3 x)
= N0 4 df = N0 f3 dx
0 1 + (f =f3 ) 0 1 + x4
f3 N0 p2 f3 p
= e cos 2 f3 =4
2
f 3 N0
c. Yes. R0 (0) = 2 = N0 BN ; BN = f3 =2
Problem 6.21
Use the integrals Z 1
b0 ds j b0
I1 = =
1 (a0 s + a1 ) ( a0 s + a1 ) a0 a1
and Z 1 b0 s2 + b1 ds b0 + a0 b1 =a2
I2 = =j
1 (a0 s2 + a1 s + a2 ) (a0 s2 a1 s + a2 ) a0 a1
to get the following results for BN .
Filter Type First Order Second Order
f = 2
Chebyshev fc =2 p qcp
1+1= 2 1+1= 2 1
Butterworth 2 fc 2
p f
2 c
12 CHAPTER 6. STOCHASTIC PROCESSES
Problem 6.22
a. The power spectral density is
N0
SY (f ) = (f =2B)
2
The autocorrelation function is
RY ( ) = N0 B sinc (2B )
Problem 6.23
a. E [Y (t)] = 0 because the mean of the input is zero.
b. The frequency response function of the …lter is
1
H (f ) =
10 + j2 f
The output power spectrum is
SY (f ) = Sx (f ) jH (f )j2
1
= 1
100 + (2 f )2
0:01 2=10
= = 0:05
1 + (2 f =10)2 1 + (2 f =10)2
which is obtained applying (6.89).
6.1. PROBLEM SOLUTIONS 13
2 0
c. Use the transform pair exp ( j j= 0 ) ! 1+(2 f 2 to …nd the power spectrum as
0)
10j j
RY ( ) = 0:05e
d. Since the input is Gaussian, so is the output. Also, E [Y ] = 0 and var[Y ] = RY (0) =
0:05, so
exp y 2 =2 2Y
fY (y) = q
2 2Y
where 2 = 0:05:
Y
Also
RY ( ) 10j j
( )= =e
RY (0)
Set = 0:03 to get (0:03) = 0:741. Put these values into (5.189).
Problem 6.24
We have
(2 f )2
jH (f )j2 =
(2 f )4 + 5; 000
Thus
j2 f j
jH (f )j = q
(2 f )4 + 5; 000
This could be realized with a second-order Butterworth …lter in cascade with a di¤erentiator.
Problem 6.25
b. For this case Hb; max = 2 and the frequency response function is a 2-unit high isoceles
triangle centered at 0 and 100 Hz wide so that
Z 1 Z 50
1 2 1
BN = jHb (f )j df = [2 (1 f =50)]2 df ; v = f =50
Hb;2 max 0 4 0
Z 1 1
2 50 3
= 50 (1 v) dv = (1 v) = 16:67 Hz
0 3 0
c. For this case Hc; max = 1 and for the given frequency response function
Z 1 Z 1
1 2 1 100
BN = jHc (f )j df = df
Hc;2 max 0 1 0 100 + (2 f )2
Z 1
1
= df ; v = 2 f =10
0 1 + (2 f =10)2
Z 1
10 1 1 5 1
= dv = tan v
2 0 1 + v2 0
5
= = 2:5 Hz
2
That is, it is a unit-high isoceles triangle of total width 10 centered at 0 on top of a unit-high
rectangle centered at 0 of total width 10. Thus Hd; max = 2 and for the given frequency
response function
Z 1 Z 5
1 2 1
BN = 2 jHd (f )j df = 2 (2 f =5)2 df; v = f =5
Hd; max 0 2 0
Z 1 1
5 51 5 3
= (2 v)2 dv = (2 v) 3
= 1 23
4 0 43 0 12
= 35=12 = 2:92 Hz
6.1. PROBLEM SOLUTIONS 15
Problem 6.26
The transfer function is
! 23
H (s) = p pp p
s + ! 3 = 2 + j! 3 = 2 s + ! 3 = 2 j! 3 = 2
A A
= p p + p p
s + ! 3 = 2 + j! 3 = 2 s + ! 3 = 2 j! 3 = 2
p
where A = j! 3 = 2 with ! 3 the 3-dB frequency in rad/s. This is inverse Fourier transformed,
with s = j!, to yield
p p !3t
h (t) = 2! 3 exp ! 3 t= 2 sin p u (t)
2
Problem 6.27
By de…nition
Z 1 Z 1 2
1 21 f 500
BN = 2
jH (f )j df = 2 df
Hmax 0 4 0 100
Z 500 2 Z 600 2
f 500 f 500 f 500
= 1+ df + 1 df ; u =
400 100 500 100 100
Z 0 Z 1
2
= 100 (1 + u) du + 100 (1 u)2 du
1 0
0 1
100 100 100 100
= (1 + u)3 (1 u)3 = +
3 1 3 0 3 3
= 66:67 Hz
16 CHAPTER 6. STOCHASTIC PROCESSES
Problem 6.28
a. Use the impulse response method. First, use partial fraction expansion to get the
impulse response:
10 1 1 10 2t 25t
Ha (f ) = , ha (t) = e e u (t)
23 j2 f + 2 j2 f + 25 23
Thus
R1 R
10 2 1
2
e 2t 25t 2 dt
1 jh (t)j dt 23 0 e
BN = hR i2 = R
1 2 10 1 2t 25t ) dt 2
2 1 h (t) dt 23 0 (e e
R1
1 0 e 4t 2e 27t + e 50t dt
=
2 1 2t + 1 e 25t 1 2
2e 25 0
1
e 4t + 2 e 27t 1 50t 1
1 4 27 50 e 0
= 2
2 (1=2 1=25)
2 2
1 50 1 2 1 1 50 529
= + =
2 23 4 27 50 2 23 27 100
= 0:463 Hz
b. Again use the impulse response method. Use the transform pair t exp ( at) u (t) $
1
(a+j2 f )2
to get
hb (t) = 100t exp ( 10t) u (t)
Problem 6.29
b. Use the result from part (a) and the modulation theorem to get
Rnp ( ) = e j j
cos (2 f0 )
2
c. The result is
2
Snc (f ) = Sns (f ) =
2 + (2 f )2
and
Snc ns (f ) = 0
Problem 6.30
c. For this case both triangles (left and right) are centered around the origin and they
f
add to give SLP (f ) = 12 N0 f2 f1 .
d. They are not uncorrelated for any case for an arbitrary delay. However, all cases give
quadrature components that are uncorrelated at the same instant.
Problem 6.31
f
a. The equivalent lowpass power spectral density is given by Snc (f ) = Sns (f ) = N0 f2 f1 :
The cross-spectral density is Snc ns (f ) = 0:
18 CHAPTER 6. STOCHASTIC PROCESSES
N0 f
b. For this case Snc (f ) = Sns (f ) = 2 2(f2 f1 ) and the cross-spectral density is
N0
Snc ns (f ) = 2 ; (f2 f1 ) f 0
N0
2 ; 0 f (f2 f1 )
c. For this case, the lowpass equivalent power spectral densities are the same as for part
(b) and the cross-spectral density is the negative of that found in (b).
For part (c), the cross-correlation function is the negative of the above.
Problem 6.32
The result is
1 1
Sn2 (f ) = Sn (f f0 ) + Sn (f + f0 )
2 2
so take the given spectrum, translate it to the right by f0 and to the left by f0 , add the two
translated spectra, and divide the result by 2.
Problem 6.33
De…ne N1 = A + Nc . Then q
R= N12 + Ns2
6.1. PROBLEM SOLUTIONS 19
1 1 h i
fN1 Ns (n1 , ns ) = 2
exp 2
(n1 A)2 + n2s
2 2
Then
Z Z
r 2
1 h i
FR (r) = 2
exp 2
( cos A)2 + ( sin )2 d d
2 2
Z0 r 0
1 2 A
= 2
exp 2
+ A2 I0 2
d
0 2
r 1 rA
fR (r) = 2
exp 2
r 2 + A2 I0 2
, r 0
2
Problem 6.34
The suggested approach is to apply
n o
E j= [x2T (t)]j2
Sn (f ) = lim
T !1 2T
where x2T (t) is a truncated version of x (t). Thus, let
N
X
x2T (t) = nk (t kTs )
k= N
Thus,
8 2
9
n o < X N =
E j= [x2T (t)]j2 = E nk e j2 kTs
: ;
k= N
( N N
)
X X
j2 kTs
= E nk e nl ej2 lTs
k= N l= N
N
X N
X
j2 (k l)Ts
= E [nk nl ] e
k= N l= N
N
X N
X
j2 (k l)Ts
= Rn (0) kl e
k= N l= N
N
X
= Rn (0) = (2N + 1) Rn (0)
k= N
But 2T = 2N Ts so that
n o
E j= [x2T (t)]j2 (2N + 1) Rn (0)
Sn (f ) = lim = lim
T !1 2T N !1 2N Ts
Rn (0)
=
Ts
Problem 6.35
a. The output is
Z t+T
1
y (t) = x( )x( )d
T t
Therefore
Z
1 t+T
E [y (t)] = E x( )x( )d
T t
Z t+T
1
= E [x ( ) x ( )] d
T t
Z t+T
1
= Rx ( ) d = Rx ( )
T t
6.1. PROBLEM SOLUTIONS 21
Problem 6.36
a. In the expectation for the cross correlation function, write the derivative as a limit:
dy (t + )
Ryy_dotp ( ) = E y (t)
dt
y (t + + ) y (t + )
= E y (t) lim
!0
1
= lim fE [y (t) y (t + + )] E [y (t) y (t + )]g
!0
Ry ( + ) Ry ( )
= lim
!0
dRy ( )
=
d
so that
Z B B
2 2 f3
Z = 2 N0 f 2 df = 2 2
N0
B 3 B
4 2
= N0 B 3
3
dR ( )
The two processes are uncorrelated because Ryy_dotp (0) = dy = 0 because the
derivative of the autocorrelation function of y (t) exists at = 0 and therefore must be 0.
Thus, the random process and its derivative are independent. Hence, their joint pdf is
2 =2N 2 2N 3
exp 0B exp =2:67 0B
fY Z ( ; )= p p
2 N0 B 2:67 3N B 3
0
c. No, because the derivative of the autocorrelation function at = 0 of such noise does
not exist (it is a double-sided exponential).
6.2. COMPUTER EXERCISES 23
xlabel(‘t’)
end
end
>> ce6_1
Sample means (across 100 sample functions)
Columns 1 through 6
-0.0121 0.0226 0.0486 0.0560 0.0421 0.0121
Columns 7 through 11
-0.0226 -0.0486 -0.0560 -0.0421 -0.0121
Typical time-average means (sample functions 1, 20, 40, 60, 80, & 100)
-0.0232 -0.0654 0.0255 -0.0344 0.0055 0.0245
Sample mean squares
Columns 1 through 6
0.4613 0.4538 0.5101 0.5525 0.5223 0.4613
Columns 7 through 11
0.4538 0.5101 0.5525 0.5223 0.4613
Typical time-average mean squares
0.4604 0.5015 0.4617 0.4676 0.4549 0.4611
0
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
1
X(t,θ)
0
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
1
X(t,θ)
0
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
1
X(t,θ)
0
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
1
X(t,θ)
0
-1
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
t
26 CHAPTER 6. STOCHASTIC PROCESSES
0
Y
-1
-2
-3
-4
-4 -3 -2 -1 0 1 2 3 4
X
%
clf
X = randn(1,1000);
Y = randn(1,1000);
disp(’Covariance matrix:’)
disp(cov(X, Y))
plot(X, Y, ’+’), axis square, xlabel(’X’), ylabel(’Y’)
>> ce6_3
Covariance matrix:
1.0553 0.0235
0.0235 1.0341
6.2. COMPUTER EXERCISES 27
>> ce6_4
Enter desired value of sigma => 2
28 CHAPTER 6. STOCHASTIC PROCESSES
0.2
fR(r)
0.15
0.1
0.05
0
0 5 10 15 20 25 30
r