Peebles Chapter7R
Peebles Chapter7R
7.0
INTRODUCTION
7.1
POWER DENSIT}'SPECTRU}I AND ITS PROPERTIES
220
O
?|i-.
22t
x(a) -J]*n,r" -i")t dt (7.r-r)
csrprrn 7:
Random
The function X(rrr), sometimes called simply the spectrum of x(l), has the unit
Processes-
o[volts per hertz when ,r(l) is a voltage and describes the way in which relative Spectral
signal voltage is distributed with frequency. The Fourier transform can, there- Characteristics
fore, be considered to be a voltage densit't' spectrum applicable to x(0. Both the
amplitudes and the phases of the frequencies present in x(t) are described by
X(co).For this reason, if X(a) is known then x(r) can be recovered by means of
the rnlerse Fourier transform
In other words. X(o) lbrms a complete description- of .x(t) and vice versa.
In attempting to apply (7.1-l) to a random process, we immediately
encounter problems. The principal problem is the fact that X(ut) may not
exist for most sample functions of the process. Thus, we conclude that a
spectral description of a random process utilizing a voltage density spectrum
(Fourier transform) is not feasible because such a spectrum may not exist.
Other problems arise if Laplace transforms are considered (Cooper and
McGillem , l97l , p. 132).
On the other hand, if we turn our attention to the description of the pow'er
in the random process as a function of frequency. instead of voltage, it results
that such a function does exist. We next proceed to develop this function,
called the pou,er density spectrumt of the random process.
(7.1-s)
XTQo) - f_rr7(t)e-t'' o, - I'-rx(r)e-i''
ctr
tMany books call this function a Fo$'er spectral dcnsit1,. We shall occasionalll use also the names
or pot{er speilrum.
pov'er densily
- 222 The energy contained in x(l) in the interval (-i", I) ist
Probability,-
Random Variables, E(D _ [, xT.o a, = l'_rte) dt (7.1-6)
and Random J-r
Signal Principles Sinc xr(l) is Fourier transformable, its energy must also be related lo X7@t)
by Parseval's theorem. Thus, from (7.1-6) and (D-21) of Appendix D
.p/7'\
\r ,, --
t[r xz(t),tt=*f
2r J-, _ryt- o, (T:r-8)
At this point we observe that lxr(ail2 /2i" is a power density spectrum because
power results through its integration. However, it is not the function that we
scek,for two reasons..One is the fact that (7.1'8) does not represent the power
in an entire sample fuirction. There remains the step of tetting I become
arbitrarily large so as to include all power in the ensemble member. The
second reason is that.(7.1-8) is only the power in one sample function and
does not represent the process. In other words, P(JI) is actually a random
variable with respect to the random process. By taking the expected value in
(7.1-E), we can obtain an average power Pyy for the random process.I
From the above discussion it is clear that we must still form the limit as
I + oo and take the expected value of (7.1-8) to obtain a suitable power
density spectrum for the random process. It is important that the limiting
operation be done last (Thomas, 1969, p. 98, or Cooper hnd McGillem,
l9?1, p. 134, and 1986, p. 233). After ther operations are performed,
(7.1-8) can be written
txx-
D
1T-+ !'-,rtx'tda'
Equation (7.1-9) establishes two important facts. First. average power
Pyy in a random process X(l) is given by the time average of its second
moment:
txx-
Jg+J:. Elx2(t\ldt - Alqx2Q)ll
D (7. r -10)
trlre assume a real process X(l) and interpret .r( l) as eithe r thc voltage across a I -Q impedance or the
current through I Q. In other words, we shall assume a l-Q real impedance whenever we discuss
eocrgt or power in subsequent work. unless specificalll" statcd otherwise.
fln uking the expected value we replace.r(r) by Xltlia{7.1-8) since the integral of -t'(r) is an
operation performed on all sample functions of X(r).
For a procegg..lhat is at least wide-sense stationary , Hx2(il -P, a constant, 223
and Pyy : X2. Second, Pyy an be obtained by a friqueniy domain integra- cxerrr,n 7:
tion. If we dcfine the power density spectrum for the random process by Random
Processcs-
exx@i:Jgry (7.r-r r) Spectral
Charactcristics
the applicable integral, which we call the power formula, is
where As and a.b are real constants and @ is a random variable uniformty
distribu,ted on the interval (0,r12). we shall find the average powcr Pxx
in X(l) by use of (7.1-10): Mean-squared value is
Aqrx2u)r):
lgl *r ,l+ 4,in(?-or)a,
Pxx:AlE[x2(t)D-AAp
EXAMPLE r.t-2. we reconsider the process of the above example to find
9xtkt) and average power Pxx by use of (7.t-tl) and (7.1-12), respec-
tively. First u,e find X7(r..r):
1r
. Xr(r):.J_rnocos(arsr + O) exp(-jat\dt
:+exp(7@) o)tlctt
J'..ro,r(oo -
ri* I[sintlr)l
I*:':IL o/ J -6(a)
(Lathi. 1968. p. l4). so (7.1-ll) and the above result give
r)^.
D :+ [- *t^. - tool * 6(a * ototld, - 4
!. J -oc
Thus, P1.; found here agrees with that of the earlier Example 7.1-1.
Assume that X(t) is a lowpass process; that is, its spectral components are
clustered near @: 0 and have decreasing magnitudes at higher frequencies.
Such processes are also called baseband. Except for the fact that the area of
9'xx@\ is not necessarily unity, I ys,fu) has characteristics similar to a prob-
ability density function (it is nonnegative and real). Indeed,.by dividing
9 xxki by its area, a new function is formed with area of unity that is
analogous to a density function.
Recall that standard deviation is a measure of the spread in a densitl'
.function. The analogous quantity for the normalized power spectrum is a
measure of its spread that we call rnrs bandv,idth,t which we denote W'r^,
(rad's). Now since 9xx@) is an even function for a real process. its "mean
value" is zero and its "standard deviation" is the square root of its second
moment. Thus, upon normalization. the rms ban{width is given by
,29 r^.1r1d,
w'l,n : I- 0 t-221
,, ,,, a\ cto
Jl-
[- do _ ,.rs [-
lO da
J-*il + Grllofi' - '" J --(loo +,2)2
:rostmrmL.fr* 'EJL}
: 50n
=ro5tmL.fi,"n-'ffi)Ll
= 5000r
Thus
w^': {@-
so"
torad/s
Although W,^,and the 6-dB bandwidth of 9 yy(a) are equal in this case,
eyy(c,t)do
f,
@o: -;6---- (7. r-23)
a'
Le *r@)
and rms bandwidth bY
ql* (, - h)'s *r@) a,
wk: (7.1-24)
o rr1'1a'
l*
The reader is encouraged to sketch a few lowpass
and bandpass power spec-
i*rnr .rA justify fiims.lf why
for the factor of 4 appears in (7 'l-24)'
7.2 227
RELATIOITISHIP BETWEEN POWER, SPECTRUM
rt\Lrrvr AND
AUTocoRnf,LATIoN FLTNCTIoN ^r\r'
ffi:''
In Section ?.1 it was stated that the inverse Fourier transform of the power 3ffi:f-
density spectrum is the time average of the autocorrelation function; that is Characteristics
.? xxd,t=
;gg ,lr+['_rru,rei'', ilif'_r*r,r',o- -', a,r)
= J55#
f ,f ,Elx(t)x(t2)ls-i.<tz-',t
dt2 dr1 (7 .z-2)
[- gxxko)ei-'d'
:lrJ-*
- I2nl-n
[* ll]L+
f-rf-,
Rxx(r, t1)s-Htt-t) dt dtt d" do) (7.2-s)
fWe use .f(0 i! 17.1-5), rather than x(l), to imply that the operations performed take place on the
process as oppoced to one sample function.
fOur develqpoent follows that of Middlcton (1960), pp. 142, 194.
228
Probability, l,f -'xx@\'i" 't'
Random Variables,
and Random : ;*# t1)6(r1 - t - rdtl ttt (7.2-61
Signal Principles f ,f ,Rrr(t'
The definition of the impulse given in (A-16) allou's the immediate evaluation
of the integral over ,r:
I [- Ixxkiej" d,
2,. J -."
_ T_x.l.l llr
'li*^-l J_r Rrr(r,t+r)(h -T<t*r<T 17.2-7\
In the limit as ln + m the condition -T < r * r < f has little meaning. The
quantity on the right side of (7.2-11 is recognized as the time average of the
process' autocorrelation function
[" 6(a)d-'d. - 2n
:ZtrJ-*' )
from (A-2) of Appendix A. Thus \
| <+ 2n6(a)
and, from the frequency-shifting property of Fourier transforms given by
(D7) of Appendix D, we get
eJ%' ,- 2'r.6(o - aro)
e xx@): dt
I]_^, 7.(t1e-i-'
PlT
I tt +(rlT)Js-i"dt*AolJo U-G/T'1fe-i"dt
-As J-r
These integrals evaluate using (C-45) and (C.46) to give
9 xxl,rrl - .4of Sa2gof p)
which is sketched in Figure i.2-2b.
230
Probability,
Random Variebhs,
and Random
Signal Principlcs
-@6 0 otg 0)
(D)
FIGURE 7.2.7
The autocorrelation function (a) and power density spectrum (D) of the wide-sense
stationary random process of Example 7.2-1.
7.3
CROSS.POWER DENSITY SPECTRUM AND ITS PROPERTIES
Consider a real random process W(t) given by the sum of t$'o other real
processesx(l) and Y(l):
tt'(t1 (7.3-1)
-X(t)+Y(t)
The autocorrelation function of IV(t) is
Rww(t, r + r) - E[W(t)W(t + t)l
- E{[x(0 + r(r)][x(r + r) + Y(t + r)]]
: Rxx(t, r + r) I Ryy(t, t + r)
*R1.y(t, t+t)* Ryy(t,t+r) (7.3-2)
Now if we take the time average of both sides of (7 .3-2) and Fourier transform
the resulring expression by applying (7 .2-9't, we have
9ww@): I xx(a)* 9yy(w) + gVlnxy(t, t + r)l) + glAlRtr'(t, I + r)J)
(7.3-3)
231
CHAPTEN, T:
Random
Proccsscs-
Spcctral
Characteristics
0
(a)
aao
fr--
-4' -2rc 0A$to)
T T
(D)
TT
FIGURE 7.2.2
The autocorrelation function (a), and power spectrum (D), for the wide-sense
stationary process of Exanple 7.2-2.
where 9l-l reptesents the Fourier transform. It is clear that the left side of
(7.3-3) is just the power spectrum of W(t). Similarly, the first two'right-side
terms are the power spectrums of X(r) and f(r), respectively. The second two
right-side terms are new quantities that are the subjects of this section. It will
be shown that they are cross-power densily spectrums defrned by (7.3-12) and
(7.3-14) below.
For two real random processes X(r) and Y(l), we define xr(r) and y7(l) as
truncated ensemble members; that is
and
{d,', ;rh:;'
,yr(r): (7.3-s)
Both xr[) and y/l) are assumed to have bounded variation and to be mag-
nitude integrabhoverthe interval (-T,I) as indicated by (7.1-4). As a con-
232 sequence. they will possess Fourier transforms that we denote by X1(ar) and
Probability, Yrko), respectively:
Random Variables.
xr(t) <+ X1(ar) (7.3-6)
and Random
Signal Principles -r'r(r) <+ Y7(ar) (7.3-7)
We next define the cro.ss pov'er P.u.(f) in the two prmsses within the
interval (- f, I) by
pxy(r) =
+ll, 'r,,,., 'r(t) ttr = +J]r,,,, 1,(ttdt (7 3-8)
Since .xr(r) and -r'1(l) are Fourier transformable, Parseval's theorem (D-20)
applies: its left side is the same as (7.3-8). Thus, we may write
This cross poweris a random quantity since its value will vary depending on
which ensemble member is considered. We form the average cross power,
denoted Pxv(T), by taking the expected value in (7.3-9). The result is
rxx(,,:)- T+*
lim
ElxiklYrko)l (7.3-12)
2T
Thus, we obtain what we call the cross-pov'er formula
(2) Re l./'Tylo,lland Re 1./ t,t@\l are even functions of ro (see Problem 7.3-4)
(7.3- r 7)
(3) Im llf sykolland Im l,f yr.(o\l are odd functions ol'rr,, (see Problem 7.3-4).
(7.3- r 8)
(4\ :/'\y(al -- 0 and ,/ t tko\ 0 if X(t) and l'(r) are orthogonal. (7.3-19)
-
(5) ii X(r)'and lr{r)'are'uncorrel':.r'ted ancl hare constant lneans i- and i-'
./'tt.ko\ : ,(/) t.x(al - 2nf iO(r) (7.3-20)
:
R4 (r)
*J]_ r'., 1ot\ei'u' cta
(7.3-2s)
1fi
r'r'(a) - lo elsewhere
>:
2v where W > O,a and b arereal constants. We use (7.3-25) to find the cross-
Probabilily, correlation function. It is
Random Variables.
and Random
Signal Principles
Rxy(r) =*f ,Q+ifla"da
L]* o)t"t o b 1t4'
Rxy(r) : +,V;l:,] *i
**[.'" V: -# I ;]
I
: ;fu\@wt - b) sin( wt) * blut cos( llzr)l
From the linearity property of Fourier transforms and pair 17, u'e get
Rxy(z) - 4u(t)ie-"'
lgxy@)l and Ryy(r) are sketched in Figure 7.3-1. :
*7.4
RELATIONSHIP BETWEEN CROSS-POWER SPECTRUM AND
CROSS-CORRELATION FUN CTION
exv@):
J:{;15,.Jl.^,,,,,
r* r) atl,-i" a, (74-r)
as indicated in (7.3-21).
The development consists of using the transforms of the truncated
processes given bY
Xr@):
. ['
J_r
X(t)e-)-!dt (1.4-2)
$vnott
0
otla
(D)
(7'4-3) to form
in (7.3-12). First, we use (7'4'2) and
i't'
xi@)Yr@): I'-rx(id'' *!'-rY(t)e dtl 0.4-4)
exvko)=;'yyff@
: J;+'[J:, xl)dd o,I'.,Y(t)g-t'" '"1
-tt drdtt Q'4-s)
= Jg *!' ,Jlrn't,, t1;e:jox"
we
developed in Section 7'2' First'
Next. we us€ a procedure similar to that as an
inr.erse Fourier transform both siOes
oi t7'a-5) and identify one integral
impulse function
i
l*
236
:!fi [* ,'/'s'v(oleiu" rla
Probability. J ---
Random Variables.
: +,J dt ttt /'r'| -"
and Random
Signal Princrples * ;* *l: ,.[1 , ^ ' ' tr' 11)1' 1ei"''
't'
- trl +r ,11, ^,,,, ,, + .[l_""".,- "+'t , dut tlr 1 dt
(7.-1-6)
lim (t. t + t)
7'*x +r ,
R.r.r clt
AB ' AB
: 2
stn(ar'r)* ''
: [' cos[ar6(2r
z lT-zrJ_r L \,\ + rl)dt
:
R The integral is readill- evaluated and is found to be zero. Finally we
f
l: Fourier transform the time-averaged cross-correlation function q'ith the
aid ol pair l2 of Appendix E:
237
q ,/ r.ytat = <'unprrn 7:
..,
:r
.:;
"l+sin(atr)) Random
-jnAB _ a4) Proc'esses-
l,:
,r.
= -a_ [6(a., - 6(ar + @o)J
Syrectral
Characteristics
7.5
POWER SPECTRUMS FOR DISCRETE.TIME PROCESSES AND
SEQUENCES
Discrete-Time Processes
Let I'(l) be a band-limited+ random process for which samples are taken at
tinres nT,. n 0. tl. +2. .. .. to form a discrete-titne process X(rrl). When
-
samplin-e is the result of multipl),ing X(l) by' a periodic "sampling" pluse train
consisting of rectangular pulses of short duration 7,, and amplitude l/Tp
occdrring each r. seconds. the sampling theory of Chapter 8 shou's that the
Drocess' autocorrelation function R.vr(r) has a sampled representation.
denoted by Rr r (r). that is eiren b1'
! tA bandlimited process. frrr our presRnt purposes, is one with a power density sPeclrum that is zero
at all frequencies except o\er a frnitc band where larl < @,/2. u'ith ar. - 2tr1T, and r. is the constant
tt time betwcen any adjacenr pairs ol samples. I is called the sampling iilterwl or sanrpling perittd.
I
of (A-29). Sampling with very narrow pulses (impulses in the limit) is called
Probahlity, ideal sampling.
Random Variables, Direct Fourier transformation of (7.5- l ) defines the power spectrum of the
and Random discrete-time (DT) random process, which we denote by ,/.1,7.,@)
Signal Principles
g x,.x.@\- RyrlnT,le-i'-r, (7.5-z)
,,1
It is to be noted that (7.5-2) is periodic in the variable a., with period
@s :2nlTr'
It is of interest to show how the power spectrum of the DT randorn
process is related to the power spectrum of the process X(l). First. we sub-
stitute the relationship (Problem 7.5-2)
,L6(r-
nr,) -l,L__*n*. 17.s-ry
into the middle form of (7.5-l) and then Fourier transform the result to get
(Problem 7.5-3)
rN
lr
9 x,x,ko) -+ D Y rr(a- nu-t,) (7.s-4)
' I ,=-o.
Now I xx@)is the central term of (7.5-4) where n : 0. If we write a rectan-
gular llnction recl(ala,\ on both sides to select out 9'y;.fut), u'e have
9 xx@) - r. rect(af o4).f x.t @) (i. s-s)
Our result, (7.5-5), shows that the process'power spectrum is f. times the
central period portion of the periodic power spectrum of the DT process.
Thus, (7.5-Z) in its central period yields the process' power spectrum within
a constant factor.
Alternatively, (7.5-5) can be obtained another way. In Chapter 8 it is
shown that the autocorrelation lunction has the following valid representa-
tion:
Discrete-Time Sequences
In general, -- can be any- complex number. However, (7.5-10) shows that the
power density speL-trum is the :-transform evaluated on the unit circle [where
: - exp(./Q). l:l - l. and the angle of : is Al. The second right-side sum of
(7.5-10) is called the,ii-rcr.'ie-rirne Fourier transforrrr (DTFT) of the sequence
R;,'[n].
tlfthe frequencl of rhe highesr nonzero spectral term in .? rt@) is ll'^ . called the spc('trul c.rrerrr- Ihe
sampling rate must hrr.r. > lll',. uhere 2lt'1 is known as the.\1'tTrrist r.tte (scc Section 8.7r.
2N EXAMPLE z.$t. Suppose the autocorrelation sequence of a DT sequence
Probability: X[n] is
.Random Variabhr
and Random
R;r [r] = ,fi lal < I
* (l - ar)
{2 : oT,
tq: (l + a') - 2acos(Q)
t,
t:
Note ihiit this power spectrum i; periodic in the yariable ft. aq are all
power ipectrurns of all f)T sequences.
Developments similar to those leading to (7.-5-10) produce expressions for
the power spectrurn of Y[n] for a process ]'(r) and for the applicable cross-
power spectrums for ,\'[r] and I[n]. These are lelt as reader exercises.
In (7.-5-10) the DTFT was defined as the second right-side form u,here we
say .?1...1("in) is the DTFT of Ry.1[n]. There is also an inyerse DTFT lor
IDTFT) u,here R1.y[rr] can be recorrred from 9t,,^..(rin). The two form a
DTFT pair:
ExAltpLE 7.s-2. We shou' that (?-5-12) is valid by provin-e that the right
side results in R1.i [n].
- 16
[2 8 e)
from (7.5- l l).
_.- -orr
erlmple consists of using MATLAB for simulating the sequence
Y[a], computing estimates of its autocorrelation function
un-d po*.i,p."-
I trum. and comparing rhe resurts to the true quantities. The
MATLAB
fr cod_eused is given in Figure 7.5-1. Specifically, we first use
Tf the procedures
;:, of Exampl.' 5.6- l to generate r002 values of zero-mean, gaussian
*. random
ti variable.l'with a variance of 4. These values are used to generate
I000
t:' values of )'[r] as defined abore. Next, we estimate
dP
the autocorrelation
Iri sequence Rr r [kJ using rhe formula (Childers. 1997, p.297)
sl
I v-l-lA'
H kl:i
Rr'r'I Y[n)Y[n+lkt] lkt <N
rC
E
I
ilit u'here A = 1000. Results are shown as the stem plot
of Figure 7.5-2,
where the exact function of ( r ) is shown as the piecewise
fi continuous
c{.\'e for comparison. \\'e see rhat some significani .r.o6 remain. eyen
P, u'ith N
:.1 - 1000 data -points. Finaily, we compute an estimate of the po*er
spectrum using the formula (Childers, I997, p. 303)
.\'- |
g'r.r {-'s
- l=-(.\'-lr
I R'r U.l e-ike {2 - atT,
24t
242 tttfttttttft$t lre*r1o 7.5-3 ttttlttt$ffitfrffi,
Probability, cloG
Random Variabhs, B r 1000r
and Random lrlr - !l t vlrl'arco of r
Signal Principles lig ' 19,
raada('3tat.',110),
r r .grt (rrver) rrradn( 1, U+2 ) r t t . t . d. Orumlaa raado wrrLrblo
n.*(3:!l+2)ltr(a)
n1 - x(2rf+l)l tr(a-l)
xa2 r xn1(1:N); tx(u-2)
y - r + 0.5rna1 + 0.25rxa2l
Ryfr r zcro. ( 1, 2rtr-1) I t lnltlall,zc
for L r -lt+1:Il-1
nd:<1 r na,x( [1 1+hI ],:ul"n( [t{+k !tl.) ; .1,-,,1..,1.:
s
rIabcI ('Lag')
ItH:tjiHn::xi"l,oo,,
f Lgrurc
glot (r, SYY-aokY(1:lr) ,'k'I
xlabcl ('Normallzcd Frcqu€acy (rad) ,)
ylatrcl (,uaguitude, )
tLtlo ( 'Pw6r SDoctnD, )
f Lgrurc
plot (w(round lotglz) : etp: Ietrgtb(w) ),Sy1t,, --k, erre Strnr€,,h, )
xlebol ('trorualizcd Frequoncf? (rad), )
ylabeI ('MagmLtuds')
tltlc ('Poreer St,€ctnln' )
. FIGURE 7.5.I
The MATLAB code used in Example 7.5-3.
Autmrrclrtim 243
cxrpren 7:
Random
Proccsscs-
5
Spectral
I
Characteristics
ie
C
to
i1
_l r : I I I I r I I r r
-r0 -8 -6 -4 -2 A 2 I 6 a r0
L-ag
FIGURE 7.5-2
True autocorrelation function and estimated autocorrelation sequence applicable to
Example 7.5-3.
Powcr spectnrm
10
50
€
Io
y,
l0
0
-4 -3 ;2 -l 0 I I 3 4
NormaIized frequency (rad)
FIGIIRE 7.5.3
Unsmoothed pouer spectrum estimate applicable to Example 7.5-3.
Powcr rpoctnrm
l6
Probability,
Random Variablcs.
and Random
Signal Principles
l4
t2 in\
i\
o
l0 i'/ \.,
it\\
!
it \\
tl
E
a8
\\
a!
.I -l
t/\
i/
-2 -t 0 I 2 3 4
Nom'ralized frequencr' (rad)
FIGURE 7.Y
Smoothed estimated and exact power spectrums applicable to Example 7.5-3.
values R.r.r[n]. even if they were available, since we cannot wait forever for
the final result, Furthermore, such a procqdure could involve an infinite
amount of memory and/or an infinite number of calculations. Thus, from a
practical standpoint, the computer typically works with a finite number of
values of R1.x.[n], say, N. For truly band-limited signals this limitation requires
truncation of R1.y[n] to A'ralues, and some error will result in computing the
power spectrum. Truncation results in some spectral distoriion and aliasing
(the overlap of spectral replicas due to distortion-caused spectral spread-see
Section 8.7 lor more detail). Because even truncated waveforms haye spec-
trums that decrease with increasing frequency, there is always some practical
frequency beyond which the spectrum's magnitude becomes negligible: this
fact allows truncation errors to be reduced by sampling at a rate,higher than
twice the practical frequencl'.
ln regard to point (2). even if a computer could determine the continuous
power spectrum (the DTFT). it must still produce results for discrete values of
Q (or ar, since g - ,I,). Thus, it is common practice to discretize the variable
Q (or ar) to a finite number of values. Usually the number is chosen the same
as the number of sample ralues (denoted by N above) to facilitate practical
computations (by using the fast Fourier transform or FFT).
From the above comments it is clear that the practical use of the DTFT of
(7.5-ll) and the IDTFT of (7.5-12) involves sequences of finite length N. Let
us define the extent of the samples as N[, and the discrete values {r{ &nd Q1. of
at and O, respectivelv. by
Zrfr/(Nfr) k : 0, l, ... , (N - l)
e)k: (7.s- r 3)
S2r: @Trl,o-t-2trklN k:0, 1,',..,(N - l) (7.s- r 4)
Next, rve define the discrete values of the power spec.trum by 245
I N-l
Rxxlnl=;I '?x,x,lk142n/-tN n:0, 1, " ', (N - l) (7.s-18)
ft=0
. rl-l
xxr.(rrr): gy,y,(o*);1na1r' n 0. ..., (N - l) (7.s-a0)
- 1,
"E
EXAMPLE 7.H. To set the staBe for the following example we determine
the autocorrelation function RxxG) for a continuous time process X(l)
that we assume has the power spectrum
7.6
SOME NOISE DEFINITIONS AND OTHER TOPICS
clcar cHePrrn 7:
Random
trr 5; Processcs-
t . 1l Spectral
Ta r 1i Characteristics
163 r pi/Tel
lf rsm(Nr2) rr g
vr - -ur:rt : 2rwxlH 3 w:ri - 2rrxlN; t frequcncy vector
elee
r r -ur:N + w:r/l{ z Z)rrl[ 3 r:ri
cad
tau - -0.5tN: ( 0.5rf,-1) ;
giacl r zerog(lrlcngrtb(tau) );
ginc2 = zerog ( 1, lengrth (tau) ) ;
f . fl.ad,(Dl.*tau - ell? -. 0); t avol.d aLtr(O) /0
eincl(f ) - sia(Dlrtau(fl -Oil2)./(pl*tau(fl -eLl2lt
f = f ind(pi*tau - ell2 == 0); t eia(0) /O - 1
eincl (f ) - oDea (1, lengtb(f ) ) ;
f = f ind(Di*t,au + 9Ll2 -= 0);
sinc2(f ) = sin(Dirtau(fl +9L12)./(pi*tau(f y +9il2li
f = find(Di*tau + 9Ll2 '.= 0) i
sine2(f ) = oneB(1,lcngth(f));
Rtnre = fs*13*s1l (2.OL) *(sincl + sinc2) ; t tnre
autocorrelation
12.= -wx z 2*wxl1,28 : wrr - Z*vxlL28i t frequetreyvector
Stnre = k*cos (OL*wZl (2rvx) ) ; % tnre Doner spectnrm
Sxx = abs(f ftshift(fft(Rtnre,N) ) ); % estimatedgower spectrun
clf
Dlot (w2 , Stru?, 'k' I
hold
gtem(w, Sxx, 'k' )
:- ::f
c
a
rI -1 -l 0 r 2
N ormahzcd frequsry (rrd)
FIGURE 7.tr
True power spectrum (solid curve) and MATlAB-calculated pou'er spectrum (stem
plot) applicable to Exampie 7.5-5.
produces a noise voltage across its open-circuited terminals having the power
spectrumt (Carlson. 1975, p. I l8)
l.t^ol2)(alr,ullT\
I n^1(a\ - (7.6-4)
eb"T - |
where a-7.64(10-12) kelvin-seconds is a constant. At a temperature of
T - 290 K lusually called room temproture although it corresponds to a rather
cool room at 63"F), this function remains above 0.9 (",1'o/2) foi frequencies up
0 0
(a) (D)
FIGURE 7.6I
(a) The autocorreldtion function and (b) the po\\'er densitl' spectrum of white noise .
tThe unir of 9r-r.(ro) is actually volts squared per heru. According to our convention. we obtain
watts per hertz by presuming the voltage exists across a l-Q resistor.
-
to l0r2 Hz or 1000GHz. Thus, thermal noise has a neaily flat spectrum at all 249
frequencies that are likely to ever be used in radio, microwave, or millimeter- cunrrsn 7:
wave systems.t Random
Noise having a nonzero and constant power spectrum over a finite fre- Processes-
qumcy band and zero everywhere else is called band-limited white noise- Spectral
Figure 7.6-2a depicts such a power spectrum that is lowpass. Here Characteristics
lPn
t
?pp(o) - | w -W<ot<W (7.6-5t
Io elsewhere
Rrvrv(r):rW (7.6-6)
FIGURE 7.6.2
Power density spectrum (a) and autocorrelation function (D) of lowpass band'
limited u'hite noise.
tThis statement must be rccramined for f < 290K, such as in some superconducting s1'stem or
otfcr low-temperature deviccs (masers).
250 The constant P equals the power in the noise.
Probability, Band-limited white noise can also be bandpass as illustrated in Figure
Random Variables, 7.G3. The applicable power spectrum and autocorrelation function are:
and Random
Signal Principles gxx(a)=frrp ab - (w/2\ < la{ <ab+ W/2)
Io elsewhere
(7.6-7)
and
where a.5 and w are constants and P is the power in the noise.
.c- 1w uo* w
1
li
I
i
tIv
FIGURE 7.G3
Power density spectrurn (a) and autocorrelation function (D) for bandpass band-
limited white noise. fAdapred from Peebles ( 1976) *ith permission of pubtishers
Addison-Wesley, Adrunced Book Program.j
Again, by analogy with colored light that has only a portion of the visible 25r
light frequencies in its spectrum, we define colored noise as any noise that is cnr,rren 7:
not white. An example serves to illustrate colored noise. Random
Pr<icesscs-
EXAMPLE 7.6t. A wide-sense stationary noise process N(l) has an auto- Spcctral
correlation function Characteristics
Rrurv(r) - Pe 3l'l
where P is a constant. We find its power spectrum. It is
I xn@l= -3it"-i'<ot 4,
I]_*
: dt *" ,G-ia), 6,
"J;r-(3+ia,)r J:-
These integrals easily evaluate using (C-45) to give
PP6P
9xx@)-3qi.,+3_io:g*;l
This power spectrum is sketched in Figure 7.6-4 along with the preceding
autocorrelation function.
0
(a)
-303a)
(D)
FIGURE 7.G4
The autocorrelation funoion (a) and power spectrum (b) of the colored noise of
Example 7.6-1. lAdaptedfrom Peebles ( 1976) with permission of publishers Addisotr
Wesley, Advanced Book Program.l
Product lhvice Response to a Random Signal
Probabili$.
Random Variablcs, Product devices are frequently encountered in electrical systems. Often they
and Random involve the product of a random waveform X(r) (either signal or noise or the
Signal Principlcs sum of signal and noise) with a cosine (or sine) "carrier" wave as illustrated in
Figure 7.G5. The response is the new process
Y(tl - X(tlAocos(a5r) (7.6-e)
where le and {rs are constants. We seek to find the power spectrum I vv@) of
Y(t) in terms of the power spectrum tl y;.Qo\ of X1r).
The autocorrelation function of Y(t) is
Rry(r. r + r) - EIY(t)Y(r + r)l
- EIA2yXQ)X(t * rlcos(r,.r6l) cos(a4t * a41r)]
:-Ai, tt rt +t r)[cos(aror)
-\tn..^/-. -\ +r cos(2a.5r
^^^11., r +r atr)]
.. -\l (7.6-10)
Tl(r..r(t.
Even if X(r) is wide-sense stationary Y(r) is not since Rl'r'(1. t + r) depends on
r, Thus, we apply (7. I - l9) to obtain I y,1.(a) after we take the time average cf
RyvQ,l*r): Let X(t) be assumed wide-scnse stationary. Then (7.6-10)
becomes
A possible power density spectrum of X(t) and that givbn by (7.6-12) are
illustrated in Figure 7.6-6.It presumes that X(t) is a lowpass process, although
this is not a constraint in applf ing (7.6-12).
i( cos (oor)
FIGURE 7.G5
A product of interest in electrical $stems. lAdapted from Peebles ( 1976 ) n'ith
permission of publishers Addison-\l:esley, Advanced $ook Progran.j
2s3
CHAPTER. T:
Random
Processes-
Spectral
Characteristics
0
(D)
FIGURE 7.6.6
Power density spectrums applicable to Figure 7.6-5; (a) at the input and (D) at the
output. lAdapted from Peebles (1976) with perntission of publishers Addison-Wesley,
Advanced Book Program.l
where -4'ol2 is the po\\'er density within the noise band. 81' applying
(7.6-12) the power densitl' spectrum of the output noise )'(r) ol the pro-
duct device is readill' lound (by sketch) to be
Probability;-'
l rroAzl8 -2@s - (W ar 12) < ot < -2c,4 + (W nrl2)
Random Variables, I yy(o) -
| "ro,qip -War/2<@<WnrlT
and Random 2q - (WnrlL\ < @ < Zao * (WnrlT)
Signal Principles
ld'n*'' elsewhere
Now only the noise in the band -Warl2 < o) < Wnr/2 cannot be
removed by a lowpass filter (which usually follows the product device
to reinove unwanted noise and other undesired outputs) bccause the
desired signal is in the same band. This remaining component of I yy
(ar) gives rise to the final output noise power, denoted Nn,
*7.7
POWER SPECTRUMS OF COMPLEX PROCESSES
g zz@) : dr (7 .7 -t\
I*_**r7k)e-t"
The inverse transform applies, so
RzzG)
- ;J _*rrrro)cl"
do (7.7-2)
For two jointly wide-sense stationary complex processes Zr,(t) and 2,,(t).
their cross-power ciensity spectrum and cross-correlation function are a
Fourier transform pair:
g z^2,(r) : dt (7.7 3)
I*_*^r^z,lrle-i"
lf*
:
Rz^2,(r)
*J _*rr,r,(otler" da (7 .7 -4)
- I7,91ri^'7
Characteristics
/.'
n:l
/V
:2n6(co - aro)
D7,
n=l
7.8
SUMMARY
7.14. Work Problem 7.1-l if the random process is given by X(t) = lo sin(c.b, + O).
*7.1-5. Work Problem 7.1-l if the random process is
7.1-7. A limiting form for the impulse function was given in Example 7.1-2. Give
arguments to show that the following are also true:
(a)
JgI#2:6(o)
t" j:+ ru - lalrl : 6(o)
7.1-9. Show that (7.1-14) is true.
7.1-f0. Prove (7.1-7). lHint: Use (D-6) of Appendix D and the definition of the deri-
vative.]
7.1-ll. A random pioot. is dcfined by 257
7.1-12. fhtermine.which of the following functions can and cannot be valid power
density spectrums. For those that are not. explain why.
-7 (D) exP[-1c.r-l)rJ
tat
ffi
I
!/' 7.1.(al:
It=l a):/'1,1.,1to)
X{rl=l11cos(Qr*69)
nhere 16 is a real constant. Q is a random variable with density function .fa().
and O is a random variable uniformlv distributed on the interval (0.22r)
independent of Q. Show that rhe poo.ispectrum of X(r) is
7.1-19. Determine the rms bandwidths of the power spcctrums given by:
(a) I yy(c,t) =
P lalcw
0 lcol>W
(b) I yy(a\ :
P{l - lcolwll kol. W
0 lcol> W
P P
"7'',kol:-
AA\-' - '+ -
7.1-21. Show that the rms bandwidth of the power spectrum of a real bandpass
process X(r) is given by
w?^,:4w-n - dll
wherea.6 is given by (7.1-23) and W'tsgiven bythe right side of (7.1-22).
:
7.L-tL The autocorrelation function of a random process X(l) is
R.rx(r) : 3 * 2exP(-4r2)
7.1-23. State whether or not each of the following functions can be a valid power
density spectrum. For those that cannot, explain why.
r7.l-30. Generalize Problems 7.1-26 and 7.1-28 by finding the rms bandwidth of the
power spectrum
fxxki-tl\+kt/W)IJN
where N Z2 is an integer.
*7.1-31. Generalize Problems 7.1-27 and 7.1-29 by finding the rms bandwidth of the
power spectrum
Find (a) the average power, (b) the rms bandwidth, and (c) the autocorrelation
function of the process.
7.1-33. Show that rms bands'idth of a lowpass random process l'(r). as gin'en by
(7.1-22), can also be obtained from
,, ,2
: -l dzRrrk)l
wrm:
' R;rreJ dr'
l,=o
where Rr.x(r) is the autocorrelation function'of X(r).
- 260 7.1-y. Assume a random process X(0 has. a power spectrum
Probability.
Random Variablcs. erxtot)=#
and Random
SignalPrinciplcs where W >0 isaconstant.
(a) Sketch ,{ xt'(.').
(t?) At what positive value of ar. denoted by o4n:*. does ./'.1.1.(ro) reach a
maximum value?
7.1-35. Treat the pou'er spectrum of Problem 7.1-34 as bandpass and find its mean
frequency ri4y and rms bandwidth I/,n.,..
7.2-1. Find the power density spectrum of the random process for which
Rr'.r(r) = P cosa(c'ror)
.rslyeo)=#
Find the average power in rhe process.
txx@l:r
6,,2
t '.t'r-(rr.,) = (,
*rpf
7.2'5. Assume ,Y(l) is a wide-scnse stationary proccss with nonzero mean valuc 261
X +0. Showthat
ffi2,
9 xxki = 2r*?6(a) * [* Cyy(r)e-t-, dt ]rT::l_
J -a,
Spectral
where Cy/tl is the autocovariance function of X(t). Characrerisrics
R.rx(r) - Pe-'2/2ot
where P > 0 and a > 0 are constants. Find the power density spectrum of
X(t).lHint: Use Appendix E to evaluate the Fourier transform of nr.r.(.).J
[ 4t-Qtlr\ o<r.Tl2
Rys.ft)
- lPll +(2r/T\l -r12 < r<0
[0 r<-Tl2 and t>T/Z
Find an<t sketch its power density spectrum. (Hinr: Use Appendix E.)
*7.2-8. A random process X(l) has a periodic autocorrelation function where the
function of Problem 7.2-7 forms the central period of duration 7'. Find and
sketch the power spectrum.
7.2-9. If the random processes of Problem 7.1-14 are stationary, zero-mean. statis-
tically indepcndent processes, show that the power spectrum of the sum is the
rr;lxs'
Fo r sta ri o na rv i ndepcnden r processes wi th
:lT:.il *LT:::f,:lil
7,2-10- Given that a process X(t) has the autocorrelation function
Rxr'(r) : lg-oltl cos(ro6r)
where A > 0- cr > 0. and rr.rs are real constants. find the power spectrum of
X(t).
7.?-ll. A random process l'(r) having the pou'er spectrum of Problem 7.2-3 is applied
to an ideal differentiator.
(a) Find tk power spectrum of the differentiator's output.
(6) What is the power in the derivative?
7.2-12. Work Problem 7.1-l I for the power spectrum of Problem 7.2-4.
7.2-13. A wide-sense stationary random process X(t) is used to define another process
.by
9vt'@)=9xx(a)lH(r\|2
262 7.2-14. A deterministic signal I cos(a6t). where A and ar1 are real constants. is added
Probability.
to a noise procrss tV(t) for which
Random Variabhs.
w1
and Random J/rr,(-) :
Signal Principles
lt,r*..I
andW>0isaconstant.
(a) Find the ratio of average signal power to average noise power.
(h) What value of llz maximizes the signal-to-noise ratio? What is the con-
sequence of choosing this value of If "?
*1.2-16. Generalize Problem '7 .2-15 b1 replacing cosl(r,.,11r; with cos^'(a4yr) where N > 0
is art integer. What is the resulting power spectrum when N is (a) odd. and (b)
even?
*7.2-17. The product of a wide-sense stationarl gaUssian random process .\'(I) with
itself delayed by I seconds forms a new process Y(t!= X(tlA'(t - f).
Determine (a) the autocorrelation function. and (h) the power spectrum of
)'(t). t,Hint: Use the fact that ElXt^'rX\X4'l : f[,Yr X]ElX\Xi+ E[XrX]l
E|X2X41+ 4,Xrx4l ElXzXr] - 2E[Xr jElX/1E[Xr]E[X.] for gaussian random
variablesXt.Xz,.Yl.andXq.(Thonras.l969.p.64.)i
7.2-19. A random process is defined by I(r) : X(tl - X(t - a). where X(r) is a wide-
sense stationarv process and d > 0 is a constant. Find the autocorrelation
function and power density spectrum of I(l) in terms of the corresponding
quantities for l'(r).
1.2-2O. Find the autocorrelation function corresponding to the power density spec-
trum
I 57 + l2or
./'7tko)=(16+r,rffi:foI
lHint: Use a partial fraction expansion (Peebles and Giuma. 1991. pp.
149- 156) and Table E- I .l
7.2-21. Find the autocorrelation function corresponding to'the power spectrum 263
exxko)=# ffJil''
Proccsscs-
lHint: Use the convolution property of Fourier transforms given by (D-16).; Spectral
Characteristics
*7.2-22. Find the power spertrum corresponding to the autocorrelation function
X(t) : z4 cos(a4t * O)
I(r): tlz(r)cos(a4, + O)
7.!4. Decompose the cross-power spectrunrs intrr rc-al and imaginary parts acco'rd-
ine to
7.3{. If X(t) and Y(t1 are real random processes, determine whkh of tlre iollowing
functions can be valid. For those that are not, state at least one reason why.
(a') Rxxftl = exp(-lrl) (b) I Rx r(rlt s r',Fqyrtol
(c) R;;(r) = 2sin(3r) (d) f txko\-61rc*7lity
(e).?y(af =tffi (f) 9xv@):3+jo2
lg\ ,? yyQo) = 186(ar)
7.3-9. Form the product of two statistically independent jointly wide-sense station-
ary random processes X(t) and Y(l) as
w,(t\ - X(r)I(r)
Find general expressions for the following correlation functions and power
spectrums in terms of those of X(t) and Y(l): (a) Rs,y(t,'t + r) and y.a'(a\. I
(D) Rxr.(t.l r) and xwk t'), and (c) RwxQ,l + r) and s,,y(co). (d) If
* I I
Rx.r'(r) = (W t / r)Sa(W t)
and
R r.r.(r) : (W 2 / n)Sa(W2t)
with constants W2 > Wr, find explicit functions for Rs.s.(t, I + r) and
I wn'(r\.
' A
7.3-fl. wide-sense stationary process X(t) is applied to aD ideal differentiator
having the response )/(l): dX(t'1/dt. The cross-correlation of the input.
output processes is known to be
Rxy(r) - dRyyft)/dt
(a) Determine ?yy(a) and ?yy(al in terms of the pow€r spectrum gxxkt\ 265
of x(0. IF*2,
(b) Since I xx@t\ must be real, nonnegative, and have even symmetry, what Random
are the properties of 91sy@)? prooess*_
Tjll?- The cross+orrelation of jointly wide-scnse stationary prooesscs X(t) and Y(t\ lff.IlLnr,,*
is assumed to be
Rxv(r) = Bu(r)exP(-Wt)
where I > 0 and W > 0 are constants.
(a'l Find Ry;.(r).
(D) Find I xvki and I yy(a\.
Rxvt) = Bu(r)rexP(-Wr)
7.y14. The cross-power spectrum for random processes X(t) and Y(t) can be written
as
9xv@l= 9xx(a\H(a)
where I xx@\ is the power spectrum of X(l) and f/(c.r) is a function with an
inverse Fourier transform /r(r). Denve expressions for Ryy(r) and Ryy(r) in
terms of Rxx(r) and i(r).
etykut=#fr
*7.+1. Again consider the random procbsses of Problem 7.3-3.
(a) Use (6.3-l l) to show that thc cross-correlation function is given by
Ati,
Rxy(t, t + t): + {cos(r,.5r) * E[cos(2O)] cos(2a.tt * aror)
7.'5. Periodic samples of the autocorrelation function of u'hite norsc N(l) with
period T, are defined by
Rrv,v(k?i,):
l;, f ;3
Find the power spectrum of the DT random process.
7.57. A random sequence Y[n] is formed by adding the white noise sequence of
Problem 7.5-5 to a one-unit delayed white noise sequence according to
Yln)- il[r]+b1N[n- l]
where b1 is a real constant. Show that
Itt+tllir
: I btd
k=o
RyytkJ k: *l and = I
Io all other k
7.fi. Find the power density spectrum of the sequence I[n] of Problem 7.5-7 by use
of (7.5-l l).
7.$9. Work Problem 7.5-7 except for the sequence Ylnl = N[n] + b-Nln - ml. where
b, is a real constant and z is a positive integer. Use (7.5-l l) to find the power
spectrum of )/[r].
7.$10. Extend Problem 7.5-7 to consider the sequence
where D2 is a real constant. Find Rr r [k] and the applicable power spectrum
from (7.5-l l).
7.5-ll. The white noise of Problem 7.5-5 is added to a "signal" X that is a random
variable statistically independent of the noise and having a mean value of zero
and a variance oi.. Assume X is a constant u'ith time. Denote the DT sequence
of samples of signal-plus-noise by ll'lnl: X[n] + N[n] where. of course."
Xlnl - X, a constant with n. Find the autocorrelation function of this
sequence and then determine the DTFT of the sequence. lHint: Use the
known sum
f cx(-jnQ) : 2n D ,(t - nzi).| 267
n=-e cxerrrn T:
Random
7.*12. A DT random scquence X[nJ has an autocorrelation function defined by tbe Processcs-
sequence Rxxlnl-- (l - lnllN) for Inl < N and is zero for lzl > H, with iV a Spectral
positive integer. Find the DTFT of the sequence. Characteristics
7.$13. For the sequenoc Y[n] defined in Example 7.5-3, show that its autocorrelation
sequencre is given by (l).
7.$14. Show that the autocorrelation sequenct defined in Equation (l) of ExampJe
7.5-3 has the power spectrum of equarion (2).
7.5-17. Rework Example 7.5-5 except assume the random process defined in Problem
7.5-16. Rework your results for N : l0 and compare to the results for N : 5.
&*
ET
-==t
7.5-18. Show that (7.5.12) can be written as
-q lT
7.6-2. For the po\\er spectrum given in Figure 7"'.6-2a. shos,(hat(i.6-6) definas the
correspondir:g band-limited noise autocorrelation function.
7.G3, Show that (7.68) gives the autocorrelation function of the bandpass b,and-
Iimited noir defined bl' Figure 7.6-1a.
268 7.H. A lowpass random X(l) has a continuous power spoctrum g yy@i1and
process
Probability,
J/xl(0) 10. Find the bandwidth W of a lowpass band-limited white-noise
power spectrum having a density /.rl (0) and the same total power as in X(r).
Random Vanables.
and Random
Signal Principlcs 7.G5. Work Problem 7.64 for a bandpass process assunring I xx(on) f 0, where <r.rs
FTGURE YI.6-6
1.ffi. The power spectrum of a bandpass process l'(t) is shown in Figure P7.6-6.
X(l) is applied to a product device where the second multiplying input
is 3cos(a.ret). Plot.the pou'er spectrum of the device's output 3X(r)cos(a,,ul).
7.G7. Let the "carrier" z{1,cos(abt) in Figure 7.6-5 be modified to add a phase
random variable O so that Y(t): AuX(t)cos(ar6l + O). If (-) is uniformly dis-
tributed on (0, 2n) and is independent of X(r), find Ryr(t, t -i r) and ,/ y.t'(-\
when .t'(l) is wide-sense stationary. :
7.G10. A signal si(r) - 2.3cos(1000r) plus an input noise process .Y,(t) having the
power spectrum shoun in Figure P7.6-l0a are applied to the product device
shown in (D). The ideal lowpass filter (LPF) acts only to remove all spectral
269
CHA?TEN,7:
Random
Processes-
Spoctral
-rrq) -rmo -500 0 500 l00O 1500 at Characteristics
(c)
r,(4.4(r) /o + Alo(r)
3 coa (lfiDt)
nGUnE P7.5-r0
and noise) that are outside the iraird lc.rl - 500 ratl:s and
components (signal
affect components inside the band.
docs not
(a) Find the output dc level Iz6.
(D) Stetch.the power density spectrum of No(r).
(c) What signai power to .u.rlg. noise power ratio, vi tfi!i,tt)], occurs at
. the output? Note that this circuit acts as a detector of the signal's ampli-
. trde in the presence of noise.
*7.7-1. A complex random process is given by
Z(t) - Ada'
whcrc Q is a random variable with probability density function/o(.) and A is a
omplex constant. Show that the power spectrum of Z(t\ is
"7.7-2. Compute the power spectrum of the complex process of Probtem 6.7'4.
*7.7-3. Ler X(r) and Y(l) be statistically independent p! ocesses with power spectrurrs
I xx@\: 26(ar) + l/U + (arl10)21
and
9vv@\:4/U+ktl2)21
A complex process
Z(t) - [x(0 +jY(t)]exp(jaar)
is formed where a4 is a constant much larger than 10.
(a) Determine the autocorrelation function of Z(t).
(61 Find and sketch the power spectrum of Z(t).