1999 Bookmatter DigitalSignalProcessing
1999 Bookmatter DigitalSignalProcessing
Digital Signal
Processing
Concepts and Applications
This book is printed on paper suitable for recycling and made from
fully managed and sustained forest sources.
10 9 8 7 6 5 4 3 2 1
08 07 06 05 04 03 02 01 00 99
Contents
Preface, x
Acknowledgements, xii
Abbreviations, xiii
Principal symbols, xvi
Special functions, xx
Introduction, xxi
Digital signal processing (DSP) provides a rapidly advancing portfolio of filtering and
estimating techniques or algorithms which are used in signal analysis and processing.
Significant current applications are in the development of mobile communications
equipment, particularly for personal use and design of sophisticated radar systems. The
aim of this book is to provide an introduction to the fundamental DSP operations of fil-
tering, estimation and signal analysis as used in signal processing.
Most of the chapters include substantive numerical examples to illustrate the
material developed, as well as self assessment questions which have been designed to
help readers aid their comprehension of this material. All the chapters conclude with
further problem questions for the student.
Chapters 1 to 3 cover basic analogue signal theory as a prerequisite to this DSP
text. Chapter 4 extends these concepts to sampled-data systems and here discrete con-
volution is introduced. Chapters 5 and 6 explore digital filters, both infinite and finite
impulse response, which implement the convolution operation and include both analyti-
cal design and software optimisation techniques. The two chapters conclude with a
brief discussion on the problems of finite precision arithmetic. Chapters 7 and 8 intro-
duce, at a more mathematical level, the concept of random signals, correlation and
spectral density. Chapter 8 covers adaptive or self learning filters which alter their char-
acteristics dependent on the signal scenario which is present. They find widespread
application in communications systems as equalisers and echo cancellers. The final
three chapters deal with spectral analysis techniques. Chapter 9 covers the discrete
Fourier transform (DFT), its derivation and the design of DFT processors. This chapter
then investigates the application of DFT processors in classical spectrum analysis
equipment before introducing the modern analysers which are based on the adaptive fil-
ter technique of Chapter 8. Chapter 10 deals with the fast Fourier transform which is
the most widely applied implementation of the DFT processing function. Chapter 11
introduces multirate techniques to extend the capabilities of these analysers to speech
and image processing applications.
With this balance between signal theory, processor design and systems applica-
tions we hope that this text will be useful both in academia and in the rapidly growing
commercial signal processing community. Advanced DSP is of fundamental impor-
tance in implementing many high performance systems such as personal communica-
tions and radar.
To aid the class instructor, the authors can provide a printed set of outline solu-
tions to the end-of-chapter problems and these are available via the WWW on password
access. MATLABTM source code is also provided on an open access basis to assist the
Preface Xl
instructor with presentation of the material and the student in understanding of the
material. In general the source code provides a computer animation of some of the fig-
ures in the book. For example the m-file Ilfig1_4.m" contains MATLAB code which
produces an animation of the complex phasor of Figure 1.4. These are identified within
the text by the g symbol. These software and solutions to problems are available via
the menu at the Edinburgh WWW server address:
http://www.ee.ed.ac.ukrpmg/SIGPRO/index.htmi. Subsequent corrections to this text
will also be available at the same WWW address.
Parts of this book have been developed from BEng, MEng, MSc and industrial training
courses provided by the Department of Electronics and Electrical Engineering at the
University of Edinburgh. These courses were also taught by Professor Colin Cowan
and Dr James Dripps, and we acknowledge their contribution to the initial shaping of
these courses which is reflected in the book's content and structure. We are grateful to
Professor Cowan for having provided a draft version of Chapter 5 and Dr Dripps for
having provided a draft version of parts of Chapter 9 and for assistance with many of
the problem solutions. We are also grateful to Dr Ian Glover at the University of Brad-
ford and Prentice-Hall for permission to include the material on bandpass sampling
within Chapter 11, and to the lEE for permission to reproduce Figure 9.22.
We would like to thank all those other colleagues at the University of Edinburgh
who have provided detailed comments on sections of this text. Thanks must go to the
many students who have read and commented on earlier versions of this material and
helped to refine the end-of-chapter problems, particularly to Miss Oh who generated the
initial version of many of the diagrams. We also gratefully acknowledge the generous
assistance of Dr Jonathon Chambers of Imperial College in carefully reviewing and
editing this text. In addition we acknowledge the assistance of Philip Yorke at
Chartwell Bratt publishing and training in encouraging us to develop, in the 1980s, the
preliminary version of this material.
Special thanks are due to Joan Burton, Liz Paterson and Diane Armstrong for
their perseverance over several years in typing the many versions of the individual
chapters, as they have evolved into their current form. We also acknowledge Bruce
Hassall's generous assistance with the preparation of the final version of the text in the
appropriate typefont and text format.
Finally we must thank our respective families: Fiona and Maeve; Marjory, Lind-
say and Jenny; and Nadine - for the considerable time that we required to prepare this
book and the associated WWW supporting material.
CD Compact disc
CDMA Code division mUltiple access
CELP Codebook of excited linear prediction
CMOS Complementary metal oxide silicon (transistor)
COFDM Coded orthogonal frequency-division multiplex
HP High pass
MA Moving average
MAC Multiply and accumulate
MATLAB MATrix LABoratory commercial DSP software product
MFSK Multiple frequency shift keying
MMSE Minimum mean square error
MODEM Modulator/demodulator
MOS Mean opinion score (for speech quality assessment)
Metal oxide silicon (transistor)
MPE Multipulse excitation
MSE Mean square error
Q Quantiser
d lag
e error vector
e(n) scalar error signal at data sample n
E energy of signal x(t)
10 centre frequency
11 passband cut-off frequency
i2 stopband edge frequency
hdB half power bandwidth
Ib bit rate
Ie centre frequency
IH highest frequency component
fL lowest frequency component
lLO local oscillator frequency
Is sample frequency (in Hz)
Fm(z) z-plane reconstruction filter m response
Principal symbols xvii
k Boltzmann's constant
K constant
L upsampling ratio
L(m) weighting function
RD dynamic range
RC resistor-capacitor time constant 'Cc
Laplace variable
power spectral density
t time
/).t sample period
x vector x
x(n) sampled input signal
fen) estimate of input signal
Xn complex Fourier coefficient
X(f/OJ) Fourier (voltage) spectrum of x(n)
IX(f/OJ)1 Fourier amplitude spectrum
X(k) DFf output value for bin or sample number k
X(s) Laplace transform of x(t)
p constant
Dirac delta
impulse function
impulse train
voltage difference
gradient vector
quantisation error
mean-square quantisation error
filter damping factor
MSE cost function
TJ efficiency
TJ(n) additive noise signal
eigenvalue i
time constant
Real life signals are generally continuous in time and analogue, i.e. they exist at all time
instances and can assume any value, within a predefined range, at these time instances.
There are many kinds of analogue signals appearing in nature:
Acoustic signals such as sound waves are converted to electrical voltages or cur-
rents by sensors or transducers, (i.e. a microphone) in order for them to be processed in
an electronic system. Analogue processing involves linear operations such as amplifi-
cation, filtering, integration and differentiation, as well as various forms of nonlinear
processing such as squaring or rectification. This text does not cover the field of non-
linear signal processing, but, in practice, saturation in amplifiers or mixing of signals
often introduces nonlinearities. Limitations of practical analogue processing operations
are:
Restricted accuracy.
Sensitivity to noise.
• Restricted dynamic range.
Poor repeatability due to component variations with time, temperature, etc.
• Inflexibility to alter or adjust the processing functions.
• Problem in implementing accurate nonlinear and time-varying operations.
• Limited speed of operation.
• High cost of storage for analogue waveforms.
However, in the 1970s, analogue signal processing in the form of surface acoustic
wave and charge-coupled sampled-data devices delivered very sophisticated matched
filter and correlator parts which were widely used in military equipment. At this time it
was not possible to match the analogue speed/performance capability with digital
devices so the accuracy of analogue processors was severely limited. The initial imple-
mentations of Dolby noise reduction systems also employed analogue filter techniques
and the early Y.21-V.29 data modems, for transmission of digital data over telephone
lines, used exclusively analogue filters and modulators.
XXll Introduction
The basic components of the digital processor, which is equivalent to the ana-
logue processing function, is considered later in Chapter 4. The DSP function is gener-
ally described as an algorithm or program which defines the in-built arithmetic opera-
tions. DSP is in fact an extension of the conventional microprocessor function except
that a fast multiplier is added as a hardware accelerator element.
The main attraction of digital processors is that their accuracy, which is con-
trolled by the quantisation step size or word length employed in the NO converter, is
extendable only at the cost of greater complexity for the ensuing processing operations,
i.e. additions and multiplications. However, floating-point number representations per-
mit the accuracy to be maintained over a wide dynamic range. Further, digital proces-
sors are generally repeatable and much less sensitive to noise than analogue processors
as they are dealing with binary symbols and the processed outputs must always possess
binary values. The microelectronics industry has been reducing continuously silicon
VLSI circuit geometrics and hence improving the speed, complexity and storage capac-
ity. The feature size in the 1970s was 5,um while in the year 2000 we will be designing
VLSI circuits with 0.18,um feature sizes and single chip complexities of 40 M individ-
ual transistors, and by the year 2010 0.7,um feature size circuits are predicted to have 3
GHz clock rates.
VLSI permits the design of application specific integrated circuits with excep-
tional cost/performance capabilities to execute sophisticated DSP processing functions.
Current developments in microelectronics are delivering an order of magnitude increase
in processor operating speed, coupled with a 30-fold reduction in power consumption,
every eight years.
Some of the key benefits which derive from digital signal processing are:
These advances in DSP, complexity and functionality over analogue signal pro-
cessing are not obtained without some penalties. High accuracy, high speed AID and
D/A conversion hardware is expensive and it can lead to noise and distortion problems.
We always require bandlimiting filters before the sampling function and this introduces
some loss of information. For some applications, e.g. RF signals, digital processors
cannot achieve the necessary high speed sampling requirements. Even with these draw-
backs the use of DSP is becoming ubiquitous, partly because of the 40% per year cumu-
lative growth of the DSP since 1988, with predicted market sales of 6,000,000,000 dol-
lars in 2000. The generic application areas are:
Speech and audio: noise reduction (Dolby), coding, compression (MPEG), recogni-
tion, speech synthesis.
Telephony: speech, data and video transmission by wire, radio or optical fibre.
Signal analysis: spectrum estimation, parameter estimation, signal modelling and clas-
sification.
Radar: filtering, target detection, position and velocity estimation, tracking, imaging,
direction finding, identification.
Sonar: as for radar but also for use in acoustic media such as the sea.
Transport: vehicle control (braking, engine management) and vehicle speed measure-
ment.
The key attraction of DSP devices is that their in-built programmability allows
one standard part to be applied to most of these processing functions by changing the
stored program or instruction set.
In terms of specific uses, the modem car has many tens of processors attached to
sensors for fuel injection, engine management, passenger compartment climate control,
braking system protection, detection of component failure, etc. In fact a major part of
the modem automobile comprises electronics rather than mechanical engineering.
Modem mobile and cellular telephone systems rely on advanced signal processing to
detect and decode the received signals, to minimise received errors, to control the
mobile transmissions, to enhance battery life, etc. The TV set and new set-top boxes
contain a large number of DSP chips to detect the low power signals received and to
decompress the video traffic efficiently.
In the late 1990s there are a tremendous number of applications for DSP and, in
the future, we confidently expect these to increase as the continuous growth in proces-
sor power and novel algorithm development unlocks even more sophisticated process-
ing algorithms which cannot be contemplated today. DSP is thus now firmly
entrenched in the consumer marketplace.