Lecture 1: Digital Signal Processing

Course Introduction

Dr. Sheraz Alam Khan

Department of Electrical Engineering

Faculty of Engineering & Computing
Credit Hours: 3+1
Pre-requisite(s): Signals and Systems, Differential Equations, CVT
Recommended 1. John G. Proakis et al. “Digital Signal Processing- Principles,
Book(s): Algorithms and Applications” 4th Edition
2. E.C. Ifeachor et al.,” Digital Signal Processing-A practical
approach”, 3rd edition.
3. M..Hayes, “Schaum's Outline of Theory and Problems Of
Digital Signal Processing” McGraw Hill.

Reference Sanjit.K.Mitra “Digital Signal Processing - Computer Based

Book(s): Approach” 3rd Edition.

Department of Electrical Engineering, National University of

2
Modern Languages
Course Learning Outcomes
CLOs Description Domain Taxonomy PLO
Level
1 Apply the basic concepts of digital signal processing to the Cognitive 3 1
process of analog to digital (A/D) and digital-to-analog(D/A)
conversion

2 Analyze discrete-time signals and systems in time domain Cognitive 4 2

3 Analyze discrete time LTI systems using Fourier and Z- Cognitive 4 2

transform
4 Design frequency selective processing FIR/IIR filters and Cognitive 5 3
develop various structures for their realization

Department of Electrical Engineering, National University of

3
Modern Languages
CLOs Course Contents

• Introduction to Digital signal Processing

• Classification of signals
CLO1
• Concept of frequency/signals in Continuous and Discrete time domain
• Analog to Digital conversion, Sampling theorem
• Digital to Analog Conversion
• Discrete Time Signals and Systems: Representation, Classification and Analysis
• Analysis of Discrete Time systems in Time domain
CLO2 • Linear constant coefficient difference equation (LCCDE) and its solution in time
domain
• Correlation of Discrete Time Signals
• Fourier Analysis of Discrete time Signals
CLO3 • Discrete Fourier Transform and Fast Fourier Transform
• Z-transform and Inverse Z-transform: properties and applications

• Fundamentals of Digital Filter Design

CLO4 • FIR filter design using window method
• IIR filter design using Bi-linear Z-transform method
Department of Electrical Engineering, National University of
4
Modern Languages
 MARKS DISTRUBUTION AND GRADING MODEL

• Internal Evaluation 25%

a. Assignments 5 - 10%
b. Quiz 5 - 10%
c. Presentation/Project 5 - 10%
• Midterm 25%
• Final term 50%

*All students are required to have atleast75% attendance to be eligible to give final
examination
*Min 25% marks must be obtained in the final examination to pass the subject
Department of Electrical Engineering, National University of
5
Modern Languages
 Signals
✓flow of information
✓Measured quantity that varies with time(or position)
✓Electrical signal received from a transducer (microphone,
thermometer, accelerometer, antenna, etc.)
✓Electrical signal that controls a process

• Continuous-time signals: voltage, current, temperature,

speed,...
• Discrete-time signals: daily minimum/maximum
temperature, lap intervals in races, sampled continuous
signals,...
Department of Electrical Engineering, National University of
6
Modern Languages
 Signal processing
• Signals may have to be transformed in order to
✓ amplify or filter out embedded information
✓ detect patterns
✓ prepare the signal to survive a transmission channel
✓ prevent interference with other signals sharing a medium
✓ undo distortions contributed by a transmission channel
✓ compensate for sensor deficiencies
✓ find information encoded in a different domain
• To do so, we also need
✓methods to measure, characterize, model, and simulate transmission
channels
✓mathematical tools that split common channels and transformations into
easily manipulated building blocks
Department of Electrical Engineering, National University of
8
Modern Languages
 Analog electronics
• Passive networks (resistors, capacitors, inductances,
crystals, SAW filters), non-linear elements (diodes, . . .
), (roughly) linear operational amplifiers.
• Advantages:
• Passive networks are highly linear over a very large
dynamic range and large bandwidths
• analog signal-processing circuits require little or no power
• Analog circuits cause little additional interference
• Disadvantages:
• Prone to noise: Easily affected by interference and
distortion.
• Limited accuracy: Hard to achieve high precision due to
component variations.
• Difficult to store: Storing analog signals without quality
loss is challenging.
• Less flexible: Circuit changes require physical adjustments,
unlike digital systems.
• High power consumption: Often uses more power than
digital circuits
Department of Electrical Engineering, National University of
9
Modern Languages
 Definition: Digital Signal Processing

• Digital Signal Processing (DSP) refers to the manipulation,

analysis, and transformation of digital signals to extract
useful information or modify the signals for specific
purposes.
• It involves various mathematical algorithms and techniques
to process digital signals, which are discrete-time
representations of analog signals.

Department of Electrical Engineering, National University of

10
Modern Languages
 Digital signal processing
• Analog/digital and digital/analog converter, CPU, DSP, ASIC, FPGA.
• Advantages:
✓noise is easy to control after initial quantization
✓highly linear (within limited dynamic range)
✓complex algorithms fit into a single chip
✓flexibility, parameters can easily be varied in software
✓digital processing is insensitive to component tolerances, aging, environmental
conditions, electromagnetic interference
• Disadvantages:
✓discrete-time processing artifacts (aliasing)
✓can require significantly more power (battery, cooling)
✓digital clock and switching cause interference

Department of Electrical Engineering, National University of

11
Modern Languages
Typical DSP applications

12
Department of Electrical Engineering, National University of
 1. Signals, Systems, and Signal Processing
• A signal is defined as any physical quantity that varies with time, space, or
any other independent variable or variables. Mathematically, we describe a
signal as a function of one or more independent variables. For example, the
functions:

• The signals described by (1.1) and (1.2) belong to a class of signals that are
precisely defined by specifying the functional dependence on the
independent variable. However, there are cases where such a functional
relationship is unknown or too highly complicated to be of any practical use.
Department of Electrical Engineering, National University of 13
Modern Languages
 Signals (cont.)

• For example, a speech signal (see Fig. 1.1) cannot be described functionally
by expressions such as (1.1). In general, a segment of speech may be
represented to a high degree of accuracy as a sum of several sinusoids of
different amplitudes and frequencies, that is, as

Department of Electrical Engineering, National University of

14
Modern Languages
 Signals (cont.)
• where {Ai(t)}, {Fi(t)}, and {θi(t)} are the sets of (possibly time-
varying) amplitudes, frequencies, and phases, respectively, of the
sinusoids.
• In fact, one way to interpret the information content or message
conveyed by any short time segment of the speech signal is to
measure the amplitudes, frequencies, and phases contained in the
short time segment of the signal.
• Another example of a natural signal is an electrocardiogram (ECG).
Such a signal provides a doctor with information about the
condition of the patient’s heart. Similarly, an
electroencephalogram (EEG) signal provides information about
the activity of the brain.
Department of Electrical Engineering
15
National University of Modern Languages
 Systems and Signal processing(Cont.)
• A system may also be defined as a physical device that performs an operation
on a signal. For example, a filter used to reduce the noise and interference
corrupting a desired information-bearing signal is called a system. In this
case the filter performs some operation(s) on the signal, which has the effect
of reducing (filtering) the noise and interference from the desired
information-bearing signal. When we pass a signal through a system, as in
filtering, we say that we have processed the signal. In this case the
processing of the signal involves filtering the noise and interference from the
desired signal.
• In general, the system is characterized by the type of operation that it
performs on the signal. For example, if the operation is linear, the system is
called linear. If the operation on the signal is nonlinear, the system is said to
be nonlinear, and so forth. Such operations are usually referred to as signal
processing.
Department of Electrical Engineering, National University of
16
Modern Languages
 Realization of DSP
• Software: A system that is realized on a digital computer by means of a
sequence of mathematical operations; that is, we have a digital signal
processing system realized in software. For example, a digital computer can
be programmed to perform digital filtering.
• Hardware: Alternatively, the digital processing on the signal may be
performed by digital hardware (logic circuits) configured to perform the
desired specified operations. In such a realization, we have a physical device
that performs the specified operations.
• In a broader sense, a digital system can be implemented as a combination of
digital hardware and software, each of which performs its own set of
specified operations.
• The method or set of rules for implementing the system by a program that
performs the corresponding mathematical operations is called an algorithm
Department of Electrical Engineering, National University of
17
Modern Languages
 1.1 Basic Elements of a Digital Signal Processing
System

• Most of the signals encountered in science and engineering are analog in nature.
That is, the signals are functions of a continuous variable, such as time or space,
and usually take on values in a continuous range. Such signals may be processed
directly by appropriate analog systems (such as filters, frequency analyzers, or
frequency multipliers) for the purpose of changing their characteristics or
extracting some desired information. In such a case we say that the signal has been
processed directly in its analog form, as illustrated in Fig. 1.2. Both the input
signal and the output signal are in analog form.
Department of Electrical Engineering, National University of
18
Modern Languages
 DSP system (Cont.)

• Digital signal processing provides an alternative method for processing

the analog signal, as illustrated in Fig. 1.3. To perform the processing
digitally, there is a need for an interface between the analog signal and the
digital processor. This interface is called an analog-to-digital(A/D) converter.
The output of the A/D converter is a digital signal that is appropriate as an
input to the digital processor.

Department of Electrical Engineering, National University of

19
Modern Languages
 1.2 Advantages of Digital over Analog Signal Processing
• Flexibility in reconfiguring the digital signal processing operations simply by
changing the program.
• Accuracy
• Easy to store and transport digital signals
• The digital signal processing method also allows for the implementation of
more sophisticated signal processing algorithms.
• Cheaper solution in mass manufacturing
• Exact replication possible
• Computers only understand digital !

Department of Electrical Engineering, National University of

20
Modern Languages
 Limitations:
• Sampling and Quantization Effects
• One practical limitation is the speed of operation of A/D converters and
digital signal processors
• Computational Complexity
• Aliasing and Nyquist Criterion
• Delay and Latency in real-time processing

Department of Electrical Engineering, National University of

21
Modern Languages
 2 Classification of Signals
2.1 Multichannel and Multidimensional Signals
• In some applications, signals are generated by multiple sources or multiple
sensors. If sk(t),k = 1, 2, 3, denotes the electrical signal from the kth sensor as
a function of time, the set of p = 3 signals can be represented by a vector
S3(t), where

We refer to such a vector of signals as a multi-channel signal.

• In electrocardiography, for example, 3-lead and 12-lead electrocardiograms
(ECG) are often used in practice, which result in 3-channel and 12-channel
signals.

Department of Electrical Engineering, National University of

22
Modern Languages
 Classification of Signals….

• If the signal is a function of a single independent variable, the signal is called a

one-dimensional signal. On the other hand, a signal is called M-dimensional if
its value is a function of M independent variables.

Department of Electrical Engineering, National University of

23
Modern Languages
 Classification of Signals….
2.2 Continuous-Time Versus Discrete-Time Signals
• Continuous-time signals or analog signals are defined for every value of time
and they take on values in the continuous interval (a, b), where a can be −∞
and b can be ∞. Mathematically, these signals can be described by functions
of a continuous variable, e.g. speech waveform in Fig. 1.1 and the signals x (t)
= cos πt , x (t) = e -|t| .
• Discrete-time signals are defined only at certain specific values of time. These
time instants need not be equidistant, but in practice they are usually taken
at equally spaced intervals for computational convenience and mathematical
tractability, e.g.

Department of Electrical Engineering, National University of

24
Modern Languages
Classification of Signals….

Department of Electrical Engineering, National University of

25
Modern Languages
 Classification of Signals….

2.3 Continuous-Valued Versus Discrete-Valued Signals

• If a signal takes on all possible values on a finite or an infinite range, it is said
to be a continuous-valued signal. Alternatively, if the signal takes on values
from a finite set of possible values, it is said to be a discrete-valued signal.
• Usually, these values are equidistant and hence can be expressed as an
integer multiple of the distance between two successive values.
• A discrete-time signal having a set of discrete values is called a digital signal.
• Figure 2.5 shows a digital signal that takes on one of four possible values.

Department of Electrical Engineering, National University of

26
Modern Languages
Department of Electrical Engineering, National University of
27
Modern Languages
 Classification of Signals….
2.3 Deterministic Versus Random Signals
• Any signal that can be uniquely described by an explicit mathematical expression, a table
of data, or a well-defined rule is called deterministic. This term is used to emphasize the
fact that all past, present, and future values of the signal are known precisely, without any
uncertainty. For example,

• In many practical applications, however, there are signals that either cannot be described
to any reasonable degree of accuracy by explicit mathematical formulas, or such a
description is too complicated to be of any practical use. The lack of such a relationship
implies that such signals evolve in time in an unpredictable manner. We refer to these
signals as random. For example, the output of a noise generator, the seismic signal or
speech signal.
• The mathematical framework for the theoretical analysis of random signals is provided by
the theory of probability and stochastic processes
Department of Electrical Engineering, National University of
28
Modern Languages
Questions are guaranteed in
Life…………….Answers are not!

Department of Electrical Engineering, National

29
University of Modern Languages