In the name of Allah

Digital Signal Processing

III Units1
Raheleh Davoodi
[email protected]
Bioelectric Master Program
Shahid Beheshti University
Fall Semester of 2024
Introduction
What is Signal?
 → flow of information
 → measured quantity that varies with time (or position)
 → electrical signal received from a transducer (microphone,
thermometer, accelerometer, antenna, etc.)
 → electrical signal that controls a process
Continuous- time signals: voltage, current, temperature, speed,...

Discrete- time signals: daily minimum/maximum temperature,

Lap intervals in races, sampled continuous signals,...

 Electronics (unlike optics) can only deal easily with time dependent
signals, therefore spatial signals, such as images, are typically first
converted into a time signal with a scanning process (TV, fax, etc.). 3
 What is signal processing?
 Signals may have to be transformed in order to
→ amplify or filter out embedded information
→ detect patterns
→ prepare the signal to survive a transmission channel
→ prevent interference with other signals sharing a medium
→ undo distortions contributed by a transmission channel
→ compensate for sensor deficiencies
→ find information encoded in a different domain.
 To do so, we also need
→ methods to measure, characterize, model and simulate transmission channels
→mathematical tools that split common channels and transformations into easily
manipulated building blocks
4
Analog Electronics
 Passive networks (resistors, capacitors,
inductances, crystals, SAW filters),
 non-linear elements (diodes,...), (roughly)
linear operational amplifiers
 Advantages:
 Passive networks are highly linear Over a
very large dynamic range And large
bandwidths•
 Analog signal- processing circuits require
little or no power•
 Analog circuits cause little additional
5
interference.
 What is Digital Signal Processing “DSP” ?
 Analog/digital and digital/analog converter, CPU, DSP, ASIC, FPGA.
 Advantages:
→ noise is easy to control after initial quantization
→ highly linear (within limited dynamic range)
→ complex algorithms fit into a single chip
→ flexibility, parameters can easily be varied in software
→ digital processing is in sensitive to component tolerances, aging,
environmental conditions, electromagnetic interference
 But:
→ discrete-time processing artifacts (aliasing)
→ can require significantly more power (battery, cooling)
→ digital clock and switching cause interference 6
Why DSP?
 Flexibility
 Accuracy
 Multi-purpose hardware
 Easy to implement sophisticated operations
 Today we have tremendous computer power

7
 The development of low-cost and high-speed digital electronics paved
the way for digital signal processing.

8
 Present in essentially all fields of modern EE
 Countless applications

9
Typical DSP Applications
Communication Astronomy Consumer electronics
systems • VLBI, • Perceptual coding of audio and
• modulation/demodulation • Speckle interferometry video on DVDs
• Speech synthesis
• Channel equalization
• Speech recognition
• Echo cancellation

Experimental physics Aviation

• sensor-data evaluation • radar
• radio navigation

10
 Typical DSP Applications
Security Medical diagnostics
Music
• Synthetic instruments • Steganography • Magnetic resonance
• audio effects • Digital watermarking • Ultrasonic imaging
• Noise reduction • Biometric identification • Computer tomography
• Surveillance systems
• ECG,EEG,MEG,AED,
• Signals intelligence
• Electronic warfare
• Audiology

Engineering Geophysics
• Control systems, • seismology
• feature extraction for pattern • oil exploration
recognition

11
Example – digital communication

12
Problem

13
Solution

14
Speech Recognition

15
Speech recognition

16
 Spectrogram of the same speech signal, now recorded with sampling
rate of 44.1 kHz

17
 Digital processing of analog signals

 Analog-to-digital converter (ADC)

 Performs filtering, sampling, and quantization
 Sampling rate may be of tens of kHz (audio processing), or it may be of tens of
GHz (optical communications)
 Digital signal processor
 Performs some operation e.g., filtering, FFT, etc.
 May be implemented on PCs with 64-bit floating-point precision, or on ASICs
with limited arithmetic precision (e.g., 6 bits).
 Digital-to-analog converter (DAC)
 Performs quantization and reconstruction (filtering)
 Sampling rate could be similar to ADC 18
Syllabus
 Signals and systems: Discrete sequences and systems, their types and properties.
Linear time-invariant systems, convolution. Harmonic phasors are the eigen-
functions of linear time-invariant systems. Review of complex arithmetic. Some
examples from electronics, optics and acoustics.
 MATLAB. Use of MATLAB on PWF machines to perform numerical experiments and
visualize the results in homework exercises.
 Fourier transform: Harmonic phasors as orthogonal base functions. Forms of the
Fourier transform, convolution theorem, Dirac’s delta function, impulse combs in
the time and frequency domain.
 Discrete sequences and spectra. Periodic sampling of continuous signals, periodic
signals, aliasing, sampling and reconstruction of low-pass and band-pass signals,
spectral inversion.
 Discrete Fourier transform. Continuous versus discrete Fourier transform,
symmetry, linearity, review of the FFT, real-valued FFT.
 Spectral estimation. Leakage and scalloping phenomena, windowing, zero padding. 19
 Finite and infinite impulse-response filters. Properties of filters,
implementation forms, window-based FIR design, use of frequency-
inversion to obtain high pass filters, use of modulation to obtain
band-pass filters, FFT-based convolution, polynomial representation,
z-transform, zeros and poles, use of analog IIR design techniques
(Butterworth, Chebyshev I/II, elliptic filters).
 Random sequences and noise. Random variables, stationary
processes, autocorrelation, cross correlation, deterministic cross
correlation sequences, filtered random sequences, white noise,
exponential averaging.

20
 Correlation coding. Random vectors, dependence versus correlation,
covariance, decorrelation, matrix diagonalization, Eigen-
decomposition, Karhunen-Loeve transform, principal/independent
component analysis. Relation to orthogonal transform
 Coding using fixed basis vectors, such as DCT.
 Lossy versus lossless compression. What information is discarded
by human senses and can be eliminated by encoders? Perceptual
scales, masking, spatial resolution, color coordinates, some
demonstration experiments.
 Quantization, image and audio coding standards. A/µ law coding,
delta coding, JPEG photographic still-image compression, motion
compensation, MPEG Video encoding, MPEG audio encoding. 21
Objectives
 By the end of the course, you should be able to
 → apply basic properties of time-invariant linear systems
 → understand sampling, aliasing, convolution, filtering, the pitfalls of
Spectral estimation
 → explain the above in time and frequency domain representations
 → use filter-design software
 → visualize and discuss digital filters in the z-domain
 → use the FFT for convolution, deconvolution, filtering
 → implement, apply and evaluate simple DSP applications in MATLAB

22
Resources: Books

 "Discrete-Time Signal Processing" by Alan V. Oppenheim, Ronald W. Schafer, and John R. Buck

 "Digital Signal Processing: Principles, Algorithms, and Applications" by John G. Proakis and

Dimitris G. Manolakis

 "Digital Signal Processing Using MATLAB" by Vinay K. Ingle and John G. Proakis

23
Resources: Datasets
 Physionet datasets: www.physionet.org
 UCI Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html
 UCI KDD Archive: http://kdd.ics.uci.edu/summary.data.application.html
 Statlib: http://lib.stat.cmu.edu/
 Delve: http://www.cs.utoronto.ca/~delve/

24
Resources: Journals
 IEEE Transactions on Signal Processing
 IEEE Signal Processing Magazine
 IEEE Transactions on Image Processing
 IEEE Transactions on Audio, Speech, and Language Processing
 Signal Processing
 Digital Signal Processing
 IEEE Journal of Selected Topics in Signal Processing
 EURASIP Journal on Advances in Signal Processing
 IEEE Transactions on Circuits and Systems I: Regular Papers
 Journal of the Acoustical Society of America (JASA)

25
Biomedical Signal Processing Journals
 IEEE Transactions on Biomedical Engineering
 IEEE Transactions on Neural Systems and Rehabilitation Engineering
 IEEE Transactions on Biomedical Circuits and Systems
 Biomedical Signal Processing and Control
 Journal of Biomedical and Health Informatics
 Medical & Biological Engineering & Computing (MBEC)
 Computer Methods and Programs in Biomedicine
 IEEE Journal of Biomedical and Health Informatics
 Journal of Neuroscience Methods
 Journal of Medical Systems
 …
26
 Iranian Journal of Biomedical Engineering www.Ijbme.org
Resources: Conferences
 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

 IEEE International Conference on Digital Signal Processing (DSP)

 IEEE Global Conference on Signal and Information Processing (GlobalSIP)

 IEEE International Conference on Signal Processing, Communications, and Computing (ICSPCC)

 European Signal Processing Conference (EUSIPCO)

 IEEE International Conference on Image Processing (ICIP)

 IEEE International Conference on Biomedical and Health Informatics (BHI)

 IEEE International Symposium on Circuits and Systems (ISCAS)

 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

27
 Asilomar Conference on Signals, Systems, and Computers
Open- source Tools
 GNU Radio
 highly modular and allows users to design, simulate, and implement DSP applications in Python and
C++.
 Software-defined radio, wireless communication systems, signal analysis, and prototyping DSP
algorithms.
 (https://www.gnuradio.org/)

 SciPy
 Signal filtering, spectral analysis, time-frequency analysis, and general-purpose DSP algorithms.
 (https://scipy.org/)

 NumPy
 Basic signal processing, array manipulation, FFT (Fast Fourier Transform), and other numerical
operations.
 (https://numpy.org/) 28
…
 MATLAB and Octave
 Signal processing research, algorithm development, simulations, and
prototyping.
 (https://www.gnu.org/software/octave/)
 FFTW (Fastest Fourier Transform in the West)
 Performing FFTs efficiently in real-time signal processing applications.
 (http://www.fftw.org/)
 SoX (Sound eXchange)
 SoX is a cross-platform command-line utility that can convert various formats of
computer audio files and apply various sound effects and signal processing.
 Audio signal processing, file format conversion, and applying DSP effects to
audio files.
 (http://sox.sourceforge.net/) 29
…
 Keras and TensorFlow
 Implementing machine learning models for signal classification, anomaly detection, and
advanced DSP tasks using neural networks.
 (https://keras.io/), (https://www.tensorflow.org/)

 PyWavelets
 Wavelet-based signal processing, image compression, denoising, and time-frequency
analysis.
 (https://pywavelets.readthedocs.io/)

 SigPy
 Image reconstruction, MRI data processing, and general DSP applications involving
iterative algorithms.
 [SigPy](https://sigpy.readthedocs.io/)

 Liquid-DSP
 Software-defined radio, communication systems, and prototyping DSP algorithms in C.
30
 (https://github.com/jgaeddert/liquid-dsp)
Prerequisites
 Signals and Systems
 Programming Language (Matlab / Python)
 (IF NOT, some basics will be taught through the course BUT hard
attempts are needed!)

31
 Course Evaluation methods

Method Class Homework Programmin Quiz Project Final

Activity Assignments g (# 4) (+ presentation)
Assignments
Soft Formula 5% 5% 5% 20% 15% 50%

Semi –soft Formula - - - - 30% 60%

Hard Formula - - - - - 80%

32
Class Rules
 Remarks:
 The BONUS up to 2/4 points for conference/journal draft papers from
the within class projects
 Cheating is not forgivable in any way! 
 Consider the deadlines 

33