Digital Signal Processing

Instructor: Ninh Khánh Duy

Embedded System Division, IT Faculty,
Danang University of Science and Technology
Email: [email protected]
Facebook: Ninh Khánh-Duy

1
Goals
! Knowledge:
!Tools such as convolution, Z-transform (ZT), Discrete-
Time Fourier Transform (DTFT) and Discrete Fourier
Transform (DFT)
!Digital signal and system analysis and its apps

! Skills:
!Matlab (or Python) programing
!Teamwork: 4 students/group for mini-projects

!Writing & presenting report

2
Grading
! Exercise: 25%
! Midterm: 25%
! Final exam: 50%

Exercise and Midterm are computer-based tests

using MATLAB or Python

3
 References
PDF files shared via Gdrive:
!

!Bài giảng Xử lý tín hiệu số

!Book: Digital signal processing - Principles, algorithms, and

applications, Proakis & Manolakis, 1995 (& its solution)

!Matlab & Python books

Books at Resource Information Center:

!

!Xử lý tín hiệu số, Quách Tuấn Ngọc, 1999

!Xử lý tín hiệu và lọc số, Nguyễn Quốc Trung, 2006

4
Signal processing programming
! Matlab: easy, but commercial software
!Self-studying Matlab:
https://www.mathworks.com/help/matlab/index.html
!Signal Processing Toolbox (chỉ cần cài SP toolbox và Matlab):

https://www.mathworks.com/help/signal/
! Python is not as easy as Matlab, but open-sourced
!Self-studying Python & its libraries:
http://cs231n.github.io/python-numpy-tutorial/
!Signal processing with SciPy:

https://docs.scipy.org/doc/scipy/reference/signal.html
!Setting up Python environment with Anaconda:

https://machinelearningmastery.com/setup-python-environment-
machine-learning-deep-learning-anaconda/ 5
 Schedule

! Chapter 1: Introduction to Digital Signal Processing

! Chapter 2: Discrete-time Signals and Systems
! Chapter 3: Z-transforms and LTI system analysis
! Chapter 4: Discrete-time Fourier Transform (DTFT)
! Chapter 5: Discrete Fourier Transform (DFT)
! Mini-projects (intended): Week 7-8, Week 14-15

6
Chapter 1: Introduction to Digital
Signal Processing
Outline:
1. Signals
2. Digital Signal Processing (DSP) systems
3. Why DSP?
4. DSP applications

7
Signals
! Physics: Physical representation of information
! Math: Function of independent variables such as
time, distance, position, temperature
! Objects that convey information
! Examples:
! 1D signal: speech, music, biosensor…
! 2D signal: image
! 3D signal: video (2D image + time)
D = dimensional
8
1D signals: f(t)

9
2D image signals: f(x,y)

10
3D video signals f(x,y,t)

11
1st step in DSP: signal acquisition
! We need devices for converting non-measurable
quantities into measurable ones (often, electrical
signals)
! Transducer:
! Microphone: audio wave " voltage signal
! Sensors

12
Only 1D signal, dimension is time
Discrete-time (DT) signal vs.
continuous-time (CT) signal
! Continuous-time signal:
- its magnitudes (amplitudes/values) define for a
continuous duration of time
- sound, voice…
! Discrete-time signal:
- define only for discrete points in time (hourly,
every second, …)
- an image in computer, a recorded audio file
- amplitude could be discrete or continuous
- if the amplitude is also discrete, the signal is digital
13
Analog signal vs. digital signal

14
Analog signal vs. digital signal

3v

Ov

T: time interval between two consecutive samples 15

 2nd step in DSP: Digitalization of signals
! Process converting contiguous signal to digital one
! Include 3 steps:
! Discretizing time axis (Sampling: lấy mẫu)
! Sampling period (chu kỳ lấy mẫu T)
! Discretizing amplitude axis (Quantization: lượng tử hoá)
! Precision/Resolution (number of quantization levels = 2N, N:
number of bits to store a sample value)
! Coding: convert quantization levels into binary codes

16
Chapter 1: Introduction to Digital
Signal Processing
Outline:
1. Signals
2. Digital Signal Processing (DSP) systems
3. Why DSP?
4. DSP applications

17
What is Digital Signal Processing?
! Represent a signal by a sequence of numbers
(called a “discrete-time signal” or “digital signal”)
! Modify this sequence of numbers by a computing
process to change or extract information from the
original signal
! The “computing process” is a system that converts
one digital signal into another — it is a “discrete-
time system” or “digital system”

18
 An example of DSP
! From a discrete-time input signal:
x[n] = { 1, 2, 4, -9, 5, 3 }
! Create a discrete-time output signal:
y[n] = { 1/3, 1, 7/3, -1, 0, -1/3, 8/3, 1 }
! What is the relation between input and output
signal? x[n]
x[n-1]
x[n-2]
3y[n]
--> System: y[n]=1/3(x[n]+x[n-1]+x[n-2]) 19
 DSP implementation
! Use basic operations of addition, multiplication and
delay (shift)
! Combine these operations to accomplish processing:
a discrete-time input signal " another discrete-time
output signal

20
Signal processing system
Analog system

Digital system
x[n] y[n]

Digitalization (COder) Recovery (DECoder)

Digital processing of analog signals 21

DSP implementation options
! Special-purpose (custom) chips: application-
specific integrated circuits (ASIC)
! Field-programmable gate arrays (FPGA)
! General-purpose microprocessors or
microcontrollers (µP/µC)
! General-purpose digital signal processors (DSP
processors)
! DSP processors with application-specific
hardware (HW) accelerators
22
DSP implementation options

23
Chapter 1: Introduction to Digital
Signal Processing
Outline:
1. Signals
2. Digital Signal Processing (DSP)
3. Why DSP?
4. DSP applications

24
Advantages of DSP
! Flexible: re-programming ability
! More reliable
! Smaller, lighter " less power
! Easy to use, to develop and test (by using the
assistant tools)
! Suitable to sophisticated applications

25
Limitations of DSP
!Aliasing in sampling: taking samples at intervals
and don’t know what happens in between
" can’t distinguish higher and lower frequencies
" to avoid: sampling theory

26
 Nyquist/Shannon sampling theory
! Goal: To guarantee that an analog signal can be perfectly
recovered from its sample values (discrete signal)
! Theory: an analog signal with maximum frequency of B
(Hz) must be sampled at least 2B times per second
! Nyquist sampling rate: minimum sampling frequency (fs
min = 2B Hz) fs = 1/T (T: sampling interval)
! Nyquist frequency (fs/2): max. freq. can be recovered
! To remove all signal elements above the Nyquist
frequency " anti-aliasing filter
Eg.: audio signals has B=22kHz " fs min=2x22kHz=44kHz=44k samples/second
27
Anti-aliasing filter

28
 Some examples of sampling
frequency
! Speech coding/compression ITU G.711, G.729,
G.723.1 (telephony)
fs = 8 kHz " T = 1/8000 s = 125µs
! Audio CDs:
fs = 44.1 kHz " T = 1/44100 s = 22.676µs
! Audio hi-fi, e.g., MPEG-2, AAC, MP3:
fs = 48 kHz " T = 1/48 000 s = 20.833µs
Homework: Record your voice with the same sentence
using Audacity software with 3 fs: 8kHz, 16kHz, 44.1kHz.
After that, playback three signals & give your remarks
about their quality. 29
 Limitations of DSP
! Quantization error: due to the limited number of bit available
" smoothly varying signal represented by stepped waveform
" limited precision in data storage and arithmetic

30
Chapter 1: Introduction to Digital
Signal Processing
Outline:
1. Signals
2. Digital Signal Processing (DSP)
3. Why DSP?
4. DSP applications

31
DSP applications - radar

32
DSP applications - biomedical
! Analysis of biomedical signals, diagnosis, patient
monitoring, preventive health care

33
DSP applications – speech
compression
(reduce much storage w/ little distortion)

34
 DSP
applications
–
speech
recognition
(speech-to-
text)
Recogniton =
Feature extraction + AI algorithm 35
DSP applications -
communication
! Digital telephony: transmission of information in
digital form via telephone lines, mobile phone

MODEM = MOdulation (D/A) + DEModution (A/D)

36
DSP applications – image
processing
! Image compression: reducing the redundancy in
the image data

37
DSP applications – image
processing
! Image restoration (enhancement): reconstruct a
degraded image using a priori knowledge of the
degradation phenomenon

38
DSP applications - music

39
DSP applications - noise removal

40