EEE 311: Digital Signal Processing I

Lecture 01

Shaikh A. Fattah

Dept. of Electrical and Electronic Engineering

BUET, Dhaka Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 1
 Signals

• Signals contain stream of information.

• Information about the state or behavior of a system.
• Information generally has a pattern of variations.
• Hence, a signal can be represented mathematically as a
function of one or more independent variables.
1D signal: speech (independent variable- time (t)),
2D signal: Image (independent variable- spatial variables (x, y))

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 2
 System and Signal Processing
System:
Signal generation is associated to system
(system response to source/stimulus/force/excitation)
A device that performs operation on signals.
(physical device or software realization)
Example: Noise reduction filter, frequency analyzer

Signal Processing:
Manipulate signal to get some processed information
Filtering: Extract/remove certain portion
Compression
Coding
Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 3
 Various Types of Signal

• Continuous-time (analog) and discrete-time signals

• Continuous valued and discrete valued signals
• Digital Signal (discrete-time and discrete amplitude)
• Multi-channel Signal
• Multi-dimensional Signal (1D, 2D, 3D…)
• Deterministic and random signals

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 4
 Analog Signal Processing
Most real-world signals are analog
– They are continuous in time and amplitude
– Convert to voltage or currents using sensors and
transducers

Analog signal processing examples

– Analog circuits: Resistors, Capacitors, Inductors,

Amplifiers,…
– Audio processing in FM radios
– Video processing in traditional TV sets

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
ELEC 442/6601Lecture-01-03 5
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
 Advantages of Digital Signal Processing
✓ Better Accuracy and tolerances, Less undesired nonlinearities)
✓ Better storage facility and scope of offline computation
✓ Flexibility to modify/reconfigure the design by simply changing
the programs (in analog SP, needs redesign, testing, verification)
✓ Opportunity for repeatability
✓ Less sensitive to electrical noise
✓ Ease of implementation
✓ Lower cost

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
ELEC 442/6601Lecture-01-03 6
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
 Digital Signal Processing
Represent signals by a sequence of numbers: Sampling or A/D conversions
Perform processing with a digital processor: Digital signal processing
Reconstruct analog signal: Reconstruction or digital-to-analog conversion
digital digital
signal signal
analog analog
signal A/D DSP D/A signal

Digital signals: discrete both in time and amplitude

-3 -2 -1 0 1 2 3 4
Sampling: A continuous to discrete-time conversion

Quantization: An interpretation of a continuous quantity by a

finite set of discrete values

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 7
 DSP Applications

Speech and Audio-Video

Compression, special effects, synthesis, recognition, echo cancellation,…
Cell Phones, MP3 Players, Movies, Dictation, Text-to-speech,…
DVD, JPEG, Movie special effects, video conferencing,…
Communication
Modulation, coding, detection, equalization, echo cancellation,…
Cell Phones, dial-up modem, DSL modem, Satellite Receiver,…
Automotive: ABS, GPS, Cruise Control, Parking,…
Medical: Magnetic Resonance, Electrocardiogram,…
Military: Radar, Sonar, Space photographs, remote sensing,…
Control: Motor control, process control, oil and mineral prospecting,…

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 8
 Analog Signal Processing
Most real-world signals are analog
– They are continuous in time and amplitude
– Convert to voltage or currents using sensors and transducers
Analog signal processing examples
– Analog circuits: Resistors, Capacitors, Inductors, Amplifiers,…
– Audio processing in FM radios
– Video processing in traditional TV sets

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 9
 Discrete-Time Signals: Sequences
• Discrete-time signals are represented by sequence of numbers
– The nth number in the sequence is represented with x[n]
• Often times sequences are obtained by sampling of continuous-time signals
– In this case x[n] is value of the analog signal at xa(nT)
– Where T is the sampling period
10

-10
0 20 40 60 80 100 t (ms)
10

-10
0 10 20 30 40 50 n (samples)
Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 10
 Discrete-Time Signal: Sampling

T = sampling interval or sampling

period (sec)
Fs = sampling rate (samples/sec) or
sampling frequency (Hz)

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 11
 Discrete-Time Representation of Sinusoid

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 12
 Discrete-Time Representation of Sinusoid

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 13
 Relationship CT Signal and DT Signal

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 14
 Discrete Time Frequency ( f )

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 15
 Discrete Time Frequency ( f )

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 16
 Finding f

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 17
 Example of Speech Signal: Sampling Frequency
Continuous time signal

Discrete time signal

Find the sampling frequency and sampling interval

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 18
 DSP Systems
digital digital
signal signal
analog analog
signal A/D DSP D/A signal

Analog input – analog output

– Digital recording of music
Analog input – digital output
– Touch tone phone dialing
Digital input – analog output
– Text to speech
Digital input – digital output
– Compression of a file on computer

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 19
 Discrete-Time Signals: Sequences
• Discrete-time signals are represented by sequence of numbers
– The nth number in the sequence is represented with x[n]
• Often times sequences are obtained by sampling of continuous-time signals
– In this case x[n] is value of the analog signal at xa(nT)
– Where T is the sampling period
10

-10
0 20 40 60 80 100 t (ms)
10

-10
0 10 20 30 40 50 n (samples)
Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
ELEC 442/6601Lecture-01-03 20
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
 Basic Sequences and Operations
• Delaying (Shifting) a sequence
y[n] = x[n − no ]
1.5

• Unit sample (impulse) sequence 1

0 n  0 0.5
 [ n] = 
1 n = 0
0
-10 -5 0 5 10
1.5

1
• Unit step sequence 0.5
0 n  0
u[n] =  0
1 n  0
-10 -5 0 5 10
1

0.5
• Exponential sequences
x[n] = A n 0
-10 -5 0 5 Fattah10

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 21
 Sinusoidal Sequences
Sinusoidal sequence xn = A cos(o n +  )

Complex sinusoid
x[n] = nu (n),   1
A = A e j ,  =  e jo
j o n
j
x[n] = A e  e = A  e j (o n + )
n n

x[n] = A  cos(o n +  ) + j A  sin(o n +  )

n n

A signal is periodic if x[n + N] = x[n]

x[n] = A cos(o n +  ) x[n] = A cos(o {n + N} +  )
cos((o + 2k )n +  ) = cos(o n +  )
cos(o n +  ) = cos(o n + o N +  )
2k
only if N = is an integer See Class Notes!!
o Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 22
 Discrete-Time Systems
• Discrete-Time Sequence is a mathematical operation that maps a given
input sequence x[n] into an output sequence y[n]

y[n] = T {x[n]} x[n] T{.} y[n]

• Example Discrete-Time Systems

– Moving (Running) Average
y[n] = x[n] + x[n − 1] + x[n − 2] + x[n − 3]
– Ideal Delay System
y[n] = x[n − no ]

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 23
 Memoryless System
• Memoryless System
– A system is memoryless if the output y[n] at every value of n
depends only on the input x[n] at the same value of n

y[n] = (x[n])
Example 2

y[n] = signx[n]

Counter example y[n] = x[n − no ]

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 24
 Linear Systems
• Linear System: A system is linear if and only if

T {x1[n] + x2 [n]} = T x1[n]+ T x2 [n] (additivity)

and
T ax[n] = aT x[n] (scaling)
Combined test
T {ax1[n] + bx2 [n]} = aT x1[n]+ bT x2 [n]

Example y[n] = x[n − no ]

T {x1[n] + x2 [n]} = x1[n − no ] + x2 [n − no ]
T {x1[n]} + T x2 [n] = x1[n − no ] + x2 [n − no ]
T ax1[n] = ax1[n − no ]
aT x1[n] = ax1[n − no ]
Counter example y[n] = exp (x[n]) See Class Notes!!
Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 25
 Time-Invariant Systems
• Time-Invariant (shift-invariant) Systems
– A time shift at the input causes corresponding time-shift at
output
y[n] = T{x[n]}  y[n − no ] = T x[n − no ]

Example (Squaring system)

y1 n = (x[n − no ])
2

y[n] = (x[n])
2 Delay the input the output is
yn - no  = (x[n − no ])
2
Delay the output gives

Counter Example (Compressor System)

y[n] = x[Mn] Delay the input the output is y1 n = x[ Mn − no ]

Delay the output gives yn - no  = xM (n − no )

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 26
 Causal System
• Causality
– A system is causal it’s output is a function of only the current
and previous samples

• Examples y[n] = x[n] − x[n − 1]

– Backward Difference

• Counter Example y[n] = x[n + 1] + x[n]

– Forward Difference

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 27
 Stable System
• Stability (in the sense of bounded-input bounded-output
BIBO)
– A system is stable if and only if every bounded input produces
a bounded outputx[n]  Bx    y[n]  By  

Example
y[n] = (x[n])
2

if input is bounded by x[n]  Bx  

output is bounded by y[n]  Bx2  

Counter example
y[n] = log10 ( x[n] )

even if input is bounded by x[n]  Bx  

output not bounded for xn = 0  y0  = log10 ( xn ) = −
Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 28
 Properties of LTI Systems
• Convolution is commutative
 
xk  hk  =  xk hn − k  =  hk xn − k  = hk  xk 
k = − k = −

x[n] h[n] y[n] h[n] x[n] y[n]

• Convolution is distributive

xk  (h1 k  + h2 k ) = xk  h1 k  + xk  h2 k 

h1[n]
x[n] + y[n] x[n] h1[n]+ h2[n] y[n]
h2[n]

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 29
 Properties of LTI Systems
• Cascade connection of LTI systems

x[n] h1[n] h2[n] y[n]

x[n] h2[n] h1[n] y[n]

x[n] h1[n]h2[n] y[n]

Fattah

Dr. Shaikh A. Fattah, Prof, Dept. of EEE, BUET Digital Signal Processing-I
Website: https://sites.google.com/site/drshaikhfattah/
Montreal, Quebec, Canada
Lecture-01-03 30