Lecture Slides
Lecture Slides
Edition 2020-05-ECE260
Michael D. Adams
To obtain the most recent version of these lecture slides or for additional information and resources
related to these slides (including errata and lecture videos), please visit:
http://www.ece.uvic.ca/~mdadams/sigsysbook
.NEXT
. . . . . . .SLIDE:
. . . . . . . .Course
. . . . . . . . .Introduction
..............
The author has taken care in the preparation of this document, but makes no expressed or implied warranty of any kind and assumes no
responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use
of the information or programs contained herein.
This document is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0) License. A copy
of this license can be found on page iii of this document. For a simple explanation of the rights granted by this license, see:
http://creativecommons.org/licenses/by-nc-nd/3.0/
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 iii
License II
License who has not previously violated the terms of this License with
respect to the Work, or who has received express permission from the
Licensor to exercise rights under this License despite a previous
violation.
h. "Publicly Perform" means to perform public recitations of the Work and
to communicate to the public those public recitations, by any means or
process, including by wire or wireless means or public digital
performances; to make available to the public Works in such a way that
members of the public may access these Works from a place and at a
place individually chosen by them; to perform the Work to the public
by any means or process and the communication to the public of the
performances of the Work, including by public digital performance; to
broadcast and rebroadcast the Work by any means including signs,
sounds or images.
i. "Reproduce" means to make copies of the Work by any means including
without limitation by sound or visual recordings and the right of
fixation and reproducing fixations of the Work, including storage of a
protected performance or phonogram in digital form or other electronic
medium.
2. Fair Dealing Rights. Nothing in this License is intended to reduce,
limit, or restrict any uses free from copyright or rights arising from
limitations or exceptions that are provided for in connection with the
copyright protection under copyright law or other applicable laws.
3. License Grant. Subject to the terms and conditions of this License,
Licensor hereby grants You a worldwide, royalty-free, non-exclusive,
perpetual (for the duration of the applicable copyright) license to
exercise the rights in the Work as stated below:
a. to Reproduce the Work, to incorporate the Work into one or more
Collections, and to Reproduce the Work as incorporated in the
Collections; and,
b. to Distribute and Publicly Perform the Work including as incorporated
in Collections.
The above rights may be exercised in all media and formats whether now
known or hereafter devised. The above rights include the right to make
such modifications as are technically necessary to exercise the rights in
other media and formats, but otherwise you have no rights to make
Adaptations. Subject to 8(f), all rights not expressly granted by Licensor
are hereby reserved, including but not limited to the rights set forth in
Section 4(d).
4. Restrictions. The license granted in Section 3 above is expressly made
subject to and limited by the following restrictions:
a. You may Distribute or Publicly Perform the Work only under the terms
of this License. You must include a copy of, or the Uniform Resource
Identifier (URI) for, this License with every copy of the Work You
Distribute or Publicly Perform. You may not offer or impose any terms
on the Work that restrict the terms of this License or the ability of
the recipient of the Work to exercise the rights granted to that
recipient under the terms of the License. You may not sublicense the
Work. You must keep intact all notices that refer to this License and
to the disclaimer of warranties with every copy of the Work You
Distribute or Publicly Perform. When You Distribute or Publicly
Perform the Work, You may not impose any effective technological
measures on the Work that restrict the ability of a recipient of the
Work from You to exercise the rights granted to that recipient under
the terms of the License. This Section 4(a) applies to the Work as
incorporated in a Collection, but this does not require the Collection
apart from the Work itself to be made subject to the terms of this
License. If You create a Collection, upon notice from any Licensor You
must, to the extent practicable, remove from the Collection any credit
as required by Section 4(c), as requested.
b. You may not exercise any of the rights granted to You in Section 3
above in any manner that is primarily intended for or directed toward
commercial advantage or private monetary compensation. The exchange of
the Work for other copyrighted works by means of digital file-sharing
or otherwise shall not be considered to be intended for or directed
toward commercial advantage or private monetary compensation, provided
there is no payment of any monetary compensation in connection with
the exchange of copyrighted works.
c. If You Distribute, or Publicly Perform the Work or Collections, You
must, unless a request has been made pursuant to Section 4(a), keep
intact all copyright notices for the Work and provide, reasonable to
the medium or means You are utilizing: (i) the name of the Original
Author (or pseudonym, if applicable) if supplied, and/or if the
Original Author and/or Licensor designate another party or parties
(e.g., a sponsor institute, publishing entity, journal) for
attribution ("Attribution Parties") in Licensor’s copyright notice,
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 vii
License VI
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 viii
License VII
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 xii
Part 0
Preface
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 xiii
About These Lecture Slides
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 xiv
Typesetting Conventions
In a definition, the term being defined is often typeset in a font like this.
To emphasize particular words, the words are typeset in a font like this.
Introduction
audio).
2 A signal with more than one independent variable is said to be
multi-dimensional (e.g., image).
Continuous or discrete independent variables:
2 A signal with continuous independent variables is said to be continuous
x(t) x(n)
3 3
2 2
1 1
t n
−30 −20 −10 0 10 20 30 −3 −2 −1 0 1 2 3
x0 y0
x1 y1
x2 System y2
.. .. .. ..
. . . .
xM yN
|{z} |{z}
Input Signals Output Signals
Number of inputs:
2 A system with one input is said to be single input (SI).
2 A system with more than one input is said to be multiple input (MI).
Number of outputs:
2 A system with one output is said to be single output (SO).
2 A system with more than one output is said to be multiple output (MO).
Discrete-Time Discrete-Time
Input Signal Signal Output
Continuous-Time Before After Continuous-Time
Signal Continuous-to- Processing Processing Discrete-to- Signal
Discrete-Time
Discrete-Time Continuous-Time
System
(C/D) Converter (D/C) Converter
Continuous-Time Continuous-Time
Input Signal Signal Output
Discrete-Time Before After Discrete-Time
Signal Discrete-to- Processing Processing Continuous-to- Signal
Continuous-Time
Continuous-Time Discrete-Time
System
(D/C) Converter (C/D) Converter
Estimate of
Message Transmitted Received Message
Signal Signal Signal Signal
Transmitter Channel Receiver
Reference
Input Error Output
+ Controller Plant
−
Sensor
Feedback
Signal
.NEXT
. . . . . . .SLIDE:
Copyright .Complex
. . . . . . . . . . .Analysis
. . . .c. . .2013–2020 . . . . . . . . . D. Adams
Michael Signals and Systems Edition 2020-05-ECE260 12
Part 2
Preliminaries
For two integers a and b, we define the following notation for sets of
consecutive integers:
[a . . b] = {x ∈ Z : a ≤ x ≤ b},
[a . . b) = {x ∈ Z : a ≤ x < b},
(a . . b] = {x ∈ Z : a < x ≤ b}, and
(a . . b) = {x ∈ Z : a < x < b}.
In this notation, a and b indicate the endpoints of the range for the set,
and the type of brackets used (i.e., parenthesis versus square bracket)
indicate whether each endpoint is included in the set.
For example:
2 [0 . . 4] denotes the set of integers {0, 1, 2, 3, 4};
2 [0 . . 4) denotes the set of integers {0, 1, 2, 3}; and
[a, b] = {x ∈ R : a ≤ x ≤ b},
(a, b) = {x ∈ R : a < x < b},
[a, b) = {x ∈ R : a ≤ x < b}, and
(a, b] = {x ∈ R : a < x ≤ b}.
In this notation, a and b indicate the endpoints of the interval for the set,
and the type of brackets used (i.e., parenthesis versus square bracket)
indicate whether each endpoint is included in the set.
For example:
2 [0, 100] denotes the set of all real numbers from 0 to 100, including both 0
and 100;
2 (−π, π] denotes the set of all real numbers from −π to π, excluding −π but
including π; and
2 [−π, π) denotes the set of all real numbers from −π to π, including −π but
excluding π.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 17
Mappings
.Example
. . . . . . . . . .2.2
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 19
Sequences
A sequence is a mapping where the domain is a set that is discrete in
nature, such as the integers, or a subset thereof.
In practice, the codomain is typically either the real numbers or complex
numbers.
Sequences are also commonly referred to as discrete-time (DT) signals.
Example:
2 Let f : Z+ → Z+ such that f (n) = n2 , where Z+ denotes the set of
To express that two functions f and g are equal, we can write either:
1 f = g; or
2 f (t) = g(t) for all t .
Of the preceding two expressions, the first (i.e., f = g) is usually
preferable, as it is less verbose.
For the functions f and g and an operation ◦ that is defined pointwise for
functions (such as addition, subtraction, multiplication, and division), the
following relationship holds:
functions mapping R to R.
2 The system H maps a function to a function.
2 In particular, the domain and codomain are each F , which is a set of
functions.
2 The system H multiplies its input function x by a factor of 2 in order to
produce its output function Hx.
2 Note that Hx is a function, not a number.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 23
Remarks on Operator Notation for CT Systems
For a system operator H and a function x, Hx is the function produced as
the output of the system H when the input is the function x.
Brackets around the operand of an operator are often omitted when not
required for grouping.
For example, for an operator H, a function x, and a real number t , we
would normally prefer to write:
1 Hx instead of the equivalent expression H(x); and
.Example
. . . . . . . . . .2.6
Copyright .Example
.c. . 2013–2020 . .2.7
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 24
Remarks on Operator Notation for DT Systems
SKIP SLIDE
Properties of Signals
2 2
1 1
t n
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
2 2
1 1
t n
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
4
... ... 3
t ··· 2 ···
−2T −T T 2T
1
n
−4 −3 −2 −1 0 1 2 3 4 5 6 7
The period of a periodic signal is not unique. That is, a signal that is
periodic with period T is also periodic with period kT , for every (strictly)
positive integer k.
x(t)
2T 2T
... ...
t
−2T −T T 2T
T T
Time shifting (also called translation) maps the input function x to the
output function y as given by
x(t)
t
−3 −2 −1 0 1 2 3
x(t − 1) x(t + 1)
3 3
2 2
1 1
t t
−3 −2 −1 0 1 2 3 −3 −2 −1 0 1 2 3
Time reversal (also known as reflection) maps the input function x to the
output function y as given by
y(t) = x(−t).
Geometrically, the output function y is a reflection of the input function x
about the (vertical) line t = 0.
x(t) x(−t)
3 3
2 2
1 1
t t
−3 −2 −1 0 1 2 3 −3 −2 −1 0 1 2 3
y(t) = x(at),
x(t)
t
−2 −1 0 1 2
x(2t) x(t/2)
1 1
t t
−2 −1 0 1 2 −2 −1 0 1 2
Time scaling maps the input function x to the output function y as given by
y(t) = x(at),
x(t) x(2t)
1 1
t t
−2 −1 0 1 2 −2 −1 0 1 2
x(t/2) x(−t)
1 1
t t
−2 −1 0 1 2 −2 −1 0 1 2
2 first, time scaling x by a, and then time shifting the result by b/a.
Note that the time shift is not by the same amount in both cases.
In particular, note that when time scaling is applied first followed by time
shifting, the time shift is by b/a, not b.
.Exercise
. . . . . . . . . .3.3
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 44
Combined Time Scaling and Time Shifting: Example
time shift by 1 and then time scale by 2
− 12 1
Given x as shown −1 1 2 3
t
−2 −1
2
1 3 2
t
2
below, find −1 −1
y(t) = x(2t − 1).
x(t)
1
1 1
− 12 1
t 2
3 t
−2 −1 1 2 −2 −1 1 2
2
−1 −1
1 1
t t
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
1 x(t) −2x(t)
2
2 2
1 1
t t
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
y(t) = x(t) + b,
1 1
t t
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
y(t) = ax(t) + b,
y(t) = a x(t) + ba .
function by b; or
2 first amplitude shifting x by b/a, and then amplitude scaling the resulting
function by a.
Properties of Functions
Sums involving even and odd functions have the following properties:
2 The sum of two even functions is even.
2 The sum of two odd functions is odd.
2 The sum of an even function and odd function is neither even nor odd,
provided that neither of the functions is identically zero.
That is, the sum of functions with the same type of symmetry also has the
same type of symmetry.
Products involving even and odd functions have the following properties:
2 The product of two even functions is even.
2 The product of two odd functions is even.
2 The product of an even function and an odd function is odd.
That is, the product of functions with the same type of symmetry is even,
while the product of functions with opposite types of symmetry is odd.
.Theorem
. . . . . . . . . . 3.1
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 52
Sum of Periodic Functions
.Example
. . . . . . . . . .3.2
Copyright .Example
.c. . 2013–2020 . .3.4
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 53
Right-Sided Functions
A function x is said to be right sided if, for some (finite) real constant t0 ,
the following condition holds:
x(t) = 0 for all t < t0
(i.e., x is only potentially nonzero to the right of t0 ).
An example of a right-sided function is shown below.
x(t)
···
t
t0
···
t
t0
x(t)
t
t0 t1
A function that is neither left sided nor right sided is said to be two sided.
An example of a two-sided function is shown below.
x(t)
···
···
Elementary Functions
A cos θ
x(t) = Aeλt ,
A A A
t t t
x(t) = Ae jωt ,
Thus, Re{x} and Im{x} are the same except for a time shift.
2π
Also, x is periodic with fundamental period T = |ω| and fundamental
frequency |ω|.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 63
Complex Sinusoidal Functions (Continued)
The graphs of Re{x} and Im{x} have the forms shown below.
|A| |A|
|A| cos θ
t t
|A| sin θ
− |A|
− |A|
2
Im
Re
−4 2
1 1.5
−3
−2 1
−1 0.5
ω = −2π
−0.5 1
−1 2
−1
−1.5 3 t
−2 4
−2
Thus, Re{x} and Im{x} are each the product of a real exponential and
real sinusoid.
One of three distinct modes of behavior is exhibited by x(t), depending on
the value of σ.
If σ = 0, Re{x} and Im{x} are real sinusoids.
If σ > 0, Re{x} and Im{x} are each the product of a real sinusoid and a
growing real exponential.
If σ < 0, Re{x} and Im{x} are each the product of a real sinusoid and a
decaying real exponential.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 66
General Complex Exponential Functions (Continued)
The three modes of behavior for Re{x} and Im{x} are illustrated below.
|A| eσt
|A| eσt
|A| eσt
t t t
Due to the manner in which u is used in practice, the actual value of u(0)
is unimportant. Sometimes values of 0 and 21 are also used for u(0).
A plot of this function is shown below.
u(t)
1 ···
··· −1 0 1
t
From its definition, one can see that the signum function simply computes
the sign of a number.
A plot of this function is shown below.
sgnt
1 ···
t
−3 −2 −1 1 2 3
··· −1
rectt
1
t
− 12 0 1
2
trit
1
t
− 12 0 1
2
The floor function, denoted b·c, is a function that maps a real number x
to the largest integer not more than x.
In other words, the floor function rounds a real number to the nearest
integer in the direction of negative infinity.
For example,
1 1
− 2 = −1, 2 = 0, and b1c = 1.
The ceiling function, denoted d·e, is a function that maps a real number x
to the smallest integer not less than x.
In other words, the ceiling function rounds a real number to the nearest
integer in the direction of positive infinity.
For example,
1 1
− 2 = 0, 2 = 1, and d1e = 1.
t t
0 0 t0
t
− 2ε 0 ε
2
.Example
. . . . . . . . . .3.8
Copyright .Example
.c. . 2013–2020 . .3.9
. . . . . . . . Michael
... .Example
D. . . . . . . . .3.10
. .Adams .NEXT
. . . . Signals . .SLIDE
. . . . .and . . .Systems
... Edition 2020-05-ECE260 78
Graphical Interpretation of Equivalence Property
δ(t − t0 )
x(t)
1
x(t0 )
t
t t0
t0
Time-Shifted Unit-Impulse
Function x
Function
x(t)δ(t − t0 )
x(t0 )
t
t0
Product
.Example
. . . . . . . . . .3.11
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 80
Representing Functions Using Unit-Step Functions
The idea from the previous slide can be extended to handle any function
that is defined in a piecewise manner (i.e., via an expression involving
multiple cases).
That is, by using unit-step functions, we can always collapse a formula
involving multiple cases into a single expression.
Often, simplifying a formula in this way can be quite beneficial.
.Example
. . . . . . . . . .3.12
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 81
Section 3.4
y = Hx,
x → y.
Note that the symbols “→” and “=” have very different meanings.
The symbol “→” should be read as “produces” (not as “equals”).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 83
Block Diagram Representations
Often, a system defined by the operator H and having the input x and
output y is represented in the form of a block diagram as shown below.
Input Output
x System y
H
y = H2 H1 x.
A parallel connection ties the inputs of both systems together and sums
their outputs.
The overall parallel-connected system is described by the equation
y = H1 x + H2 x.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 85
Section 3.5
t
−∞ t0 ∞
.Example
. . . . . . . . . .3.15
Copyright .Example
.c. . .2013–2020 . . .3.16
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 88
Causality
A system H is said to be causal if, for every real constant t0 , Hx(t0 ) does
not depend on x(t) for some t > t0 .
In other words, a causal system is such that the value of its output at any
given point in time can depend on the value of its input at only the same or
earlier points in time (i.e., not later points in time).
If the independent variable t represents time, a system must be causal in
order to be physically realizable.
Noncausal systems can sometimes be useful in practice, however, since
the independent variable need not always represent time (e.g., the
independent variable might represent position).
A memoryless system is always causal, although the converse is not
necessarily true.
t ≤ t0
t
−∞ t0 ∞
.Example
. . . . . . . . . .3.19
Copyright .Example
.c. . .2013–2020 . . .3.20
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 90
Invertibility
The inverse of a system H (if it exists) is another system H−1 such that,
for every function x,
H−1 Hx = x
(i.e., the system formed by the cascade interconnection of H followed by
H−1 is a system whose input and output are equal).
A system is said to be invertible if it has a corresponding inverse system
(i.e., its inverse exists).
Equivalently, a system is invertible if its input can always be uniquely
determined from its output.
An invertible system will always produce distinct outputs from any two
distinct inputs (i.e., x1 6= x2 ⇒ Hx1 6= Hx2 ).
To show that a system is invertible, we simply find the inverse system.
To show that a system is not invertible, we find two distinct inputs that
result in identical outputs (i.e., x1 6= x2 and Hx1 = Hx2 ).
In practical terms, invertible systems are “nice” in the sense that their
effects can be undone.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 91
Invertibility (Continued)
A system H−1 being the inverse of H means that the following two
systems are equivalent (i.e., H−1 H is an identity):
x y x y
H H−1
.Example
. . . . . . . . . .3.23
Copyright .Example
.c. . .2013–2020 . . .3.24
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 92
Bounded-Input Bounded-Output (BIBO) Stability
A system H is said to be bounded-input bounded-output (BIBO)
stable if, for every bounded function x, Hx is bounded (i.e., |x(t)| < ∞ for
all t implies that |Hx(t)| < ∞ for all t ).
In other words, a BIBO stable system is such that it guarantees to always
produce a bounded output as long as its input is bounded.
To show that a system is BIBO stable, we must show that every bounded
input leads to a bounded output.
To show that a system is not BIBO stable, we only need to find a single
bounded input that leads to an unbounded output.
In practical terms, a BIBO stable system is well behaved in the sense that,
as long as the system input is finite everywhere (in its domain), the output
will also be finite everywhere.
Usually, a system that is not BIBO stable will have serious safety issues.
For example, a portable music player with a battery input of 3.7 volts and
headset output of ∞ volts would result in one vaporized human (and likely
a big lawsuit as well).
.Example
. . . . . . . . . .3.27
Copyright .Example
.c. . .2013–2020 . . .3.28
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 93
Time Invariance (TI)
A system H is said to be time invariant (TI) (or shift invariant (SI)) if,
for every function x and every real constant t0 , the following condition
holds:
Hx(t − t0 ) = Hx0 (t) for all t, where x0 (t) = x(t − t0 )
(i.e., H commutes with time shifts).
In other words, a system is time invariant if a time shift (i.e., advance or
delay) in the input always results only in an identical time shift in the
output.
A system that is not time invariant is said to be time varying.
In simple terms, a time invariant system is a system whose behavior does
not change with respect to time.
Practically speaking, compared to time-varying systems, time-invariant
systems are much easier to design and analyze, since their behavior
does not change with respect to time.
Let St0 denote an operator that applies a time shift of t0 to a function (i.e.,
St0 x(t) = x(t − t0 )).
A system H is time invariant if and only if the following two systems are
equivalent (i.e., H commutes with St0 ):
x y
St0 H x y
H St0
.Example
. . . . . . . . . .3.32
Copyright .Example
.c. . .2013–2020 . . .3.33
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 95
Additivity, Homogeneity, and Linearity
A system H is said to be additive if, for all functions x1 and x2 , the
following condition holds:
H(x1 + x2 ) = Hx1 + Hx2
(i.e., H commutes with addition).
A system H is said to be homogeneous if, for every function x and every
complex constant a, the following condition holds:
H(ax) = aHx
(i.e., H commutes with scalar multiplication).
A system that is both additive and homogeneous is said to be linear.
In other words, a system H is linear, if for all functions x1 and x2 and all
complex constants a1 and a2 , the following condition holds:
H(a1 x1 + a2 x2 ) = a1 Hx1 + a2 Hx2
(i.e., H commutes with linear combinations).
The linearity property is also referred to as the superposition property.
Practically speaking, linear systems are much easier to design and
analyze than nonlinear systems.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 96
Additivity, Homogeneity, and Linearity (Continued 1)
The system H is additive if and only if the following two systems are
equivalent (i.e., H commutes with addition):
x1 y x1 y
+ H H +
x2 x2
H
System 1: y = H(x1 + x2 )
System 2: y = Hx1 + Hx2
x y x y
a H H a
The system H is linear if and only if the following two systems are
equivalent (i.e., H commutes with linear combinations):
x1 y x1 y
a1 + H H a1 +
x2 x2
a2 H a2
.Example
. . . . . . . . . .3.35
Copyright .Example
.c. . .2013–2020 . . .3.36
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 98
Eigenfunctions of Systems
.Example
. . . . . . . . . .3.41
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 99
Part 4
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 100
Why Linear Time-Invariant (LTI) Systems?
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 101
Section 4.1
Convolution
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 102
CT Convolution
.Example
. . . . . . . . . .X.4.1
Copyright .c. . .2013–2020
. Michael D. Adams Signals and Systems Edition 2020-05-ECE260 103
Practical Convolution Computation
we proceed as follows:
1 Plot x(τ) and h(t − τ) as a function of τ.
2 Initially, consider an arbitrarily large negative value for t . This will result in
h(t − τ) being shifted very far to the left on the time axis.
3 Write the mathematical expression for x ∗ h(t).
4 Increase t gradually until the expression for x ∗ h(t) changes form. Record
the interval over which the expression for x ∗ h(t) was valid.
5 Repeat steps 3 and 4 until t is an arbitrarily large positive value. This
corresponds to h(t − τ) being shifted very far to the right on the time axis.
6 The results for the various intervals can be combined in order to obtain an
expression for x ∗ h(t) for all t .
.Example
. . . . . . . . . .4.1
Copyright .Exercise
.c. . 2013–2020 . .4.18(u)
. . . . . . . . Michael
. . . . . . . D. Adams Signals and Systems Edition 2020-05-ECE260 104
Properties of Convolution
The convolution operation is commutative. That is, for any two functions x
and h,
x ∗ h = h ∗ x.
The convolution operation is associative. That is, for any functions x, h1 ,
and h2 ,
(x ∗ h1 ) ∗ h2 = x ∗ (h1 ∗ h2 ).
The convolution operation is distributive with respect to addition. That is,
for any functions x, h1 , and h2 ,
x ∗ (h1 + h2 ) = x ∗ h1 + x ∗ h2 .
.Theorem
. . . . . . . . . . 4.1
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 105
Representation of Functions Using Impulses
x ∗ δ = x.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 106
Periodic Convolution
SKIP SLIDE
(i.e., x0 (t) equals x(t) over a single period of x and is zero elsewhere).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 107
Section 4.2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 108
Impulse Response
The response h of a system H to the input δ is called the impulse
response of the system (i.e., h = Hδ).
For any LTI system with input x, output y, and impulse response h, the
following relationship holds:
y = x ∗ h.
In other words, a LTI system simply computes a convolution.
Furthermore, a LTI system is completely characterized by its impulse
response.
That is, if the impulse response of a LTI system is known, we can
determine the response of the system to any input.
Since the impulse response of a LTI system is an extremely useful
quantity, we often want to determine this quantity in a practical setting.
Unfortunately, in practice, the impulse response of a system cannot be
determined directly from the definition of the impulse response.
.Theorem
. . . . . . . . . . 4.5
Copyright .Example
.c. . 2013–2020 . .4.5
. . . . . . . .Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 109
Step Response
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 110
Block Diagram Representation of LTI Systems
x y
h
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 111
Interconnection of LTI Systems
x y x y
h1 h2 ≡ h1 ∗ h2
x y
h1 +
x y
≡ h1 + h2
h2
.Example
. . . . . . . . . .4.7
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 112
Section 4.3
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 113
Memory
A LTI system with impulse response h is memoryless if and only if
h(t) = Kδ(t),
y = x ∗ (Kδ) = Kx
.Example
. . . . . . . . . .4.8
Copyright .Example
.c. . 2013–2020 . .4.9
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 114
Causality
a causal function.
.Example
. . . . . . . . . .4.10
Copyright .Example
.c. . .2013–2020 . . .4.11
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 115
Invertibility
h ∗ hinv = δ.
Consequently, a LTI system with impulse response h is invertible if and
only if there exists a function hinv such that
h ∗ hinv = δ.
Except in simple cases, the above condition is often quite difficult to test.
.Example
. . . . . . . . . .4.12
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 116
BIBO Stability
.Example
. . . . . . . . . .4.14
Copyright .Example
.c. . .2013–2020 . . .4.15
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 117
Eigenfunctions of LTI Systems
As it turns out, every complex exponential is an eigenfunction of all LTI
systems.
For a LTI system H with impulse response h,
.Corollary
. . . . . . . . . . .of
Copyright
Theorem
. . . . . . . . . . 4.12
c. . .2013–2020 ... .Example
. . Michael. .D. . . . . .4.16
. . .Adams .... Signals and Systems Edition 2020-05-ECE260 119
Part 5
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 120
Introduction
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 121
Section 5.1
Fourier Series
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 122
Harmonically-Related Complex Sinusoids
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 123
CT Fourier Series
A periodic (complex-valued) function x with fundamental period T and
fundamental frequency ω0 = 2π T can be represented as a linear
combination of harmonically-related complex sinusoids as
∞
x(t) = ∑ ck e jkω0t .
k=−∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 124
CT Fourier Series (Continued)
1
Z
ck = x(t)e− jkω0t dt,
T T
.Example
. . . . . . . . . .5.1
Copyright .Example
.c. . 2013–2020 . .5.3
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 125
Section 5.2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 126
Remarks on Equality of Functions
The equality of functions can be defined in more than one way.
Two functions x and y are said to be equal in the pointwise sense if
x(t) = y(t) for all t (i.e., x and y are equal at every point).
Two functions x and y are said to be equal in the mean-squared error
(MSE) sense if |x(t) − y(t)|2 dt = 0 (i.e., the energy in x − y is zero).
R
Again, let xN denote the Fourier series for the periodic function x truncated
after the N th harmonic components as given by
N
xN (t) = ∑ ck e jkω0t .
k=−N
If limN→∞ xN (t) = x(t) for all t (i.e., limN→∞ xN is equal to x in the
pointwise sense), the Fourier series is said to converge pointwise to x.
If convergence is pointwise and the rate of convergence is the same
everywhere, the convergence is said to be uniform.
If limN→∞ 1 2
T T |xN (t) − x(t)| dt = 0 (i.e., limN→∞ xN is equal to x in the
R
MSE sense), the Fourier series is said to converge to x in the MSE sense.
Pointwise convergence is a stronger condition than MSE convergence
(i.e., pointwise convergence implies MSE convergence, but the converse
is not true).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 128
Convergence of Fourier Series: Continuous Case
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 129
Convergence of Fourier Series: Finite-Energy Case
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 130
Dirichlet Conditions
The Dirichlet conditions for the periodic function x are as follows:
1 over a single period, x is absolutely integrable (i.e.,
T |x(t)| dt < ∞);
R
2 over a single period, x has a finite number of maxima and minima (i.e., x is
which is finite.
Examples of functions violating the Dirichlet conditions are shown below.
x(t)
x(t)
1/t
t
1 2
sin(2π/t)
t
0 1
x(t)
··· ···
1
2
1
4
··· ···
t
−1 0 1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 131
Convergence of Fourier Series: Dirichlet Case
where x(ta− ) and x(ta+ ) denote the values of the function x on the left- and
right-hand sides of the discontinuity, respectively.
Since most functions tend to satisfy the Dirichlet conditions and the above
convergence result specifies the value of the Fourier series at every point,
this result is often very useful in practice.
.Example
. . . . . . . . . .5.6
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 132
Gibbs Phenomenon
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 133
Gibbs Phenomenon: Periodic Square Wave Example
1.5 1.5
1 1
0.5 0.5
0 0
-1 -0.5 0 0.5 1 -1 -0.5 0 0.5 1
-0.5 -0.5
-1 -1
-1.5 -1.5
Fourier series truncated after the Fourier series truncated after the
3rd harmonic components 7th harmonic components
1.5 1.5
1 1
0.5 0.5
0 0
-1 -0.5 0 0.5 1 -1 -0.5 0 0.5 1
-0.5 -0.5
-1 -1
-1.5 -1.5
Fourier series truncated after the Fourier series truncated after the
11th harmonic components 101st harmonic components
.Annotated
. . . . . . . . . . .c.example
Copyright . .2013–2020
....... Michael D. Adams Signals and Systems Edition 2020-05-ECE260 134
Section 5.3
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 135
Properties of (CT) Fourier Series
CTFS CTFS
x(t) ←→ ak and y(t) ←→ bk
Property
Parseval’s Relation 1R
T T |x(t)|2 dt = ∑∞
k=−∞ |ak |
2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 136
Linearity
CTFS
Let x and y be two periodic functions with the same period. If x(t) ←→ ak
CTFS
and y(t) ←→ bk , then
CTFS
αx(t) + βy(t) ←→ αak + βbk ,
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 137
Time Shifting (Translation)
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 138
Frequency Shifting (Modulation)
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 139
Time Reversal (Reflection)
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 140
Conjugation
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 141
Periodic Convolution
SKIP SLIDE
x ~ y(t) ←→ Tak bk .
CTFS
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 142
Multiplication
SKIP SLIDE
CTFS
Let x and y be two periodic functions with the same period. If x(t) ←→ ak
CTFS
and y(t) ←→ bk , then
∞
CTFS
x(t)y(t) ←→ ∑ an bk−n
n=−∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 143
Parseval’s Relation
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 144
Even and Odd Symmetry
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 145
Real Functions
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 146
Trigonometric Forms of a Fourier Series
where θk = arg ck .
The trigonometric form of a Fourier series has the appearance
∞
x(t) = c0 + ∑ [αk cos(kω0t) + βk sin(kω0t)] ,
k=1
where αk = 2 Re ck and βk = −2 Im ck .
Note that the trigonometric forms contain only real quantities.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 147
Other Properties of Fourier Series
.Zeroth
. . . . . . . .Coefficient
Copyright . . .c. . .2013–2020
...... Michael D. Adams Signals and Systems Edition 2020-05-ECE260 148
Section 5.4
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 149
A New Perspective on Functions: The Frequency Domain
The Fourier series provides us with an entirely new way to view functions.
Instead of viewing a function as having information distributed with respect
to time (i.e., a function whose domain is time), we view a function as
having information distributed with respect to frequency (i.e., a function
whose domain is frequency).
This so called frequency-domain perspective is of fundamental
importance in engineering.
Many engineering problems can be solved much more easily using the
frequency domain than the time domain.
The Fourier series coefficients of a function x provide a means to quantify
how much information x has at different frequencies.
The distribution of information in a function over different frequencies is
referred to as the frequency spectrum of the function.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 150
Motivating Example
Consider the real 1-periodic function x having the Fourier series
representation
t
−1 − 12 1 1
2
− 12
−1
The terms that make the most dominant contribution to the overall sum
are the ones with the largest magnitude coefficients.
To illustrate this, we consider the problem of determining the best
approximation of x that keeps only 4 of the 8 terms in the Fourier series.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 151
Motivating Example (Continued)
approximation
1 x(t)
1
2
t
−1 − 12 1 1
2
− 12
−1
approximation
1 x(t)
1
2
t
−1 − 12 1 1
2
− 12
−1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 152
Fourier Series and Frequency Spectra
To gain further insight into the role played by the Fourier series coefficients
ck in the context of the frequency spectrum of the function x, it is helpful to
write the Fourier series with the ck expressed in polar form as follows:
∞ ∞
x(t) = ∑ ck e jkω0t = ∑ |ck | e j(kω0t+arg ck ) .
k=−∞ k=−∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 153
Fourier Series and Frequency Spectra (Continued)
.Example
. . . . . . . . . .5.7
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 154
Frequency Spectra of Real Functions
Recall that, for a real function x, the Fourier series coefficient sequence c
satisfies
ck = c∗−k
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 156
Frequency Response
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 157
Fourier Series and LTI Systems
Thus, if the input x to a LTI system is a Fourier series, the output y is also
CTFS CTFS
a Fourier series. More specifically, if x(t) ←→ ck then y(t) ←→ H(kω0 )ck .
The above formula can be used to determine the output of a LTI system
from its input in a way that does not require convolution.
.Example
. . . . . . . . . .5.9
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 158
Filtering
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 159
Ideal Lowpass Filter
An ideal lowpass filter eliminates all frequency components with a
frequency whose magnitude is greater than some cutoff frequency, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response of the form
(
1 |ω| ≤ ωc
H(ω) =
0 otherwise,
where ωc is the cutoff frequency.
A plot of this frequency response is given below.
H(ω)
ω
−ωc ωc
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 160
Ideal Highpass Filter
An ideal highpass filter eliminates all frequency components with a
frequency whose magnitude is less than some cutoff frequency, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response of the form
(
1 |ω| ≥ ωc
H(ω) =
0 otherwise,
where ωc is the cutoff frequency.
A plot of this frequency response is given below.
H(ω)
1
··· ···
ω
−ωc ωc
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 161
Ideal Bandpass Filter
An ideal bandpass filter eliminates all frequency components with a
frequency whose magnitude does not lie in a particular range, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response of the form
(
1 ωc1 ≤ |ω| ≤ ωc2
H(ω) =
0 otherwise,
ω
−ωc2 −ωc1 ωc1 ωc2
.Example
. . . . . . . . . .5.10
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 162
Part 6
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 163
Motivation for the Fourier Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 164
Section 6.1
Fourier Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 165
Development of the Fourier Transform [Aperiodic Case]
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 166
Development of the Fourier Transform [Aperiodic Case] (Continued)
1
becomes 2π dω, and k(2π/T ) = kω0 becomes ω).
This representation for aperiodic functions is known as the Fourier
transform representation.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 167
Generalized Fourier Transform
The
R ∞ classical Fourier transform for aperiodic functions does not exist (i.e.,
x(t)e − jωt dt fails to converge) for some functions of great practical
−∞
interest, such as:
2 a nonzero constant function;
2 a periodic function (e.g., a real or complex sinusoid);
2 the unit-step function (i.e., u); and
2 the signum function (i.e., sgn).
Fortunately, the Fourier transform can be extended to handle such
functions, resulting in what is known as the generalized Fourier
transform.
For our purposes, we can think of the classical and generalized Fourier
transforms as being defined by the same formulas.
Therefore, in what follows, we will not typically make a distinction between
the classical and generalized Fourier transforms.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 168
CT Fourier Transform (CTFT)
The (CT) Fourier transform of the function x, denoted Fx or X , is given
by
Z ∞
Fx(ω) = X(ω) = x(t)e− jωt dt.
−∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 170
Remarks on Dot Notation
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 171
Remarks on Notational Conventions
SKIP SLIDE
Since dot notation is less frequently used by engineers, the author has
elected to minimize its use herein.
To avoid ambiguous notation, the following conventions are followed:
1 in the expression for the operand of a Fourier transform operator, the
independent variable is assumed to be the variable named “t” unless
otherwise indicated (i.e., in terms of dot notation, each “t ” is treated as if it
were a “·”)
2 in the expression for the operand of the inverse Fourier transform operator,
the independent variable is assumed to be the variable named “ω” unless
otherwise indicated (i.e., in terms of dot notation, each “ω” is treated as if it
were a “·”).
For example, with these conventions:
2 “F{cos(t − τ)}” denotes the function that is the Fourier transform of the
of the function V (ω) = δ(3ω − λ) (not the inverse Fourier transform of the
function V (λ) = δ(3ω − λ)).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 172
Section 6.2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 173
Convergence of the Fourier Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 174
Convergence of the Fourier Transform: Continuous Case
SKIP SLIDE
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 175
Convergence of the Fourier Transform: Finite-Energy Case
2
If a function x is of finite energy (i.e., −∞ |x(t)| dt < ∞), then its Fourier
R∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 176
Dirichlet Conditions
The Dirichlet conditions for the function x are as follows:
1 the function x is absolutely integrable (i.e.,
−∞ |x(t)| dt < ∞);
R∞
2 on any finite interval, x has a finite number of maxima and minima (i.e., x is
10 ··· t
−1.25 −1 −0.75 −0.5 −0.25 0.25 0.5 0.75 1 1.25
···t −1
0.5 1
0.75
0.5
0.25
···
t
0.25 0.5 0.75 1
x(ta ) + x(ta− ) ,
1
+
x̃(ta ) = 2
where x(ta− ) and x(ta+ ) denote the values of the function x on the left- and
right-hand sides of the discontinuity, respectively.
Since most functions tend to satisfy the Dirichlet conditions and the above
convergence result specifies the value of the Fourier transform
representation at every point, this result is often very useful in practice.
.Example
. . . . . . . . . .6.6
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 177
Section 6.3
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 178
Properties of the (CT) Fourier Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 179
Properties of the (CT) Fourier Transform (Continued)
Property
2 1 R∞ 2
Parseval’s Relation
R∞
−∞ |x(t)| dt = 2π −∞ |X(ω)| dω
Even Symmetry x is even ⇔ X is even
Odd Symmetry x is odd ⇔ X is odd
Real / Conjugate Symmetry x is real ⇔ X is conjugate symmetric
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 180
(CT) Fourier Transform Pairs
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 181
Linearity
CTFT CTFT
If x1 (t) ←→ X1 (ω) and x2 (t) ←→ X2 (ω), then
CTFT
a1 x1 (t) + a2 x2 (t) ←→ a1 X1 (ω) + a2 X2 (ω),
.Example
. . . . . . . . . .6.7
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 182
Time-Domain Shifting (Translation)
CTFT
If x(t) ←→ X(ω), then
CTFT
x(t − t0 ) ←→ e− jωt0 X(ω),
.Example
. . . . . . . . . .6.9
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 183
Frequency-Domain Shifting (Modulation)
CTFT
If x(t) ←→ X(ω), then
CTFT
e jω0t x(t) ←→ X(ω − ω0 ),
.Example
. . . . . . . . . .6.10
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 184
Time- and Frequency-Domain Scaling (Dilation)
CTFT
If x(t) ←→ X(ω), then
CTFT 1 ω
x(at) ←→ X ,
|a| a
where a is an arbitrary nonzero real constant.
This is known as the dilation (or time/frequency-domain scaling)
property of the Fourier transform.
.Example
. . . . . . . . . .6.11
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 185
Conjugation
CTFT
If x(t) ←→ X(ω), then
CTFT
x∗ (t) ←→ X ∗ (−ω).
This is known as the conjugation property of the Fourier transform.
.Example
. . . . . . . . . .6.12
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 186
Duality
CTFT
If x(t) ←→ X(ω), then
CTFT
X(t) ←→ 2πx(−ω)
This is known as the duality property of the Fourier transform.
This property follows from the high degree of symmetry in the forward and
inverse Fourier transform equations, which are respectively given by
Z ∞ Z ∞
X(λ) = x(θ)e− jθλ dθ and x(λ) = 2π 1
X(θ)e jθλ dθ.
−∞ −∞
That is, the forward and inverse Fourier transform equations are identical
except for a factor of 2π and different sign in the parameter for the
exponential function.
CTFT
Although the relationship x(t) ←→ X(ω) only directly provides us with the
Fourier transform of x(t), the duality property allows us to indirectly infer
the Fourier transform of X(t). Consequently, the duality property can be
used to effectively double the number of Fourier transform pairs that we
know.
.Example
. . . . . . . . . .6.13
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 187
Time-Domain Convolution
CTFT CTFT
If x1 (t) ←→ X1 (ω) and x2 (t) ←→ X2 (ω), then
CTFT
x1 ∗ x2 (t) ←→ X1 (ω)X2 (ω).
This is known as the convolution (or time-domain convolution)
property of the Fourier transform.
In other words, a convolution in the time domain becomes a multiplication
in the frequency domain.
This suggests that the Fourier transform can be used to avoid having to
deal with convolution operations.
.Example
. . . . . . . . . .6.14
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 188
Time-Domain Multiplication
CTFT CTFT
If x1 (t) ←→ X1 (ω) and x2 (t) ←→ X2 (ω), then
Z ∞
CTFT 1 1
x1 (t)x2 (t) ←→ 2π X1 ∗ X2 (ω) = 2π X1 (θ)X2 (ω − θ)dθ.
−∞
.Example
. . . . . . . . . .6.15
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 189
Time-Domain Differentiation
CTFT
If x(t) ←→ X(ω), then
dx(t) CTFT
←→ jωX(ω).
dt
This is known as the (time-domain) differentiation property of the
Fourier transform.
Differentiation in the time domain becomes multiplication by jω in the
frequency domain.
Of course, by repeated application of the above property, we have that
d n CTFT
( jω)n X(ω).
dt x(t) ←→
The above suggests that the Fourier transform might be a useful tool
when working with differential (or integro-differential) equations.
.Example
. . . . . . . . . .6.16
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 190
Frequency-Domain Differentiation
CTFT
If x(t) ←→ X(ω), then
CTFT d
tx(t) ←→ j X(ω).
dω
This is known as the frequency-domain differentiation property of the
Fourier transform.
.Example
. . . . . . . . . .6.17
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 191
Time-Domain Integration
CTFT
If x(t) ←→ X(ω), then
Z t
CTFT 1
x(τ)dτ ←→ X(ω) + πX(0)δ(ω).
−∞ jω
This is known as the (time-domain) integration property of the Fourier
transform.
Whereas differentiation in the time domain corresponds to multiplication
by jω in the frequency domain, integration in the time domain is
associated with division by jω in the frequency domain.
Since integration in the time domain becomes division by jω in the
frequency domain, integration can be easier to handle in the frequency
domain.
The above property suggests that the Fourier transform might be a useful
tool when working with integral (or integro-differential) equations.
.Example
. . . . . . . . . .6.18
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 192
Parseval’s Relation
2
Recall that the energy of a function x is given by −∞ |x(t)| dt .
R∞
CTFT
If x(t) ←→ X(ω), then
Z ∞ Z ∞
|x(t)|2 dt = 1
2π |X(ω)|2 dω
−∞ −∞
.Example
. . . . . . . . . .6.19
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 193
Even/Odd Symmetry
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 194
Real Functions
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 195
More Fourier Transforms
.Example
. . . . . . . . . .6.26
Copyright .Exercise
.c. . .2013–2020 . . .6.5(g)
. . . . . . .Michael .Exercise
. . . . . . . . . .6.2(j)
. . . . . .D. Adams . .Signals
... and Systems Edition 2020-05-ECE260
Section 6.4
(i.e., xT (t) is equal to x(t) over a single period and zero elsewhere).
Let a denote the Fourier series coefficient sequence of x.
Let X and XT denote the Fourier transforms of x and xT , respectively.
The following relationships can be shown to hold:
∞
X(ω) = ∑ ω0 XT (kω0 )δ(ω − kω0 ),
k=−∞
∞
ak = T1 XT (kω0 ), and X(ω) = ∑ 2πak δ(ω − kω0 ).
k=−∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 196
Fourier Transform of Periodic Functions (Continued)
.Example
. . . . . . . . . .6.20
Copyright .Example
.c. . .2013–2020 . . .6.21
. . . . . . .Michael Example
. . . . . . . . . .6.24
. . . . D. .Adams . . . Signals
. and Systems Edition 2020-05-ECE260 197
Section 6.5
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 198
The Frequency-Domain Perspective on Functions
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 199
Fourier Transform and Frequency Spectra
To gain further insight into the role played by the Fourier transform X in
the context of the frequency spectrum of x, it is helpful to write the Fourier
transform representation of x with X(ω) expressed in polar form as
follows:
Z ∞ Z ∞
x(t) = 1
2π X(ω)e jωt dω = 1
2π |X(ω)| e j[ωt+arg X(ω)] dω.
−∞ −∞
In effect, the quantity |X(ω)| is a weight that determines how much the
complex sinusoid at frequency ω contributes to the integration result x.
The quantity arg X(ω) determines how the complex sinusoid at frequency
ω is shifted related to complex sinusoids at other frequencies.
Perhaps, this can be more easily seen if we express the above integral as
the limit of a sum, derived from an approximation of the integral using the
areas of rectangles, as shown on the next slide. [Recall that
−∞ f (x)dx = lim∆x→0 ∑k=−∞ ∆x f (k∆x).]
R∞ ∞
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 200
Fourier Transform and Frequency Spectra (Continued 1)
Expressing the integral (from the previous slide) as the limit of a sum, we
obtain
∞
x(t) = lim 1
∑ ∆ω |X(ω)| e j[ωt+arg X(ω)] ,
∆ω→0 2π
k=−∞
where ω = k∆ω.
In the above equation, the kth term in the summation corresponds to a
complex sinusoid with fundamental frequency ω = k∆ω that has had its
amplitude scaled by a factor of |X(ω)| and has been time shifted by an
amount that depends on arg X(ω).
For a given ω = k∆ω (which is associated with the kth term in the
summation), the larger |X(ω)| is, the larger the amplitude of its
corresponding complex sinusoid e jωt will be, and therefore the larger the
contribution the kth term will make to the overall summation.
In this way, we can use |X(ω)| as a measure of how much information a
function x has at the frequency ω.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 201
Fourier Transform and Frequency Spectra (Continued 2)
The Fourier transform X of the function x is referred to as the frequency
spectrum of x.
The magnitude |X(ω)| of the Fourier transform X is referred to as the
magnitude spectrum of x.
The argument arg X(ω) of the Fourier transform X is referred to as the
phase spectrum of x.
Since the Fourier transform is a function of a real variable, a function can
potentially have information at any real frequency.
Since the Fourier transform X of a periodic function x with fundamental
frequency ω0 and the Fourier series coefficient sequence a is given by
X(ω) = ∑∞ k=−∞ 2πak δ(ω − kω0 ), the Fourier transform and Fourier series
give consistent results for the frequency spectrum of a periodic function.
Since the frequency spectrum is complex (in the general case), it is
usually represented using two plots, one showing the magnitude
spectrum and one showing the phase spectrum.
.Example
. . . . . . . . . .6.30
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 202
Frequency Spectra of Real Functions
Recall that, for a real function x, the Fourier transform X of x satisfies
X(ω) = X ∗ (−ω)
Image A Image B
Magnitude Spectrum from Image B and Magnitude Spectrum from Image A and
Phase Spectrum from Image A Phase Spectrum from Image B
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 204
Magnitude and Phase Distortion in Images (Continued)
SKIP SLIDE
Magnitude Spectrum from Image B and Magnitude Spectrum from Image A and
Phase Spectrum from Image A Phase Spectrum from Image B
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 205
Bandwidth
A function with the Fourier transform X is said to be bandlimited if, for
some (finite) nonnegative real constant B, the following condition holds:
X(ω) = 0 for all ω satisfying |ω| > B.
The bandwidth B of a function with the Fourier transform X is defined as
B = ω1 − ω0 , where X(ω) = 0 for all ω 6∈ [ω0 , ω1 ].
In the case of real-valued functions, however, this definition of bandwidth
is usually amended to consider only nonnegative frequencies.
The real-valued function x1 and complex-valued function x2 with the
respective Fourier transforms X1 and X2 shown below each have
bandwidth B (where only nonnegative frequencies are considered in the case of x1 ).
X1 (ω) X2 (ω)
1 1
ω ω
−B B − B2 B
2
One can show that a function cannot be both time limited and
bandlimited.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 206
Energy-Density Spectra
SKIP SLIDE
where
Ex (ω) = |X(ω)|2 .
We refer to Ex as the energy-density spectrum of the function x.
The function Ex indicates how the energy in x is distributed with respect to
frequency.
For example, the energy contributed by frequencies in the range [ω1 , ω2 ]
is given by
Z ω2
1
2π Ex (ω)dω.
ω1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 207
Section 6.6
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 208
Frequency Response of LTI Systems
Consider a LTI system with input x, output y, and impulse response h, and
let X , Y , and H denote the Fourier transforms of x, y, and h, respectively.
Since y(t) = x ∗ h(t), we have that
Y (ω) = X(ω)H(ω).
The function H is called the frequency response of the system.
A LTI system is completely characterized by its frequency response H .
The above equation provides an alternative way of viewing the behavior of
a LTI system. That is, we can view the system as operating in the
frequency domain on the Fourier transforms of the input and output
functions.
The frequency spectrum of the output is the product of the frequency
spectrum of the input and the frequency response of the system.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 209
Frequency Response of LTI Systems (Continued 1)
|Y (ω)| = |X(ω)| |H(ω)| and argY (ω) = arg X(ω) + arg H(ω).
The magnitude spectrum of the output equals the magnitude spectrum of
the input times the magnitude response of the system.
The phase spectrum of the output equals the phase spectrum of the input
plus the phase response of the system.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 210
Frequency Response of LTI Systems (Continued 2)
(i.e., the magnitude response |H(ω)| is even and the phase response
arg H(ω) is odd).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 211
Block Diagram Representations of LTI Systems
Consider a LTI system with input x, output y, and impulse response h, and
let X , Y , and H denote the Fourier transforms of x, y, and h, respectively.
Often, it is convenient to represent such a system in block diagram form in
the frequency domain as shown below.
X Y
H
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 212
Interconnection of LTI Systems
X Y
≡ H1 + H2
H2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 213
LTI Systems and Differential Equations
Many LTI systems of practical interest can be represented using an
Nth-order linear differential equation with constant coefficients.
Consider a system with input x and output y that is characterized by an
equation of the form
N M
d k d k
∑ bk dt y(t) = ∑ ak dt x(t),
k=0 k=0
.Example
. . . . . . . . . .6.34
Copyright .Example
.c. . .2013–2020 . . .6.35
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 214
Section 6.7
Application: Filtering
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 215
Filtering
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 216
Ideal Lowpass Filter
An ideal lowpass filter eliminates all frequency components with a
frequency whose magnitude is greater than some cutoff frequency, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response H of the form
(
1 |ω| ≤ ωc
H(ω) =
0 otherwise,
where ωc is the cutoff frequency.
A plot of this frequency response is given below.
H(ω)
ω
−ωc ωc
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 217
Ideal Highpass Filter
An ideal highpass filter eliminates all frequency components with a
frequency whose magnitude is less than some cutoff frequency, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response H of the form
(
1 |ω| ≥ ωc
H(ω) =
0 otherwise,
where ωc is the cutoff frequency.
A plot of this frequency response is given below.
H(ω)
1
··· ···
ω
−ωc ωc
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 218
Ideal Bandpass Filter
An ideal bandpass filter eliminates all frequency components with a
frequency whose magnitude does not lie in a particular range, while
leaving the remaining frequency components unaffected.
Such a filter has a frequency response H of the form
(
1 ωc1 ≤ |ω| ≤ ωc2
H(ω) =
0 otherwise,
where the limits of the passband are ωc1 and ωc2 .
A plot of this frequency response is given below.
H(ω)
ω
−ωc2 −ωc1 ωc1 ωc2
.Example
. . . . . . . . . .6.38
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 219
Section 6.8
Application: Equalization
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 220
Equalization
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 221
Equalization (Continued)
Input Output x y
horig heq horig
Let Horig denote the frequency response of original system (i.e., without
equalization).
Let Hd denote the desired frequency response.
Let Heq denote the frequency response of the equalizer.
The new system with equalization has frequency response
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 223
Electronic Circuits
R
i + −
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 224
Inductors
An inductor is a circuit element that converts an electric current into a
magnetic field and vice versa.
An inductor uses the energy stored in a magnetic field in order to oppose
changes in current (through the inductor).
An inductor is characterized by an equation of the form
Z t
d 1
v(t) = L dt i(t) (or equivalently, i(t) = L v(τ)dτ),
−∞
where L is a nonnegative real constant, and v and i respectively denote
the voltage across and current through the inductor as a function of time.
As a matter of terminology, the quantity L is known as the inductance of
the inductor.
Inductance is measured in units of henrys (H).
In circuit diagrams, an inductor is denoted by the symbol shown below.
L
i + −
v
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 225
Capacitors
A capacitor is a circuit element that stores electric charge.
A capacitor uses the energy stored in an electric field in order to oppose
changes in voltage (across the capacitor).
A capacitor is characterized by an equation of the form
Z t
1
v(t) = C i(τ)dτ (or equivalently, i(t) = C dtd v(t)),
−∞
where C is a nonnegative real constant, and v and i respectively denote
the voltage across and current through the capacitor as a function of time.
As a matter of terminology, the quantity C is known as the capacitance of
the capacitor.
Capacitance is measured in units of farads (F).
In circuit diagrams, a capacitor is denoted by the symbol shown below.
C
i + −
v
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 226
Circuit Analysis with the Fourier Transform
The Fourier transform is a very useful tool for circuit analysis.
The utility of the Fourier transform is partly due to the fact that the
differential/integral equations that describe inductors and capacitors are
much simpler to express in the Fourier domain than in the time domain.
Let v and i denote the voltage across and current through a circuit
element, and let V and I denote the Fourier transforms of v and i,
respectively.
In the frequency domain, the equations characterizing a resistor, an
inductor, and a capacitor respectively become:
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 228
Motivation for Amplitude Modulation (AM)
In communication systems, we often need to transmit a signal using a
frequency range that is different from that of the original signal.
For example, voice/audio signals typically have information in the range of
0 to 22 kHz.
Often, it is not practical to transmit such a signal using its original
frequency range.
Two potential problems with such an approach are:
1 interference; and
2 constraints on antenna length.
Since many signals are broadcast over the airwaves, we need to ensure
that no two transmitters use the same frequency bands in order to avoid
interference.
Also, in the case of transmission via electromagnetic waves (e.g., radio
waves), the length of antenna required becomes impractically large for the
transmission of relatively low frequency signals.
For the preceding reasons, we often need to change the frequency range
associated with a signal before transmission.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 229
Trivial Amplitude Modulation (AM) System
x y y x̂
× ×
Transmitter Receiver
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 230
Trivial Amplitude Modulation (AM) System: Example
X(ω)
C1 (ω) C2 (ω)
1
2π 2π
ω
−ωb ωb
ω ω
ωc −ωc
Transmitter Input
Y (ω) X̂(ω)
1 1
ω ω
ωb ωc − ωb ωc ωc + ωb −ωb ωb
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 231
Double-Sideband Suppressed-Carrier (DSB-SC) AM
Transmitter Receiver
If ωb < ωc0 < 2ωc − ωb , we have X̂(ω) = X(ω) (implying x̂(t) = x(t)).
.System
. . . . . . . . .Analysis
Copyright . .c. . .2013–2020
.... Michael D. Adams Signals and Systems Edition 2020-05-ECE260 232
DSB-SC AM: Transmitter
c(t) = cos(ωct)
x y
×
y(t) = cos(ωct)x(t)
X = Fx, Y = Fy
Y (ω) = F{cos(ωct)x(t)}(ω)
= F 21 e jωc t + e− jωc t x(t) (ω)
= 12 [X(ω − ωc ) + X(ω + ωc )]
c(t) = cos(ωct)
2ωc0
h(t) = π sinc(ωc0t)
y v x̂
× h
2ωc0
v(t) = cos(ωct)y(t), h(t) = π sinc(ωc0t), x̂(t) = v ∗ h(t)
Y = Fy, V = Fv, H = Fh, X̂ = Fx̂
V (ω) = F{cos(ωct)y(t)}(ω)
= F 21 e jωc t + e− jωc t y(t) (ω)
= 21 [Y (ω − ωc ) +Y (ω + ωc )]
n o
H(ω) = F 2ωπc0 sinc(ωc0t) (ω)
= 2 rect 2ωωc0
V (ω) = 12 [Y (ω − ωc ) +Y (ω + ωc )]
= 12 21 [X([ω − ωc ] − ωc ) + X([ω − ωc ] + ωc )] +
1
2 [X([ω + ωc ] − ωc ) + X([ω + ωc ] + ωc )]
= 12 X(ω) + 14 X(ω − 2ωc ) + 14 X(ω + 2ωc )
X̂(ω) = H(ω)V (ω)
= H(ω) 12 X(ω) + 14 X(ω − 2ωc ) + 14 X(ω + 2ωc )
−ωb ωb ω
−ωc ωc ω −ωc0 ωc0 ω
Transmitter Input
Y (ω)
1
2
ω
−2ωc −ωc − ωb−ωc−ωc + ωb −ωb ωb ωc − ωb ωc ωc + ωb 2ωc
Transmitter Output
V (ω)
1
2
1
4
ω
−2ωc − ω−2ωc c + ωb
b −2ω
−ωb ωb 2ωc − ωb 2ωc 2ωc + ωb
X̂(ω)
ω
−2ωc −ωc −ωb ωb ωc 2ωc
Receiver Output
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 233
Single-Sideband Suppressed-Carrier (SSB-SC) AM
Transmitter Receiver
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 234
SSB-SC AM: Example
X(ω) C(ω) G(ω) H(ω)
1
π π ··· 1 ··· 4
Q(ω)
1
2
Y (ω)
1
2
V (ω)
1
2
1
4
ω
−2ωc − −2ω
ωb −2ω
c c + ωb −ωb ωb 2ωc − ωb2ωc2ωc + ωb
X̂(ω)
1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 235
Section 6.11
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 236
Sampling and Interpolation
Note that, unless very special conditions are met, the sampling process
loses information (i.e., is not invertible).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 237
Periodic Sampling
Although sampling can be performed in many different ways, the most
commonly used scheme is periodic sampling.
With this scheme, a sequence y of samples is obtained from a function x
according to the relation
y(n) = x(T n) for all integer n,
where T is a (strictly) positive real constant.
As a matter of terminology, we refer to T as the sampling period, and
ωs = 2π
T as the (angular) sampling frequency.
An example of periodic sampling is shown below, where the function x has
been sampled with sampling period T = 10, yielding the sequence y.
x(t) y(n)
4 4
3 3
2 2
1 1
t n
0 10 20 30 40 50 60 70 0 1 2 3 4 5 6 7
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 238
Invertibility of Sampling
Unless constraints are placed on the functions being sampled, the
sampling process is not invertible.
In other words, in the absence of any constraints, a function cannot be
uniquely determined from a sequence of its equally-spaced samples.
Consider, for example, the functions x1 and x2 given by
x s convert from y
× impulse train
to sequence
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 240
Model of Sampling: Various Signals
x(t)
p(t)
4
3 1 1 1 1
2 ··· ···
1 t
0 T 2T 3T
t
0 T 2T 3T Periodic Impulse Train
Input Function
s(t)
y(n)
x(T )
4 x(T )
4
3 x(3T )
x(2T )
3 x(2T ) x(3T )
2 x(0)
2 x(0)
1
1
t
0 T 2T 3T n
0 1 2 3
Impulse-Sampled Function
Output Sequence (Discrete-Time)
(Continuous-Time)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 241
Model of Sampling: Invertibility of Sampling Revisited
ideal C/D converter
∞
p(t) = ∑ δ(t − kT )
k=−∞
x s convert from y
× impulse train
to sequence
Since sampling is not invertible and our model of sampling consists of only
two steps, at least one of these two steps must not be invertible.
Recall the two steps in our model of sampling are as follows (in order):
∞
1 x −→ s(t) = x(t)p(t) = ∑ x(nT )δ(t − nT ); and
n=−∞
∞
2 s(t) = ∑ x(nT )δ(t − nT ) −→ y(n) = x(nT ).
n=−∞
Step 1 cannot be undone (unless we somehow restrict which functions x
can be sampled).
Step 2 is always invertible.
Therefore, the fact that sampling is not invertible is entirely due to step 1.
x s convert from y
× impulse train
to sequence
∞
2π
p(t) = ∑ δ(t − kT ), ωs = T
k=−∞
∞
p(t) = ∑ ck e jkωs t
k=−∞
Z T /2
ck = 1
T p(t)e− jkωs t dt
−T /2
Z T /2
= 1
T δ(t)e− jkωs t dt
−T /2
Z ∞
= 1
T δ(t)e− jkωs t dt
−∞
1
= T
ωs
= 2π
∞
p(t) = ωs
2π ∑ e jkωs t
k=−∞
x s convert from y
× impulse train
to sequence
∞
2π
s(t) = p(t)x(t), p(t) = ∑ δ(t − kT ), ωs = T
k=−∞
∞
p(t) = ωs
2π ∑ e jkωs t
k=−∞
∞
s(t) = ωs
2π ∑ e jkωs t x(t)
k=−∞
X = Fx, S = Fs
∞
ωs
S(ω) = 2π ∑ X(ω − kωs )
k=−∞
Spectrum of Input
1
Function
(Bandwidth ωm )
ω
−ωm 0 ωm
S(ω)
Spectrum of Impulse-
1
T Sampled Function:
··· ··· No Aliasing Case
(ωs > 2ωm )
ω
−ωs − ωm −ωs −ωs + ωm −ωm 0 ωm ωs − ωm ωs ωs + ωm
S(ω)
Spectrum of Impulse-
1
T
Sampled Function:
··· ··· Aliasing Case
ω
(ωs ≤ 2ωm )
0 ωm
ωs − ωm ωs
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 244
Model of Interpolation
y convert from s x̂
sequence to h
impulse train
π
h(t) = sinc Tt
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 245
Sampling Theorem
Sampling Theorem. Let x be a function with Fourier transform X , and
suppose that |X(ω)| = 0 for all ω satisfying |ω| > ωM (i.e., x is
bandlimited to frequencies [−ωM , ωM ]). Then, x is uniquely determined by
its samples y(n) = x(T n) for all integer n, if
ωs > 2ωM ,
where ωs = 2πT . The preceding inequality is known as the Nyquist
condition. If this condition is satisfied, we have that
∞ π
x(t) = ∑ y(n) sinc T (t − T n) ,
n=−∞
We call ω2s the Nyquist frequency and 2ωM the Nyquist rate.
.Example
. . . . . . . . . .6.41
Copyright .NEXT
. . . . . . .SLIDE:
.c. . .2013–2020 . . . . . . . .PFEs
Michael .D.
. . .Adams
.. Signals and Systems Edition 2020-05-ECE260 247
Part 7
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 248
Motivation Behind the Laplace Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 249
Motivation Behind the Laplace Transform (Continued)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 250
Section 7.1
Laplace Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 251
(Bilateral) Laplace Transform
The (bilateral) Laplace transform of the function x, denoted Lx or X , is
defined as
Z ∞
Lx(s) = X(s) = x(t)e−st dt.
−∞
The inverse Laplace transform of X , denoted L−1 X or x, is then given
by
Z σ+ j∞
1
L−1 X(t) = x(t) = X(s)est ds,
2π j σ− j∞
where Re(s) = σ is in the ROC of X . (Note that this is a contour
integration, since s is complex.)
We refer to x and X as a Laplace transform pair and denote this
relationship as
LT
x(t) ←→ X(s).
In practice, we do not usually compute the inverse Laplace transform by
directly using the formula from above. Instead, we resort to other means
(to be discussed later).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 252
Bilateral and Unilateral Laplace Transforms
For the most part, we will focus our attention primarily on the bilateral
Laplace transform.
We will, however, briefly introduce the unilateral Laplace transform as a
tool for solving differential equations.
Unless otherwise noted, all subsequent references to the Laplace
transform should be understood to mean bilateral Laplace transform.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 253
Remarks on Operator Notation
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 254
Remarks on Dot Notation
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 255
Remarks on Notational Conventions
Since dot notation is less frequently used by engineers, the author has
elected to minimize its use herein.
To avoid ambiguous notation, the following conventions are followed:
1 in the expression for the operand of a Laplace transform operator, the
independent variable is assumed to be the variable named “t” unless
otherwise indicated (i.e., in terms of dot notation, each “t ” is treated as if it
were a “·”)
2 in the expression for the operand of the inverse Laplace transform operator,
the independent variable is assumed to be the variable named “s” unless
otherwise indicated (i.e., in terms of dot notation, each “s” is treated as if it
were a “·”).
For example, with these conventions:
2 “L{(t − τ)u(t − τ)}” denotes the function that is the Laplace transform of
the function v(t) = (t − τ)u(t − τ) (not the Laplace transform of the function
v(τ) = (t − τ)u(t − τ)).
2 “L−1 { 1 }” denotes the function that is the inverse Laplace transform of
s2 −λ
the function V (s) = { s2 1−λ } (not the inverse Laplace transform of the
function V (λ) = { s2 1−λ }).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 256
Relationship Between Laplace and Fourier Transforms
Let X and XF denote the Laplace and (CT) Fourier transforms of x,
respectively.
The function X evaluated at jω (where ω is real) yields XF (ω). That is,
X( jω) = XF (ω).
Due to the preceding relationship, the Fourier transform of x is sometimes
written as X( jω).
The function X evaluated at an arbitrary complex value s = σ + jω (where
σ = Re(s) and ω = Im(s)) can also be expressed in terms of a Fourier
transform involving x. In particular, we have
.Example
. . . . . . . . . .7.3
Copyright .Example
.c. . 2013–2020 . .7.4
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 258
Section 7.2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 259
Left-Half Plane (LHP)
Re(s) < a
Re{s} Re{s}
a a
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 260
Right-Half Plane (RHP)
Re(s) > a
Re{s} Re{s}
a a
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 261
Intersection of Sets
1 1 1
Re Re Re
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1 −1
−2 −2 −2
R1 R2 R1 ∩ R2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 262
Adding a Scalar to a Set
S + a = {z + a : z ∈ S}
2 2
1 1
Re Re
−3 −2 −1 1 2 3 −3 −2 −1 1 2 3
−1 −1
−2 −2
R R+1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 263
Multiplying a Set by a Scalar
For a set S and a scalar constant a, aS denotes the set given by
aS = {az : z ∈ S}
(i..e, aS is the set formed by multiplying each element of S by a).
Multiplying z by a effects z by: scaling by |a| and rotating about the origin
by arg a.
So, effectively, multiplying a set by a scalar applies a scaling and/or
rotation to the region associated with the set.
An illustrative example is given below.
Im
2
Re
−5 −4 −3 −2 −1 1 2 3 4 5
−1
−2
Im
R Im
2 2
1 1
Re Re
−5 −4 −3 −2 −1 1 2 3 4 5 −5 −4 −3 −2 −1 1 2 3 4 5
−1 −1
−2 −2
2R −2R
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 264
Region of Convergence (ROC)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 265
ROC Property 1: General Form
Re Re Re
Re Re Re
Re Re Re
If a function x is right sided and the (vertical) line Re(s) = σ0 is in the ROC
of the Laplace transform X = Lx, then all values of s for which Re(s) > σ0
must also be in the ROC (i.e., the ROC is a RHP including Re(s) = σ0 ).
Some examples of sets that would be either valid or invalid as ROCs for
X , if x is right sided, are shown below.
Im Im Im
Re Re Re
If a function x is left sided and the (vertical) line Re(s) = σ0 is in the ROC
of the Laplace transform X = Lx, then all values of s for which Re(s) < σ0
must also be in the ROC (i.e., the ROC is a LHP including Re(s) = σ0 ).
Some examples of sets that would be either valid or invalid as ROCs for
X , if x is left sided, are shown below.
Im Im Im
Re Re Re
If a function x is two sided and the (vertical) line Re(s) = σ0 is in the ROC
of the Laplace transform X = Lx, then the ROC will consist of a strip in
the complex plane that includes the line Re(s) = σ0 .
Some examples of sets that would be either valid or invalid as ROCs for
X , if x is two sided, are shown below.
Im Im Im
Re Re Re
Thus, we can infer that, if X exists, its ROC can only be of the form of a
LHP, a RHP, a vertical strip, or the entire complex plane.
For example, the sets shown below would not be valid as ROCs.
Im Im
Re Re
Invalid Invalid
.Example
. . . . . . . . . .7.7
Copyright .c. . 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260
Section 7.3
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 268
Properties of the Laplace Transform
Property
Initial Value Theorem x(0+ ) = lim sX(s)
s→∞
Final Value Theorem lim x(t) = lim sX(s)
t→∞ s→0
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 269
Laplace Transform Pairs
Pair x(t) X(s) ROC
1 δ(t) 1 All s
1
2 u(t) s Re(s) > 0
1
3 −u(−t) s Re(s) < 0
n!
4 t n u(t) sn+1
Re(s) > 0
n!
5 −t n u(−t) sn+1
Re(s) < 0
6 e−at u(t) 1
s+a Re(s) > −a
7 −e−at u(−t) 1
s+a Re(s) < −a
8 t n e−at u(t) n!
(s+a)n+1
Re(s) > −a
9 −t n e−at u(−t) n!
(s+a)n+1
Re(s) < −a
s
10 cos(ω0t)u(t) s2 +ω20
Re(s) > 0
ω0
11 sin(ω0t)u(t) s2 +ω20
Re(s) > 0
12 e−at cos(ω0t)u(t) s+a
(s+a)2 +ω20
Re(s) > −a
13 e−at sin(ω0t)u(t) ω0
(s+a)2 +ω20
Re(s) > −a
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 270
Linearity
LT LT
If x1 (t) ←→ X1 (s) with ROC R1 and x2 (t) ←→ X2 (s) with ROC R2 , then
LT
a1 x1 (t) + a2 x2 (t) ←→ a1 X1 (s) + a2 X2 (s) with ROC R containing R1 ∩ R2 ,
.Example
. . . . . . . . . .7.8
Copyright .Example
.c. . 2013–2020 . .7.9
. . . . . . . . Michael
... D. Adams Signals and Systems Edition 2020-05-ECE260 271
Time-Domain Shifting
LT
If x(t) ←→ X(s) with ROC R, then
LT
x(t − t0 ) ←→ e−st0 X(s) with ROC R,
.Example
. . . . . . . . . .7.10
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 272
Laplace-Domain Shifting
LT
If x(t) ←→ X(s) with ROC R, then
LT
es0t x(t) ←→ X(s − s0 ) with ROC R0 = R + Re(s0 ),
Re Re
σmin σmax σmin + Re(s0 ) σmax + Re(s0 )
R R0 = R + Re(s0 )
.Example
. . . . . . . . . .7.11
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 273
Time-Domain/Laplace-Domain Scaling
LT
If x(t) ←→ X(s) with ROC R, then
LT 1 s
x(at) ←→ X with ROC R0 = aR,
|a| a
where a is a nonzero real constant.
This is known as the (time-domain/Laplace-domain) scaling property
of the Laplace transform.
As illustrated below, the ROC R is scaled and possibly flipped left to right.
Im Im Im
Re Re Re
σmin σmax aσmin aσmax aσmax aσmin
.Example
. . . . . . . . . .7.12
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 274
Conjugation
LT
If x(t) ←→ X(s) with ROC R, then
LT
x∗ (t) ←→ X ∗ (s∗ ) with ROC R.
This is known as the conjugation property of the Laplace transform.
.Example
. . . . . . . . . .7.13
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 275
Time-Domain Convolution
LT LT
If x1 (t) ←→ X1 (s) with ROC R1 and x2 (t) ←→ X2 (s) with ROC R2 , then
LT
x1 ∗ x2 (t) ←→ X1 (s)X2 (s) with ROC R containing R1 ∩ R2 .
This is known as the time-domain convolution property of the Laplace
transform.
The ROC R always contains R1 ∩ R2 but can be larger than this
intersection (if pole-zero cancellation occurs).
Convolution in the time domain becomes multiplication in the Laplace
domain.
Consequently, it is often much easier to work with LTI systems in the
Laplace domain, rather than the time domain.
.Example
. . . . . . . . . .7.14
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 276
Time-Domain Differentiation
LT
If x(t) ←→ X(s) with ROC R, then
dx(t) LT
←→ sX(s) with ROC R0 containing R.
dt
This is known as the time-domain differentiation property of the
Laplace transform.
The ROC R0 always contains R but can be larger than R (if pole-zero
cancellation occurs).
Differentiation in the time domain becomes multiplication by s in the
Laplace domain.
Consequently, it can often be much easier to work with differential
equations in the Laplace domain, rather than the time domain.
.Example
. . . . . . . . . .7.15
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 277
Laplace-Domain Differentiation
LT
If x(t) ←→ X(s) with ROC R, then
LT dX(s)
−tx(t) ←→ with ROC R.
ds
This is known as the Laplace-domain differentiation property of the
Laplace transform.
.Example
. . . . . . . . . .7.16
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 278
Time-Domain Integration
LT
If x(t) ←→ X(s) with ROC R, then
Z t
LT 1
x(τ)dτ ←→ X(s) with ROC R0 containing R ∩ {Re(s) > 0}.
−∞ s
This is known as the time-domain integration property of the Laplace
transform.
The ROC R0 always contains at least R ∩ {Re(s) > 0} but can be larger (if
pole-zero cancellation occurs).
Integration in the time domain becomes division by s in the Laplace
domain.
Consequently, it is often much easier to work with integral equations in the
Laplace domain, rather than the time domain.
.Example
. . . . . . . . . .7.17
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 279
Initial Value Theorem
where x(0+ ) denotes the limit of x(t) as t approaches zero from positive
values of t .
This result is known as the initial value theorem.
In situations where X is known but x is not, the initial value theorem
eliminates the need to explicitly find x by an inverse Laplace transform
calculation in order to evaluate x(0+ ).
In practice, the values of functions at the origin are frequently of interest,
as such values often convey information about the initial state of systems.
The initial value theorem can sometimes also be helpful in checking for
errors in Laplace transform calculations.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 280
Final Value Theorem
.Example
. . . . . . . . . .7.18
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 281
More Laplace Transform Examples
.Example
. . . . . . . . . .7.19
Copyright .Example
.c. . .2013–2020 . . .7.25
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 282
Section 7.4
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 283
Finding Inverse Laplace Transform
.Example
. . . . . . . . . .7.27
Copyright .Example
.c. . .2013–2020 . . .7.28
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 284
Section 7.5
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 285
System Function of LTI Systems
Consider a LTI system with input x, output y, and impulse response h. Let
X , Y , and H denote the Laplace transforms of x, y, and h, respectively.
Since y(t) = x ∗ h(t), the system is characterized in the Laplace domain by
Y (s) = X(s)H(s).
As a matter of terminology, we refer to H as the system function (or
transfer function) of the system (i.e., the system function is the Laplace
transform of the impulse response).
A LTI system is completely characterized by its system function H .
When viewed in the Laplace domain, a LTI system forms its output by
multiplying its input with its system function.
If the ROC of H includes the imaginary axis, then H( jω) is the frequency
response of the LTI system.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 286
Block Diagram Representations of LTI Systems
Consider a LTI system with input x, output y, and impulse response h, and
let X , Y , and H denote the Laplace transforms of x, y, and h, respectively.
Often, it is convenient to represent such a system in block diagram form in
the Laplace domain as shown below.
X Y
H
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 287
Interconnection of LTI Systems
X Y
≡ H1 + H2
H2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 288
Causality
.Example
. . . . . . . . . .7.31
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 289
BIBO Stability
.Example
. . . . . . . . . .7.32
Copyright .Example
.c. . .2013–2020 . . .7.33
. . . . . . .Michael Example
. . . . . . . . . .7.34
. . . . D. .Adams . . . Signals
. and Systems Edition 2020-05-ECE260 290
Invertibility
H(s)Hinv (s) = 1,
1
Hinv (s) = .
H(s)
Since distinct systems can have identical system functions (but with
differing ROCs), the inverse of a LTI system is not necessarily unique.
In practice, however, we often desire a stable and/or causal system. So,
although multiple inverse systems may exist, we are frequently only
interested in one specific choice of inverse system (due to these
additional constraints of stability and/or causality).
.Example
. . . . . . . . . .7.35
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 291
LTI Systems and Differential Equations
Many LTI systems of practical interest can be represented using an
Nth-order linear differential equation with constant coefficients.
Consider a system with input x and output y that is characterized by an
equation of the form
N M
d k d k
∑ bk dt y(t) = ∑ ak dt x(t),
k=0 k=0
.Example
. . . . . . . . . .7.36
Copyright .Example
.c. . .2013–2020 . . .7.37
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 292
Section 7.6
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 293
Electronic Circuits
R
i + −
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 294
Inductors
An inductor is a circuit element that converts an electric current into a
magnetic field and vice versa.
An inductor uses the energy stored in a magnetic field in order to oppose
changes in current (through the inductor).
An inductor is characterized by an equation of the form
Z t
d 1
v(t) = L dt i(t) (or equivalently, i(t) = L v(τ)dτ),
−∞
where L is a nonnegative real constant, and v and i respectively denote
the voltage across and current through the inductor as a function of time.
As a matter of terminology, the quantity L is known as the inductance of
the inductor.
Inductance is measured in units of henrys (H).
In circuit diagrams, an inductor is denoted by the symbol shown below.
L
i + −
v
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 295
Capacitors
A capacitor is a circuit element that stores electric charge.
A capacitor uses the energy stored in an electric field in order to oppose
changes in voltage (across the capacitor).
A capacitor is characterized by an equation of the form
Z t
1
v(t) = C i(τ)dτ (or equivalently, i(t) = C dtd v(t)),
−∞
where C is a nonnegative real constant, and v and i respectively denote
the voltage across and current through the capacitor as a function of time.
As a matter of terminology, the quantity C is known as the capacitance of
the capacitor.
Capacitance is measured in units of farads (F).
In circuit diagrams, a capacitor is denoted by the symbol shown below.
C
i + −
v
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 296
Circuit Analysis with the Laplace Transform
The Laplace transform is a very useful tool for circuit analysis.
The utility of the Laplace transform is partly due to the fact that the
differential/integral equations that describe inductors and capacitors are
much simpler to express in the Laplace domain than in the time domain.
Let v and i denote the voltage across and current through a circuit
element, and let V and I denote the Laplace transforms of v and i,
respectively.
In the Laplace domain, the equations characterizing a resistor, an
inductor, and a capacitor respectively become:
.Example
. . . . . . . . . .7.38
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 297
Section 7.7
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 298
Control Systems
A control system manages the behavior of one or more other systems with
some specific goal.
Typically, the goal is to force one or more physical quantities to assume
particular desired values, where such quantities might include: positions,
velocities, accelerations, forces, torques, temperatures, or pressures.
The desired values of the quantities being controlled are collectively
viewed as the input of the control system.
The actual values of the quantities being controlled are collectively viewed
as the output of the control system.
A control system whose behavior is not influenced by the actual values of
the quantities being controlled is called an open loop (or non-feedback)
system.
A control system whose behavior is influenced by the actual values of the
quantities being controlled is called a closed loop (or feedback) system.
An example of a simple control system would be a thermostat system,
which controls the temperature in a room or building.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260
Feedback Control Systems
Reference
Input Error Output
+ Controller Plant
−
Sensor
Feedback
Signal
input: desired value of the quantity to be controlled
output: actual value of the quantity to be controlled
error: difference between the desired and actual values
plant: system to be controlled
sensor: device used to measure the actual output
controller: device that monitors the error and changes the input of the
plant with the goal of forcing the error to zero
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 299
Stability Analysis of Feedback Systems
.Example
. . . . . . . . . .7.40
Copyright .Exercise
.c. . .2013–2020 . . .7.30
. . . . . . .Michael
. . . . D. Adams Signals and Systems Edition 2020-05-ECE260 300
Stabilization Example: Unstable Plant
X Y
P
10
P(s) = s−1
ROC of P:
Im
1 Re
X Y
W P
10 s−1
P(s) = s−1 , W (s) = 10(s+1)
ROC of H :
Im
−1 Re
X R Y
+ C P
−
10
P(s) = s−1 , C(s) = β, Q(s) = 1
system function H of feedback system:
C(s)P(s) 10β
H(s) = 1+C(s)P(s)Q(s) = s−(1−10β)
ROC of H :
Im
Re
1 − 10β
Y (s) = C(s)P(s)R(s)
= C(s)P(s)[X(s) − Q(s)Y (s)]
= C(s)P(s)X(s) −C(s)P(s)Q(s)Y (s)
10
P(s) = s−1 , C(s) = β, Q(s) = 1
C(s)P(s)
H(s) =
1 +C(s)P(s)Q(s)
10
β( s−1 )
= 10
1 + β( s−1 )(1)
10β
=
s − 1 + 10β
10β
=
s − (1 − 10β)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 301
Unilateral Laplace Transform
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 302
Inversion of the Unilateral Laplace Transform
L−1 −1
u {Lu x}(t) = Lu {L{xu}}(t)
= L−1 {L{xu}}(t)
= x(t)u(t)
(
x(t) t ≥ 0
=
0 t < 0.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 303
Unilateral Versus Bilateral Laplace Transform
Due to the close relationship between the unilateral and bilateral Laplace
transforms, these two transforms have some similarities in their properties.
Since these two transforms are not identical, however, their properties
differ in some cases, often in subtle ways.
In the unilateral case, we have that:
1 the time-domain convolution property has the additional requirement that
the functions being convolved must be causal;
2 the time/Laplace-domain scaling property has the additional constraint that
the scaling factor must be positive;
3 the time-domain differentiation property has an extra term in the expression
for Lu {Dx}(t), where D denotes the derivative operator (namely, −x(0− ));
4 the time-domain integration property has a different lower limit in the
time-domain integral (namely, 0− instead of −∞); and
5 the time-domain shifting property does not hold (except in special
circumstances).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 304
Properties of the Unilateral Laplace Transform
Property
Initial Value Theorem x(0+ ) = lim sX(s)
s→∞
Final Value Theorem lim x(t) = lim sX(s)
t→∞ s→0
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 305
Unilateral Laplace Transform Pairs
4 e−at 1
s+a
5 t n e−at n!
(s+a)n+1
s
6 cos(ω0t) s2 +ω20
ω0
7 sin(ω0t) s2 +ω20
9 e−at sin(ω0t) ω0
(s+a)2 +ω20
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 306
Solving Differential Equations [Using the Unilateral Laplace Transform]
.Example
. . . . . . . . . .7.42
Copyright .Example
.c. . .2013–2020 . . .7.43
. . . . . . .Michael NEXT
. . . . . . .SLIDE:
. . . . D. .Adams . .Epilogue
. . . . . . Signals
. . . . . . .and
. . . Systems Edition 2020-05-ECE260 307
Part 8
Complex Analysis
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 308
Complex Numbers
z = x + jy,
where x and y are real numbers. The quantities x and y are called the real
part and imaginary part of z, and are denoted as Re z and Im z,
respectively.
The polar form of the complex number z expresses z in the form
where r and θ are real numbers and r ≥ 0. The quantities r and θ are
called the magnitude and argument of z, and are denoted as |z| and
arg z, respectively. [Note: e jθ = cos θ + j sin θ.]
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 309
Complex Numbers (Continued)
Since e jθ = e j(θ+2πk) for all real θ and all integer k, the argument of a
complex number is only uniquely determined to within an additive multiple
of 2π.
The principal argument of a complex number z, denoted Arg z, is the
particular value θ of arg z that satisfies −π < θ ≤ π.
The principal argument of a complex number (excluding zero) is unique.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 310
Geometric Interpretation of Cartesian and Polar Forms
Im Im
z z
y
θ
Re Re
x
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 311
The arctan Function
Im Im
(1, 1)
1 1
−1 −1
π + arctan( −1 ) arctan( −1 )
arctan( 11 )
Re Re
−1 1 −1 1
−1 −1
(−1, −1)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 312
The atan2 Function
The angle θ that a vector from the origin to the point (x, y) makes with the
positive x axis is given by θ = atan2(y, x), where
arctan(y/x) x>0
x = 0 and y > 0
π/2
atan2(y, x) , −π/2 x = 0 and y < 0
arctan(y/x) + π x < 0 and y ≥ 0
arctan(y/x) − π x < 0 and y < 0.
z = x + jy and z = re jθ .
To convert from polar to Cartesian form, we use the following identities:
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 314
Properties of Complex Numbers
z1 + z2 = z2 + z1 and
z1 z2 = z2 z1 .
For complex numbers, addition and multiplication are associative. That is,
for any three complex numbers z1 , z2 , and z3 ,
z1 (z2 + z3 ) = z1 z2 + z1 z3 .
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 315
Conjugation
z∗ = x − jy.
Geometrically, the conjugation operation reflects a point in the complex
plane about the real axis.
The geometric interpretation of the conjugate is illustrated below.
Im
z = x + jy
Re
z∗ = x − jy
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 316
Properties of Conjugation
|z∗ | = |z| ,
arg z∗ = − arg z,
zz∗ = |z|2 ,
Re z = 12 (z + z∗ ), and
1 ∗
Im z = 2 j (z − z ).
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 317
Addition
Cartesian form: Let z1 = x1 + jy1 and z2 = x2 + jy2 . Then,
z1 + z2 = (x1 + jy1 ) + (x2 + jy2 )
= (x1 + x2 ) + j(y1 + y2 ).
That is, to add complex numbers expressed in Cartesian form, we simply
add their real parts and add their imaginary parts.
Polar form: Let z1 = r1 e jθ1 and z2 = r2 e jθ2 . Then,
z1 + z2 = r1 e jθ1 + r2 e jθ2
= (r1 cos θ1 + jr1 sin θ1 ) + (r2 cos θ2 + jr2 sin θ2 )
= (r1 cos θ1 + r2 cos θ2 ) + j(r1 sin θ1 + r2 sin θ2 ).
That is, to add complex numbers expressed in polar form, we first rewrite
them in Cartesian form, and then add their real parts and add their
imaginary parts.
For the purposes of addition, it is easier to work with complex numbers
expressed in Cartesian form.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 318
Multiplication
That is, to multiply two complex numbers expressed in polar form, we use
exponent rules.
For the purposes of multiplication, it is easier to work with complex
numbers expressed in polar form.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 319
Division
Cartesian form: Let z1 = x1 + jy1 and z2 = x2 + jy2 . Then,
z1 z1 z∗2 z1 z∗2 (x1 + jy1 )(x2 − jy2 )
= ∗ = 2
=
z2 z2 z2 |z2 | x22 + y22
x1 x2 − jx1 y2 + jx2 y1 + y1 y2 x1 x2 + y1 y2 + j(x2 y1 − x1 y2 )
= = .
x22 + y22 x22 + y22
That is, to compute the quotient of two complex numbers expressed in
Cartesian form, we convert the problem into one of division by a real
number.
Polar form: Let z1 = r1 e jθ1 and z2 = r2 e jθ2 . Then,
z1 r1 e jθ1 r1
= jθ
= e j(θ1 −θ2 ) .
z2 r2 e 2 r2
That is, to compute the quotient of two complex numbers expressed in
polar form, we use exponent rules.
For the purposes of division, it is easier to work with complex numbers
expressed in polar form.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 320
Properties of the Magnitude and Argument
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 321
Euler’s Relation and De Moivre’s Theorem
e jθ = cos θ + j sin θ.
From Euler’s relation, we can deduce the following useful identities:
cos θ = 12 (e jθ + e− jθ ) and
1 jθ − jθ
sin θ = 2 j (e − e ).
De Moivre’s theorem. For all real θ and all integer n,
n
e jnθ = e jθ .
[Note: This relationship does not necessarily hold for real n.]
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 322
Roots of Complex Numbers
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 323
Quadratic Formula
az2 + bz + c = 0,
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 324
Complex Functions
F(z) = a0 + a1 z + a2 z2 + · · · + an zn ,
a0 + a1 z + a2 z2 + . . . + an zn
F(z) = ,
b0 + b1 z + b2 z2 + . . . + bm zm
where a0 , a1 , . . . , an , b0 , b1 , . . . , bm and z are complex.
Observe that a polynomial function is a special case of a rational function.
Herein, we will mostly focus our attention on polynomial and rational
functions.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 325
Continuity
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 326
Differentiability
A function F is said to be differentiable at a point z = z0 if the limit
F(z)−F(z0 )
F 0 (z0 ) = limz→z0 z−z0
An open disk in the complex plane with center z0 and radius r is the set of
complex numbers z satisfying
|z − z0 | < r,
Im
z0
Re
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 328
Analyticity
.Example
. . . . . . . . . .A.10
Copyright .Example
.c. . .2013–2020
. . . .A.11
. . . . . . .Michael
. . . . . D. Adams Signals and Systems Edition 2020-05-ECE260 329
Zeros and Singularities
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 330
Zeros and Poles of a Rational Function
.Example
. . . . . . . . . .A.12
Copyright .NEXT
. . . . . . .SLIDE:
.c. . .2013–2020
. . . . . . . . .Signals
Michael .D.
. . Adams
..... Signals and Systems Edition 2020-05-ECE260 331
Part 9
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 332
Motivation for PFEs
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 333
Strictly-Proper Rational Functions
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 334
Section 9.1
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 335
Partial Fraction Expansions (PFEs) [CT and DT Contexts]
am vm + am−1 vm−1 + . . . + a0
F(v) = .
vn + bn−1 vn−1 + . . . + b0
Furthermore, the denominator polynomial D(v) = vn + bn−1 vn−1 + . . . + b0
in the above expression for F(v) can be factored to obtain
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 336
Simple-Pole Case [CT and DT Contexts]
D(v) = (v − p1 )(v − p2 ) · · · (v − pn ),
where the pk are distinct.
In this case, F has a partial fraction expansion of the form
A1 A2 An−1 An
F(v) = + +...+ + ,
v − p1 v − p2 v − pn−1 v − pn
where
Ak = (v − pk )F(v)|v=pk .
Note that the (simple) pole pk contributes a single term to the partial
fraction expansion.
.Example
. . . . . . . . . .B.1
Copyright .c. . .2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 337
Repeated-Pole Case [CT and DT Contexts]
Suppose that the (rational) function F has at least one repeated pole.
In this case, F has a partial fraction expansion of the form
A1,1 A1,2 A1,q1
F(v) = + +...+
v − p1 (v − p1 )2 (v − p1 )q1
A2,1 A2,q2
+ +...+
v − p2 (v − p2 )q2
AP,1 AP,qP
+...+ +...+ ,
v − pP (v − pP )qP
where
1 h q −`
d k qk
i
Ak,` = [(v − p k ) F(v)] .
(qk − `)! dv v=pk
Note that the qk th-order pole pk contributes qk terms to the partial fraction
expansion.
Note that n! = (n)(n − 1)(n − 2) · · · (1) and 0! = 1.
.Example
. . . . . . . . . .B.2
Copyright .NEXT
. . . . . . .SLIDE:
.c. . .2013–2020 . . . . . . .LT
.Michael . .D.
. Adams Signals and Systems Edition 2020-05-ECE260 338
Section 9.2
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 339
Partial Fraction Expansions (PFEs) [DT Context]
Any rational function F can be expressed in the form of
am vm + am−1 vm−1 + . . . + a1 v + a0
F(v) = .
bn vn + bn−1 vn−1 + . . . + b1 v + 1
Furthermore, the denominator polynomial
D(v) = bn vn + bn−1 vn−1 + . . . + b1 v + 1 in the above expression for F(v)
can be factored to obtain
D(v) = (1 − p−1 q1 −1 q2 −1 qn
1 v) (1 − p2 v) · · · (1 − pn v) ,
D(v) = (1 − p−1 −1 −1
1 v)(1 − p2 v) · · · (1 − pn v),
where
Ak = (1 − p−1
k v)F(v) v=pk
.
Note that the (simple) pole pk contributes a single term to the partial
fraction expansion.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 341
Repeated-Pole Case [DT Context]
Suppose that the (rational) function F has at least one repeated pole.
In this case, F has a partial fraction expansion of the form
" #
A1,1 A1,2 A1,q1
F(v) = −1
+ −1 2
+...+
1 − p1 v (1 − p1 v) (1 − p−1
1 v)
q1
" #
A2,1 A2,q2
+ −1
+...+
1 − p2 v (1 − p−1
2 v)
q2
AP,1 AP,qP
+...+ +...+ ,
1 − p−1
P v (1 − p−1P v)
qP
where
1 h q −` i
Ak,` = (−pk )qk −` dv
d k
[(1 − p−1
k v)qk
F(v)] .
(qk − `)! v=pk
Note that the qk th-order pole pk contributes qk terms to the partial fraction
expansion.
Note that n! = (n)(n − 1)(n − 2) · · · (1) and 0! = 1.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 342
Part 10
Miscellany
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 343
Sum of Arithmetic and Geometric Sequences
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 344
Part 11
Epilogue
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 345
Other Courses Offered by the Author of These Lecture
Slides
Computing
For further information about the above courses (including the URLs for
web sites of these courses), please refer to the slides that follow.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 346
1
0.8
0.6
0.4
0.2
0
80
60 70
60
40 50
40
30
20 20
10
0 0
ECE 486/586:
Multiresolution Signal and Geometry Processing with C++
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 347
SENG 475:
Advanced Programming Techniques for Robust Efficient
Computing (With C++)
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 348
Part 12
References
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 349
Online Resources I
1 Barry Van Veen. All Signal Processing Channel on YouTube.
https://www.youtube.com/user/allsignalprocessing.
2 Iman Moazzen. Signal Processing Hacks With Iman.
http://www.sphackswithiman.com.
3 Iman Moazzen. YouTube Channel for Signal Processing Hacks With Iman.
https://www.youtube.com/channel/UCVkatNMgkEdpWLhH0kBqqLw.
4 Wolfram Alpha Derivative Calculator.
https://www.wolframalpha.com/input/?i=derivative+.
5 Wolfram Alpha Integral Calculator.
https://www.wolframalpha.com/input/?i=integral+.
6 Wolfram Alpha Unilateral Laplace Transform Calculator. https://www.
wolframalpha.com/input/?i=laplace+transform+calculator.
7 Wolfram Alpha Unilateral Z Transform Calculator. https:
//www.wolframalpha.com/input/?i=Z+transform+calculator.
8 DSP Stack Exchange. https://dsp.stackexchange.com.
9 Math Stack Exchange. https://math.stackexchange.com.
Copyright c 2013–2020 Michael D. Adams Signals and Systems Edition 2020-05-ECE260 350