Signals and System Chapter 3 - Fourier Transform Notes
Signals and System Chapter 3 - Fourier Transform Notes
ECS204
1 History
The idea of Fourier series, which is completely mathematical in nature, had
come from the study of physics phenonmena.It is the heat propagation and
diffusion.Like how the heat distribution will look over time, and found series
in sinusoids to be useful in representation of the temperature distribution in
the body, and also had helped to explain many physical phenomena unrelated
to heat like Brownian motion and Black Scoles equation.
But here we will just know how the Fouries series help in representing the
various broad class of signals in terms of linear combination of complex expo-
nential signal.Before moving directly on the Fourier series, let’s understand
eigenvalues and function which help in understanding the usefulness of LTI
system and their outputs
Af (x) = λf (x).
Here LTI system act as the linear operator and the complex signal in the
form of complex function act as eigenfunction.
So the complex exponential signal in both discrete and continuous time case
is the eigenfunction in context of the LTI system.It is represented as follows:
• Continuous time:
est → H(s)est
• Discrete time:
z n → H(z)z n
2
Z ∞
y(t) = h(τ )x(t − τ ) dτ
−∞
Z ∞
y(t) = h(τ )es(t−τ ) dτ
−∞
Z ∞
= h(τ )e−sτ est dτ
−∞
Z ∞
= h(τ )e−sτ est dτ
−∞
Z ∞
=e st
h(τ )e−sτ dτ
−∞
Now we denote est by the H(s). Therefore, our new equation becomes,
y(t) = H(s)est where H(s) is related by the equation,
Z ∞
H(s) = h(τ )e−sτ dτ
−∞
∞
X
= h[k]z [n−k]
k=−∞
Assuming the convergence of the complex exponential signal the above equa-
tion takes the form of
y[n] = H(z)z n
3
where,
∞
X
H(z) = h[k]z −k
k=−∞
So from the above example we can see that each coefficient is multiplied by
its eigenvalue H(sk ) associated with esk
4
3 Fourier Series Representation of Continu-
ous Time Periodic Signals
3.1 Linear Combination of Harmonically Related Com-
plex Exponentials
Signal is periodic if, for some positive values of T
x(t) = cos ω0 t
x(t) = ejω0 t
is also periodic with period T in the above equation k = 0 is constant, and the
components for k = +N and k = −N are referred to as the N th components.
Suppose that x(t) is real and can be represented in the form of eq.(1) then
since x∗ = x(t) we obtain
+∞
X
x(t) = a∗k e−jkω0 t
k=−∞
5
Replacing k by −k in summation we get
+∞
X
x(t) = a∗−k ejkω0 t
k=−∞
Now it requires that a∗k = a−k and further rearranging and substituting these
in eq.(1) we get
X∞
x(t) = a0 + ak ejkω0 t + a∗k e−jkω0 t
k=1
Since two terms inside the summation are complex conjugate of each other
and if ak is expressed in polar form we get
∞
X
x(t) = a0 + 2 Re{Ak ej(kω0 t+θk ) }
k=1
That is ∞
X
x(t) = a0 + 2 Ak cos (kω0 t + θk )
k=1
6
For k ̸= n , cos(k − n)ω0 t and sin(k − n)ω0 t are sinusoids with fundamental
period (T /|k − n|). So for k ̸= n both integrals on right-hand side of eq.(2)
are zero For k = n the integrand on left equals 1 and thus the integral equals
T and consequently the right-hand side reduces to, T an Therefore
ZT
1
an = x(t)e−jnω0 t dt
T
0
we will obtain the same result if integrate over any interval of length T .
This pair of equations then defines the Fourier series of periodic continuous-
time signal
+∞
X +∞
X
x(t) = ak ejkω0 t = ak ejk(2π/T )t
k=−∞ k=−∞
Z Z
1 −jkω0 t 1
ak = x(t)e dt = x(t)e−jk(2π/T )t dt
T T
T T
Notice that this signal is periodic but, due to it being not bounded, its in-
tegral is not always defined so (2) doesn’t always yield a finite answer. So
7
Figure 1: Signal x(t) = tan(t)
x(t) = tan(t) is a signal whose Fourier is not defined, which implies period-
icity is not sufficient.
•
R
|x(t)|dt < ∞ , i.e. the absolute integral of the signal over the time
T
period must be finite
• The signal must have finitely many maxima and minima in the time
period
• The signal must have finite number of discontinuities within the time
period
Together, these condition ensures that the periodic signal has a Fourier rep-
resentation.
8
4.2 Gibbs Phenomenon
Let’s observe what happens when we take different frequency into consider-
ation, i.e:
N
a0 X
xN (t) = + an cos(nπt) (4)
2 1
The interesting effect that we can observe in Figure 2 is that the behaviour of
the partial sum in the vicinity of the discontinuity exhibits ripples and that
the peak amplitude of these ripples does not seem to decrease with increasing
N. Josiah Gibbs, a mathematical physicist, showed that this is in fact the
case. So, for any finite N, the peak amplitude of the ripples remains constant.
This behaviour has come to be known as the Gibbs phenomenon.
9
N=5 N=10
N=50 N=100
Figure 3: Convergence of the Fourier series representation of a square wave: an
illustration of the Gibbs phenomenon. Here, we have depicted the finite series
approximation xN (t) = a20 + N
P
1 a n cos(nπt) for several values of N.
We can also, observer that although the ripple at the discontinuity does not
seem to decrease the function itself is converging, as the ripples are getting
closer and closer to the point of discontinuity, hence decreasing the area of
ripples. So we must take sufficiently large values of N while approximating
so that the energy difference between the approximation and the signal is
negligible.
10
5 Properties of Continuous-time Fourier Se-
ries
Fourier series representations possess a number of important properties that
are useful for developing conceptual insights into such representations, and
they can also help to reduce the complexity of the evaluation of the Fourier
series of many signals.
We define a shorthand notation to indicate the relationship between a peri-
odic signal x(t) and its Fourier series coefficients ak as:
s F
x(t) ←→ ak (5)
5.1 Linearity
Let x(t) and y(t) be two periodic signals that obey Dirichlet conditions, so
there exist axk s and ayk s such that,
s F s F
x(t) ←→ axk and y(t) ←→ ayk (6)
Let, z(t) be a linear combination of x(t) and y(t), i.e, z(t) = Ax(t) + By(t)
be a periodic signal then we have,
s F
z(t) = Ax(t) + By(t) ←→ Aaxk + Bayk (7)
Z T Z T
1 −2jnπt 1 −2jnπt
bn = y(t)e T dt = x(t − t0 )e T dt (8)
T 0 T 0
11
1 T
Z
−2jnπ(t0) −2jnπ(t−t0) −2jnπ(t0)
=e T x(t − t0 )e T dt = e T an (9)
T 0
it follows from above that
F −2jnπ(t−t0)
s
x(t − t0 ) ←→ e T axk (10)
One consequence of this property is that, when a periodic signal is shifted in
time, the magnitudes of its Fourier series coefficients remain unaltered. That
is, |bn | = |an |·
by comparison we get,
bn = a−n (13)
If our function is even, i.e x(−t) = x(t), then we know bn = an from (13) we
have, an = a−n
12
While the Fourier coefficients have not changed, the Fourier series represen-
tation has changed because of the change in the fundamental. frequency
5.5 Multiplication
Let x(t) and y(t) be periodic functions that have Fourier series expansion
say ak and bk respectively, we define z(t) = x(t)y(t), assuming z(t) obeys
Dirichlet conditions then we know it has a Fourier expansion given by,
1 T 1 T
Z Z
−2jnπt −2jnπt
cn = z(t)e T dt = (x(t)y(t))e T dt (15)
T 0 T 0
Notice, the integral will give non-zero values if and only if l +k = n, in fact in
such situation the value of integral will be ak bl T ,so it follows that k = n − l.
We substitute all this in the above equation to get,
∞
X
cn = al bn−l or cn = an ∗ bn (18)
l=−∞
5.6 Conjugation
Let x(t) be a nice periodic signal with coefficients ak , consider the complex
conjugate of x(t) be represented by (x(t))∗ then the Fourier series expansion
of it will be,
∞
X 2jkπt
(x(t))∗ = ( ak e T ) ∗ (19)
k=−∞
13
Since (a + b)∗ = a∗ + b∗ and (ab)∗ = a∗ b∗ , we get,
∞ ∞
X 2jkπt X −2jkπt
∗ ∗
(x(t)) = (ak e T ) = ak ∗ e T
k=−∞ k=−∞
∞
X 2jkπt
= a−k ∗ e T (20)
k=−∞
By comparison we get,
F
x(t)∗ ←→
s
a−k ∗ (21)
If x(t) be a real signal then we get x(t)∗ = x(t), it follows from above that
a−k ∗ = ak , Moreover if the signal is even then we know a−k = ak . Combining
both yields, ak ∗ = ak .
So if x(t) is a real even periodic signal then, its coefficients are always real.
1 T
Z
Pavg = x(t)x(t)∗ dt
T 0
Using 5.6 we can obtain,
" ∞
#
Z T
1 X −2jkπt
Pavg = x(t) ak ∗ e T dt
T 0 −∞
∞
" #
Z T
X 1 −2jkπt
= ak ∗ x(t)e T dt
−∞
T 0
14
∞
X
Pavg = ak ∗ [ak ]
−∞
∞
X
= |ak |2 (22)
−∞
So average power is equal to the sum of average power of all harmonics, this
is called Parseval’s theorem.
x[n + N ] = x[n]
2jπkn 2jπpN n
=e N e N
15
2jπkn
=e N e2jπpn
2jπkn
=e N
= Φk [n] (25)
What (25) means is that if we change k by an integer multiple of N then the
identical signal Φ is generated, so while writing discrete-time Fourier series
we only need to consider different signals, using this fact in (33) we obtain
that we just need our sum over N successive integers or,
N N −1+q
X 2jπkn X 2jπkn X 2jπkn
x[n] = ak e N = ak e N = ak e N (26)
k=1 k=q k∈⟨N ⟩
This sum is equivalent to the sum of roots of xq = 1 for some q, since the
equation doesn’t have any x terms we have sum of roots is zero so,
X 2jkπn
e N = 0 for k ̸= 0
n∈⟨N ⟩
16
Consider the sum,
1 X −2jkπn
x[n]e N
N
n∈⟨N ⟩
" #
1 X X 2j(p−k)πn
= ap e N (28)
N
p∈⟨N ⟩ n∈⟨N ⟩
17
6.3 Differences Between Discrete-Time Fourier Series
(DTFS) and Continuous-Time Fourier Series(CTFS)
DTFS CTFS
x[n] is periodic in n x(t) is periodic in t
ejkω0 n is periodic in both k and n ejkω0 t is periodic in both t but not in
k
Coefficients are periodic Coefficients are not periodic
x[n] is defined by a finite sum of har- x(t) is defined by an infinite sum of
monic signals harmonic signals
No Dirichlet condition Dirichlet conditions are present
7.1 Linearity
Let x[n] and y[n] be periodic discrete-time signals of the same fundamental
time period, and let ak and bk be coefficients of them respectively, then
s F
Ax[n] + By[n] ←→ Aak + Bbk (30)
This property is similar to what we have seen in CTFS.
By comparison we get,
−2jkπn0
bk = e N ak (31)
18
7.3 Multiplication
Let y[n] and x[n] be periodic discrete-time signals with period N and Fourier
coefficients ak and, bk respectively. We define z[n] = x[n]y[n], let cn be its
Fourier coefficients then, X
cn = al bn−l (32)
l∈⟨N ⟩
19
7.5 Properties Summary
Let x[n] and y[n] be discrete-time periodic signals with same period N with
Fourier coefficients ak and bk respectively, then,
|al |2
P
Parseval’s theorem x[n] Pavg = l∈⟨N ⟩
Real and even x[n] is real and even ak are real and even
Real and odd x[n] is real and odd ak are purely imaginary
and odd
which h(t) is the impulse response of the LTI system. Similarly, if x[n] = z n
is the input to a discrete-time LTI system, then the output is given by y[n] =
20
H(z)z n , where
x
X
H(z) = h[k]z −k (35)
k=−x
Figure 4: (a) The square-wave sequence x[r] in Example; (b) the sequence x[r]
equal to x[r] for −3 ≤ r ≤ 3 and zero otherwise; (c) the sequence x[n − r]; (d)
the sequence w[n] equal to the periodic convolution of x[n] with itself and to the
aperiodic convolution of x[n] with x[n]
When s or z are general complex numbers, H(s) and H(z) are referred to
as the system functions of the corresponding systems. For continuous-time
signals and systems, we focus on the specific case in which Re{s} = 0, so
that s = jω, and consequently, est is of the form ejωt — i.e., H(jω) viewed
as a function of ω — is referred to as the frequency response of the system
21
and is given by
Z ∞
H(jω) = (h(t)e−jωt )dt (36)
−∞
Suppose that we apply this signal as the input to an LTI system with impulse
response h(t). Then, since each of the complex exponentials in (38) is an
eigenfunction of the system, it follows that the output is
+x
X
y(t) = ak H(jkω0 )ejkω0 t (39)
k=−x
Thus, y(t) is also periodic with the same fundamental frequency as x(t).
Furthermore, if {ak } is the set of Fourier series coefficients for the input
22
x(t), then {ak H(jkω0 )} is the set of coefficients for the output y(t). That
is, the effect of the LTI system is to modify individually each of the Fourier
coefficients of the input through multiplication by the value of the frequency
response at the corresponding frequency.
Example 1: Suppose that the periodic signal x(t) is the input signal to an
LTI system with impulse response
To calculate the Fourier series coefficients of the output y(t), we first compute
the frequency response:
Z x
−jω
H(jω) = e−τ e−e dt (41)
0
1 −jω ∞
=− e−e |0 x
1 + jω
1
=
1 + jω
2π
Therefore, using (39) and (40), together with the fact that ω0 = T
in this
example, we obtain
3
X
y(t) = bk ejk2t (42)
k=−3
b0 = 1,
1 1
b1 = (1 + j2), b−1 = (1 − j2),
4 4
1 1 (43)
b2 = (1 + j4), b−2 = (1 − j4),
2 2
1 1
b3 = (1 + j6), b−3 = (1 − j6)
3 3
23
Note that y(t) must be a real-valued signal, since it is the convolution of x(t)
and h(t), which are both real. This can be verified by examining (41) and
observing that b∗k = b−k .
3
2X
y(t) = 1 + Dk cos(2kt + k) (44)
3 k=1
Or
3
2X
y(t) = 1 + (Ek cos 2kt − Fk sin 2kt)
3 k=1
Where
bk = Dk ejk = Ek + Fk , k = 1, 2, 3 (45)
In discrete time, the relationship between the Fourier series coefficients of the
input and output of an LTI system exactly parallels (38) and (39). Specif-
ically, let x[n] be a periodic signal with Fourier series representation given
by
N
X −1
x[n] = ak ejk(2π/N )n (46)
k=0
If we apply this signal as the input to an LTI system with impulse response
h[n], then with zk = ejk(2π/N ) , the output is
N
X −1
y[n] = ak H(ej2π/N )n (47)
k=0
24
Thus, y[n] is also periodic with the same period as x[n], and the kth Fourier
coefficient of y[n] is the product of the kth Fourier coefficient of the input
and the value of the frequency response of the LTI system, H(ej2πk/N ), at
the corresponding frequency.
25