Linear Algebra:

What are we going to learn?

What are we going to learn?
• A system of linear equations

coefficients variables constant term

2 𝑥1 +3 𝑥2 +5 𝑥3 ¿ A linear
5
equation
3 𝑥1 +1 𝑥2 −1 𝑥3 ¿ 2
− 2 𝑥1 +1 𝑥2 +1 𝑥3 ¿ 1
a system of linear equations

I believe you know how to solve it.

 What are we going to learn?
• A system of linear equations

m
equations

n variables
In this course, m and n can be large
 What are we going to learn?
• Solving a system of linear equations
Ind
ep end
ent
n
spa
rank

Does it have Does it have How to find Determinants

solution? unique the solution? ( 行列式 )
Approximate solution? Beyond 3 X 3
Solution
Different view from high school
 x1 y1
Linear System x2
System
y2

• We use a system of linear equations to describe a

linear system
• What is system?
• function, transformation, operator
• A system has input and output
• E.g. Speech Recognition System: The input is audio
signals, and the output is recognition results.
• E.g. Siri: You say “Hi, Siri”, it reply “What can I do for
you?”
• E.g. Communication system
• Can have multiple inputs and outputs
Linear System
• Linear system have two properties
• 1. Persevering Multiplication

Linear Linear
x y kx ky
System System

• 2. Persevering Addition

Linear
x1 y1
System x1+x2 y1+y2
Linear
Linear System
x2 y2
System
Linear System x System x2

• Linear system have two properties

• 1. Persevering Multiplication

Linear Linear
x x 2 kx k2 x 2
System System
kx2
• 2. Persevering Addition

𝑥1 Linear
( 𝑥 1 )2
System 𝑥1 + 𝑥 2 ( 𝑥 1+ 𝑥 2 ) 2
Linear
𝑥2 Linear System
( 𝑥 2 )2
System
≠ ( 𝑥 1) 2 + ( 𝑥 2 )2
 𝑥1 𝑥1 + 𝑥 2
Linear System 𝑥2 System 𝑥1 − 𝑥 2

• Two properties
• 1. Persevering Multiplication

𝑥1 𝑥1 + 𝑥 2 𝑘 𝑥1 𝑘 𝑥 1 +𝑘 𝑥 2
𝑥2 System 𝑥1 − 𝑥 2 System
𝑘𝑥 2 𝑘 𝑥 1 − 𝑘𝑥2

• 2. Persevering Addition
𝑥1 𝑥1 + 𝑥 2
𝑥2 System 𝑥1 + 𝑥 ′1
𝑥1 − 𝑥 2
′ System
𝑥 1
′
𝑥 +𝑥
1
′
2
System 𝑥 2+ 𝑥 ′2
𝑥′2 𝑥′1 − 𝑥 ′2
Linear System v.s.
System of Linear Equations

?
𝑥1 𝑏1
𝑥2 𝑏2
Linear
System
……

……
𝑥𝑛 𝑏𝑚
1 𝑎 11 0 𝑎 12 0 𝑎1 𝑛
0 Linear 𝑎 21 1 Linear 𝑎 22 0 Linear 𝑎2 𝑛
……
System System System

……

……

……
……

……

……
0 𝑎𝑚 1 0 𝑎𝑚 2 1 𝑎 𝑚𝑛

𝑥1 0 0
0 𝑥2 0
……

……
……

……

……
……

……
0 0 𝑥𝑛

𝑥1
𝑥2
Linear
System
……

𝑥𝑛

A linear system is described by a system of linear equations

Applications
Most system are (assumed to) be linear

Input: voltage source, current source

Linear output: voltage and current on the
load ( 燈泡、引擎 )

Circuit
+
v i
-
input output
( 大二上 ) Linear System
 Applications
Most system are (assumed to) be linear

Communication System
Linear
Channel

Transmitter Receiver

Linear System

( 大二下 )
Applications 坪數
位置 房價 價格
• Machine Learning …….
分析
• E.g. Prediction Linear system

今天天氣
氣象
昨天天氣 明天天氣
…….
預報
Linear system

股票
分析
今天行情 明天行情
Linear system
Applications
• We will learn EigenXXXXX

Input equals to output Output is zero

𝑥1 𝑥1 𝑥′1 0
𝑥2 𝑥2 𝑥′2
Linear Linear 0
……

System

……
System
……

……
𝑥𝑛 𝑥𝑛 𝑥′𝑛 0

Filter
Applications – Image
Compression
壓縮比 : 25 壓縮比 : 12.5

壓縮比 : 5 壓縮比 : 2.5

原圖
Linear Algebra is Important