CH 2
CH 2
HS1071
LINEAR ALGEBRA AND
DIFFRENTIAL EQUATIONS
Contents
• Introduction
• Vector Space and standard vector spaces
• Subspace
• Linear Combination
• Span of a set ,
• Spanning set
• Linearly dependent and independent vectors
• Basis and dimension of a subspace
• Fundamental subspaces
INTRODUCTION
Vector spaces have numerous applications across various fields, including:
Physics and Engineering
1. Mechanics: Describing forces, velocities, and accelerations.
2. Electromagnetism: Representing electric and magnetic fields.
3. Quantum Mechanics: State vectors and operators.
4. Signal Processing: Filtering, convolution, and Fourier analysis.
Computer Science
1. Graphics: 2D/3D transformations, projections, and animations.
2. Machine Learning: Data representation, neural networks, and deep learning.
3. Natural Language Processing (NLP): Text analysis, sentiment analysis, and word embeddings.
4. Computer Vision: Image processing, object recognition, and segmentation.
Mathematics
1. Linear Algebra: Solving systems of linear equations.
2. Differential Equations: Modeling dynamic systems.
3. Optimization: Linear and nonlinear programming.
4. Statistics: Regression analysis and hypothesis testing.
INTRODUCTION
Data Analysis and Data Science:
Translation
invariance
for detecting
Mechanical or modeling
stresses in an object
rock
Chemical reactions
DEFINITION OF VECTOR SPACE
2. Addition is commutative
𝑢+𝑣 =𝑣+𝑢
3. Addition is associative
𝑢 + 𝑣 + 𝑤 = 𝑢 + 𝑣 + 𝑤.
1. Trivial Space
2. Euclidean space
𝑅𝑛 = 𝑥1 , 𝑥2 , 𝑥3 , … , 𝑥𝑛 ∣ 𝑥1 , 𝑥2 , … , 𝑥𝑛 ∈ 𝑅
Set of all ordered 𝑛-tuple of real or complex numbers) is a vector space under component wise addition
and scalar multiplication as follows
𝑥1 , 𝑥2 , ⋯ , 𝑥𝑛 + 𝑦1 , 𝑦2 , ⋯ , 𝑦𝑛 = 𝑥1 + 𝑦1 , 𝑥2 + 𝑦2 , ⋯ , 𝑥𝑛 + 𝑦𝑛
And
𝛼 ⋅ 𝑥1 , 𝑥2 , ⋯ , 𝑥𝑛 = 𝛼𝑥1 , 𝛼𝑥2 , ⋯ , 𝛼𝑥𝑛
Standard Vector Spaces
𝑃𝑛 𝑥 = 𝑎0 𝑥 𝑛 + 𝑎1 𝑥 𝑛−1 + ⋯ + 𝑎𝑛 /𝑎0 , 𝑎1 , … , 𝑎𝑛 ∈ 𝑅
= Set of all polynomials in 𝑥 of degree ′less than or equal ′𝑛 ′ with real
coefficients
Operations are as follows :
𝑎0 𝑥 𝑛 + 𝑎1 𝑥 𝑛−1 + ⋯ + 𝑎𝑛 + 𝑏0 𝑥 𝑛 + 𝑏1 𝑥 𝑛−1 + ⋯ + 𝑏𝑛 = 𝑎0 + 𝑏0 𝑥 𝑛 + 𝑎1 + 𝑏1 𝑥 𝑛−1 + ⋯ + 𝑎𝑛 + 𝑏𝑛
And
This collection is not a vector space because the scalar multiplication does not satisfy the
property 1. 𝑢 = 𝑢 for 𝑢 ∈ 𝑉.
Note that ,
1. (𝑥, 𝑦, 𝑧) = (1𝑥, 0,0) as per given rule (scalar multiplication) 𝑐(𝑥, 𝑦, 𝑧) = (𝑐𝑥, 0,0).
Examples
ANSWER
This collection is not a vector space because the scalar multiplication does not satisfy the property
(𝑐 + 𝑑)𝑢 = 𝑐𝑢 + 𝑑𝑢 for 𝑢 ∈ 𝑉 and 𝑐, 𝑑 ∈ 𝑅.
Note that
(𝑐 + 𝑑)(𝑥, 𝑦) = ((𝑐 + 𝑑)𝑥, 𝑦) = (𝑐𝑥 + 𝑑𝑥, 𝑦)
THEOREM:
A non-empty subset U of vector space V is a subspace of V if and only if
1. 𝑈 is closed under addition, i. e.,
𝑢1 + 𝑢2 ∈ 𝑈 for all 𝑢1 , 𝑢2 ∈ 𝑈
2. 𝑈 is closed under scalar multiplication, i. e., 𝛼𝑢 ∈ 𝑈 for every 𝛼 ∈ 𝑅 and 𝑢 ∈ 𝑈.
Solution : Let 𝑢, 𝑣 ∈ 𝑊
𝑢 = 𝑥1 , 𝑦1 , 𝑧1 ∈ 𝑊 ⇒ 𝑥1 + 𝑦1 + 𝑧1 = 0
𝑣 = 𝑥2 , 𝑦2 , 𝑧2 ∈ 𝑊 ⇒ 𝑥2 + 𝑦2 + 𝑧2 = 0
𝑢 + 𝑣 = 𝑥1 , 𝑦1 , 𝑧1 + 𝑥2 , 𝑦2 , 𝑧2 = 𝑥1 + 𝑥2 , 𝑦1 + 𝑦2 , 𝑧1 + 𝑧2
But 𝑥1 + 𝑥2 + 𝑦1 + 𝑦2 + 𝑧1 + 𝑧2 = 𝑥1 + 𝑦1 + 𝑧1 + 𝑥2 + 𝑦2 + 𝑧2 = 0 + 0 = 0
∴𝑢+𝑣 ∈𝑊
Thus 𝛼𝑢 ∈ 𝑊.
Thus, W = {(𝑥, 𝑦, 𝑧)/𝑥 + 𝑦 + 𝑧 = 0 ∈ 𝑅} ⊆ 𝑅3 is subspace of 𝑅3 .
EXAMPLES
Ex. 2 : Let W = {(𝑥, 𝑦, 𝑧)/2𝑥 + 3𝑦 + 𝑧 = 5} ⊆ 𝑅3 . Is 𝑊 Subspace of 𝑅3 ?
Solution:
Zero element of 𝑅3 is (0,0,0). Given plane does not pass through (0,0,0).
∴ W is not a subspace.
Ex. 5:
W = {(𝑥, 𝑦)/𝑦 = 𝑚𝑥, 𝑚 fixed } ⊆ 𝑅2 is a subspace of 𝑅2 ?
Solution: Let 𝑢, 𝑣 ∈ 𝑊
u = 𝑥1 , 𝑦1 , 𝑣 = 𝑥2 , 𝑦2 ∈ W ⇒ 𝑦1 = 𝑚𝑥1 , 𝑦2 = 𝑚𝑥2
𝑢 + 𝑣 = 𝑥1 + 𝑥2 , 𝑦1 + 𝑦2 .
But 𝑦1 + 𝑦2 = 𝑚𝑥1 + 𝑚𝑥2 = 𝑚 𝑥1 + 𝑥2 .
⇒ 𝑢 + 𝑣 ∈ W.
W is closed w.r.t addition.
Let 𝑢 = 𝑥1 , 𝑦1 ∈ W and 𝛼 ∈ 𝑅 then 𝛼𝑢 = 𝛼𝑥1 , 𝛼𝑦1
𝑞(𝑥) = 𝑟𝑥 2 + 𝑠𝑥 + 𝑡 where 𝑟 + 𝑠 + 𝑡 = 0
Consider 𝑝 + 𝑞 = 𝑎𝑥 2 + 𝑏𝑥 + 𝑐 + 𝑟𝑥 2 + 𝑠𝑥 + 𝑡 = 𝑎 + 𝑟 𝑥 2 + 𝑏 + 𝑠 𝑥 + 𝑐 + 𝑡
Now (𝑎 + 𝑟) + (𝑏 + 𝑠) + (𝑐 + 𝑡) = (𝑎 + 𝑏 + 𝑐) + (𝑟 + 𝑠 + 𝑡) = 0 + 0 = 0
∴ 𝑝 + 𝑞 ∈ W.
where 𝛼𝑎 + 𝛼𝑏 + 𝛼𝑐 = 𝛼(𝑎 + 𝑏 + 𝑐) = 𝛼0 = 0 ∴ 𝛼𝑝 ∈ W
∴ W is a subspace of 𝑃2 .
EXAMPLES
Solution:
Let 𝑢, 𝑣 ∈ U1 ∩ U2 ⇒ 𝑢, 𝑣 ∈ U1 and 𝑢, 𝑣 ∈ U2
But U1 and U2 are subspaces, so are closed w.r.t addition and scalar multiplication.
∴ 𝑢, 𝑣 ∈ U1 and 𝑢, 𝑣 ∈ U2 ⇒ 𝑢 + 𝑣 ∈ U1 and 𝑢 + 𝑣 ∈ U2
Thus 𝑢 + 𝑣 ∈ U1 ∩ U2 and 𝑘𝑢 ∈ U1 ∩ U2
Thus , U1 ∩ U2 is also a subspace.
Solution: Consider,
U1 = {(𝑥, 𝑦) ∣ 𝑦 = 2𝑥}
𝑢 = 𝑥1 , 𝑦1 , 𝑣 = 𝑥2 , 𝑦2 ∈ U1 ⇒ 𝑦1 = 2𝑥1 , 𝑦2 = 2𝑥2
𝑢 + 𝑣 = 𝑥1 , 𝑦1 + 𝑥2 , 𝑦2 = 𝑥1 + 𝑥2 , 𝑦1 + 𝑦2 and
𝑦1 + 𝑦2 = 2𝑥1 + 2𝑥2 = 2 𝑥1 + 𝑥2 .
Definition:
Let 𝐻 = 𝑣1 , 𝑣2 , 𝑣3 , … , 𝑣𝑛 be a subset of a vector space V ,then the sum 𝑐1 𝑣1 + 𝑐2 𝑣2 + ⋯ + 𝑐𝑛 𝑣𝑛 , where
𝑐1 , 𝑐2 , … , 𝑐𝑛 ∈ 𝑅 is defined as a linear combination of 𝑣1 , 𝑣2 , … , 𝑣𝑛 .
Definition:
SPAN OF SET
Let H = 𝑣1 , 𝑣2 , 𝑣3 , … , 𝑣𝑛 be a subset of a vector space 𝑉. Then span of 𝐻 denoted by
spanH is defined as
spanH = 𝑐1 𝑣1 + 𝑐2 𝑣2 + ⋯ + 𝑐𝑛 𝑣𝑛 ∣ 𝑐1 , 𝑐2 , … , 𝑐𝑛 ∈ 𝑅
= Set of of all possible linear combinations of H
SPANNING SET
Let H = {𝑣1 , 𝑣2 , … , 𝑣𝑛 } be a subset of vector space V.
H is said to be a spanning set of V if every element of
V is expressible as linear combination of elements of H.
⟹ 𝑣 ∈ span𝐻 for all 𝑣 ∈ V.
𝑖. 𝑒. 𝑣 = 𝑐1 𝑣1 + 𝑐2 𝑣2 + ⋯ + 𝑐𝑛 𝑣𝑛 is consistent for all 𝑣 ∈ 𝑉.
RESULT
Important Result
Let 𝐻 = 𝑣1 , 𝑣2 , … , 𝑣𝑛 be a subset of a vector space V , then
i) spanH is a subspace of 𝑉
ii) spanH is a smallest subspace which contains set H .
Important: Above result is useful tool to prove that given subset a subspace or not.
Note:
1. For any non-zero vector 𝑣 in 𝑅2 or 𝑅3 span(𝑣) is a line passing through origin.
2. For any two non zero vectors
𝑣1 , 𝑣2 in 𝑅3 span 𝑣1 , 𝑣2 , where 𝑣1 ≠ 𝛼𝑣2 , represents a plane passing through origin
EXAMPLES
𝑎 + 2𝑏
Ex. 1 Show that 𝑊 = : 𝑎, 𝑏 ∈ 𝑅 ⊆ 𝑅2 is a subspace of 𝑅2 .
𝑎−𝑏
𝑎 + 2𝑏 𝑟 + 2𝑠
Let 𝑢, 𝑣 ∈ 𝑊 ∴ 𝑢 = ,𝑣 =
Solution:Method 1 : 𝑎−𝑏 𝑟−𝑠
𝑎 + 2𝑏 𝑟 + 2𝑠 (𝑎 + 𝑟) + 2(𝑏 + 𝑠)
∴𝑢+𝑣 = + = ∈ 𝑊, as 𝑎 + 𝑟, 𝑏 + 𝑠 ∈ 𝑅.
𝑎−𝑏 𝑟−𝑠 (𝑎 + 𝑟) − (𝑏 + 𝑠)
To show 𝛼𝑢 ∈ 𝑊
𝑎 + 2𝑏 𝛼𝑎 + 𝛼2𝑏 𝛼𝑎 + 2𝛼𝑏
𝛼 ∈ 𝑅, 𝑢 = ∈ 𝑊, 𝛼𝑢 = =
𝑎−𝑏 𝛼𝑎 − 𝛼𝑏 𝛼𝑎 − 𝛼𝑏
∴ W is a subspace of 𝑅2 .
Method 2 : Solution:
𝑎 + 2𝑏 𝑎 2𝑏 1 2
= + =𝑎 +𝑏 , 𝑤ℎ𝑒𝑟𝑒 𝑎, 𝑏 ∈ 𝑅
𝑎−𝑏 𝑎 −𝑏 1 −1
1 2
∴ W = span ,
1 −1
∴ W is a subspace of 𝑅2 .
EXAMPLES
Ex. 2 Show that the set of all symmetric matrices of order 2 × 2 is a subspace of 𝑀2×2 (𝑅).
Solution:
𝑎 𝑐
We will use spanning set theorem i.e we will show that can be expressed as linear combination of
𝑐 𝑏
members of 𝑀2×2 (𝑅).
𝑎 𝑐 1 0 0 0 0 1
Consider =𝑎 +𝑏 +𝑐
𝑐 𝑏 0 0 0 1 1 0
1 0 0 0 0 1
∴ H = span , , .
0 0 0 1 1 0
Hence the result.
Ex. 3 𝑟−𝑠
Show that U = 2𝑟 − 5𝑠 + 𝑡 /𝑟, 𝑠, 𝑡 ∈ 𝑅 subspace of 𝑅 3 .
𝑠+𝑡
Solution:
𝑟−𝑠 𝑟 −𝑠 0 1 −1 0
2𝑟 − 5𝑠 + 𝑡 = 2𝑟 + −5𝑠 + 𝑡 = 𝑟 2 + 𝑠 −5 + 𝑡 1
𝑠+𝑡 0 𝑠 𝑡 0 1 1
1 −1 0
∴ U = span 2 , −5 , 1
0 1 1
Thus, U is subspace of 𝑅 3 .
EXAMPLES
Ex. 4
𝑎−𝑏+𝑐
2𝑎 − 𝑏
Show that 𝐻 = : 𝑎, 𝑏, 𝑐 ∈ 𝑅 is a subspace of 𝑅4 .
𝑎 − 𝑏 − 5𝑐
2𝑎 − 𝑐
Solution:
𝑎−𝑏+𝑐 1 −1 1
2𝑎 − 𝑏 2 −1 0
Consider =𝑎 +𝑏 +𝑐
𝑎 − 𝑏 − 5𝑐 1 −1 −5
2𝑎 − 𝑐 2 0 −1
1 −1 1
2 −1 0
⇒ H = span , , = span 𝑣1 , 𝑣2 , 𝑣3 , where 𝑣1 , 𝑣2 , 𝑣3 ∈ 𝑅4 .
1 −1 −5
2 0 −1
∴ H is a subspace of 𝑅4 .
Ex. 5
For what value of ℎ, will 𝑦 be in a subspace spanned by 𝑣1 , 𝑣2 , 𝑣3 .
1 5 −3 −4
where 𝑣1 = −1 , 𝑣2 = −4 , 𝑣3 = 1 , 𝑦 = 5 .
−2 −7 0 ℎ
Solution:
i) Let 𝑦 = 𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3
−4 1 5 −3
5 = 𝑐1 −1 + 𝑐2 −4 + 𝑐3 1
ℎ −2 −7 0
Ex. 6 𝑎 1 5 −3
3
Let 𝑣 = 𝑏 ∈ 𝑅 ⋅ 𝑣 = 𝑐1 −1 + 𝑐2 −4 + 𝑐3 1
𝑐 −2 −7 0
1 5 −3 𝑎
[A: B] = −1 −4 1 𝑏
−2 −7 0 𝑐
Reducing to echelon form
1 5 −3 𝑎
A : B ∼ 0 1 −2 𝑏+𝑎
0 0 0 𝑐 − 3𝑏 − 𝑎
As 𝜌[𝐴] = 2, ∴ the system will not be consistant for every 𝑣 ∈ 𝑅3 .
∴ span 𝑣1 , 𝑣2 , 𝑣3 ≠ 𝑅3 .
SUM OF SUBSPACES
Let U and W are subspaces of a vector space V .
Sum of 𝑈 and 𝑊 is defined as
U + W = {𝑢 + 𝑤 ∈ V: 𝑢 ∈ U and 𝑤 ∈ W}
Show that U + W is a subspace of V .
𝑥 + 𝑦 = 𝑢1 + 𝑤1 + 𝑢2 + 𝑤2
= 𝑢1 + 𝑢2 + 𝑤1 + 𝑤2
but 𝑢1 + 𝑢2 ∈ 𝑈 and 𝑤1 + 𝑤2 ∈ 𝑊
2) Find the value of k , for which 𝑣 = (3,0, 𝑘) be in the subspace spanned by u1 , 𝑢2 , 𝑢3 where
𝑢1 = (1, −1,2), 𝑢2 = (2,4, −2), 𝑢3 = (1,2, −4).
𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3 + ⋯ + 𝑐𝑛 𝑣𝑛 = 0
𝑐1
𝑐
𝐴𝐶 = 0 where 𝐴 = 𝑣1 𝑣2 𝑣3 …𝑣𝑛 , 𝐶 = 2 .
…
𝑐𝑛
This is a homogenous system of linear equation which is always consistent i.e., the system has trivial
solution always
Step2:
Find rank of A. Let 𝜌(𝐴) = 𝑟
Step3:
𝑖 ) If 𝜌(𝐴) = 𝑟 = 𝑛 (Number of unknowns), then the set is linearly independent.
ii) If 𝜌(𝐴) = 𝑟 < 𝑛 (Number of unknowns), then the set is linearly dependent.
Step4:
If dependent find relation between the vectors.
EXAMPLES
Ex. 1
Examine for linear dependence or independence the following system of vectors. If dependent, find the
relation between them.
𝑥1 = (3,1, −4), 𝑥2 = (2,2, −3), 𝑥3 = (0, −4,1)
Solution:
Let 𝑐1 𝑥1 + 𝑐2 𝑥2 + 𝑐3 𝑥3 = 0
Substitute 𝑐1 , 𝑐2 , 𝑐3 in
c1 x1 + c2 x2 + c3 x3 =0
−2tx1 + 3tx2 + tx3 =0
•
−2x1 + 3x2 + x3 =0
∴ 2x1 = 𝟑𝐱 𝟐 + x𝟑
EXAMPLES
Ex. 2
Examine whether the following vectors are linearly dependent or independent.
x1 = 2,2,7, −1 , x2 = 3, −1,2,4 , x3 = (1,1,3,1)
Solution:
Let 𝑐1 𝑥1 + 𝑐2 𝑥2 + 𝑐3 𝑥3 = 0
−1 4 1 0
R1 ↔ R 4 2 −1 1 0
7 2 3 0
2 3 1 0
−1 4 1 0
𝑅2 + 2𝑅1, 𝑅3 + 7𝑅1, 𝑅4 + 2𝑅1 0 7 3 0
0 30 10 0
0 11 3 0
−1 4 1 0
0 7 3 0
R 3 − 4R 2 , R 4 − R 2
0 2 −2 0
0 4 0 0
−1 4 1 0
0 1 9 0
R2 − 3R3, 14 R4
0 2 −2 0
0 1 0 0
EXAMPLES
−1 4 1 0
0 1 9 0
R 3 − 2R 2 , R 4 − R 2
0 0 −20 0
0 0 −9 0
−1 4 1 0
−1 −1 0 1 9 0
𝑅3 , 𝑅4
20 9 0 0 1 0
0 0 1 0
−1 4 1 0
0 1 9 0
R4 − R3
0 0 1 0
0 0 0 0
Matrix is in echelon form.
𝜌(𝐴) = 𝜌(𝐴, 𝐵) = 3 = number of unknowns.
Thus, above system has trivial solution only.
Solution:
𝑣1 = 1 − 𝑡, 𝑣2 = 2𝑡 + 3𝑡 2 , 𝑣3 = 𝑡 2 − 2𝑡 3 , 𝑣4 = 2 + 𝑡 3
Consider,
𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3 + 𝑐4 𝑣4 = 0
𝑐1 (1 − 𝑡) + 𝑐2 2𝑡 + 3𝑡 2 + 𝑐3 𝑡 2 − 2𝑡 3 + 𝑐4 2 + 𝑡 3
= 0 + 0𝑡 + 0𝑡 2 + 0𝑡 3
1 0 0 2
−1 2 0 0
𝐴∼
0 3 1 0
0 0 −2 1
1 0 −2 1 3 4 −3 −3
𝐻= , , ,
2 3 −1 0 2 3 1 3
Solution:
1 0 −2 1 3 4 −3 −3
Let 𝑣1 = , 𝑣2 = , 𝑣3 = , 𝑣4 =
2 3 −1 0 2 3 1 3
1 0 −2 1 3 4 −3 −3 0 0
𝑐1 + 𝑐2 + 𝑐3 + 𝑐4 =
2 3 −1 0 2 3 1 3 0 0
𝑐1 − 2𝑐2 + 3𝑐3 − 3𝑐4 = 0
𝑐2 + 4𝑐3 − 3𝑐4 = 0
2𝑐1 − 𝑐2 + 2𝑐3 + 𝑐4 = 0
3𝑐1 + 3𝑐3 + 3𝑐4 = 0
1 −2 3 −3
0 1 4 −3
⇒𝐴=
2 −1 2 1
3 0 3 3
EXAMPLES
1 −2 3 −3 1 −2 3 −3
0 1 4 −3 0 1 4 −3
𝐴∼ ∼
0 3 −4 7 0 0 −16 16
0 6 −6 12 0 0 −30 30
1 −2 3 −3
0 1 4 −3
𝐴∼
0 0 1 −1
0 0 0 0
−2 5
1 2 −4
4 −10
𝐜. 1 , 3 , −6 𝐝. 𝑣1 = , 𝑣2 =
6 −15
1 4 −8
10 −25
Answers
−1 4 −6
1. S1 = 2 , 1 , 3
1 −3 5
1 0 0 1
2. S2 = 1 , 1 , 0 , 0
1 1 1 1
1 0 1 0 0
3. S3 = 1 , 1 4. S4 = 1 , 1 , 0
1 1 1 1 1
A
EXAMPLES
Ex.1 Find the condition on 𝑡 for which the set of {(𝑡, 1,1), (1, 𝑡, 1), (𝑡, 1,3)} is linearly independent.
Solution: Let 𝑣1 = 𝑡, 1,1 , 𝑣2 = 1, 𝑡, 1 , 𝑣3 = (𝑡, 1,3)
Set of vectors {𝑣1 , 𝑣2 , 𝑣3 } is linearly independent iff
𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3 = 0 ⇒ 𝑐1 = 𝑐2 = 𝑐3 = 0
Consider, 𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3 = 0
i.e. 𝑐1 𝑡, 1,1 + 𝑐2 1, 𝑡, 1 + 𝑐3 𝑡, 1,3 = 0,0,0
Thus, ( 𝑡𝑐1 +𝑐2 + 𝑡𝑐3 , 𝑐1 + 𝑡𝑐2 + 𝑐3 , 𝑐1 +𝑐2 +3𝑐3 ) = 0,0,0
⇒ 𝑡𝑐1 + 𝑐2 + 𝑡𝑐3 = 0
𝑐1 + 𝑡𝑐2 + 𝑐3 = 0
𝑐1 + 𝑐2 + 3𝑐3 = 0
Since given set is linearly independent, Above system has trivial solution only.
i.e. 𝑡 1 𝑡
1 𝑡 1 ≠0
1 1 3
A
EXAMPLES
∴ 𝑡 3𝑡 − 1 − 1 3 − 1 + 𝑡 1 − 𝑡 ≠ 0
∴ 3𝑡 2 − 𝑡 − 2 + 𝑡 − 𝑡 2 ≠ 0
∴ 2𝑡 2 − 2 ≠ 0
∴ 𝑡2 − 1 ≠ 0
∴ 𝑡2 ≠ 1
∴ 𝑡 ≠ ±1
Thus , 𝑖𝑓 𝑡 ≠ ±1
then the set {(𝑡, 1,1), (1, 𝑡, 1), (𝑡, 1,3)} is linearly independent.
BASIS
finite dimensional.
IMPORTANT
𝑖𝑖) A set having maximum number of linearly independent vectors is the basis.
𝑖𝑖𝑖) Minimum number of vectors which spans the vector space is the basis.
𝑣)If a vector space V has one basis with n vectors,then every basis for V has n vectors.
NOTE
Note:
1) In an n − dimensional vector space V, any set of “n + 1” vectors or more is always linearly dependent.
2) In an n − dimensional vector space V, any set having " less than n " vectors cannot span vector space V.
STANDARD BASIS
1. V = 𝑅𝑛 , 𝐵 = {𝑒1 , 𝑒2 , … , 𝑒𝑛 }
where 𝑒1 = (1,0, … , 0), 𝑒2 = (0,1, … , 0), . . . , e𝑛 = (0,0, … , 1).
dim( 𝑅𝑛 ) = 𝑛.
1 0 0 1 0 0 0 0
2. V = 𝑀2×2 (𝑅), 𝐵 = , , ,
0 0 0 0 1 0 0 1
1 −1 1 1
Is 𝐵 = 2 , 2 , 1 , 2 a basis of 𝑅3 ?
1 1 1 3
1 0 −1 0 2 1 1 1
𝑆= , , ,
0 1 1 1 1 0 0 1
Solution:
Since dim( 𝑀2×2 (𝑅)) = 4, and S contains 4 vectors, therefore
S is a basis for𝑀2×2 (𝑅) if and only if given set of vectors
are linearly independent.
1 0 −1 0 2 1 1 1
Let 𝑣1 = , 𝑣2 = , 𝑣3 = , 𝑣4 =
0 1 1 1 1 0 0 1
Let us check whether {𝑣1 , 𝑣2 , 𝑣3 , 𝑣4 } is linearly independent or not.
Consider 𝑐1 𝑣1 + 𝑐2 𝑣2 + 𝑐3 𝑣3 + 𝑐4 𝑣4 = 0. . . (1)
1 −1 2 1
0 0 1 1
A𝐶 = 0 𝑤ℎ𝑒𝑟𝑒 A =
0 1 1 0
1 1 0 1
1 −1 2 1
0 1 1 0
Reducing it to echelon form we get A ~
0 0 1 1
0 0 0 4
𝜌(𝐴) = 4
∴ System 1 has trivial solution only. ∴ S is linearly independent.
∴ S is a basis for 𝑀2×2 𝑅 .
Method of determining the dimension of a subspace:
⇒ 𝑐1 , 𝑐1 + 𝑐2 , 𝑐2 , 𝑐1 − 𝑐3 = 0,0,0,0
Thus, we get
𝑐1 = 0, 𝑐1 + 𝑐2 = 0, 𝑐2 = 0, 𝑐1 − 𝑐3 = 0
EXAMPLES
Solution continued :
∴ 𝑐1 = 0, 𝑐2 = 0 and 𝑐1 − 𝑐3 = 0 ⇒ 0 − 𝑐3 = 0 ⇒ 𝑐3 = 0
Thus, above system has trivial solution only.
∴ The set of vectors are linearly independent.
𝐛) 𝑆 = 3𝑎, 𝑎, 𝑏, 0 : 𝑎, 𝑏 ∈ 𝑅
𝑆𝑜𝑙𝑢𝑡𝑖𝑜𝑛:
3𝑎, 𝑎, 𝑏, 0 = 𝑎(3,1,0,0) + b( 0,0,1,0)
we can see that S is spanned by (3,1,0,0), (0,0,1,0)
∴ 𝐵 = (3,1,0,0), 0,0,1,0 spans S .
∴ dim( 𝑆) = 𝐵 = 2.
EXAMPLES
𝑄𝑢𝑒𝑠𝑡𝑖𝑜𝑛 ∶
𝑎+𝑐 𝑎 0 𝑐 1 0 1
𝑎 + 2𝑏 − 𝑐 = 𝑎 + 2𝑏 + −𝑐 = 𝑎 1 + 𝑏 2 + 𝑐 −1
𝑎+𝑏 𝑎 𝑏 0 1 1 0
1 0 1
∴ S = 𝑠𝑝𝑎𝑛 1 , 2 , −1 ⇒ S is a subspace.
1 1 0
1 0 1
Note that 1 , 2 , −1 is a spanning set but
1 1 0
1 0 1 vectors in above set are
1 − 2 = −1 ⇒ not linearly independent.
1 1 0
1 0 1
Hence 1 , 2 , −1 is not a basis.
1 1 0
1 0
To find the basis, note that if 𝑢 = 1 , 𝑣 = 2
1 1
1
and 𝑤 = −1 then we have 𝑢 − 𝑣 = 𝑤.
0
Because any 𝑥 ∈ S is
𝑥 = 𝑎𝑢 + 𝑏𝑣 + 𝑐𝑤 = 𝑎𝑢 + 𝑏𝑣 + 𝑐 𝑢 − 𝑣 = (𝑎 + 𝑐)𝑢 + (𝑏 − 𝑐)𝑣.
1 0 0 1
Thus basis of S is 1 , 2 OR 2 , −1 .
1 1 1 0
Therefore dimension of S is 2.
EXAMPLES
Question
𝑎 𝑏
If W = : 𝑎, 𝑏, 𝑐 ∈ ℝ is a subspace of M2×2 .
0 𝑐
what is a dimension of W?
Solution:
𝑎 𝑏 1 0 0 1 0 0
=𝑎 +𝑏 +𝑐
0 𝑐 0 0 0 0 0 1
1 0 0 1 0 0
W = 𝑠𝑝𝑎𝑛 , ,
0 0 0 0 0 1
W is a subspace of M2×2
dim( 𝑊) = 3.
EXAMPLES Question:
Solution:
1 2 −5 11 3
2 4 −5 15 2
Consider AX = 0 where A =
1 2 0 4 5
3 6 −5 19 −2
1 2 −5 11 3
0 0 5 −7 −4
Reducing A to Echelon form we get A~
0 0 0 0 2
0 0 0 0 0
Equivalent system is
𝑥1 + 2𝑥2 − 5𝑥3 + 11𝑥4 − 3𝑥5 = 0, 5𝑥3 − 7𝑥4 − 𝑥5 = 0, 𝑥5 = 0
7
Let 𝑥4 = 𝑠, 𝑥2 = 𝑡, 𝑥3 = 𝑠, 𝑥1 = −2𝑡 − 4𝑠
5
𝑥1 −2𝑡 − 4𝑠 −2 −20
𝑥2 𝑡 1
7 𝑠 0
∴ Solutionis 𝑥3 = 𝑠 =𝑡 0 + 7
𝑥4 5 5
𝑠 1 5
𝑥5 0 0
0
−2 −20
1 0
𝐵= 0 , 7 is a basis for solution space of homgeneous system.
1 5
0 0
Solution:
K is a solution space of 𝑐1 𝑣1 + 𝑐2 𝑣2 = 𝑐3 𝑢1 + 𝑐4 𝑢2 .
𝑖. 𝑒. K is a solution space of 𝑐1 𝑣1 + 𝑐2 𝑣2 − 𝑐3 𝑢1 − 𝑐4 𝑢2 = 0
5 1 −2 0
Coefficient matrixA = 3 3 1 0
8 4 −4 −1
1 5 4 0
By reducing it to echelon form A ∼ 0−12−11 0
0 0 −3 −1
∴ 𝜌(A) = 3
Let 𝑐4 = 𝑘 free variable
1 11 7
𝑐3 = − 𝑘, 𝑐2 = 𝑘, 𝑐1 = − 𝑘.
3 36 36
7 11 1
Thus 𝑐1 = − 𝑘, 𝑐2 = 𝑘, 𝑐3 = − 𝑘, 𝑐4 = 𝑘
36 36 3
−24𝑘/36
7 5 11 1 𝑘 −2
− 𝑘 3 + 𝑘 3 = 12𝑘/36 = 1
36 36 3
8 4 −12𝑘/36 −1
1 2 0 𝑘 −2 −2
OR − 𝑘 −1 + 𝑘 0 = 1 ∴ Basis for 𝐾 = 1 .
3 3
4 1 −1 −1
Exercise
1 0 1 −1 1 0 −1 1
4. Find the basis for span
1 1 1 1 0 −1 −1 1
FUNDAMENTAL SUBSPACES
COLUMN SPACE
The collection of all possible linear combinations of columns of A,
i.e., span of columns of A, denoted as col(A)/Col(A) is defined as
Column space.
col(A)=span C1 , C2 , ⋯ , C𝑛 .
The set of all linearly independent columns of A
form basis of col(A) and dim(col(A))=rank of A=𝜌(A).
NOTE
OR
𝑅𝑛 𝑅𝑚
0 0
NULL SPACE
Null( A) 𝑖𝑠 𝑆𝑢𝑏𝑠𝑝𝑎𝑐𝑒 of 𝑅𝑛 .
Null( A) = X ∈ 𝑅𝑛 : AX = 0
A (X + Y) = AX + AY = 0 + 0 = 0 ⇒ X + Y ∈ Null( A)
A 𝑘X = 𝑘AX=𝑘0=0 ⇒ 𝑘X ∈ Null( A)
Null space of A𝑡
Null(A𝑡 ) = Y ∈ 𝑅𝑚 : A𝑡 Y = 0 is a subspace of 𝑅𝑚 .
The dimension of this subspace is known as nullity of A𝑡 .
NOTE
Null space of A𝑡 is also known as left null space of A and denoted as LNull(A)/lNull(A).
EXAMPLES
1 3 −5 −3
1. 𝐼𝑠 𝑢 = 3 ∈ Null(A), 𝑊ℎ𝑒𝑟𝑒 A = 6 −2 0 ?
−4 −8 4 1
Solution:
3 −5 −3 1 0
Consider, A𝑢 = 6 −2 0 3 = 0 . ∴ 𝑢 ∈ Null(A).
−8 4 1 −4 0
5 3 −5 −3
2. 𝐼𝑠 𝑢 = 3 ∈ Null A , 𝑤ℎ𝑒𝑟𝑒 A = 6 −2 0 ?
0 −8 4 1
Solution:
3 −5 −3 5 0
A𝑢 = 6 −2 0 3 = 18 ≠ 0 ∴ 𝑢 ∉ Null(A).
−8 4 1 0 52
EXAMPLES 3. Find the Basis and dimension for row A , col A and Null( A)
1 2 −1 0 3
𝑡
Null(A ), 𝑤ℎ𝑒𝑟𝑒 A = 0 0 1 0 1 .
0 0 1 0 1
Solution:
1 2 −1 0 3
Consider, A = 0 0 1 0 1
0 0 1 0 1
1 2 −1 0 3
Reduce it to echelon form 0 0 1 0 1
0 0 0 0 0
From echelon form of A,𝜌 A = 2.
Thus dimension of row space dim(row(A))=2.
row(A)=span 1,2, −1,0,3 , 0,0,1,0,1 and the basis is
1,2, −1,0,3 , 0,0,1,0,1 .
Solution:
1 0 0 1 0 0 1 0 0 1 0 0
2 0 0 0 0 0 0 0 0 0 1 1
−1 1 1 ~ 0 1 1 ~ 0 1 1 ~ 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0
3 1 1 0 1 1 0 0 0 0 0 0
⇒ 𝜌 A𝑡 = 2
1 0 1 0
Thus, col(A)=span 0 , 1 and basis of col(A) is 0 , 1 .
0 1 0 1
Dimension of col(A)=2.
1 0 0 0
0 1 1 𝑦1 0 𝑦 =0
0 0 0 𝑦2 = 0 ⇒ 𝑦 +1 𝑦 = 0
2 3
0 0 0 𝑦3 0
0 0 0 0
Here free variable is 𝑦3 , let 𝑦3 = 𝑡 ∈ 𝑅
𝑦1 0 0 0
𝑦2 = −𝑡 = 𝑡 −1 ∴ Null(A )=span −1 .
𝑡
𝑦3 𝑡 1 1
0
Further, −1 is also linearly independent.
1
0
∴ Basis of Null(A𝑡 ) is −1 and dimension of
1
𝑡 𝑡
Null(A ), i.e., nullity of A is 1.
Another Method to find basis of column space of A
1 2 −1 0 3
Consider, A = 0 0 1 0 1 .
0 0 1 0 1
1 2 −1 0 3
Echelon form of A is 0 0 1 0 1 .
0 0 0 0 0
Here the pivot elements are observed in column 1 and
column 3. Hence consider first and third columns of A.
−2 0
1 0
basisis 0 , 0 . 𝐷𝑖𝑚(𝑁𝑢𝑙𝑙(A)) = 2.
0 1
0 0
EXAMPLES
Find basis for 𝑁𝑢𝑙𝑙 (A), 𝐶𝑜𝑙(A) and 𝑅𝑜𝑤(A)𝑤ℎ𝑒𝑟𝑒
2 −4 0 2 0
A = −1 2 1 2 4
2 −2 1 4 4
Solution:
We will reduce A to echelon form
1 −2 1 4 4 𝑅2 + 𝑅1 1 −2 1 4 4
𝑅1 + 𝑅2 ⇒ −1 2 1 2 4 ⇒ 0 0 2 6 8
𝑅3 − 2𝑅1
2 −2 1 4 4 0 2 −1 −4 −4
1 −2 1 4 4 1 −2 1 4 4
1
𝑅23 ⇒ 0 2 −1 −4 −4 𝑅 ⇒ 0 2 −1 −4 −4
2 3
0 0 2 6 8 0 0 1 3 4
2 −4 0
Basis for 𝐶𝑜𝑙(A) = −1 , 2 , 1 and dim 𝐶𝑜𝑙(A) = 3.
2 −2 1
𝑢1 𝑢1
𝑢2 1 −2 1 4 4 𝑢2 0
Let 𝑥 = 𝑢3 ∈ 𝑁𝑢𝑙𝑙(A) ⇒ 0 2 −1 −4 −4 𝑢3 = 0
𝑢4 0 0 1 3 4 𝑢4 0
𝑢5 𝑢5
This gives 𝑢3 + 3𝑢4 + 4𝑢5 = 0,2𝑢2 − 𝑢3 − 4𝑢4 − 4𝑢5 = 0
𝑢1 − 2𝑢2 + 𝑢3 + 4𝑢4 + 4𝑢5 = 0.
𝑡
Let 𝑢4 = 𝑡, 𝑢5 = 𝑠, 𝑡, 𝑠 ∈ 𝑅 ⇒ 𝑢3 = −3𝑡 − 4𝑠, 𝑢2 = , 𝑢1 = 0
2
The solution is
0 0 0 0 0
𝑡/2 𝑡 1 0 1 0
−3𝑡 − 4𝑠 = −6 + 𝑠 −4 ⇒ 𝑁𝑢𝑙𝑙(A) = 𝑠𝑝𝑎𝑛 −6 , −4
2
𝑡 2 0 2 0
𝑠 0 1 0 1
dim( 𝑁𝑢𝑙𝑙(A)) = 2.
EXAMPLES −8 −2 −9 2
Let A = 6 4 8 and𝑤 = 1 .
4 0 4 −2
𝑖)determine if 𝑤 is in column space of A.
𝑖𝑖)Is 𝑤 in null space of A? 𝑖𝑖𝑖)Is 𝑤 in row space of A?
EXAMPLES
Ex : LetA3×3 be such that A ≠ 0, 𝑓ind
fundamental subspaces of A.Let B = A A ,
also find Fundamental subspacesofB. Further,
find bases for all subspaces.
Solution:
1 2 3
𝐿𝑒𝑡 A = 0 1 5 . since A ≠ 0, AX=0has a trivial solution,
0 0 1
0
therefore 𝑁𝑢𝑙𝑙(A) = 0 . As A is in euchelon form, all columns of
0
1 2 3
A are pivot columns, 𝐶𝑜𝑙(A) = 𝑠𝑝𝑎𝑛 0 , 1 , 5 and
0 0 1
𝑅𝑜𝑤(A) = 𝑠𝑝𝑎𝑛 1,2,3 , 0,1,5 , 0,0,1 .
1 2 3
Basis of 𝐶𝑜𝑙(A) is 0 , 1 , 5 𝑎𝑛𝑑basis of 𝑅𝑜𝑤(A)
0 0 1
is 1,2,3 , 0,1,5 , 0,0,1 .
1 0 0 1 0 0
B= A A = 0 1 0 0 1 0 . B is in echelon form,
0 0 1 0 0 1
1 0 0 1 0 0
𝐶𝑜𝑙(A) = 𝑠𝑝𝑎𝑛 0 , 1 , 0 . Basis is 0 , 1 , 0 .
0 0 1 0 0 1
SOLUTION
AX = V is consistant means V ∈ 𝑐𝑜𝑙 A , &
AX = W 𝑖𝑠 consistant means W ∈ 𝑐𝑜𝑙(A).
But 𝑐 𝑜𝑙 A 𝑖𝑠 𝑎 𝑠𝑢𝑏𝑠𝑝𝑎𝑐𝑒. ∴ V + W ∈ 𝑐𝑜𝑙(A) ∴ AX = V + W is consistant.
THEOREM
𝐿𝑒𝑡𝐴 𝑏𝑒 𝑚 × 𝑛 𝑚𝑎𝑡𝑟𝑖𝑥 𝑎𝑛𝑑 𝜌(𝐴) = 𝑟, 𝑡ℎ𝑒𝑛
dim( 𝑐𝑜𝑙(A)) + dim( 𝑁𝑢𝑙𝑙(A)) = 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐶𝑜𝑙𝑢𝑚𝑛𝑠 𝑜𝑓 A.
EXAMPLES
Ex: 𝐿𝑒𝑡𝜌 𝐴6×8 = 5, 𝑊ℎ𝑎𝑡 𝑎𝑟𝑒 𝑡ℎ𝑒 dimensions of four subspaces?
SOLUTION
dim(Col(A)) = dim(Row(A))=5.
Dim(NullA)=3,dim(LNullA)=dim(NullA𝑡 )=1.
QUESTION
• Question: Determine if the following statements are true or false, and justify your answers.