MT 1117: Linear Algebra For ICT: Instructor: A.V. Mathias Department of Mathematics & Statistics University of Dodoma
MT 1117: Linear Algebra For ICT: Instructor: A.V. Mathias Department of Mathematics & Statistics University of Dodoma
Lecture 6
2 Nullity
Null space
3 Rank of a Matrix
Row rank of a Matrix
Column space
Example
Show that the set S = {x1 , x2 , x3 , x4 } is the basis for R4 given that
x1 = (1, 0, 1, 0), x2 = (0, 1, −1, 2), x3 = (0, 2, 2, 1) and
x4 = (1, 0, 0, 1).
0 2 1 1 d
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 4 / 35
Basis and dimension cont . . .
It follows that
1 0 0 1 c1 a
0 1 2 0 c2 b
1 −1 2 0 c3 = c
0 2 1 1 c4 d
Since the coefficient matrix is a square matrix we need to show
that its determinant
is non-zero
for S to span R4 .
1 0 0 1
0 1 2 0
Let A = 1 −1 2 0
0 2 1 1
1 0 0 1 1 0 0 1
0 1 2 0 0 1 2 0
det(A) = ∼ ... ∼ =1
1 −1 2 0 0 0 4 −1
0 2 1 1 0 0 0 14
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 5 / 35
Basis and dimension cont . . .
Since det(A) = 1 6= 0, the linear system is consistent and hence S
spans R4
Testing the linear independence of S
Required to check that for c1 x1 + c2 x2 + c3 x3 + c4 x4 = 0 then
c1 = c2 = c3 = c4 = 0.
It
implies that
1 0 0 1 c1 0
0 1 2 0 c2 0
1 −1 2 0 c3 = 0
0 2 1 1 c4 0
It
follows that
1 0 0 1 0 1 0 0 1 0
∼ ... ∼ 0 1 2 0 0
0 1 2 0 0
1 −1 2 0 0 0 0 4 −1 0
0 2 1 1 0 0 0 0 41 0
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 6 / 35
Basis and dimension cont . . .
We then find that c1 + c4 = c2 + 2c3 = 4c3 − c4 = 14 c4 = 0
Thus, c1 = c2 = c3 = c4 = 0, which imply that S is linearly
independent set.
Therefore, S is the basis for R4 .
Theorem
Let S = {x1 , x2 , . . . , xn } be a basis for a vector space V, then every
vector in V can be written in one and only one way as a linear
combination of the vectors in S.
Proof
Let x ∈ V. Since S is a basis it implies S spans V and S is also a
linearly independent set of vectors.
It implies that x = c1 x1 + c2 x2 + . . . + cn xn . . . (i)
Let also that x = d1 x1 + d2 x2 + . . . + dn xn . . . (ii)
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 7 / 35
Basis and dimension cont . . .
We need to show that c1 = d1 , c2 = d2 , . . . ,cn = dn
Subtracting (ii) from (i)
x − x = (c1 − d1 )x1 + (c2 − d2 )x2 + . . . + (cn − dn )xn
Implies that
0 = (c1 − d1 )x1 + (c2 − d2 )x2 + . . . + (cn − dn )xn
Since S is linearly independent, it implies
c1 − d1 = c2 − d2 = c3 − d3 = . . . = cn − dn = 0
It follows that c1 = d1 , c2 = d2 , . . . ,cn = dn .
Therefore, x can be written in one and only one way as the linear
combination of vectors in S.
Theorem
Let S = {x1 , x2 , . . . , xn } be a set of non-zero vectors of the vector
space V and let W = spanS, then some subset of S is the basis for W.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 8 / 35
Basis and dimension cont . . .
Construction of basis
Let V be a vector space and S = {x1 , x2 , . . . , xn } be a subset of V. The
procedure to find the subset of S that is the basis for W = spanS is
1. Form the linear combination c1 x1 + c2 x2 + . . . + cn xn = 0
2. Form the augmented matrix of a homogeneous system in step 1
3. Reduce the system obtained in step 2 to r.r.e.f.
4. The vectors in S that are corresponding to columns with leading
1s form basis for W = spanS
Example
Let S = {x1 , x2 , x3 , x4 , x5 } be set of vectors in R4 where
x1 = (1, 2, −2, 1), x2 = (−3, 0, −4, 3), x3 = (2, 1, 1, −1),
x4 = (−3, 3, −9, 6) and x5 = (9, 3, 7, −6). Find the subset of S that is
a basis for W = spanS.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 9 / 35
Basis and dimension cont . . .
We reduce the augmented matrix corresponding to the linear
system
c1 x1 + c2 x2 + c3 x3 + c4 x4 + c5 x5 = 0
It follows
that
1 −3 2 −3 9 0
2 0 1 3 3 0
−2 + c2 −4 + c3 1 + c4 −9 + c5 7 = 0
c1
1 3 −1 6 −6 0
Thus,
c1
1 −3 2 −3 9 0
2 c2
0 1 3 3 0
−2 −4 1 −9 7 c3 = 0
c4
1 3 −1 6 −6 0
c5
Note
If W is a subspace of a vector space V, then dim(W) ≤ dim(V).
Theorem
If S = {x1 , x2 , . . . , xn } and T = {y1 , y2 , . . . , ym } are two bases for a
vector space V then m = n.
Exercise
Find the basis for R4 that contains the vectors x1 = (1, 0, 1, 0) and
x2 = (−1, 1, −1, 0).
Theorem
If S is a linearly independent set of vectors in a finite dimensional
vector space V, then there is a basis T for V which contains S.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 12 / 35
Basis and dimension cont . . .
Theorem
Let V be an n−dimensional vector space and let S = {x1 , x2 , . . . , xn }
be a set in V, then
(a) if S is linearly independent then it is the basis for V.
(b) if S spans V then it is the basis for V.
Example
Find all values of a for which S = {(a2 , 0, 1), (0, a, 2), (1, 0, 1)} is a
basis for R3 .
Example
Find the dimension of the subspace of all vectors of the form
(a, b, c, d) where c = a − b and d = a + b for a, b ∈ R.
Nullity
Nullity is the dimension of the null space.
Example
Find space of Ax = 0 given that
the basis for the solution
1 1 0 2
A = −2 −2 1 −5.
1 1 −1 3
0 1
Therefore, {(−1, 1, 0, 0), (−2, 0, 1, 1)} spans the null space of A
and it is the linearly independent set. So it is the basis for the null
space of A. Its nullity is 2.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 18 / 35
Row rank of a Matrix
Row space
The row space of a matrix is the subspace spanned by the rows of that
matrix.
Theorem
The non-zero rows of a row reduced matrix form a basis for the row
space of that matrix and the row rank is the number of non-zero rows.
Theorem
If A and B are two m × n row equivalent matrices, then they have the
same row space.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 20 / 35
Row rank of a Matrix cont . . .
Note
To obtain the row rank of a matrix, use elementary row operations to
transform the matrix to row reduced form and then count the number
of non-zero rows.
Example
1 3 4
2 −1 1
Determine the row rank of matrix A given that A =
3 2 5
5 15 20
Transforming
the matrixA to r.e.fwe obtain
1 3 4 1 3 4
2 −1 1 0 1 1
3 2 5 ∼ . . . ∼ 0 0 0
5 15 20 0 0 0
The row rank of A is 2.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 21 / 35
Column space
Consider
the matrix A given by
a11 a12 . . . a1n
a21 a22 . . . a2n
A= .
with m− rows and n−columns
. ... .
am1am2 . .. amn
a 11 a 12 a1n
a a a2n
21 22
Let S = , , . . . ,
. . .
am1 am2 amn
A subspace of Rm spanned by S is the column space of A
The dimension of the column space of A is the column rank of A.
Note 1.
The basis for the row space of a matrix is obtained by reducing the
matrix to r.r.e.f and the set of non-zero rows forms the basis for the row
space.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 22 / 35
Column space cont . . .
Note 2.
The basis for the column space of a matrix A, we find the basis for the
row space of AT .
Example
1 −2 0 3 −4
3 2 8 1 4
Let A =
2
3 7 2 3
−1 2 0 4 −3
(a) Find the basis for the row space of A.
(b) Find the basis for the column space of A.
(c) Find the basis for the row space that only contains only rows of A.
(d) Find the basis for the column space that contains only columns of
A.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 23 / 35
Column space cont . . .
(a) Basis for the row space of A
We reduce
the matrix A to r.r.e.f
1 −2 0 3 −4 1 0 2 0 1
3 2 8 1 4 ∼ . . . ∼ 0 1 1 0 1
A= 2 0 0 0 1 −1
3 7 2 3
−1 2 0 4 −3 0 0 0 0 0
The basis is the set of all non-zero rows of the matrix in r.r.e.f
which is {(1, 0, 2, 0, 1), (0, 1, 2, 0, 1), (0, 0, 0, 1, −1)}
(b) Basis for the column space of A
We’veto find the basis for the rowspace of AT
1 3 2 −1 1 0 0 11 24
−2 2 3 2 0 1 0 − 49
24
AT = 0 8 7 0 ∼ . . . ∼ 0 0 1 7
3
3 1 2 4 0 0 0 0
−4 4 3 −3 0 0 0 0
Basis is {(1, 0, 0, 24 ), (0, 1, 0, − 24 ), (0, 0, 1, 73 )}
11 49
r.r.e.f which correspond to the 1st ,2nd and 3rd rows of matrix A
respectively .
Thus, the basis is {(1, −2, 0, 3, −4), (3, 2, 8, 1, 4), (2, 3, 7, 2, 3)}
(d) Basisfor the column spaceof A containing only the rowsof A
1 −2 0 3 −4 1 0 2 0 1
3 2 8 1 4 ∼ . . . ∼ 0 1 1 0 1
A= 2 0 0 0 1 −1
3 7 2 3
−1 2 0 4 −3 0 0 0 0 0
Basis is {(1, 3, 2, −1), (−2, 2, 3, 3), (3, 1, 2, 4)}
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 25 / 35
Basis and Coordinates
Basis and Coordinates
Let {x1 , x2 , . . . , xn } be the basis for the vector space V then any vector
x ∈ V has the unique representation x = c1 x1 + c2 x2 + . . . + cn xn
where ci ∈ R. The coefficients c1 , c2 , c3 . . . and cn are called the
coordinates of x relative to the basis {x1 , x2 , . . . , xn }.
Example
Find the coordinates of the vector x = (7, 4) relative to the basis
B = {x1 , x2 } given that x1 = (2, 1) and x2 = (3, 1).
Exercise
Let P3 (t) be the vector space of polynomials of degree at most 3
(a) Show that B = {1, t, t2 , t3 } is the basis for P3 (t).
(b) Find the coordinates of v(t) = 3 − t2 − 7t3 relative to B.
Exercise 2
Consider the bases B = {p1 , p2 } and B0 = {q1 , q2 } for P1 where
p1 = 6 + 3x, p2 = 10 + 2x, q1 = 2 and q2 = 3 + 2x,
(a) find the transition matrix from B0 to B.
(b) find the transition matrix from B to B0 .
Exercise 3
Let V be a space spanned by {f1 , f2 } where f1 = sinx and f2 = cosx,
(a) show that g1 = 2sinx + cosx and g2 = 3cosx form basis for V.
(b) find the transition matrix from B0 = {g1 , g2 } to B = {f1 , f2 }.
(c) compute [h]B given that h = 2sinx − 5cosx.
Instructor: A.V. Mathias Department of Mathematics & MT 1117:University
Statistics of Dodoma
Linear Algebra for ICT(Lecture 6) January 12, 2022. 34 / 35
Thank you for your Attention.