Vector Space Workbook
Vector Space Workbook
Lecture 1
Objectives: In the first Lecture of Vector Space or Linear Algebra, basic of Vector Space
will be discussed.
Field:
A non-empty set F forms a field with respect to two binary compositions + and ., if
i. a + b ϵ F ∀ c, d ϵ F,
ii. a + (b + c) = (a + b) + c ∀ a, b, c ϵ F,
iii. there exist an element, called zero element and denoted by 0 in F such that a + 0 =
a, ∀ a ϵ F,
iv. for each a ϵ F, there exist an element, denoted by –a in F such that a + (-a) = 0,
v. a + b = b + a for any two elements a, b in F,
vi. a.b ϵ F ∀ a, b ϵ F,
vii. a.(b.c) = (a.b).c ∀ a, b, c ϵ F,
viii. there exist an element called identity element and denoted by I in F s.t. a.I = a ∀
aϵ F,
ix. For each non-zero element a in F there exist an element denoted by a-1 in F s.t. a.
(a-1) = I,
x. a.b = b.a for all a, b in F,
xi. a.(b + c) = a.b + a.c for all a, b, c in F
The field is denoted by (F, +, .), or by F.
V is said to be a vector space over a field F if the following conditions are satisfied:
i. u ⨁ v ϵ V ∀ u, v ϵ V,
ii. u⨁v=v⨁u ∀ u, v ϵ V,
iii. u ⨁ (v ⨁ w) = (u ⨁ v) ⨁ w ∀ u, v, w ϵ V,
iv. ∃ an element θ (called Zero element or Null element) in V s.t. u ⨁ θ = u ∀ u ϵ
V,
v. For each u ϵ V, ∃ an element –u ϵ V s.t. u ⨁ (-u) = θ,
vi. c ⨁ u ϵ V ∀ c ϵ F, u ϵ V,
vii. c ⦿ (d ⦿ u) = (c.d) ⦿ u, for all c, d ϵ F & u ϵ V,
viii. c ⦿ (d ⨁ u) = c ⦿ u ⨁ d ⦿ u, for all c, d ϵ F & u ϵ V,
ix. (c + d) ⦿ u) = c + u ⦿ d + u, for all c, d ϵ F & u ϵ V,
x. 1⦿ u = u, 1 being identity element in F.
Subspace:
Let V be a vector space over a field F. A non-empty subset W of V is called a subspace of V
if W under the composition of V, is a vector space over F.
Theorem: A non-empty subset W of a vector space V over a field F is a subspace of V if
i. w1 ϵ W, w2 ϵ W => w1 + w2 ϵ W and
ii. w ϵ W, c ϵ F => cw ϵ W.
Theorem: The intersection of two subspaces of a vector space V over a field F is a subspace
of V.
Theorem: If V, W be two subspaces of a vector space V over a field F, then the union U ∪
W is a subspace of V iff either U ⊆ W or W ⊆ U.
Theorem: Let U, W be two subspaces of a vector space V over a field F. Then the linear sum
V + W is a subspace of V.
Theorem: The subspace U + W is the smallest subspace of V containing U and W.
Linear Combination: Let V be a vector space over a field F. Let v1, v2, …, vr V. A vector v
in V is said to be a linear combination of the vectors v1, v2, …, vr if v can be expressed as
v = c1v1 + c2v2 + … + crvr for some scalars c1, c2, …, cr in F.
Theorem: Let V be vector space over a field F and S be a non-empty finite subset of V. Then
the set W of all linear combinations of the vectors in S forms a subspace of V and this is the
smallest subspace containing the set S.
Note: The smallest subspace containing S is the intersection of all subspaces containing S.
Linear Span: The smallest subspace containing a finite set S of vectors of a vector space V
is said to be the linear span of S and is denoted by L(S).
L(S) is said to be generated (or spanned) by the set S and S is said to be the set of generators
of L(S).
If S = Ф, then L(S) = { θ}, since θ is the intersection of all subspaces containing Ф.
Theorem: If S and T be two non-empty finite subsets of a vector space V over a field F and
S ⊂ T then L(S) ⊂ L(T).
Theorem: If S be a non-empty subset of a vector space V over a field F then L(L(S)) = L(S).
Theorem: Let S and T be non-empty subsets of a vector space V over a field F. Then L(S ∪T)
= L(S) + L(T).
Exercise 2: Let V be the set of all real polynomials of degree < n. A real polynomial f of
degree r is f = a0 + a1x + …. + arxr, where a0, a1, …, ar are real number.
Let + be a composition on V, called addition defined by
(a0 + a1x + a2x2 + … + amxm) + (b0 + b1x + b2x2 + … + brxr)
= a0 + b0 + (a1 + b1)x + (a2 + b2)x2 + … + (am + bm)xm + … + brxr if m < r
= a0 + b0 + (a1 + b1)x + (a2 + b2)x2 + … + (ar + br)xr + … + bmxm if m > r
= a0 + b0 + (a1 + b1)x + (a2 + b2)x2 + … + (am + bm)xm if m = r
and an external combination of R with V, called ‘multiplication of polynomials by real
numbers’ be defined by
c(a0 + a1x + …. + arxr ) = ca0 + ca1x + …. + carxr, c ϵ R. Verify whether V forms a vector
space or not.
Exercise 3: Let V be a vector space over a field F and let v ∈ V. Then show that the set W =
{cv: c ∈ F} forms a subspace of V.
Note: This subspace is said to be generated by the vector v and v is said to be a generator of
the subspace W.
Exercise 4: Let V be a vector space over a field F and let u, v ∈ V. Then show that the set W
= {cu + dv: c, d ∈ F} forms a subspace of V.
Note: This subspace is said to be generated by the vector u and v and {u, v} is said to be a
generator of the subspace W.
Exercise 6: In R3, u = (4, 3, 5), v = (0, 1, 3), w = (2, 1, 1), t = (4, 2, 2).
Examine if (i) u is a linear combination of v and w,
(ii) v is a linear combination of w and t.
Exercise 7: Determine the subspace of R3 spanned by the vectors u = (1, 2, 3), v = (3, 1, 0).
Examine if w = (2, 1, 3), t = (-1, 3, 6) are in the subspace.
Exercise 10: Examine if the set S is a subspace of the vector space R2x2, where
i. S={ [ ac bd ] : a + b = 0},
a b a b
ii. S= { [ ] [ ]
c d
: det
c d
= 0}.
Lecture 2
Objectives: In this second Lecture of Vector Space or Linear Algebra, linear dependence
and independent vectors will be discussed.
Linearly Independent: A finite set of vectors {v1, v2, … , vn} of a vector space V over a field
F is said to be linearly independent if the following equality
c1v1 + c2v2 + … + cnvn = θ -------- (1)
has only trivial solution, i.e., c1 = c2 = ... = cn = 0.
The set is said to be linearly dependent if there exists c1, c2, …, cn not all zero in F s.t.
c1v1 + c2v2 + … + cnvn = θ
Theorem: A superset of a linearly dependent set of vectors in a vector space V over a field F
is linearly dependent.
Theorem: A subset of a linear independent set of vectors in a vector space V over a field F is
linearly independent.
Note: The set Ф is linearly independent.
Theorem: A set of vectors containing the null vector θ in a vector space V over a field F is
linearly dependent.
Theorem: If the set of vectors {v1, v2, … , vn} in a vector space V over a field F be linearly
dependent, then atleast one of the vectors of the set can be expressed as a linear combination
of the remaining others.
Conversely, if one of the vectors of the set {v1, v2, … ,vn} be a linear combination of the
remaining others, the set is linearly dependent.
Theorem: A set of vectors {u1, u2, … ,un} (ui ≠ θ, i=1,2, …, n) in a vector space V over a
field F is linearly dependent if and only if there exist a vector in the set which is a linear
combination of the preceding others.
Theorem (Deletion theorem): If a vector space V over a field F be spanned by a linearly
dependent set { u1, u2, … ,un }, then V can also be spanned by a suitable proper subset of { u1,
u2, … ,un } [That is, some vector can be deleted from a linearly dependent spanning set of V.]
Theorem: If S = { u1, u2, … ,un } be linearly independent set of generators of a vector space
V, then no proper subset of S can be a spanning set of V.
Exercise 2: Prove that the set of vectors {(1, 2, 2) , (2, 1, 2), (2, 2, 1)} is linearly independent
in R3.
Exercise 4: Let u1 = (1, 2, 0), u2 = (3, -1, 1), u3 = (4, 1, 1). Show that the set S = {u1, u2, u3} is
linearly dependent. Apply Deletion Theorem to find a proper subset of S that can generate
L(S).
Lecture 3
Objectives: In this Lecture basis and dimension of a vector space will be discussed.
Finite Dimensional Vector Space: Let V be a vector space over a field F. V is said to be
finite dimensional, or finitely generated if there exists a finite set of vectors in V generating
V.
Otherwise, V is said to be infinite dimensional.
Basis: Let V be a vector space over a field F. A subset S of vectors in V is said to be a bais of
V if
i. S is linearly independent in V, and
ii. S generates V.
Theorem: There exists a basis for every finite dimensional vector space.
Theorem (Replacement theorem): If { u1, u2, … ,un } be a basis of a vector space V over a
field F and a non-zero vector v of V is expressed as v = c1u1 + c2u2 + … + cnun, ci ∈ F, then if
cj ≠ 0, { u1, u2, … ,uj-1, v, uj+1, …, un} is a new basis of V. [That is, v can be replace by uj in
the basis.]
Theorem: If { u1, u2, … ,un } be a basis of a finite dimensional vector space V over a field F,
then any set of linearly independent vectors of V contains atmost n vectors.
Theorem: Any two bases of finite dimensional vector space V have the same numbers of
vectors.
Dimension: The number of vectors in a basis of a vector space V is said to be the dimension
(or rank) of V and is denoted by dim V.
Example: Dimension of R2 is 2, R3 is 3, …, Rn is n.
Theorem: Let V be a vector space of dimension n over a field F. Then any linearly
independent set of n vectors of V is a basis of V.
Theorem: Let V be a vector space of dimension n over a field F. Then any subset of n
vectors of V that generates V is a basis of V.
Theorem (Extension theorem): A linearly independent set of vectors in a finite dimensional
vector space V over a field F is either a basis of V, or it can be extended to a basis of V.
Theorem: If { u1, u2, … ,un } be a basis of a vector space V over a field F, then every vector
v in V can be expressed as a linear combination of u1, u2, … ,un in one and only one way.
Co-ordinate of vectors: Let B = { u1, u2, … ,un } be an ordered basis of a vector space V
over a field F. Then to each vector v in V there corresponds a well determined ordered set of
n scalars c1, c2, …, cn in F such that v = c1u1 + c2u2 + … + cnun.
The ordered n-tuple (c1, c2, …, cn) is said to be the co-ordinate vector of v relative to the
ordered basis R.
Exercise 3: Find the dimension of the vector space Rmxn of all mxn real matrices.
Exercise 4: Show that dimension of the vector space P of all real polynomials is infinite.
Exercise 5: Find a basis for the vector space R3 that contains the vectors (1, 2, 0) and (1, 3,
1).
Exercise 6: Prove that the set S = {(2, 1, 1), (1, 2, 1), (1, 1, 2)} is a basis of R3.
Exercise 7: Let V be a real vector space with {u, v, w} as a basis. Check whether {u+v+w,
v+w, w} is also a basis of V.
Exercise 8: Find a basis and the dimension of the subspace W of R3 where W {(x, y, z): x + y
+ z = 0}.
Exercise 10: Extend the set {(1, 1, 1, 1), (1, -1, 1, -1)} to a basis of R4.
Exercise 11: Find the co-ordinate vector of u=(1, 3, 1) relative to the ordered basis B = {u1 =
(1, 1, 1), u2 = (1, 1, 0), u3 = (1, 0, 0)} of R3.
Lecture 4
T(f) = ∫ f ( t ) dt, f ∈ V.
a
Lecture 5
Topics Covered: Range and Kernel of a linear map, Rank and Nullity
Objectives: In this Lecture range and kernel of linear transformation or linear map will be
discussed.
Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping. The set of
all vector v ∈ V such that T(v) = θ’, θ’ being the null vector in W, is said to be the kernel of T
and is denoted by Ker T.
Ker T = {v ∈V: T(v) = θ’}
Theorem: Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping.
Then Ker T is a subspace of V.
Note: Ker T is also called null space of T and is denoted by N(T).
Theorem: Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping.
Then T is injective iff Ker T = { θ ‘}.
Theorem: Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping
and Ker T= { θ ‘}. Then the images of a linearly independent set of vectors {v1, v2, …, vr} in
V are linearly independent in W.
Note: If T: V →V be a linear mapping on V such that Ker T = { θ }, then a basis of V is
mapped onto another basis of V.
Image of a linear mapping: Let V and W be vector spaces over a field F. Let T: V →W be a
linear mapping. The images of the elements of V under the mapping T form a subset of W.
This subset is said to be the image of T and is denoted by Im T.
Im T = {T(v): v ∈ V}
Theorem: Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping.
Then image is a subspace of W.
Note: Im T is also called the range of T and is denoted by R(T).
Theorem: Let V and W be vector spaces over a field F. Let T: V →W be a linear mapping
and {u1, u2, …, un} be a basis of V. Then the vector T(u1), T(u2), …, T(un) generate Im T.
Note: If Ker T = {θ} then the images of the basis vectors u1, u2, …, un are linearly
independent. In this case { T(u1), T(u2), …, T(un) } form a basis of V.
Nullity and Rank of a linear mapping:
Let T:V→W be a linear mapping. Then dim Ker T = Nullity of T and dim Im T = Rank of T.
If V be a finite dimensional then both Ker T and Im T are finite dimensional.
Theorem: Let V and W be finite dimensional vector spaces of the same dimension over a
field F and T:V→W be a linear mapping. Then T is one-to-one if and only if T is onto.
Corollary: If T be a linear mapping on a finite dimensional vector space V, then T is one-to-
one iff T is onto.
Lecture 6
Objectives: In this Lecture one of most important theorem of linear algebra will be
discussed.
Rank-Nullity theorem : Let V and W be vector spaces over a field F and V is finite
dimensional. If T:V→W be a linear mapping then
dim Ker T + dim Im T = dim V.
In other words, the nullity of T + rank of T = dim V.
Theorem: Let V and W be finite dimensional vector spaces of the same dimension over a
field F and T:V→W be a linear mapping. Then T is one-to-one iff T is onto.
Corollary: If T be a linear mapping on a finite dimensional vector space V, then T is one-to-
one iff T is onto.
Linear mapping with prescribed images:
Theorem: Let V and W be vector spaces over a field F. Let {u1, u2, …, un} be a basis of V
and {v1, v2, …, vn} be arbitrary chosen elements (not necessarily distinct) in W. Then there
exists one and only one linear mapping T:V→W such that T(ui) = vi for i = 1, 2, …, n.
Lecture 7
Let V, W, U be vector spaces over a field F and let T: V →W, S: W → U be linear mappings.
The composite mapping S0T: V → U is defined by S0T(v) = S{T(v)}, v ∈V.
The composition S0T is generally denoted by ST and it is also said to be the product mapping
ST.
Theorem: Let V, W, U be vector spaces over a field F and let T: V →W, S: W → U be
linear mappings. The composite mapping S0T: V → U is linear.
Definition: Let V and W be vector spaces over a field F. A linear mapping T: V→ W is said
to be invertible if there exists a mapping S: W→ V such that ST = Iv and TS = Iw.
In this case, S is said to be an inverse of T.
Theorem: Let V and W be vector spaces over a field F. A linear mapping T:V→W is
invertible if and only if T is one-to-one and onto.
Theorem: Let V and W be vector spaces over a field F. If a linear mapping T:V→W be
invertible, then the inverse mapping T-1: W→V is linear.
Note 1: The linear mapping T-1: W→V has the property that T-1T=Iv, TT-1=Iw.
Note 2: If T: V→V be an invertible linear mapping on V then the linear mapping T-1:V→V
has the property that T-1T=TT-1=Iv.
Definition: A linear mapping T:V→W is said to be non-singular if T be invertible.
Isomorphism: Let V and W be finite dimensional vector spaces over a field F. A linear
mapping T:V → W is said to be an isomorphism if T is both one-to-one and onto.
Theorem: Two finite dimensional vector spaces V, W over a field F are isomorphic if and
only if dim V = dim W.
Isomorphisms from V to Fn.
Theorem: Let V be a vector space of dimension n over a field F. Then V is isomorphic to Fn.
Theorem: Let V and W be finite dimensional vector spaces over a field F and T:V→W be an
isomorphism. Then for a set of vectors S in V,
S is linearly independent in V iff T(S) is linearly independent in W.
Note: Since V and W are isomorphic, dim V = dim W. Therefore S is a basis of V iff T(S) is
a basis of W.
Lecture 8
Objectives: In this Lecture relation between linear transformation and matrix will be
discussed.
Let V and W be finite dimensional vector space over a field F with dim V = n and dim W =
m. Let T:V →W be a linear mapping. T is completely determined by its action on a given
basis of V. Let (u1, u2, …, un) be an ordered basis of V and (v1, v2, …, vm) be an ordered basis
of W.
T is completely determined by the images T(u1), T(u2), …, T(un).
Each T(ui) in W is a linear combination of the vectors v1, v2, …, vm.
Let T(u1) = a11v1 + a12v2 + … + am1vm
T(u2) = a21v1 + a22v2 + … + am2vm
…. … …..
T(un) = a1nv1 + a2nv2 + … + amnvm, where aij are unique scalars in F determined by the
ordered basis (v1, v2, … ,vm).
Let u = x1u1 + x2u2 + … + xnun be an arbitrary vector of V and let T(u) = y1v1 + y2v2 + .. +
ymvm, xi, yi ∈F.
T(v) = T(x1u1 + x2u2 + … + xnun)
= x1T(u1) + x2T(u2) + … + xnT(un), since T is linear
= x1(a11v1 + a12v2 + … + am1vm) + x2(a21v1 + a22v2 + … + am2vm) + … + xn(a1nv1 + a2nv2 +
… + amnvm).
Since {v1, v2, … ,vm} is linearly independent,
y1 = a11x1 + a12x2 + … +a1nxn
y2 = a21x1 + a22x2 + … + a2nxn
….
ym = am1x1 + am2x2 + … + amnxn
y1 x1
a 11 a 12 . .. a 1n
( )(
Or, .
.
y2
ym
= a 21 a 22
. .. . ..
a m1 a m2
. .. a 2n
. .. .. .
. .. a mn
)( )
x2
.
.
xn
a11 a 12 . .. a 1n
The matrix A =
(
a 21 a 22
. .. . ..
a m1 a m2
. .. a 2n
. .. .. .
. .. a mn
)
is said to be the matrix associated with the
linear mapping T relative to the chosen ordered bases of V and W. A is also called the
matrix of T relative to the chosen ordered bases.
Note: Corresponding to the chosen ordered bases the matrix A is uniquely determined,
since aij are unique scalars determined by the basis (v1, v2, … , vm).
Exercise 3: The matrix of a linear mapping T:R3→R2 relative to the ordered bases
Lecture 9
The concept of magnitude of vectors and angle between two vectors in R3 can be generalized
by using the concept of Inner Product Space.
A vector space V together with a Inner Product defined on it is classed Inner Product Space
and is denoted by (V, (,)).
Lecture 10
A set of vectors {v1, v2, …, vr} in a Euclidean space is said to be orthogonal if (vi, vj)=0
whenever i ≠ j.
A set of vectors {v1, v2, …, vr} in a Euclidean space is said to be orthonormal if (vi, vj)=0
whenever i≠j and (vi, vj) = 1 if i = j.
Exercise 3: Prove that the set of vectors {(1, 2, 2), (2, -2, 1), (2, 1, -2)} is an orthogonal basis
of the Euclidean space R3 with standard inner product. Express (4, 3, 2) as a linear
combination of these basis vectors.
Lecture 11