Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Algebra
Lecture - 07: Linear Independence and Dependence; Basis and Dimension ; Linear

Transformation

Nijjwal Karak
BITS Pilani, Hyderabad Campus
[email protected]

February 24, 2024

1 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Outline

Linear Independence and Dependence

Basis and Dimension

Row and Column Spaces

Linear Transformation

Examples

2 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Independence

Definition
Let S = {u1 , u2 , u3 , . . . , un } be a finite non-empty subset of a vector space V . Then
the set S is linearly independent if and only if for real scalars a1 , a2 , . . . , an ,
a1 u1 + a2 u2 + . . . + an un = 0
then a1 = a2 = . . . = an = 0

• If S is linearly independent then no vector ui ∈ S can be written as a linear

combination of remaining vectors of S

• This implies that ui ∈

/ span(S − {ui })

3 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Dependence

Definition
Let S = {u1 , u2 , u3 , . . . , un } be a finite non-empty subset of a vector space V . Then
the set S is linearly dependent if and only if for real scalars a1 , a2 , . . . , an ,
a1 u1 + a2 u2 + . . . + an un = 0
then not all of a1 , a2 , . . . , an are 0

• If S is linearly dependent then at least one of ai ̸= 0

• This implies that at least one vector ui ∈ S can be written as a linear

combination of all other vectors in S − {ui }

• In this case ui ∈ span(S − {ui })

4 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples for Linear Independence

Example
The subset S = {(1, 1, 1)} of the vector space R3 is linearly independent

Example
The subset S = {(1, 0), (0, 1)} of the vector space R2 is linearly independent

Example
Let S = {u}, a one-element subset of the vector space Rn .
• S is linearly independent if and only if u ̸= 0

• S is linearly dependent if and only if u = 0

5 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples for Linear Dependence

Example
The subset S = {(1, 0), (0, 1), (1, 1)} of the vector space R2 is linearly dependent

Example
The subset S = {(0, 0), (1, 1)} of the vector space R2 is linearly dependent 1

Example
Let S = {(0, 0, 0, 0)}, the zero vector of the vector space R4 . Then S is linearly
dependent 1

1
Why the presence of zero vector in any S makes it linearly dependent ?
6 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Test for Linear Independence

Let S be a non-empty finite subset of a vector space V . To check whether S is

linearly independent or not, perform the following steps:

• Since S is finite, then S = {v1 , v2 , . . . , vn }

• For S to be linearly independent
c1 v1 + c2 v2 + . . . + cn vn = 0 =⇒ c1 = c2 = . . . = cn = 0

• The linear system can be written as the homogeneous system Ax = 0

• Here A is a matrix such that whose columns are the vectors of S
• x is the unknown vector given by x = (c1 , c2 , . . . , cn )
• If the homogeneous system has trivial solution then the vectors in S are linearly
independent
• If it has non-trivial solutions then the vectors in S are linearly dependent

7 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Independence of Infinite Sets

Definition
Let S be an infinite subset of a vector space V . Then S is linearly independent if and
only if every finite subset T of S is linearly independent

Definition
Let S be an infinite subset of a vector space V . Then S is linearly dependent if and
only if there is some finite subset T of S such that T is linearly dependent

8 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Basis of a Vector Space

Definition
Let V be a vector space and let B be a subset of the vector space V . Then the set B
is called a Basis for V if and only if it satisfies the following properties:

• B spans V . This implies that span(B) = V

• B is linearly independent

9 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

Example
The subset B = {(1, 0), (0, 1)} is a basis for the vector space R2

Example
The subset B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} is a basis for the vector space R3

Example
The subset B = {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)} is a basis for the vector
space R4

• These are called the standard bases

10 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

Example
What is the standard basis for the vector space M32 ?

Example
What are the standard bases for the vector spaces P3 and Pn ?

11 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Dimension of a Vector Space

Definition
Let V be a vector space and let B be a basis for the vector space V . Then the
dimension of the vector space V is defined as the number of elements in the set B. It
is denoted by dim(V ).

• If B is finite, then dim(V ) = |B|

• If B is infinite, then the vector space has no finite basis

• Then V is called as an infinite dimensional vector space

12 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Dimension of a Subspace

Theorem
Let V be a finite dimensional vector space and let W be a subspace of V . Then W is
also finite dimensional with dim(W ) ≤ dim(V ). Moreover, dim(W ) = dim(V ) if and
only if W = V .

Example
Let V = M22 and W is an upper or lower triangular or diagonal matrix.
• If W is an upper or lower triangular matrix, then dim(W ) = 3 while dim(V ) = 4
• If W is a diagonal matrix, then dim(W ) = 2 while dim(V ) = 4

13 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Useful Subspaces

Definition (Row Space)

Let A be an m × n matrix. The space spanned by the rows of A is called the row
space of A.

• It is denoted by RS(A)
• How to find the RS(A) ?
• First find the REF(A)
• Then the space spanned by the non-zero rows in the REF(A) gives RS(A)
• Note: It is a subspace of Rn

14 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Useful Subspaces

Definition (Column Space)

Let A be an m × n matrix. The space spanned by the columns of A is called the
column space of A.

• It is denoted by CS(A)
• How to find the CS(A) ?
• First find the REF (AT )
• Then the space spanned by the non-zero rows in the REF (AT ) gives CS(A)
• CS(A) = RS(AT )
• Note: It is a subspace of Rm

15 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation

Definition
Let V and W be vector spaces, and let f : V → W be a function from V to W. Then
f is a linear transformation if and only if the following conditions are true

• f (v 1 + v 2 ) = f (v 1 ) + f (v 2 ), for all v 1 , v 2 ∈ V

• f (cv) = cf (v), for all c ∈ R and all v ∈ V

16 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : Mmn → Mnm , given by f (A) = AT for any m × n matrix
A. Is f a linear transformation ?

17 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : Mmn → Mnm , given by f (A) = AT for any m × n matrix
A. Is f a linear transformation ? Yes

17 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : Mmn → Mnm , given by f (A) = AT for any m × n matrix
A. Is f a linear transformation ? Yes

Example
Consider the function g : Pn → Pn−1 , given by g(p) = p′ . Is g a linear
transformation ?

17 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : Mmn → Mnm , given by f (A) = AT for any m × n matrix
A. Is f a linear transformation ? Yes

Example
Consider the function g : Pn → Pn−1 , given by g(p) = p′ . Is g a linear
transformation ? Yes

17 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : R2 → R2 , given by f (x, y) = [x + 1, y + 1]. Is f a
linear transformation ?

18 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : R2 → R2 , given by f (x, y) = [x + 1, y + 1]. Is f a
linear transformation ? No

18 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : R2 → R2 , given by f (x, y) = [x + 1, y + 1]. Is f a
linear transformation ? No

Example
Let A be any m × n matrix. Consider the mapping f : Rn → Rm defined by
f (x) = Ax, for all x ∈ Rn . Is f a linear transformation ?

18 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : R2 → R2 , given by f (x, y) = [x + 1, y + 1]. Is f a
linear transformation ? No

Example
Let A be any m × n matrix. Consider the mapping f : Rn → Rm defined by
f (x) = Ax, for all x ∈ Rn . Is f a linear transformation ? Yes

18 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : M22 → R3 , defined by
" #!
a b
f = [b, 0, c]
c d
• Is f a linear transformation ?

19 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Transformation: Examples

Example
Consider the mapping f : M22 → R3 , defined by
" #!
a b
f = [b, 0, c]
c d
• Is f a linear transformation ? Yes

19 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Operator

Definition
Let V be a vector space. A linear transformation whose domain and codomain are
both V is called a linear operator

20 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Operator

Definition
Let V be a vector space. A linear transformation whose domain and codomain are
both V is called a linear operator

Examples
• Identity linear operator: The mapping f : V → V defined by f (v) = v, for all
v∈V

20 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Linear Operator

Definition
Let V be a vector space. A linear transformation whose domain and codomain are
both V is called a linear operator

Examples
• Identity linear operator: The mapping f : V → V defined by f (v) = v, for all
v∈V
• Zero linear operator: The mapping f : V → V defined by f (v) = 0V , for all
v∈V

20 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Reflection Operators

The reflection operators are linear transformations

Examples (In two-dimensions)

• The mapping f : R2 → R2 defined by f ([v1 , v2 ]) = [−v1 , v2 ]. This operator is
called reflection about y-axis

21 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Reflection Operators

The reflection operators are linear transformations

Examples (In two-dimensions)

• The mapping f : R2 → R2 defined by f ([v1 , v2 ]) = [−v1 , v2 ]. This operator is
called reflection about y-axis

• The mapping f : R2 → R2 defined by f ([v1 , v2 ]) = [v1 , −v2 ]. This operator is

called reflection about x-axis

21 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Reflection Operators

The reflection operators are linear transformations

Examples (In three-dimensions)

• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , v2 , −v3 ]. This opera-
tor is called reflection about xy-plane

22 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Reflection Operators

The reflection operators are linear transformations

Examples (In three-dimensions)

• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , v2 , −v3 ]. This opera-
tor is called reflection about xy-plane
• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [−v1 , v2 , v3 ]. This opera-
tor is called reflection about yz-plane

22 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Reflection Operators

The reflection operators are linear transformations

Examples (In three-dimensions)

• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , v2 , −v3 ]. This opera-
tor is called reflection about xy-plane
• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [−v1 , v2 , v3 ]. This opera-
tor is called reflection about yz-plane
• The mapping f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , −v2 , v3 ]. This opera-
tor is called reflection about xz-plane

22 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Contraction and Dilation Operators

Examples
The mapping f : Rn → Rn defined by f (v) = kv, for all v ∈ Rn

• If |k| > 1, then the operator f is called a dilation (lengthening) of the vectors in
Rn
• If |k| < 1, then the operator f is called a contraction (shrinking) of the vectors in
Rn

Contraction/dilation operators are linear transformations

23 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Projection Operators

Examples
• f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , v2 , 0]. f maps each vector in R3 to
a corresponding vector in the xy-plane
• f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [v1 , 0, v3 ]. f maps each vector in R3 to
a corresponding vector in the xz-plane
• f : R3 → R3 defined by f ([v1 , v2 , v3 ]) = [0, v2 , v3 ]. f maps each vector in R3 to
a corresponding vector in the yz-plane
• The mapping f : R4 → R4 defined by f ([v1 , v2 , v3 , v4 ]) = [0, v2 , v3 , 0]. This
operator maps each vector in R4 to a corresponding vector whose first and fourth
coordinates are zero
• Find the inverse transformation of L : R2 → R2 defined by L(x1 , x2 ) = (x2 , 2x1 −
x2 ).

24 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

25 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

26 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

27 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

28 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

29 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

30 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

31 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

32 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

33 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

34 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

35 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

36 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

37 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

38 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

39 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

40 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

41 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

42 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

43 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

44 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

45 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

46 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

47 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

48 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

49 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

50 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

51 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

52 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

53 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

54 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

55 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

56 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

57 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

58 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

59 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

60 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

61 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

62 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

63 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

64 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

65 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

66 / 67
Linear Independence and Dependence Basis and Dimension Row and Column Spaces Linear Transformation Examples

Examples

67 / 67