Unit III (NMOT Updated)
Unit III (NMOT Updated)
HBN
Vector Spaces and Linear transformations: Vector space, subspaces, linear combination
and linear span of set, Linear dependence and independence, Basis and Dimensions, Gram-
Schmidt orthogonalisation. Linear transformations.
Vector Space:
Definition:
Let F be a field, V be non empty set, then the set V is said to be vector space over a field F if
the following axioms are satisfied for every , , V and for every a, b F
, V + V
+ = + , , V
( + ) + = + ( + ), , , V
Note:
1. Instead of saying V is a vector space over the field F we shall say that V(F) is a vector
space.
1
Unit-3 NMP Dr. JSK and Dr. HBN
4. The identity element of the group V under addition is denoted by 0 and is called zero
vector or null vector which is unique.
5. The null vector o should not be confused with the scalar 0, later we shall see these two are
connected by a relation.
6. When F=R the field of real numbers, then V(R) is called real vector space.
7. When F=C the field of Complex numbers, then V(C) is called Complex vector space.
8. The space {0} is called zero space or null space. It is easy to verify that all the conditions
of vector spaces are satisfied in case of zero space.
9. Last four axioms are satisfied in V means these are also satisfied in sub set of V.
Show that the set of all 22 matrices with real elements is a vector space over the field of real
numbers.
Solution:
Under addition:
1. Closure
A, B V, A + B V
2. Associability (A + B) + C = A + (B + C)
2
Unit-3 NMP Dr. JSK and Dr. HBN
= A + (B + C)
3 Existence of Identity: A + 0 = A = 0 + A A V, 0 V.
Similarly 0 + A = A
Thus A + 0 = A = 0 + A
Similarly (- A) + A = 0
Thus A + (-A) = 0 = (- A) + A
5 Commutatively: A + B = B + A A, B V
= [bij]22 + [aij]22 = B + A
6. F, A V.
A = [aij]22 = [aij]22 V
7. ( + ) A = A + A, , F, A V
= [aij]22 + [aij]22 = A + A
8. (A + B) = A + B, F, A, B V
9. ()A = (A) , F, A V
10. 1.A = A, A V, 1 F
3
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
Show that the polynomials of degree at most 3 with real coefficients is a vector space over
the field of real numbers.
Solution:
Let V be the set of all polynomials of degree at most 3 with real coefficients and F be a field.
3
Let p(x) = a0 + a1x + a2x2 + a3x3 = a x
n0
n
n
3
q(x) = b0 + b1x + b2x2 + b3x3 = b x
n 0
n
n
3
r(x) = c0 + c1x + c2x2 + c3x3 = c x
n 0
n
n
Under addition:
1. Closure:
p(x), q(x) V
3
p(x) + q(x) = (a
n 0
n bn ) x n V
2. Associativity: p(x), q(x), r(x) V we have (p(x) + q(x)) + r(x) = p(x) + (q(x) + r(x))
3 3
3 3 3
(p(x) + q(x)) + r(x) = an x n bn x n cn x n = (an bn ) x n cn x n
n 0 n0 n0 n0 n 0
3 3
= (an bn ) cn x n = an (bn cn ) x n
n 0 n 0
3 Existence of Identity: p(x) V, 0(x) V such that p(x) + 0(x) = 0(x) + p(x) = p(x)
4
Unit-3 NMP Dr. JSK and Dr. HBN
3
Here 0(x) = 0x
n 0
n
V
3 3 3 3
Now p(x) + 0(x) = an x n 0 x n =
n0 n 0
(an 0) x n =
n0
a x
n0
n
n
= p(x)
4. Existence of Inverse:
3 3
p(x) = an xn V, - p(x) =
n0
( a
n0
n )xn V
6. F, and p(x) V
3 3
p(x) = an xn =
n0
( a
n0
n )xn V
5
Unit-3 NMP Dr. JSK and Dr. HBN
3
= ( a
n0
n bn ) x n (Since elements of F satisfy distributive law)
3 3 3 3
= ( an ) x n ( bn ) x n = an x n bn x n = p(x) + q(x)
n0 n0 n0 n0
3 3 3
3
(.)p(x) = (.) an x n = (( ) an ) x n = ( an ) x n = an x n =(p(x))
n0 n 0 n 0 n 0
Example:
If F is a field verify that F* - n tuple space is a vector space over the field F.
Solution:
Let x = (x1, x2, x3, ….. xn), y = (y1, y2, y3, ….. yn), z = (z1, z2, z3, ….. zn) F* and xi’s, yi’s,
zi’s, a, b F
Under Addition:
1. Closure: x + y F* x, y F*
6
Unit-3 NMP Dr. JSK and Dr. HBN
x + y = (x1, x2, x3, ….. xn) + (y1, y2, y3, ….. yn) = (x1 + y1, x2 + y2, x3+y3, ….. xn+yn) F*
Therefore x + y F* x, y F*
2. Associativity: (x + y) + z = x + (y + z) x, y, z F*
(x + y) + z = ((x1, x2, x3, ….. xn) + (y1, y2, y3, ….. yn)) + (z1, z2, z3, ….. zn)
= (x1 + y1, x2 + y2, x3 + y3, ….. xn + yn) + (z1, z2, z3, ….. zn)
= (x1, x2, x3, ….. xn) + (y1 + z1, y2 + z2, y3 + z3, ……. , yn + zn)
= (x1, x2, x3, ….. xn) + ((y1, y2, y3, ….. yn) + (z1, z2, z3, ….. zn)) = x + (y + z)
Therefore (x + y) + z = x + (y + z) x, y, z F*
Similarly 0 + x = x
Therefore x + 0 = x = 0 + x x F* and 0 F*
x + (- x) = (x1, x2, x3, ….. xn) + (-x1, -x2, -x3, ….. -xn)
Similarly (-x) + x = 0
Therefore x + (- x) = 0 = (- x) + x, x F*, (- x) F*
5. Commutativity: x + y = y + x, x, y F*
x + y = (x1, x2, x3, ….. xn) + (y1, y2, y3, ….. yn) = (x1 + y1, x2 + y2, x3+y3, ….. xn+yn)
= (y1 + x1, y2 + x2, y3 + x3, ….. yn + xn) = (y1, y2, y3, ….. yn) + (x1, x2, x3, ….. xn) = y + x
(Commutativity in F)
Therefore x + y = y + x, x, y F*
6. ax F*, a F and x F*
ax = a(x1, x2, x3, ….. xn) = (ax1, ax2, ax3, ….. axn) F*
ax F*
7. a(x + y) = ax + ay a F and x, y F*
a(x + y) = a((x1, x2, x3, ….. xn) + (y1, y2, y3, ….. yn)) = a(x1 + y1, x2 + y2, x3+y3, ….. xn+yn)
= (ax1, ax2, ax3, ….. axn) + (ay1, ay2, ay3, ….. ayn)
= a(x1, x2, x3, ….. xn) + a(y1, y2, y3, ….. yn) = ax + ay
8. (a + b)x = ax + bx a, b F and x F*
(a + b)x = (a + b)(x1, x2, x3, ….. xn) = ((a + b)x1, (a + b)x2, (a + b)x3, ….. (a + b)xn)
= (ax1, ax2, ax3, ….. axn) + (bx1, bx2, bx3, ….. bxn) = ax + bx
(ab)(x1, x2, x3, ….. xn) = ((ab)x1, (ab)x2, (ab)x3, ….. (ab)xn)
= (a(bx1), a(bx2), a(bx3), ….. a(bxn)) = a((bx1), (bx2), (bx3), ….. (bxn))
1.x = 1. (x1, x2, x3, ….. xn) = (1.x1, 1.x2, 1.x3, ….. 1.xn) = (x1, x2, x3, ….. xn) = x
8
Unit-3 NMP Dr. JSK and Dr. HBN
Sub Spaces:
Definition:
A non empty sub set W of a vector space V over a field F is called a sub space of V. If W is
itself a vector space over F under the same operations of addition and scalar multiplication as
defined in V.
Note: Two special examples of sub spaces of any vector space V over F are
These two sub spaces are called Trivial or improper sub spaces of V. Any sub space of
different from {0} and V is called a proper sub space of V.
Theorem:
A non empty sub set W of a vector space V over a field F is a subspace of V if and only if
(i) , W + W
(ii) c F, W c W (or)
Proof:
Conversely,
+ is a binary operation on W.
Therefore W
And by (ii) c F, W c W
In particular if c = 0 F, W 0. = 0 W
9
Unit-3 NMP Dr. JSK and Dr. HBN
if c = -1 F, W (-1) = - W, W
The other axioms of the vector space hold in W as they hold in the whole space V.
Theorem:
if and only if a + b W , W, a, b F .
Proof:
Let W be a subspace of V
Conversely
Let a + b W, , W, a, b F
Hence W is subspace of V.
Theorem:
The intersection of any two subspaces of a vector space V over a field F is also a subspace
of V.
Proof:
Let S and T be any two subspaces of the vector space V over the field F.
10
Unit-3 NMP Dr. JSK and Dr. HBN
a + b ST a, b F
, ST , S and , T
a + b S and a + b T a, b F
a + b ST
Note:
1. The result of the above theorem can be extended to any number of subspaces.
n
i.e. if S1, S2, S3, ……. Sn are n subspaces of V then S
i 1
i is also a subspace of V.
Example (1):
Let V = R3, the vector space of all ordered triples of real numbers over the field of real
numbers. Show that the sub set W = {(x, 0, 0) / xR} is a subspace of R3.
Solution:
= (x1 + x2, 0, 0) W
Hence W is a subspace of R3
Example (2):
Prove that the set W = {(x, y, z) / x-3y+4z=0} of vector space V3(R) is a subspace of V3(R).
Solution:
Let 1 = (x1, y1, z1), 2 = (x2, y2, z2) be any two elements of W.
11
Unit-3 NMP Dr. JSK and Dr. HBN
Then 1 + 2 = (x1, y1, z1) + (x2, y2, z2) = (x1 + x2, y1+ y2, z1+ z2)
1 + 2 W
a1 W
Example (3):
Which of the following set of a real function f(x) defined on 0 x 1 or [0, 1] are the
subspace of vector space of all such functions over the field of real number F(R).
Example (4):
Which of the following sets of vectors = (a1, a2, a3 ………. an) in Rn are subspaces of Rn
(n3).
Solution:
Let = (a1, a2, a3 ………. an), = (b1, b2, b3 ………. bn) W, where a1, b1 0.
12
Unit-3 NMP Dr. JSK and Dr. HBN
Then c a1 + d b1 = -3 – 8 = -11 0.
Thus c + d W
Let = (a1, a2, a3 ………. an), = (b1, b2, b3 ………. bn) W, where a2 = a12and b2 = b12.
We have (c a1 + d b1)2 c a2 + d b2
Thus c + d W.
13
Unit-3 NMP Dr. JSK and Dr. HBN
Let = (a1, a2, a3 ………. an), = (b1, b2, b3 ………. bn) W, where a2.a1 = 0 and b2 .b1 = 0.
Thus c + d W.
Let = (a1, a2, a3 ………. an), = (b1, b2, b3 ………. bn) W, where a2, b2 are rationals.
Thus c + d W.
Example (5):
Let V be the (real) vector space of all functions f from R in to R. Which of the following sets
of functions are subspaces of V
Solution:
14
Unit-3 NMP Dr. JSK and Dr. HBN
= f(x2)+ g(x2)
(f + g) W.
(f + g) W.
Hence W is a subspace of V.
(f + g)(3) = f(3)+ g(3) = {(1 + f(-5)}+ {(1 + g(-5)} Using (1)
15
Unit-3 NMP Dr. JSK and Dr. HBN
(f + g) W.
Hence W is a subspace of V.
(f + g) W.
Hence W is a subspace of V.
Theorem:
If w1 and w2 are subspaces of the vector space V(F) then w1 + w2 is a subspace of V(F) and
w1 + w2 = [w1 w2]. Prove the above statement.
{If U and W are subspaces of the vector space V then U + W is a subspace of V and U + W =
[U W]. Prove the above statement.}
Proof:
Now if a, b F then
Therefore a, b F and , w1 + w2 a + b w1 + w2
16
Unit-3 NMP Dr. JSK and Dr. HBN
Linear combination:
Definition: Let V be a vector space over a field F and 1, 2, 3, 4 ………. n be any n
vectors of V, then the vector of the form
where C1, C2, C3, C4…………………. Cn F is called a linear combination of the vectors 1,
2, 3, 4 ………. n.
Example:
Consider the vectors 1 = (-1, 3, -1), 2 = (-1, 2, 3) and 3 = (1, 0, 1) of the vector space R3,
then the vector
= ( -4, 4, -8)
is a linear combination of the vectors 1, 2 and 3 by choosing different set of scalars
different linear combinations of 1, 2 and 3 can be formed.
Definition:
Let S be a non empty sub set of a vector space V(F). The set of all linear combinations of
finite number of elements of S is called the linear span of S and is denoted by L[S].
If L[S], then is of the form = C11 + C22 + C3 3 + C44 +………. + Cnn for
scalars C1, C2, C3, C4…………………. Cn F
Theorem:
Proof:
17
Unit-3 NMP Dr. JSK and Dr. HBN
Let , L[S]
Consider
Let L[S]
i.e. W
Example:
18
Unit-3 NMP Dr. JSK and Dr. HBN
Express the vector (3, 5, 2) as a linear combination of the vectors (1, 1, 0), (2, 3, 0), (0, 0, 1)
of V3(R).
Solution:
C1 + 2C2 = 3
C1 + 3C2 = 5
C3 = 2
C1 = -1, C2 = 2, C3 = 2.
Example:
Let S = {(1, -3, 2), (2, 4, 1), (1, 1, 1)} be a subset of V3(R). Show that the vector (3, -7, 6) is
in L[S].
Solution:
If (3, -7, 6) L[S] then (3, -7, 6) = c1(1, -3, 2) + c2(2, 4, 1) + c3(1, 1, 1)
c1+2c2+ c3=3
-3c1+4c2+ c3=-7
Augmented matrix is
1 2 1 : 3
3 4 1 : 7
2 1 1 : 6
19
Unit-3 NMP Dr. JSK and Dr. HBN
1 2 1 : 3
0 10 4 : 2
0 3 1 : 0
R3 = 10R3+3R2
1 2 1 : 3
0 10 4 : 2
0 0 2 : 6
C1+2C2+ C3=3
10C2+ 4C3= 2
2C3=6
C1 = 2, C2 = -1, C3 = 3.
Example:
Show that the vector (2, -5, 3) V3(R) is not in L[S] where S = {(1, -3, 2), (2, -4, -1),
(1, -5, 7)}
Solution:
If (2, -5, 3) L[S] then (2, -5, 3) = C1(1, -3, 2) + C2(2, -4, -1) + C3(1, -5, 7)
C1+2C2+ C3=2
-3C1-4C2-5C3=-5
Augmented matrix is
20
Unit-3 NMP Dr. JSK and Dr. HBN
1 2 1 : 2
3 4 5 : 5
2 1 7 : 3
1 2 1 : 2
0 2 2 : 1
0 5 5 : 1
R3 = 2R3+5R2
1 2 1 : 2
0 2 2 : 1
0 0 0 : 7
(A) (A:B)
Hence (2, -5, 3) cannot be expressed as combination of the elements of S and therefore it is
not in L[S].
Example:
Determine whether the polynomial 3x2 + x + 5 is the linear span of the set
S = {x3, x2 + 2x, x2 +2, 1-x} of the vector space of all polynomials over the field R.
Solution:
C1=0
C2 + C3 = 3
2C2 – C4 = 1
2C3 + C4 = 5
By solving we get
C1 = 0, C2 = 3, C3 = 0, C4 = 5
21
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
1
For what values of scalar k will the vector y be in the span {V1, V2, V3} where V1 1 ,
2
5 3 4
V2 4 , V3 1 and y 3
7 0 k
Solution:
k 2C1 7C2
C1+5C2-3C3= -4
-C1-4C2+C3=3
2C1- 7C2=k
Augmented matrix is
1 5 3 : 4
1 4 1 : 3
2 7 0 : k
1 5 3 : 4
0 1 2 : 1
0 17 6 : k 8
22
Unit-3 NMP Dr. JSK and Dr. HBN
R3 = R3+17R2
1 5 3 : 4
0 1 2 : 1
0 0 28 : k 9
Therefore for any value of k the vector y be in the span {V1, V2, V3}.
Linearly dependent:
Definition:
A set {1, 2, 3, 4 ………. n} of vectors of a vector space V[F] is said to be linearly
dependent if there exists scalars C1, C2, C3 ………. Cn F not all zero such that
Linearly independent:
Definition:
A set {1, 2, 3, 4 ………. n} of vectors of a vector space V[F] is said to be linearly
independent if there exists scalars C1, C2, C3 ………. Cn F if
when C1 = C2 = C3 +……….+ Cn = 0
Example:
Solution:
Consider
23
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
Show that the set S = {(1, 0, 1), (1, 1, 0), (-1, 0, -1)} is linearly dependent in V3(R).
Solution:
C1+ C2 –C3 = 0
C2=0
C1- C3=0
C2=0, C1= C3
Therefore any non zero value for C1 will do. Say C1=1
i.e. C1=1
Note:
2) An infinite sub set S of a vector space V[F] is said to be linearly independent if every finite
sub set of S is linearly independent.
24
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
4 7 1 1 1 2 1 1
M , A 1 1 , B 3 4 , C 4 5
7 9
Solution:
4 7 1 1 1 2 1 1
i.e. 1 2 3
7 9 1 1 3 4 4 5
4 7 1 1 2 2 2 3 3
7 9 3
4 2 4 3 5 3
1 1 2
4 7 1 2 3 1 2 2 3
7 9 3 4 4 5
1 2 3 1 2 3
1 2 3 4
1 22 3 7
1 3 2 43 7
1 4 2 5 3 9
1 = 2, 2 = 3, 3 = -1
Therefore M = 2A + 3B – C.
Example:
If , , are linearly independent in V(F), prove that the vectors +, -, -2+ are also
linearly independent.
Solution:
25
Unit-3 NMP Dr. JSK and Dr. HBN
(a + b +c) + (a – b – 2c) + c = 0
Therefore a + b +c = 0
a – b – 2c = 0
c=0
a = 0, b = 0, c = 0
Hence (1) holds only if a = 0, b = 0, c = 0 which shows that the vectors +, -, -2+ are
linearly independent.
Example:
Show that the vectors (1,1,2,4), (2,-1,-5,2), (1,-1,-4,0) and (2,1,1,6) are linearly independent
R4 and extract a linearly independent subset.
Solution:
Let x1 = (1, 1, 2, 4), x2 = (2, -1, -5, 2), x3 = (1, -1, -4, 0) and x4 = (2, 1, 1, 6)
(a + 2b + c + 2d, a – b – c + d, 2a – 5b – 4c + d, 4a + 2b + 6d) = 0
a + 2b + c + 2d = 0
a–b–c+d=0
2a – 5b – 4c + d = 0
4a + 2b + 6d = 0
Example:
Prove that the non zero rows of matrix in echelon form are linearly independent.
26
Unit-3 NMP Dr. JSK and Dr. HBN
Basis:
Definition:
(ii) L[B] = V
That is a basis of a vector space V[F] is a linearly independent sub set which spans the whole
space.
Finite Dimensional:
Definition:
A vector space V[F] is said to be a finite dimensional space if it has finite basis.
Example:
Solution:
The set S={1, 2, 3, 4 ………. n} is a linearly independent set if
Further any vector (x1, x2, x3, x4 ………. xn) Vn[R] can be expressed as a linear
combination of the elements of S as
27
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
Prove that the set of vectors {(1,0,0), (0,1,0), (0,0,1)} is basis for three dimensional vector
space V[R]
Solution:
C1 = C2= C3 = 0
a = x1, b = x2, c= x3
Therefore
Example:
If (-1,0,0), (4,2,0), (5,-3,8) are basis in B, express the vectors (x1, x2, x3) with respect to the
basis B. Hence express (1,2,3) with respect to B.
Solution:
28
Unit-3 NMP Dr. JSK and Dr. HBN
2C2 - 3C3 = 0
8C3=0
- a+ 4b + 5c = x1
2b – 3c = x2
8c = x3
22 x3 x 3x x
a x1 2 x2 , b 2 3, c 3
16 2 16 8
Therefore
22 x3 x 3x x
(x1, x2, x3)= x1 2 x2 (-1,0,0) + 2 3 (4,2,0)+ 3 (5,-3,8)
16 2 16 8
Therefore
66 2 9 3
(1, 2, 3)= 1 4 (-1,0,0) + (4,2,0)+ (5,-3,8)
16 2 16 8
57 25 3
(1, 2, 3)= (-1,0,0) + (4,2,0)+ (5,-3,8)
8 16 8
Example:
Show that the set B = {(1,1,0), (1,0,1), (0,1,1)} is a basis of the vector space V3[R]
Solution:
29
Unit-3 NMP Dr. JSK and Dr. HBN
C1+ C2=0
C1+ C3=0
C2+ C3=0
a + b= x1
a + c= x2
b + c= x3
x1 x2 x3 x x3 x2 x x3 x1
a , b 1 , c 2
2 2 2
Therefore
x1 x2 x3 x x3 x2 x x3 x1
(x1, x2, x3)= (1,1,0)+ 1 (1,0,1)+ 2 (0,1,1)
2 2 2
Note:
The above example shows that a vector space V[F] can have more than one basis for different
values of x1, x2, x3.
1
then , = . = 1 2
T
3 2 is called the inner product.
3
30
Unit-3 NMP Dr. JSK and Dr. HBN
Inner Product Space: (*Topic is not included for IA and SEE as per the syllabus)
Example:
Show that u = (u1, u2), v = (v1, v2) in R2 defined by u, v = 4u1v1 + 5u2v2 is inner product
space.
Solution:
= 4u1v1 + 5u2v2
= u, v
= u, w + v, w
= c(4u1v1) + c(5u2v2)
= c(4u1v1 + 5u2v2)
= cu, v
31
Unit-3 NMP Dr. JSK and Dr. HBN
Note:
Let t0, t1, t2, t3 ….. tn be distinct real numbers for p and q Pn (Polynomial), then inner
product of p and q is defined by
Example:
Let V be P2 (polynomial of degree 2) with the inner product where t0 = 0, t1 = 1/2, t2 = 1 and
p(t) = 12t2, q(t) = 2t - 1. Compute p, q and q, q.
Solution:
= 12
=2
Length (Norm):
Let V be an inner product space with the inner product denoted by u, v, the length of the
vector V is denoted by ||V|| and is defined as ||V|| = u, v and is a scalar.
Note:
Distance:
32
Unit-3 NMP Dr. JSK and Dr. HBN
Let u and v be the two vectors in the vector space V, the distance between u and v is denoted
by ||u - v|| = u v, u v
Orthogonal Vector:
Example:
Solution:
- <u, u> + <u, v> + <u, v> - <v, v> | <u, v> = <v, u>
= 4<u, v>
+ <u, u> - <u, v> - <u, v> + <v, v> | <u, v> = <v, u>
33
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
If V is an inner product space, then prove that for any vectors , in V || + || |||| + ||||.
Solution:
= ||||2 + <, > + <, > + ||||2 | <, > = <, >
||||2 + 2|||| ||||> + ||||2 |by Schwartz inequality <, > |||| ||||
Example:
Compute the length of the vectors p(t) = 12t2 and q(t) = 2t-1 where t0 = 0, t1 = 1/2, t2 = 1
Solution: ||p(t)|| = p, p
= 153
||q(t)|| = q, q
= 2
34
Unit-3 NMP Dr. JSK and Dr. HBN
Example:
Find the distance between the vectors u = (7, 1)T, v = (3, 2)T
Solution:
7 3 4
u–v=
1 2 1
Example:
Solution:
Theorem:
If S = {u1, u2, u3 …………… up} is an orthogonal set of non zero vectors in Rn. Then S is
linearly independent and hence is a basis for the subspace spanned by S.
Proof:
35
Unit-3 NMP Dr. JSK and Dr. HBN
Hence {u1, u2, u3 …………… up}is a basis for a sub space spanned by S.
Note:
2) Let {u1, u2, u3 …………… up} be a orthogonal basis for a subspace W of Rn. For each y in
W the scalars in the linear combination
y.u j
y = c1u1 + c2u2 + c3u3 + …………… + cpup are given by cj = j = 1, 2, 3, 4………p
u j .u j
Example:
8
Solution:
36
Unit-3 NMP Dr. JSK and Dr. HBN
11 12 33
c1 = , c2 = , c3 =
11 6 33 2
c1 = 1, c2 = - 2, c3 = - 2
y = u1 - 2u2 - 2u3
Orthogonal Projection:
Let y and u be the two vectors in vector space V(R). The orthogonal projection of y on u is
y.u
denoted by ŷ and is given by yˆ u and component of y orthogonal to u is given by
u.u
y.u
y yˆ y u
u.u
Example:
7 4
Let y and u , find the orthogonal projection of y orthogonal to u.
6 2
Solution:
T
7 4 4
y.u 7 6 28 12 40
6 2 2
T
4 4 4
u.u 4 2 16 4 20
2 2 2
Orthogonal projection of y on u is
y.u 40 4 4 8
yˆ u 2 2 4
u.u 20 2
7 8 1
Component of y orthogonal to u is y yˆ
6 4 2
37
Unit-3 NMP Dr. JSK and Dr. HBN
Gram-Schmidt Process:
Then v1 = x1
x2 .v1
v2 = x2 v1
v1 .v1
x3 .v1 x .v
v3 = x3 v1 3 2 v2
v1 .v1 v2 .v2
x4 .v1 x .v x .v
v4 = x4 v1 4 2 v2 4 3 v3
v1 .v1 v2 .v2 v3 .v3
………………………………………...
…………………………………………
Example:
1 0 0
1 1 0
Construct an orthogonal basis for W where W by Gram-Schmidt process.
1 1 1
1 1 1
Solution:
38
Unit-3 NMP Dr. JSK and Dr. HBN
1
1
Let V1=X1=
1
1
X 2 V1
V2 X 2 V1
V1 V1
0 1 3 / 4
1 1/ 4
3 1
V2
1 4 1 1/ 4
1 1 1/ 4
X 3 V1 X V
V3 X 3 v1 3 2 V2
V1 V1 V2 V2
0 1 3 / 4 0
0 1
2 2 / 4 1/ 4 2 / 3
V3
1 4 1 12 /16 1/ 4 1/ 3
1 1 1/ 4 1/ 3
Thus {V1, V2, V3} is an orthogonal set of non zero vectors and hence a linearly independent
set in W.
Let S be the subspace of inner product space R4, spanned by the vectors V1 = (1, 1, 1, 1),
V2 = (1, 2, 4, 5), V3 = (1, -3, -4, -2) in R4. Apply Gram-Schmidt orthogonalization process to
find an orthogonal basis and orthonormal basis of S.
Solution:
1 1 1
1 2 3
Given X 1 X X
1 2 4 3 4
1 5 2
1
1
Let V1=X1=
1
1
39
Unit-3 NMP Dr. JSK and Dr. HBN
X 2 V1
V2 X 2 V1
V1 V1
1 1 1 3 2
2
12 1 2 3 1
V2
4 4 1 4 3 1
5 1 5 3 2
X 3 V1 X V
V3 X 3 V1 3 2 V2
V1 V1 V2 V2
1 1 2 1 2 7 / 5 8 / 5
3 1
8 7 1 3 2 7 /10 17 /10
V3
4 4 1 10 1 4 2 7 /10 13 /10
2 1 2 2 2 7 / 5 7 / 5
Thus {V1, V2, V3} is an orthogonal set of non zero vectors and hence a linearly independent
set in R4.
1/ 2 2 / 10 16 / 910
1/ 2
1/ 10 17 / 910
u1 u
u3
1/ 2 2
1/ 10 13 / 910
1/ 2
2 / 10 14 / 910
Use Gram-Schmidt process on the basis {(1, 0, 0), (1, 1, 0), (1, 1, 1)} to obtain orthonormal
basis of R3.
Solution:
1 1 1
Given X 1 0 X 2 1 X 3 1
1
Let V1=X1= 0
0
X 2 V1
V2 X 2 V1
V1 V1
40
Unit-3 NMP Dr. JSK and Dr. HBN
1 1 1 1 0
1
V2 1 0 1 0 1
1
0 0 0 0 0
X 3 V1 X V
V3 X 3 V1 3 2 V2
V1 V1 V2 V2
1 1 0 1 1 0 0
1 1
V3 1 0 1 1 0 1 0
1 1
1 0 0 1 0 0 1
Thus {V1, V2, V3} is an orthogonal set of non zero vectors and hence a linearly independent
set in R3. Here {V1, V2, V3} itself is the orthonormal basis.
Given v1 = (1, 1, 1), v2 = (0, 1, 1), v3 = (0, 0, 1). Use Gram-Schmidt orthogonalization and
find orthonormal basis.
Solution:
1
Let V1 = v1 = 1
1
v2 V1
V2 v2 V1
V1 V1
0 1 0 2 / 3 2 / 3
2
V2 1 1 1 2 / 3 1/ 3
3
1 1 1 2 / 3 1/ 3
v3 V1 v V
V3 v3 V1 3 2 V2
V1 V1 V2 V2
41
Unit-3 NMP Dr. JSK and Dr. HBN
Thus {V1, V2, V3} is an orthogonal set of non zero vectors and hence a linearly independent
set in R3.
1/ 3 2 / 6 0
Orthonormal basis are u1 1/ 3 u2 1/ 6 u3 2
2
1/ 3 1/ 6
Use Gram-Schmidt process on the basis {(1, 0, 1), (1, 0, -1), (0, 3, 4)} to obtain orthonormal
basis of R3.
Solution:
1 1 0
Given v1 0 v2 0 v3 3
1 1 4
1
Let V1 = v1 = 0
1
v2 V1
V2 v2 V1
V1 V1
1 1 1
0
V2 0 0 0
2
1 1 1
v3 V1 v V
V3 v3 V1 3 2 V2
V1 V1 V2 V2
0 1 1 0 2 2 0
4 4
V3 3 0 0 3 0 0 3
2 2
4 1 1 4 2 2 0
Thus {V1, V2, V3} is an orthogonal set of non zero vectors and hence a linearly independent
set in R3.
42
Unit-3 NMP Dr. JSK and Dr. HBN
1/ 2 1/ 2 0
Orthonormal basis are u1 0 u2 0 u3 1
1/ 2 1/ 2 0
Linear transformation:
Let U and V be two spaces over a same field F then the mapping T : U V from a
vector space U to a vector space V is said to be linear transformation if
i) T ( ) T ( ) T ( )
ii) T ( c ) cT ( ) for all , U , c F
Theorem:
i) T (0) 0/
ii) T ( ) T ( )
Solution:
We have 0 0 0
T (0 0) T (0)
We have ( ) 0
T ( ( )) T (0)
T ( ) T ( ) T (0)[ T is linear ]
T ( ) T ( ) 0 / T (0) 0 /
Theorem:
43
Unit-3 NMP Dr. JSK and Dr. HBN
Prove that T : U V of a vector space U to a vector space V over the same field F is
linear transformation if and only if
T ( u v ) T (u ) T ( v ), , F and u , v U
Proof:
i) T ( ) T ( ) T ( )
ii) T ( c ) cT ( )
T ( u v ) T ( u ) T ( v )[ from(i )]
T (u ) T (v )[ from(ii )]
T ( u v ) T (u ) T ( v ), , F and u , v U
Conversely,
T (u v ) T (u ) T ( v ), u , v U (2)
T ( u ) T (u ), u U (3)
Solution:Given, T ( x1 , x2 , x3 ) ( x1, x2 , 0)
( x1 , x2 , x3 ); ( y1 , y2 , y3 ) V3
Then consider
( x1 , x2 , x3 ) ( y1 , y2 , y3 ) ( x1 y1 , x2 y2 , x3 y3 )
T ( ) T ( x1 y1 , x2 y2 , x3 y3 )
( x1 y1 , x2 y2 , 0)
( x1 , x2 , 0) ( y1 , y2 , 0)
T ( ) T ( ) (1)
44
Unit-3 NMP Dr. JSK and Dr. HBN
Again,
cT ( ) (2)
( x1 , y1 ); ( x2 , y2 ) V2
Then consider
( x1 , y1 ) ( x2 , y2 ) ( x1 x2 , y1 y2 ) V2
T ( ) T ( x1 x2 , y1 y2 )
( x1 x2 cos ( y1 y2 ) sin , x1 x2 sin ( y1 y2 ) cos ))
T ( ) T ( ) T ( x1 , y1 ) T ( x2 , y2 )
T ( x, y ) ( x1 cos y1 sin , x1 sin y1 cos ) ( x2 cos y2 sin , x2 sin y2 cos )
( x1 cos y1 sin x2 cos y2 sin ,
(2)
x1 sin y1 cos x2 sin y2 cos ))
Again,
c c( x1 , y1 ) (cx1 , cy1 )
T (c ) T (cx1 , cy1 )
(cx1 cos cy1 sin ,, cx1 sin cy1 cos )
c( x1 cos y1 sin , x1 sin y1 cos )
cT ( ) (##)
45
Unit-3 NMP Dr. JSK and Dr. HBN
Solution: Given, T ( x) ( x, 2 x 2 , x3 )
x; y V
Then consider
x yR
T ( ) T ( x y ) (1)
x y, 2 x y , x y
2 3
T ( ) T ( ) T ( x ) T ( y )
( x, 2 x 2 , x3 ) ( y, 2 y 2 , y 3 )
(2)
( x y, 2( x 2 y 2 ), ( x3 y 3 ))
Example 4:
(i) T ( x, y , z ) ( x y , y z )
(ii) T ( x , y , z ) (2 x y , y z , 2 y 4 z )
(iii) T ( x , y ) (3 x 2 y , 3 x 4 y )
Let ( x, y ) R 2 then
( x, y ) c1 (1, 0) c2 (0,1)
( x, y ) (c1 , c2 )
x1 c1 , y c2
T ( x, y ) xT (1, 0) yT (0,1)
x (1, 2) y (4,3)
46
Unit-3 NMP Dr. JSK and Dr. HBN
Example 6: Find the L.T T : R 2 R 3 defined by T (1,1) (0,1, 2) and T ( 1,1) (2, 3, 0)
Let ( x, y ) R 2 then
( x, y ) c1 (1,1) c2 (1,1)
( x, y ) (c1 c2 , c1 c2 )
c1 c2 x; c1 c2 y
On solving we get,
x y yx
c1 ; c2
2 2
x y yx
( x, y ) (1,1) (1,1)
2 2
x y yx
T ( x, y ) T (1,1) T (1,1)
2 2
x y yx
(0,1, 2) (2,1, 0)
2 2
( y x, y , x y )
verification : T (1,1) (0,1, 2)
Example 7: Find the L.T T : R 2 R 4 defined by T (1,1) (1, 1,1, 1) and T ( 1,1) (1,1,1,1)
.
Example 8: Find the L.T T : R 2 R 2 defined by T (2,1) (2,1) and T (1, 2) (4, 2) .
Let U and V be two vector space of dimensions n and m respectively.Let B1 1 , 2 ,..., n
and B1 1 , 2 ,..., m be the ordered basis of U and V respectively. Then T : U V be a
linear mapping defined by
b
T ( i ) cij 1 c2 j 2 ... cmj m cij i where i, j 1, 2,..., m
j 1
47
Unit-3 NMP Dr. JSK and Dr. HBN
Then the coordinate vectors of T (1 ), T ( 2 ),..., T ( n ) are successive written as a column
vectors in the form of rectangular array is called the matrix of linear transformation related
the ordered basis B1 and B2 .It is denoted by AT or (T : B1 , B2 ) .Therefore,
Example 1:
Solution: Given, T ( x , y , z ) ( x y , y z )
Then consider
c1 1, c2 0
48
Unit-3 NMP Dr. JSK and Dr. HBN
Also
c1 2, c2 1
2 1 2
AT (write coordinate vectors in terms of columns)
2 0 1
1 1 2
Example1: Find the linear transformation for the matrix AT with respect to the
3 1 0
basis B1 (1,0,0),(0,1,0),(0,0,1) and B1 (1,0),(0,1) .
1 1 2
Solution: Given AT
3 1 0 23
Define T : V3 ( R) V2 ( R) by
49
Unit-3 NMP Dr. JSK and Dr. HBN
Let ( x, y, z) V3 ( R) then
1 2
1 with respect to the
Example 2: Find the linear transformation for the matrix AT 0
1 3
basis B1 (1,1),(1, 1) and B1 (1,1,1),(1, 1,1),(0,0,1) .
1 2
1 with respect to the
Example 3: Find the linear transformation for the matrix AT 0
1 3
basis B1 (1, 2),(2,1) and B1 (1, 1, 1),(1, 2,3),(1,0,2) .
50