LECTURE NOTE ON LINEAR ALGEBRA II Page |1

AMU
Chapter 2:orthogonalty

2.1.Inner product

Definition An inner product on real or complex vector spaces V is afunction that

associates areal or complex with each pair vector in V in such that
thr following axiom s are satisfied for all u v and w in V and for all scalr k in field K

1. symmety axiom
2. additives axioms
3. homogenity axiom
4. positvity axioms

2.2Inner product spaces:

Defintion :A real or complex vector space V with an inner product is called an inner
product space

Examples: Eucleadean inner product on define u,v in by

< satisfy the axioms of inner productin such that

Solution:

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |2
AMU
√ ( ) ( ) √( )( )

If norm is one the v is called unit vector

Examples: if u,v in verify satisfy the four inner product

axioms

Solution:

Examples. If V is vector spaces of matrices over real number veryfy that

( )

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |3
AMU
Inner products generated by matices

The euclidean inner product and weighet euclidean inear product are special cases
of inner product on

Called Matrix inner products define .if u.v is Euclidean inner product on then
,A is invertable matrix

Note. If u and v are in column form then ( ) the

weighted Euclidean inner product< is
generated by matrix

√
√
√

( √ )

Examples : let the

(√ )
√

Examples An inner product on if are an nxn matrices then

( )

Exercise .Take 3by3 matrices and check by your own

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |4
AMU
Examples :standard inner product on

If ( ) ( ) are
polynomial in define the inner product on this space

√ √

( ) ( ) compute

a)
b)

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |5
AMU
Examples :Evaulation inner product o n

If ( ) ( ) are
polynomial in and if are distinct real numbers then

p( ) ( ) ( ) ( ) ( ) ( ) ( ) ( ) viewed as dot
prudct in satisfies the axioms of inner product

√ √ ( ) ( ) ( ) ( ) ( ) ( ) ( ) ( )

Examples; working with evaluation inner product

Let ,

( ) ( ) compute

c) d)

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |6
AMU
Examples : An inner product on collection of continues function on C[a,b]

Let ( ) ( ) be thwo continoues function on [a,b] define by

∫ ( ) ( ) verify the four inner product axioms

Orthogonality

Two vector u and V in inner product spaces are called orthogonal if

Examples : euclidean inner product spaces in where the operation is dot

product

Take your own particular examples

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |7
AMU
2.3.Orthogonal and ortho normal sets

Definition : Aset of two or more vectors in areal inner product spaces is said to be
orthogonal if for all pairs of distinct vectors in the set are orthogonal

An orthogonal set in which every vectors has norm one is said to be orthonormal

Examples .

let ( ) ( ) ( ) and assume that has the euclidean inner

product so each vector are orthogonal to each other . show

Examples :constructing an orthonormal set

Let * ( ) ( ) ( )+ then ( ) √ ( ) √
( ) then unit vector *( ) ( ) ( )+ are orthogonal to each
√ √
other

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |8
AMU
Theorem If * + is an orthogonal set of nonzero vectors in an inner
product spaces then S is lineary independent

Proof:assume that ( )

We want show for each it follow that from equation (1)

from the axiom of inner product spaces

From orthogonalty of S it follow that {

Examples :standard orthonormal basis in in with euclidean inner product

( ) ( ) ( )

Examples : ortho normal basis

The set *( ) ( ) ( )+ are orhonormal then linearly independent

√ √
sets and s is basis for by the above theorem

Coordinates relatives to orthonormal bases

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II Page |9
AMU
We express linear combination of basis vector * + thar
means

vector equation

so coordinate vector realatives to s is ( ) ( )

theorem : If * + is an orthogonal basis for inner product spaces

V and if is any vector in then
(|| ||) (|| ||) (|| ||)

(|| ||)
prooof: * + is basis for V, every vector in u in V can
expreesed in the form of
so
=
(|| ||)

(|| ||)
theorem : If * + an orthonormal basis for an inner produc
spaces V and u is any vector in V then
(|| ||) (|| ||) (|| ||)

(|| ||)
(|| ||)
Prooof: from the above theorem normality of each vector
Examples : find coordinate vector relatives to the orthonormal basis
*( ). / . /+ set is an orthonormal basis for with
Euclidean
express the vector ( ) as LC of vector in S and find
coordinate vector ( )

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 10
AMU
examples : An orthogonal and orthonormal basis
a) Show that the vector ( ) ( ) ( ) form
orthogonal Basis for with respect to Euclidean inner product
b) Expess vector ( ) as LC of orthonormal basis vector in part (a)

Orthogonal projection

Projection theorem: If W is a finte dimensional subspaces of inner product spaces V,

then every vector u in V can be expressed in exactly one way as

U= + where and and

( ) ( )

Calculating orthogonal projection

Theorem :let W be finite dimensional subspaces of an inner product spaces V

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 11
AMU
a) If * + an orthogonal basis for W and u is any vector in V then

(|| ||) (|| ||) (|| ||) (|| ||)

b) If * + orthonormal basis for w and u is any vector in V then

and where

can be expressed interms of basis vector for W as

(|| ||) (|| ||) (|| ||) (|| ||)

Since is orthoigonal to W it follow that

So
(|| ||) (|| ||) (|| ||) (|| ||)

(|| ||) (|| ||) (|| ||) (|| ||)

Proof of (b) in this case ( )

Examples :calculting projection :let have the inner product and let W be the
subspaces spanned by orthonormal basis {( ). / ( )} if
( ) find

And

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 12
AMU
2.4.Gram –schmidt orthogonalization process

Theorem :every non zero finite dimensional inner product has an orthonormal
basis

Proof:let W be non zero finte dimensional subspaces of an innerproduct spaces

.supposes that

* + is any bss for W.T.S that W has an orthogonal basis

{* +}

Step1:

Step2:construct orthogonal to so
(|| ||)

Step3: construct orthogonal to and :we compute component of

orthogonalto space spanned by *
(|| ||)
+
(|| ||)

Step4: to determine that is orthogonal to we compute the component

of orthogonal to the spaces spanned by

(|| ||) (|| ||) (|| ||)

Continuing this way for r –step

where * +

* +
(|| ||) (|| ||) (|| ||) (|| ||)

To construct orthonormal basis { + || ||

for i=1,2…r

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 13
AMU
Examples: using gram -schmdit process tranform the basis vectors

a) *( )( )( + to orthogonal basis* +

Example.calculate the set of orthonormal polynomial w.r.t inner product define by

∫ ( ) ( )

* + to orthogonal and orthonormal basis* +

* + to orthogonal and orthonormal basis* +
Solution: set ing ( ) , our othogonal
set { } and setorthonormal set by{ }
( ) ( )

‖ ( )‖ √ √∫ √

( )
( ) √
‖ ( )‖
( ) ( ) ( ) ( ) ( ) √ ∫ √

‖ ( )‖ √ √∫ √

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 14
AMU
( )
( ) √
‖ ( )‖
( ) ( ) ( ) ( ) ( ) ( ) ( ) ( )

√ >√ √ √

‖ ( )‖ √ √∫ ( )( ) √

√
( ) √
( ) ( )
‖ ( )‖
Continiung this procese we obtaion
( ) √
( ) ( )
‖ ( )‖
In genneral
( )
( )
‖ ( )‖
√ ( ) where ( ) is legendre polynomial
What is legender polynomial ?

Theorem : cauchy –schwarz in equality

Angle and orthogonallity in inner product

Recall : angle , ( ) ( )

( )

Implies taking absolute both sides ( ) ( )

Theorem : cauchy –schwarz in equality

If u and v are vector in real inner product spaces , then

( ) ( )

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 15
AMU
Theorem : if u,v and w are vector in real inner product spaces V and if k is any
scalar then

a) ( ) ( ) ( ) triangle in equalty
b) ( ) ( ) ( ), where d is distance by ( ) ( )

2.6 The Dual spaces

Let V= avector spaces over field K and let ( ) the set of all linear maps
from V to K, is vectors spaces over K

Definition: the vector spaces is called the dual spaces of V . an element of are
called linear fuctional on V.

Notation.Let or ( ) we will use the notation < ( )

1. <
2. <
3. <
4.
Defition 2: * + is called the dual basis of * +
Let V= an inner product spaces to each we can associate linear function
given by
( )
Note. ( ) ( ) ( )
( )
:Let V= a finite dimensional inner product spaces. Let
* + be b asis for then { } is basis of

Proof:let

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 16
AMU
Examples of dual spaces:
1. : be projection of i component define by ( )
. then is linear so it linear funtional on . for every

Solution:
2. Let matrices over K (field) defined by T(A)= trace(A)
where
T is linear so it is Linear functional on V
3. by ( ) is linear functional on

Theorem:dual basis. Suppose * + is basis for be linear functional

defined by ( ) { then * + is basis for

Proof:
Example or exercise :dual basis
1. Consider basis of * ( ) ( )+Define ( )
( ) find dual basis by the above theorem

2. Let be linear functional define by ( )

( ) ;
3. Given basis for * ( ) ( )( )+find dual basis
* +
4. Let V be a vector spaces of polynomial over R of deegree let
be linear functional on V defined by

( ( )) ∫ ( )

( ( )) ( ) and ( ( )) ( ) here f( ) find basis

* ( ) ( ) ( ) + of V which is dual to * +

2.7 Ad joint of linear operators

Definition: let finite dimensional inner product spaces. Let T= a linear

operator on V then there exist a unique liear operator on V such that

( ) ( ) for all . is called ad joint of T

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 17
AMU
Theorem: let finite dimensional inner product spaces. Let T,S= a linear
operator on V.let , - then

i. ( )
ii. ( ) ̅
iii. ( )
iv. ( )
Proof:

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 18
AMU
Example: Let be defined by ( ) ( ) clearly T is
linear operator o .find ( )

solution:

( ) ( ) ( ) ( ) ( ) ( )

hence A=[T]=[ ] and , - [ ]

( ) =[ ][ ] ( )

Examples 2;let by ( ) and ( ) A and B are matrix

, Define inner product

( ) ( ) and ( ) ( ). If what is ad joint Linear

operator on V

Solution: clearly T is linear operator on V . is ad joint Linear operator on V by

definition if

( ) ( ) ( ) ( ).

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 19
AMU
2.8 Self-ad joint linear operators

Definition: let dimensional inner product spaces. A linear operator T

on V is called self-ad joint linear operator if

Note: If V is Euclidean spaces and T is a self-ad joint linear operator on V then T is

called symmetric

Theorem:let dimensional inner product spaces. A linear operator T on

V is self-ad joint linear operator on V then

i. Each eigen values of T is real

ii. Eigen vector of T associated with distance Eigen values are orthogonal
Proof:

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 20
AMU
Example: Self-ad joint linear operators:

let by ( ) ,A are matrix , Define inner product

( ) ( ) and ( ) ( ) and T* is self adjoint then A

is symmetric matrix

Solution: ( ) ( ) ( ) ( ) by definition.

( ) ( ) hence A is symmetric matrix

2.9 Isometric

Definition: let dimensional inner product spaces and T is linear

operator on V. the following are equivalent:

i.
ii. preserves inner products I i.e ( ) ( )
iii. preserves length .i.e.‖ ( )‖ ‖ ‖
is called an isometric if it satisfies any of the three equivalent
conditions

let dimensional inner product spaces and T is linear operator

on V. let * + be orthonormal basis of V let ( ) , ) be the
matrix of T w.r.t then ( )

Proof:

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 21
AMU
Theorem: let dimensional inner product spaces and T is linear operator
on V. let ( ) , ) be the matrix of T w.r.t orthonormal basis then T is
isomeric iff

Proof:

Examples: rotation in

1. Let Let be defined by ( ) . /. / , -

then clearly T is linear operator and isometry. Show?

Prepared by NURE AMIN

LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 22
AMU
2.

i. ( ) [ ]

ii. ( ) [ ]

iii. ( ) [ ]

( ) ( ( )) ,
( ) ( ( )) and ( ) ( ( )) is linear operator and isometric?.
Show

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 23
AMU

2.10 Normal operators

Definition: let dimensional inner product spaces and T is linear

operator on V.

T is called normal operator if

Theorem: let dimensional inner product spaces and T is normal linear

operator on V then for any is normal operator

Proof:

Examples of normal operator.

1. Let Let be defined by ( ) . /. / , -

and is fixed then .show?
Exercise. Are the following are normal operator ?

) ( ) [ ]

) ( ) [ ]

( ) [ ]

( ) ( ( )) ,
( ) ( ( )) and ( ) ( ( )) .

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 24
AMU

Definition: let V be avector spaces over a afield K .T= a .l.o. on V, W=

subspaces of V we say that w is T in variant if for each . the vector
( )

Theorem: let V= an inner product spaces .T= a.l.o. on V. W= a T invariant

subspaces of V then is invariant

Proof: let. then ( )

( ) ( ) ( ) ( )

Hence is invariant.

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 25
AMU
Worksheet# 2
1. Compute inner product of the following vectors

a) . / . / use Euclidean inner product on square matrix

b) such that
c)

2. Use inner product defined by ∫ ( ) ( ) . Compute inner product

for the following function

a) ( ) ( ) ( ) ( );
b) ( ) ( )

3. find a basis for orthogonal complement of the subspace of spanned by the

vectors

a) ( ) ( ) ( )
b) ( ) ( ) ( )
c) ( ) ( ) ( )
d) ( ) ( ) ( ) ( )

4. let the vector space have inner product ∫ ( ) ( ) apply grams

Schmidt process to transform the standard basis* +for into orthogonal
basis

5. Verify that the vectors ( ) ( ) ( )

( ) form an orthogonal basis with Euclidean inner product. Then
express each of the following vectors as linear combination of and find
coordinate vectors for each vector’s

i. ( ) viii. ( )
ii. ( ) ix. ( )
iii. ( ) x. ( )
iv. ( ) xi. ( )
v. ( ) xii. ( )
vi. ( ) xiii. ( )
vii. ( ) xiv. ( )

Prepared by NURE AMIN

 LECTURE NOTE ON LINEAR ALGEBRA II P a g e | 26
AMU
xv. ( ) xvi. ( )

6. from the Q5. If w is subspace spanned by the vectors of find projection

of each vector on w

7. Find the orthogonal projection of u on subspace of

a) ( ) ( ) ( ) ( )
b) ( ) ( ) ( ) (

8 Let be linear functional define by ( )

( ) ;

9 Given basis for * ( ) ( )( )+find dual basis

* +

10Let V be a vector spaces of polynomial over R of deegree let be

linear functional on V defined by

( ( )) ∫ ( )

( ( )) ( ) and ( ( )) ( ) here f( ) find basis

* ( ) ( ) ( ) + of V which is dual to * +

Prepared by NURE AMIN