Lecture-19
Lecture-19
Chapter 3: Orthogonality
Inner Product:
Let x = (x1 , x2 ) and y = (y1 , y2 ). Then the inner product of two vectors x
and y is denoted by xT y and defined as xT y = x1 y1 + x2 y2
Let x = (x1 , x2 , x3 ) and y = (y1 , y2 , y3 ). Then xT y = x1 y1 + x2 y2 + x3 y3
Let x = (x1 , x2 , ......, xn ) and y = (y1 , y2 , ...., yn ).
Then xT y = x1 y1 + x2 y2 + ..... + xn yn
1
Note:
x1
x2
xT x = x1 x2 ......xn
......
xn
= x21 + x22 + ..... + x2n = ||x2 ||
Hence inner product of a vector with itself is equal to the length square of
the vector.
• If xT y > 0, their angle is less than deg 90. If xT y < 0, their angle is
greater than deg 90.
• The only vector with length zero and the only vector orthogonal to
itself is the zero vector.
Orthogonal Vectors:
Two vectors x and y are said to be orthogonal iff xT y = 0
Orthogonal Subspaces:
Two subspaces V and W of the same space Rn are orthogonal if every vector
v in V is orthogonal to every vector w in W i.e v T w = 0 for all v and w.
Examples
• y = x line ⊥ y = −x line in R2 .
Notes
2
Fundamental theorem of orthogonality: The row space is orthogonal to
the nullspace (in Rn ). The column space is orthogonal to the left nullspace
(in Rm ).
Examples