‘aK Orthogonality and Least Squares unit 4 SYLLABUS Inner product, Length, and Orthogonality = Orthogonal Sets = Orthogonal Projections = The Gram-Schmidt Process, LEARNING OBJECTIVES After studying this unit, a student will have thorough knowledge about the following key concepts, ¥ Inner Product, Length and Orthogonality Y — Orthogonal Sets and Orthogonal Projections Y The Gram-Schmidt Process |_INTRODUCTION In linear algebra, inner product space refers to a vector space with natural setting of similar or different problems over the field R of real numbers. It is positive definite, bilinear and symmetric. Linear spaces of real functions defined on a certain domain explain inner product spaces, Inner product also induces a norm naturally. Hence, it is also referred as normed vector space. ‘This unit also explains orthogonal basis and orthonormal basis. Orthogonal bases areeasier to work with, and they help in performing various computations such as finding vector coordinates with respect to this basis, projecting vectors on various subspaces of a vector space etc. Gram-Schmidt process transforms an arbitrary basis into an orthonormal basis. ma !XeronlPhotocopying of this book la CRIMINAL, act Anyone found gully InLIABLE to face LEGAL proceedingsUNEAR ALGEag, | 108 PART-A SHORT QUESTIONS AND ANSWERS Serena scm eanera aawven oo ms oper Present Answer: It'w and y are two inner product of w and v. ie, mv, (00) Now oe. og wectors [fe matrices of order nx 1] in R, then the product 1: (ot) Wy is referred i. Properties of Inner Product If'w, v and w are vectors in R° and ‘c’ be any scalar then, uar2 Oand wu =0 (1, -2, 2, 0). Answer : ‘Write the properties of inner product of vectors in R". (ut v0 wt (cw).v = clu.) = udev) if ond only if w=0. ‘Also find the norm of the vacta, [model Papers, G10 | (OU) Junelduty-9, oy Properties of Inner Product of Vectors in R* For answer refer Us Problem Given vector is, /, Page No. 108, Ql, Topic: Properties of Inner Product. 1 oaner| fl ‘The norm (length) of vector is given by, L- Feo 2 |el-s : Given vector is, « =C1,2) 3. Find a unit vector in the direction of the vector u, where u = (— 1, 2). Answer ‘The unit vector in the direction of w is given as, (KU) Dec.-18, 013) snort Sea Sinpie —<—— pe * Tel Wall = ETF +P = 15 B} Al mt] £ Unit vector, x = | PUBLISHERS AND DISTRIBUTORS PVT. LTD. Fa a_UNIT-4: Ortho, SY ON Least Sauores IY (\ Of Finda unit vactorin the bes a Q6.._ Verity the parattelogram law for vectors Meeceali vandvin Answer : Moder 3 Given vector ix Papers, 2141 (OW) suy.24, Re flory IP + fav = 2nuyp + 24 v F 6 Answer : v=|4 is Given w and » are vectors in The unit vector 1 in the ditection vis given as, y wil = IMl= Yer 1 v6, Unit vector, v= VOTH Bi 4]= =6 Year| 4 vor 3 ¥6r | 'Q5. Define the unit vector. f v= (1, ~2, 2, 0). Find a unit vector uin the same direction as Vv. Answer : Unit Vector A vector of unit length is called a unit vector. Problem Given vector is, = ea ver 4 (MGU) Novibec.-18, 03 1 Gi rerente- me =(1,-2,2,0)= Bl acer] . 9 ‘The unit vector i in the direction of ¥ is given as, a 1 ie TQ @ 0 | 2 1] [1/3 : 1 |2|_|24 alt 2/3 0 1/3 7 _|27) + Unit veetor, w= 17 /, 0 Consider, et P= (eee vy Wet ol le + mv =i cry fe ori = and ay =n} Consider, Meo P =(@-9)u—9) =n —v9—vart vw fu-viP =e (P—2e9 +P 2 ‘Adding equations (1) and (2), Gate P+ deo = ules dev +p vie +HelF-2ev +i = 2 ulP+ 2h ee Hw IP + 2 v IF ie | fiut vit e—vl 2 a7. Comtesse] 8 I-41 6 Dodet Papert, 10 | (OU) Juty-25, G71 Consider, 2} vvr-[]- - s 5 Ther, |b + v||= VCS) +9)" +S) = Bes Nut vil= Vis ilu v= VBI = ‘rh book & CRIMINAL act. Anyone found gly LABLE to fce LEGAL proceedings) (Warning :XeroxPhotocopring '110 _ 8, Find (dist (a, yp, Answer ! (Model Papersi,12 | (OU) Nov/Oee.10, 08) List (w, -999? = ju ~ (~ v9 = hee VIP = ut veut vy Sut + vt v) UW v= we + v0) Suu tay unetey = Wel? + WolP + Qa [8 wy = vse] S__Ldist (99)? = fi + oye + 20 Q9, Define orthogonal sot Answer t [Model Paper-ll, 11 | (OU) Nov/Dec. -19, 06} An orthogonal set is referred to the set of vectors {yp ¥y +++ 4) im R*, in which each pair of distinct vectors must be orthogonal Q10, Show that u =(-3,7,4,1), 9 =(1,~8,15,-1) are orthogonal in R’. Answer 1 [Model Popor, 12 | (KU) Doe.-18, Q1U) Given vectors are, [= 3) 7=C37,4,1)=|) 1 1 — -8 and v =(1,~8, 15,-1)= 15 1, Consider, wv=ury 1 = [2374 ei =-3(1) + 7(-8) +415) + 11) wand Y_are orthogonal in Rt. Q11. Compute orthogonal projection of (1,—1) ‘onto the line through (- 4, 2) and (0, 0). Answer : Let the vectors be, v[sfae-b (KU) Dee.18, a4) SIA PUBLISHERS AND DISTRIBUTORS PVT. LT LINEAR ALGEBRA q ‘The orthogonal projection of y onto is gi Sofie" a) il] yu [allo 1-4) -1Q)°=6 4 | w= Lol | 2 AC A) + 2(2) = 20 Substituting the corresponding values jin equation (1), ¢ 6 ed Y* FO" " TO] 2 12 | 10 6 | io | 12 | The orthogonal projection is 7 = | ! y To ‘Qiz. State the orthogonal decomposition theorem. Answer + ‘The orthogonal decomposition theorem states that if Wis a subspace of R* then each y in R can be written uniquely in the form, yopte Where, in Wand zis in W. Additionally, if (uj, ..-- basis of IY, then the orthogonal projection of y onto Wis, 4i,) isan orthogonal | Yat Ay Yur. pat,“ Fi = A vane andz=y— p.UNIT-4: Orthogonalty and Least squares [CA RT-B 44 INNER PRODUCT, .[-1 4 3 ats. Late] Dp y= ghee = —s vou curly tw) Given vectors are, wm ESSAY QUESTIONS AND ANSWERS LENGTH AND ORTHOGONALITY 8 2]. 3 uot wit “Eblth-[3)=-[4 ua = lil? = (1+ QF =144 > uns varie [a af | = 41) +62) var =8 zw=ziw= [6 2 | 3 -1 -s =6(3)- 2-1) +35) xw=5 xx [iF +2 +OF> LINEAR ALGEBR, 12 : t+ (s)2 Consider, dy wil (3: y+ + (1)? + (-5)? = v9+1+25 Goat = |wl= i ; ' 5 = -s -1 14, Determine which pairs of j ehogorie: =2-1)-5-4)-106) Mm > uy=0 lee |i 3 Ill = @R+C5R4 CHF = |lu|P=30 (y= : ,z= Consider, a a7 Answer : Model Paper, 194) Perms tlc. () Given vectors are, z . 12 2 a u=| 3 |andv=|-3 = ep eles “5 3 ee Consider, Es 2 5 = [12 3 -5]|-3] Then, 3 |lu+v |? =(5P + C9 + (5P=25 4 81 +25 ) = 12@) + 3(-3) 5) = ut vlF |= 30+ 101 | = uv=0 = lat vl = [ule +i vie and v are orthogonal. Wet y P= ll P+ VIP @)_— Given vectors are, Sralahoe 3 1 thaty is orthogonal to every w in Span {u, v}. wi -8 ell and z= 15 0 =7 Consider, = 4 yanylc Z a) = ne Sow =Ea74 0/5 -1 3(1) + 7(-8) + 4(15) + 0(-7) yz=1#0 y and z are not orthog. 2 7 Q15. Letu= [3] and v= FI Compute and 1 6 compare uy, || u [f, |] v I, and |} u + v |p. Answer : Given vectors are, 2 7 + 4 6 “lie -1 | SIA PUBLISHERS AND DISTRIBUTORS PVT. LTD. Answer : Let w be an arbitrary vector in Span {u,v} ‘Then, w=c,u + c,y Where c,, c, are scalars I vector is orthogonal o wand y Then, y.v=0 and y.»=0 ‘Consider, wy = (cut ey).y RGU SRA CUNTiS =qQuy)te(ny) [rs =¢,(0) +c,0)=0+0 wy=0 is orthogonal to every w in Span{u, y}, (et vow = ua + vw) (cu). = e(u.v)) >& Orthogonatity and Leas, $qu ORTHOGONAL seTs H7. #8 =(4,,U,....u) Is ano, Non-z6ro vectors in Re 1s linearty Independen rthogonal set of » then prove that 5 it HOU) Now 006.-18, or4¢0yu9 wert (OY) Junsisuy.49, a, (ON) Given that, iS Wty) Asan " orthogonal set of non-zero vectors j in Re ( Since u, is orthogonal to %,...... then ee 113 Consider, 5 = (1-2-2 1 m-St4el > uw=0 Each pair of distinct vectors is orthogonal i.e., 4. ¥), (¥. 7), (us W) are orthogonal The given set is orthogonal Feit. toy mo 219. Determine ifthe sot {u, v, w} Is orthogonal 4 5 3 s in Set. Givenu=| 41,v=|2|,w=|—4 Then (CMG t 480), = Oy Pen z CHD HP GWOM Fe Ae) wae |) nnamars (OU) Juty.24, 40) e(u, Wl +. bey, u)=0 Given set of vectors are, “lle e404... F029 > o(u.n) =0 a ae Os 4,4 0% u,44 20) Consider, Similarly, ¢,,.....¢=0 uy =u'y iy a ee Hence, S= {u, ,) is linearly independent, =[-1 4 -3]]2| Don't a] > escape from =-1(5)+4@)-3(1) me => uv=0 (OU) June/July-t9, aso) Consider, Given set of vectors are, we =v 0 <5 3 ),w=|2 =(521]|-4 2 1 =F Consider, w= uly =5@)+2C-4) +107) 0 => vw =0.! aes sft] Consider, uw = lw =0-2+2 3 > 1v=0 aera aa Consider, 7 vw = n =-13)+4-4)~3¢7) | “101 [3] => uw=240 Sars: } Since u,v = v.w + w.w, the set {u, v, w} is not an > vw=0 orthogonal set. LIABLE to face LEGAL proceedings. ) Warning ‘Xerox/Photocopying of this book is a CRIMINAL act. Anyone found guilty isa a LINEAR ALGEBR, ERR ALGEBRA 3 920. Define orthogonal sot. If ii; « i) key ! 4 ~f 2 iis w(-12 1) 2 = 12), UG» | -2/ thon show that d 1 4 2 $= (01, 1,0;) te an orthogonal basis for ie --1(-4) +2(-2) “1(Z) > iyt,=0 (MGU) Nov/Dec.-18, O6(b) t id sk Consider, ye iy Show that the set (u,, u,, u,} is an i | 3 el =piy|2 orthogonal sot, whore u, = |1],u, =| 2 |, j 1 if ie 1 Zi andu,=| 2]. =3[ 3) F1+1(3) 7 2 = 48,90 (Refer Only Topte: Problem) bnieh a yy yt, = tly = Olt) is an Answer + (04) Novsbes.-10, 99(090) | 21, tot u,= [2 ee that (u,, u,) is an orthogonal basis for R?, Orthogonal Set An orthogonal set is roferred to the set of vectors ,) in RY, in which each pair of distinct be orthogonal ‘Answer 5 Given vectors are, i.e, vy)" 0, 48). we [tlonc[ 2 foto] Problem I) tz mI: 3 Consider, Given set of vectors are, ‘ yt, ul, 3 et 4, | Vet 2s ere =6 afe| 1 1 i . id ' =-646 Consider, mere yg tH) thy s+ {tty} is an orthogonal set ST Since, uy, 4, are non-zero vectors, =(11) | Al => yt are linearly independent and form a basis for. 1 (1), 4) is an orthogonal basis for R2, IE +1@)+1() Let x be linear combination of veetors 1, xa = mu,=0 ney q@= 3 tel = 63) +3(1) => xu, =-15 xa, = xu, = 2 raf = -(-2) + 3(6) => 44, =30 ih wu, Fe 3 ab; af} ]-20 +10 = mytt,=10 Myst, = uu, =12.6| 2 | --2¢9) 6 |" 2D +616) > ty, 40 : ‘Substituting the corresponding values in equation (1), -8 31,3) eli) 3E]- 2b Flt] Q22. Determine which sets of vectors are orthogonal. If a sot is only orthogonal, normalize the vectors to produce an orthonormal set. " 4] fa i} ojyo @ |Z} 0 (i) [:|= 4a}| 4 ollo z|lz Answer : () Given set of vectors are, 1 =} [a a lies Bil ne a}jt Zz 2 1 ae a a ioe u=|—| andv=| 0 Let, A io z 2 ofr akip 1 or sal PSOE of is BOOK Ie GAIRIINAL act Airs fo a6 LADLE © fSS® LBGAL roseesineLINEAR ALGEgR Pr ns Consider, avewy 1 141115 -[333 | t 2 -$(4}-$0° 56) as => {x,y} is an osthogonal set. rae- GF +) +6) => WP-5 Since, Ju P= lv iF#1 2 {u,} is not an orthonormal set. “The vectors w an v are normalized to form the orthonormal set. 1 |e ie gp-tnt- 1 t 119 Co fE\3\ fE 3 {1 + 3 az 1 alae =14|4F|2| 0 Hf ay 3 2 i ely WS, | {a Ba Nee = b] © |r=q] aah] ® || 2 eee eset |e |e =1 {rat SSIS ak esl C @ SIA PUBLISHERS AND DISTRIBUTORS PVT. LTD.= 00) + 1(-1) + 0(0) = uy=-120 = (uy) isnot an orthogonal set 23, Show that {v,, v,, v,) is an orthonoangy basis of R? where eeiys! “(Fever aa)»s (40.53), 47(33-¥). (Answer! [Model Paper, 219 | (KU) Dec.18, asta) 4 a =a ste) = ps2 a otieal| ee 4 38-91 a -4 sf gala) ao ail) yyy 9 Fy, => yyn0 ie [eo yh V2 ° V2 3 ay -7()-F2) => yy%=0 Since, v,.¥, = vy. 4 =v) %=0 = (¥,.¥ v5} is an orthogonal set. > vO Gal = Ihyl=1 inl= Y[Za) +P = Ibyl=1 oa TOT 2. Unyl=liyl=In1= 1, (,.¥5.»,) sanonthonormal set. Since v,, vj, v, ate linearly independent and forms a basis for 2? (4%) is an orthogonal basis for R?. Q24, Find the orthogonal projection of | 1 Z onto the line through lie | and tho origin. Answer 1 (00) Juty-21, 144) oe) ya el - ie : eMae 10118 Substituting the corresponding values in| ‘equation (1), 10 goon -if3] “| . The orthogonal projection is, ji -[h a2s. Lety = [2] andu= [4]. Find the orthogonal projection of y onto u. Then writey as the ‘sum of two orthogonal vectors, one in span {u} and other one orthogonal to u. Answer: (OU) Novsove.18, 110) ‘Given vectors are, 7 4 fd - --f ‘The osthogonal projection of y onto w is given as, pe tbe a y yas (al) =1(4) + 62)= 40 me (a) = 44) +2(2)=20 Substituting the corresponding values in equation (1), 5 pe 4 ->;] [s =| y can be represented as sum of two vectors one in span{u} and one orthogonal to # ie,y= 9 +@- 5) ‘The component of y orthogonal to wis, slletal “fed => -® UNEAR ALGEBRA akersaring io carrenpandivg: valves ty ‘equation (2), 26. Lety = 1 | Compute the -3| wns distance from y to the line through ang the origin: Given vector are, 3 1 19 2 Answer + and w= ‘The distance from y to the line through w and the origin is I] y— il ‘The orthogonal projection of y onto is given as, po, »-[3I = 31) + 92)= 15 -[:] 0] =1()+2@)=5 a Substituting the corresponding values ia equation (1), 2 oe Consider, y— “PH =[522 rf Then, ly yll= VEO)? +6)" = V3649 ~ V5 = 3/5 The distance from y to the line through « => a oarlal and origin is 3/5 4% SIA PUBLISHERS AND DISTRIBUTORS PVT. LTD. | i | | |: al TEED egoncity ond Least Squares 4.3 ORTHOGONAL PROJECTIONS G27. State and prove the orthogonal decomposition ; Wy = Let the orthogonal basis for a subspace W be {u, May» (A) 4, Up tly ‘equation (1), ¥ isa linear combination of we, uy -....u, such that y isin W. [C= From equation (1)) u Ly can be written as sum of two veetors (in Wand Win two different ways ie,LINEAR ALGERR, y Figure From equations (2) & (3), pee jee, @) isin Wthenvy=0 => y=0 Ifv=Othen §- j,-0 => § Substituting = j, in equation (4), Hence, y can be written uniquely in the form, y= +z where jis in Wand zis in W*, Q28. Assume {u,, u,, u,, u,} 1s an orthogonal basis for R‘ and write x as the sum of two vectors, ‘one in span {u,, u,, u,} and the other in span {u,). o 3 1 5] [10 ue uae w=) uals] x= | 2 Oi aes ayes ja} 2 1 1 4. 1 ° Answer : Given vectors are, 0] 3 1 s 10] 5 0 3 -8 Tps= | am= |] ende= [9 1 4. 1 0 Let (14, ty, %, 44} is an orthogonal basis for R¢ then, X= eu, + 6M, + ous + ou, ~(l) ‘The vector x can be represented as sum of two vectors (.¢, in span {uy yu) and span (1,)) as, x=z,t2, Where, (2) 2,501, + Cs, es Jn span {14 #4, 4} and c,u, is in span {u,) 4 SIAPUBLISHERS AND DISTRIBUTORS PVT. LTD. )1 el +6, + cu, = = & Ls ae a a 2. Cat ee ‘ Mats a 10] [ oj xa= | 1 TY 2) | gt = 1000) — 801) + 20-4) + 0-1) == 16 °. i) uu=| 1 I WN Va] |g] = 000) + 101) — 4¢-4)— 10-1) =18 3 Ss 1] = 10G)~8(5) +271) + 01) = 1 3 s 11] =3G)+ 505) +10) + 14) =36 1 10) [4 =] | 0 y= 9) 1 1] =10)—8(0) +201) + 0¢-4) = 12 0. 4: 1 1 t F = 1(1) +00) + 11) -4-4)= 18 4} |-4| Substituting the ‘corresponding values in equation (3), . Els CaN ui Wt Se yt Sw, sya saa -@ ‘1 1 5 5 4] [A] 50-3) -1ey= 10 =36 1 10] a | 3) = 10(5) - 86-3) +214 001) = 72 “Xerox/Photocopying of this book is a CRIMINAL act. Anyone found guilty s LIABLE to face LEGAL proceedings.122 Substituting the corresponding values in ‘equation (5), Bei 10] [ o] {10 | -/9 97), bs} _ I-21, | } “/32_ 2,217 |-2)~] 4]™ Ja] 9°93 2) [E2 eee 9° 973 0} 10) : -2 6 + xis represented as sum of two vectors |" 4| and |}. =e 2 Q28. Find the orthogonal projection of y onto span{u,,u,} = W “Asli Answer : ‘Model Papers, Given vectors are, — “tet ‘The orthogonal projection of y onto span {u, u,} is given as, 5a IM, Tae “ar araasie oS -O Uyatty al 3 Jt, = | zs [| =—1(3) + 2C-1) + 6(2)=7 6 2 @ SIA PUBLISHERS AND DISTRIBUTORS PVT. LID )ht The ortho, ject zonal projection of y onto span, u,) = Wis the closest point in Wto y. G30, Let W be the subspace ‘spanned by the u's and write vector orthogonal to W. ¥ a8 the sum of a vector in W and a lel Answer + is 4 4. Given veetors are, = 165) +3(1)-24) > 44470 {up ,} is an orthogonal set. By orthogonal decomposition theorem, y can b (ic, A). written as sum of vector in W and a vector orthogonal to 7 ~@) wok is a CRIMINAL act.Anyone found gullty is LIABLE to face LEGAL proceeding’‘Substituting the corresponding values in equation (2), LINEAR ALGean, 1h ential pret hv ents Ve pve we Substituting the corresponding vai yi Vly question (1), fae a “ 0° i ay rel kar i 1 4 5 HUTA) | A] ety 8 aj 6 A apg ya 4 4 Z 5} | a a 3 fa 3} 43 mae! AL) Al @ tye aay aayo 14 ware Be a1 1s 7 om," = 15) 4 11) 4 504) = 28 : 3 me 3} 43 | |-s 11) + 4(4) = 42 | ~~ maa] “34 ae Proof 3 pete eee 7/5) i é of yonto Wis ¥. 3 From equation (1), sya) ‘Substituting the corresponding values in above ‘equation, Q31, State and prove the best approximation Let W be a subspace of F°, y any vector in fe, and § the orthogonal projection of y onto W. Then 5 is the closest point in W to y, inthe sense that lly ~ < [y=] for all v in W distinct from 5. For any vector y in IV, the orthogonal projection Let v be the distinct vector in subspace As both the vectors j and v are in W, the vector 3 —vwill also be in W. By orthogonal decomposition theorem, y — j je is orthogonal to W such that y- j and j —v are ae E 2 orthogonal. Hence, the three vectors j~v, and y~ j 5 B form a right angled triangle as shown in figure. 3 By Pythagorous theorem, 10 lea; 19 —¥IP+ Wb SIP = ly — ve mi gee calles Since the vectors v and ¥ are distinct, & aaa ve) > §-v00 = v0 ‘Then, a Ib 3IP

y.v,=0 {vy} is an orthogonal set. From the best approximation theorem, the closest Pola toy in isthe orthogonal projection ofy onto 77 vibyerslenle The orthogonal projection ofy onto Wis given as, YM Va V5.0 % (1) 3 1 1 yy, = |e] mE i 1 4+ The closes point to yis | 4. 1. =3G3) + 11) + 5-1) + 1(1)=6 ' ScerouPhotocopying of this book js a CRIMINAL act. Anyone found guilty x LIABLE to face LEGAL proceedings Warning #LINEAR ALGERRy Consider, |-3 3 5 3 |-5|,u,=] 2]. Find the aaa |e 1 1 aN els distance from y to the plane in R? spanned: u 5-3 by u, and u,. Bi 33 Answer : 5+. Given vectors are, Ee 5 Es: 3 SN) = y=|-9|, 4,=]-S| andu,=| 2 G u : ‘Then, By the best approximation theorem, the distance eT OEZ OME} from y to subspace 7 in Ris |ly— 5 ||. weal The orthogonal projection of y onto Wis given as, ais, pe as The distance from y to the plane in R° spanney 4 ty i. 5] [3 ei! ta eo yeu, = }-9] . |-5) 2 ati “ies lea =5¢-3)-9-5) + 5(1) =35 Q34, Lety = ki uly 3) and ees s 2 ay aay 1-5] [Es 3 3 1 1 W = span {u,, u,}. =-3¢-3) —5(-5) +101) =35 {a) Let U=[u, uJ. compute U'U and uu 5] [3 {b) Compute proj,, y and (UU)y. yu,=|-9] | 2] al Answer t $ 4-3)-90) 450) 08 Given veetors are, 3] [-3 2 2 3 3 Pf a ALE la a icielsi ial =-3(-3) +2(2) + 1(1) =14 2 + _ Substituting the corresponding values in above | (Given matixis, ‘equation, Aelia 23 € 9= sc —ag * U=(u, 4) -3] [3] [33] [6 i212] =1}-5]-2] 2] =|-s]-] 4 5 1 1 1) [2 =e 2 => Ul, 5 -3+6 ie =|-s-4 313 1-2 3 212 a13uIa 3 = -|9 Meee m2 2 1 -1 3.313 3IA_ PUBLISHERS AND DISTRIBUTORS PVT. LTD.137 =, aoa Ss Faciacia == seas = See as alnalnala ——e ale aleale 3 z — qedinala E = == Seale 3 = ae wa + —— 3 so= SS Tt ——— SEBS Saar ( =e = <> Beam sleciesim Cf. 8 tee ae jel Sea lanlasla slestlezolss = a a Sean ae eS es I Faded esioels GS = = es Se megs TEESE ala one So os mer es Seance alasianio gjaniasia S elagjanla > te ote ee Se We ananassae 5 a = oe | Fe elagjactia 5 = = ; =a aleninaia alasinalm, slaslowia, Ue sss as u 8 aEB aa LINEAR ALGEap, 8-2 @+2, A ony a 5 =15 O+5@+50) 2s 4igy+5, 9+ 5+ 50) D jmelbole 4 enue ia ae 2 Proj,y = Uy = [4 bi 4.4 THE GRAM.SCHMIDT PROCESS Q35. State and prove the Gram-schmidt process. Given a basis {x,..,,...1,) for a subspace IV of R*, define y=x, Soa t0 sore vy Vb = Span (45X39 ny) for +3) forl skp Assign v,=s, then Span {v,} = Span{x,) ~ ¥%} is an orthogonal basis for WY, then v,. By orthogonal decomposition theorem, vis orthogonal to W, Since Projy,x,,, is in W,,Proj,,x,,, will also be in I, 1 PPO} %., fork

ez Ee 3 ¥30|| Ve 5 «a5 | 2/3 * Orthonormal basis for Wis |=} | T= 1 Warning. ‘of this book is 2 CRIMINAL act.Anyone found guilty is LIABLE to face LEGAL proceedings. Kerox!Photocopying130, Q37. Write tho stops involved in finding the QR factorization of a matrix. Answer + ‘The steps involved in finding the OR factorization ‘of a matrix are as follows = Step 1 Assign the columns: of the matrix as basis i-e., Ayal Sy 9%) Step? on vy) BY ‘Obtain the orthogonal basis {¥, Vy using the Gram-schmidt process Step 3 Normalize the orthogonal basis {¥, Vj) =~» 4) t0 obtain the orthonormal basis (ty yy» ty) Step 4 ‘Assign the orthonormal vectors as columns of 0 ies Opag = {yt ne ty) Step 5 Obtain the upper triangular matrix 2 by using the transformation, R,,,, = "A Q38. Find an orthogonal basis for the column 2 5 11-4 space of matrix |-1 4 -3]. Also find 1-47 gaz the QR factorization, Answer = ‘Model Paper-|, 20 Given matrix is, 1 2's H-1 1 ~4| 1 4 3 1-47 i a i 1 -1 Let the basis be x,=|-1], x, 1 1 By Gram-schmidt process, =2(1) + 11) + AC) 40) +201) = 5 2)f8 1 ft 4|Ja 4} } 1 2}l1 iif ji] |—1 yy = [-H].|-1 t}ft rj{i =1(1)- 161) -1C1) + 1) + 10) =5 Then, 5)fi 4] )1 x0, =|-3] 1 1 1 3% ¥5.¥y 24 se 4-1 44 241S$) [1] 73 So 20. 4 -4} Jal fo 3 36 7 |-3)—aale 5 o { 1 -3] 1 3 1 3 (3) +O" + G+ +6)"|_3) ALIEN) TO) seen a ~4] |-4! Jo] |gsgeo 3 =|3|-l-4]+]1|=|-34441 ° 7174) dal fa-4-4 sis Vy tay tid [ieaey ies is 3 0 a = y=|2 Zi ale A iS iy = 4-|2 = The orthogonal basis for the column space is ea 17/3] [2 7 -1}}0]] 0 i -1}] 3] 2 “ - 1}}-3]/2 1 1} {3} [| DP? Let ,, #, and u, be the orthonormal basis for the ¥y ¥, and v, respectively. Then, the matrix Q is M4 4) ~ Or OF +O) FO) + “= z v; oe F = -1 1 ae VO +E +E +O? FO? 4 1 1 1 = 1 1 1 ' aS been & 1 BLS =e eNl= ole RISES ‘i esis Tg 512i & Mh =r Tsai) vs eee oe |e Jak el ite te sin Osa ae 5 ie YS 2) 2 5 | ita i= pS seve ‘of this book is a CRIMINAL act. Anyone found guilty is LIABLE to face LEGAL proceedings) ; Xerox/Photocopying1] UNEAR ALGEBRA | 132 “Te upper triangular mateix (2) = O74 | Q39. Find the loast squares solution of Ax = b for A= aE 4 Answer : [Model Papert, 020(i | (KU) Dec-18, 50] 2 0 WW. The least square solution of Ax = b satisfies the normal equations Given matrices are, 4 0) A=[0 2) ando= 11 x Adz = AT Ww ‘Ax = AT where, x i] ~() Consider, 4 0) 7. [401 A safe fee aera O+04+1 O+4+1 “ry Ce SIA LISHERS AND DISTRIBUTORS PVT. LTI; Se boil] iy =[Sto+n +0411 19) 1 Substituting the comesponding " II - “f fay = ig -1 1765)-10) [-1 17 nl seat ol thy) ‘The genecal least square solution for Ax ~ 6 is given as, = (FAS Lb “aL ht ~ tla] -E] ave [r Z The lest sqeare stun is # ~[}] ‘values in equation (1), D Conside“= LINEAR ALGEBRA inner product. Reter ax) pono Write the properties of inner product of vectors in R. Also find the NOM Of the vector (1, -2, 2, 0), Peter a2) (OU) Same/Juty-19, 8 3. Find a unit vector in the cirection of the vector @, where'd = (— 1, 2),0mteras (RU) Dee--12, ange 6) 4. Pode siecarnnamconcty| <|imavou (0%) Jp 24, 09 3, 5. Define the unit vector. If ¥= (1, — 2, 2, 0). Find a unit vector Zin the same direction as. ¥.(Reter a5) (GU) Nov Fonc-18, cn 2 -7] 6 Compute [ju + vjj Where u= |~5], v= |_ 4] creteran (OW) Sty-21, 7 1 6 j 7. Find [dist(u, — v)J2.Reter aa) (OU) Mov JOee-19, a8, 8. Define orthogonal set (Refer 29) (0) Novibec-19, 06 9 Show that 0 =(-3,7, 4,1). 7 =(1, 8, 15,—1) are orthogonal in Ré.(Refer a10) (1) Dec.-18, a1) 10. Compute orthogonal projection of (1, ~ 1) onto the line through C4, 2) and (0, 0),(Reter an) (4) Dec18, a1 4,} is an orthogonal set of non-zero vectors in R°, then linearly Independent Peter @17) [OU Nowsbec-18, 216i | (U) June/Juty-48, 21100} 2. Verify whether the set of vectors 1 WS=(u,u, Prove that S 4] fo -5 ~2), |] and |~2} are orthogonal (Refer a1) (OU) dunetduyet9, 211 0) q [2 | 3. Determine if the set {u, v, w} is orthogonal set. 1 5) 3 Given u = fhv= FE w= | [mom (OU) July-21, ata, 1 & 4. — Define orthogonal set. If u, = | 1 then show that S= {u,, [O4GU) NoviDec.-18, 06(6) | (OU) Nov/Dec-18, Q11(oKI] i} is an orthogonal basis for IR? (Refer a20)ee i Satie, «, oie Dae oF Where EO REF) ween mrnem ene ||| ante | | Z| sree orn. me cen (OU Jaye ara 7) -:: [s] w= 2]: Find the orthogonal projection of y onto u Then write y 85 the sum of two Orthogonat vectors, one in span fu} ‘and other one orthogonal toy. ‘eter 025, New Ose 79. a918) (om least 4 0] 2 Find the Squares Soliton of Ax=btora= lo 21 5=| weet | si seca 14 14