Department of Mathematics Four Fundamental Subspaces Null Space ‘The null space of am xn matrix A, written as Nul A, is the set of all homogrneous equation Ax = 0. Theorem: ‘The null space of a m xn matrix A, is a subspace of R", Equivalent] the set of all solutions to a system Ax = 0 of m homogeneous linear equations in n unknowns is a subspace of R” Problems: | and u~ | 3 2 Determine if u belongs to the mull space of A Solution: 1 -3 vue am[I, al 5-944 ]_ fo) [-25 + 27-2] = |o 6-11 2. Find a spanning set for the null space of the matrix | 1-2 2 3 1 2-4 5 8 -4 wis in Nul A Solution: Consider Ax = 0. Reducing A to echelon form -3 6 -11 -T A=|1 -2 2 3-1], 2-4 5 8 -4 3+ Sean 3Rs + 2Ry 0 0 13 26 5 f-3 6 -11 -7 Rik aloo 1 2-2 ae [o 0 0 0 o { Bx, + Gary — 5 ++ 24 — Tas = 0 {22% Bay + tary — Tay > > 43+ Inq 2x = 0 ry = 2g + Das nm) [2x2 424-325 x 2 ts 2x4 + 205 > |xs| =22 Jo] +2 z4 4 4 0 ts a5 15 oO = nyu nyu + asw Every linear combination of u,v, w is an clement of NulA. Thus {u,v,w} is a spanning sot for NulA. ‘Third SemesterZ Department of Mathematics Column Space: ‘The Column space of an mxn matrix A, written as ColA, is the set of all linear combinations of the columns of A. IEA = (ar, a2, .., a), then ColA = span{ar, a2, .., dn} ‘Theorem: The column space of am x n matrix A is a subspace of R” Problems: ‘ba — 6 1. Find a matrix A such that W = Cold, where W = { [ria] a,beR} —Ta Solution: W can be written as 6 1) W={a]1}+6]1]:abeR 1 0 Using the vectors in the spanning set as the columns of A, we get / ‘Then W = Cold as desired. Note: The column space of an m x m matrix A is all of R” iff the equation Ax = b has a solution for each b in R” 4-21 2. Let A= -5 7 3 307 -8 6 (a) If the column space of A is a subspace of R*, what is k? (b) If the null space of A is a subspace of R*, what is k? Solution (a) m = 3, ColA is a subspace of R™, where m = 3. (b) n =4, Nulld is a subspace of R", where n = 4 204 21 3. Let A= —5 7 3), find a non-zero vector in ColA and a non-zero vector in 7 -8 6, Null A. Solution: 2 Any column of A belongs to ColA. eg, [?] © ColA, -2 3 2 4 Veo Consider Ar =Qie,, A= |-2 -3 3:0 3.7 8 6:0, 24 21 Rit Ry2Rs-3R, => A= [0 -1 5 4:0 0 2 -10 9:0 2 Ryt+2R) => A=|0 -1 5 4 0 0 0 17:0 => 2m + dry — 203 + 24 = 05-22 + 55 + 44 0,2) = 515,21 = —945 —> 215 is a free variable 1, then 2 = —9,2) = 5,24 =0. The vector x = (~9,5, 1,0) € NulA. ‘Third SemesterZ Department of Mathematics 4. With A= (a) Determine if w is in NulA, Could w be in ColA? (b) Determine if v is in CoA. Could v be in NulA? solution: : 3 Who, (2) Consider a [? i 4 a 7 wo) |) ug NulA whas 4 entries and ColA is subspace of R°, u ¢ ColA. 204 -21 3 (b) Consider [A vjie, |-2 —5 7 3 :-1 3 7 -8 6:3 2 4 -2 1:3 Rt Ry2Rs—3R, => ]O -1 5 4 22 0 2 -10 9 :~ 24 21:3 Rs+2R, => [0 -1 5 4 32 0 0 0 17:0 => Ar = vis consistent, vis in ColA. v has 3 entries and NulA is a subspace of R*, u ¢ NulA. Row Space: If Ais an m x m matrix, each row of A has n entries and this can be identified with a vector in R®, The set of all linear combinations of the row vectors is called the row space of A and is denoted by RowA. Each row has n entries, so RowA is a subspace of R”. Since the rows of A are identified with the columns of A”, we could also write CoLA” in place of RowA. Problems: 2 = 8 0 =r 13 5 1 5 Ble A=! 3 nag 7 1 1 7 -13 5-3 Solution: n= (-2,-5,8,0,17) 12 = (1,3,-5,1,5) rs =(B,11,-19,7,1) 14 = (,7,-13,5,-3) ‘The row space of A is the subspace of R* spanned by {ri,ra7,74}. That is RowA Span{ri,r2,7s, Ta} ‘Theorem: If two matrices A and B are equivalent, then their row spaces are the same. If B is in eche- lon form, then non-zero rows of B form a basis for the row space of A as well as for that of B. ‘Third SemesterDepartment of Mathematics 2. Find the basis for the row space of 2-5 8 0 -IT 13 5 1 5 A-ls nw 7 1 1 7 -18 5-3 Solution: To find the basis for the row space, reduce A to echelon form. 2-5 8 0 -IT 13 5 1 5 A-ls nw 7 1 1 7 -13 5-3 1 15 2 0-17 RoR = ly ar 1 5 13-5 1 5 Rik Jo <7} Ry—2R: 01-22 — RoR 02 1a) R- 4k; => |00 0 0 0 a Re o4 = 00 0 -4 20 13 15 RoR = B= |)! x se Rt <> B= ly 9 9 4 20 oo 0 0 0 ‘The first three rows of B form a basis for the row space of A(as well as for the row space of B) Basis for Row = {(1,3 2,-7), (0,0,0, ~4, 20)} 1,5), (0,1, 3. Find the basis for the row space of 2-3 6 2 5 Rak 3 } R-2R, => A=]? 3 Rah ° b 2 5 Ry+ Ry a-|e 1 Ry-3Ry => ° a ° 3 2-36 2 5 ROR = Geka oo000 ‘The first three rows of B form the basis for the rowspace of A RowA = {(2,-3,6,2,5), (0,0,3,-1,1), (0,0,0,1,3)} ‘Third SemesterZ Department of Mathematics Left null space ‘The left mull space of an sm x n matrix A written as Nul(47), is the set of all solutions to the homogeneous equation ATy — 0. ‘Theorem ‘The left mull space of an m x n matrix A is a subspace of R”. Equivalently, the set of all solutions to a system ATy = 0-n homogeneous linear equations in m unknowns is a subspace of R” Problems: 12 3) 1. Let A=], G) andv=|7 Determine if v belongs to the left mull space of A. Solution: ve FL] a) fl vis in NulA?. 2, Find a spanning set for the left null space of the matrix, [ ° ‘I Solution: 1 AT =| 0 wk ‘Ji)-E) => 1 = 0, jp is a free variable. Ee] [i]=» f] -- every linear combination of wis an element of NulA?. Thus {u} is a spanning set of NulAT. Problem: 1, Find the dimension and basis for the four fundamental subspaces of the matrix A = 13 32 2697 -1 -33 4 Solution: 1332 13 1332 Re = |o 0 3 3|,R,-2R, = fo oo11 at Ry 0066 0000 000 0 eno => a, try + Buy F 2xy = 0, 3x5 + 3x4 W240, = 3x +24 ; 4 are free variables. ~e +a4 —3 1 1 0 =e] g | +e [ oy 0 1 beh 3,120,0), (10,1, 1} forts basis ot NulA and dim(NulA) = 2 {(1, 2, =1), (3, 9,3)} forms a basis of ColA and dim(ColA) = 2. {(1,3, 3,2), (2,6,9,7)} forms a basis of RowA and dim(Row)A = 2. ‘Third SemesterDepartment of Mathematics 12-4 r_|3 6 -3 A= \3 9 3 27 4 12 12-1 12 fa Sk 000 03 6 01 Ri-3R, => |) 3 OI ROR (Raa poe 03 6 000 00 1 aR 000 000 00 12-1 - ay-o— JO 2) 07 fy Ay oo of |”) >] a0 o| Sth + 2a — Ys = Oya + 2ys = 0 => yy = —2ys, v1 = —2ya + Ys = dus + ys = Sus, uw Sus 5 wo} = |~2us} = ys | 2 Lys us 1 {(5, -2,1)} forms a basis of Null ‘The dimension of the column sp: Since RowA is the same as Col’ ‘The dimension of the mull space is called the nullity of A ) and dimNul(A7) = 1 e of A, is call | the dimension of the row space of A is the rank of A” the rank of A Rank-Nullity Theorem: For an m Xn matrix A, rank A+ nullity A =n Problems: 1. If Ais a 7 x 9 matrix with two dimensional null space, what is the rank of A? Solution: rank + nullity = 9 <> rank +2=9 —> rank =7. 2, Could a 6 x 9 matrix have a two-dimensional null space? Solution: rank + nullity = 9 —> rank +2=9 —> rank = 7, which contradicts that basis of ColA is a subspace of R® 2.6 x 9 matrix cannot have a two-dimensional null space Exercise: , 1 3-5 3 1. Determine if u= | 3 | isin Nuld,whereA=|6 -2 0 4 841 Answer: Yes, w is in NulA. 5 a 19 2. Determine if v= |-3} is in NulA, where A= 13 23. 2 2 8 M1 3. Find an explicit description of NulA, by listing vectors that span the mull space. : 15-4 31 oa-[prg ‘Joa 210 000 00 “Answer: (i) NulA = {equ + cua}, where uy = (7,—4,1,0), ua ~ (-6,2,0,1) (i) NulA = {cyt + cata + cam}, where ay = (-6.2,1,0,0),u2 — (8,-1,0,1,0),1, (-1,0,0,0,1) ‘Third Semester& 4, Find A such that the given set is Col, 2s-+3t rhs 2t MA=C[ GSS] mst wal}, GA bed real} Br—s-t 0 2 3 0 1 1 = 1 Answer: (i) r]4[ ts] 7] tel @ |. (ie +a iy 3 -1 -1 1 5. Find (a) & such that NulA is a subspace of R¥, (b) k such that ColA is a subspace of R* 2 -6 7-20 -1 3 -20 -8 45 260) O]-, 2) @ os 7 fi) [i lod she fl -3 9 0 -5] 3-9 7-2 Answer: (i) (a) k 2, (b) k= 4, (il) (a) k= 3, (b) k= 4, (ill) (a) b= 5, (b) & (a) k=5, (b) k -6 os -1 3 135 0 6. with) A= |p], A [ tae 3-9 non-zero vector in Cold. ‘Answer: (i) (3,1) € NulA, (2,—1,—4,3) € ColA. () e1(7, 4,1, 0) + ea(—6,2,0, 1) € NulA, c4(1,0) + 09(3,1) € ColA Tit a=] § 2 andu= Al Determine if u is in ColA. Is w in NulA? Solution: uc Cold, w€ NulA -8 -2 -9 2 Bet A=] 6 4 8 | andv=| 1 |. Determine if v isin ColA. Is v in NulA? 40 4 -2, Answer: v € Cold, v © Nuld, 9. Find a basis for the set of vectors in R° in the plane a + 2y + z= 0. Answer: Basis = {(—2,1,0),(-1,0,1)} 10. Find a basis for the set of vectors in R? on the line y = 5c. Answer: Basis = {(1, 5)} 4-2 -4 1 -5 19 Answer: (i) Basis for NulA = {(~6,~5/2,1,0), (5, ~3/2,0,1)} and basis for ColA = {(-2,2, -3), (4, -6,8)} (Gi) Basis for NulA = {(—2,1,0,0, 0), (~4,0, 7/5, 1,0)} and basis for ColA = {(1, 2,1,3), (—5, 5,0, —5), (-3, 2,5, -2)} ‘Third SemesterZ Department of Mathematics 12, Find the basis for the row space and column space of the matrix 15-23 5 _{oo 1 -10 “loo o 01 oo 0 0 0 Answer: Basis for RowA (1,5, =2, 3,5), (0,0, 1, 1,0), (0,0,0,0, 1)}, basis for ColA = {(1, 0,0,0), (—2,1,0,0), (5,0, 1,0)} 13. Determine a basis for the null space and left null space of the matrix, 2-4 1 2-2 -3 A=|-1 2 001 -1 10-4 -2 4 -2 4 Answer: Basis of NulA = {(—1,=1/2,~2,1,0,0), (0-1/2, 0,0, 1,0), (1,1,5,0,0,1)}, basis of A? = {} 14. Find the bases for the null spaces of the matrices 0 -3 2 -5 1-5 4], 6 21 8 i) Basis of NulA = {(3,5,1,0), (-2, -4,0,1 (Gi) Basis of NulA = {(5,4,1, 0,0), (-7, -6,0,3, 1)} 2-1 5 6 A -4 -4 -12 -8 2 0 6 -2 4 -3 1 7 -2 12 15. Find a bases for the four fundamental sub-spaces of A = Answer: Basis of NulA = {(3,2,1,0,0), (0,-8,0,2,1)}, Basis of RowA = {(-1,2,~1,5,6),(4,—4, ~4, 12, 8), (~3, 1,7, -2,12)}, Basis of ColA = {(—1,4,2, ~3), (2, —4,0,1), (5, ~12, -2, ~2)}, Basis of NulA’ {(-2,-1,1,0)}. ‘Transformation: Consider the matrix equation Ax = b, where A is an m xm matrix, 2 ia an mx 1 matrix and bis an m x 1 matrix, In other words is a vector in RY and b is a vector in R™ Solving the equation Ar = b amounts to finding all vectors x in R” that are transformed into the vector 6 in R” under the action of multiplication by A, ‘The correspondence from x to Ax is a function from one set of vectors to another. This concept generalizes the common notation of a function as a rule that transforms one real number into another A transformation(or function or mapping) T' from R” to R™ is a rule that assigns to cach voctor x in Ra vector T(z) in R™. The set Ris called the domain of T and R" is called the co domain of T. The notation T': R" —+ R™ indicates that the domain of T is R” and the co domain is R™. For x in RY, the veotor T(x) in R” is called the image of x. The sot of all images T(x) is called the range of T. Matrix Transformations: For each x in R", T(x) is computed as Ax, where A is an m x n matvix. It is also denoted by the matrix transformation « —y Ax, Observe that the domain of Tis R" when A has n columns and codomain of T is R"™ when each column of A has m entries. ‘The range of T is the set of all linear combinations of the columns of A, because each image T(c) is of the form Ax ‘Third Semester@ Department of Mathematics Problems: 1. Let A and define a transformation Ee] TR? 4 RY by T(x) = Az, so that T(x) = (a) Find T(u), the image of u under the transformation T. (b) Find an x in R? whose image under T is b. (c) Is there more than one x whose image under T is b? (d) Determine if c is in the range of the transformation 7. Solution: 1 -3 wr =aen [2 “| E)- (b) Ta) =b > Ar=b = 3 * | 2 which ean be written in the 5, 1-3: 3 matrix formas | 3005: 2 <1 73-5 Reducing to echelon form as below 1-3: 8 1-3: 3 TR = Jo: 7], Rat 4R, = |o a4 * O04: 0 ! > 2) Bry = 8) 1dry = 7 > xy = -1/2, 2) — 3/2. Hence (c) From (b) we can see that, the vector 2 is unique 1 (a) Let 7 wea seve [3 ee j A ttle) | 1-3: 3 i Roem = |o 4: -7|,R,-14R,-4R, = Jo 4 poses o 4 8 0 ° M0, ‘Third row shows that 0 = 140(which is invalid). Hence the system is inconsistent Hence c is not in the range of the transformation. 20 2 Let A= [i Hp define T : R? —+ R? by T(x} Ax. Find the images under T of ‘Third Semester