Show That The Set of All Solutions To The Nonhomoge-: Spanning Sets
Show That The Set of All Solutions To The Nonhomoge-: Spanning Sets
2007/2/16
page 258
i i
23. Show that the set of all solutions to the nonhomoge- and let
neous differential equation
S1 + S2 = {v ∈ V :
y + a1 y + a2 y = F (x), v = x + y for some x ∈ S1 and y ∈ S2 } .
c1 v1 + c2 v2 + · · · + ck vk , (4.4.1)
DEFINITION 4.4.1
If every vector in a vector space V can be written as a linear combination of v1 ,
v2 , . . . , vk , we say that V is spanned or generated by v1 , v2 , . . . , vk and call the
set of vectors {v1 , v2 , . . . , vk } a spanning set for V . In this case, we also say that
{v1 , v2 , . . . , vk } spans V .
This spanning idea was introduced in the preceding section within the framework
of differential equations. In addition, we are all used to representing geometric vectors
in R3 in terms of their components as (see Section 4.1)
v = ai + bj + ck,
where i, j, and k denote the unit vectors pointing along the positive x-, y-, and z-axes,
respectively, of a rectangular Cartesian coordinate system. Using the above terminology,
we say that v has been expressed as a linear combination of the vectors i, j, and k, and
that the vector space of all geometric vectors is spanned by i, j, and k.
We now consider several examples to illustrate the spanning concept in different
vector spaces.
i i
i i
i i “main”
2007/2/16
page 259
i i
Solution: We must establish that for every v = (x1 , x2 ) in R2 , there exist constants
c1 and c2 such that
v = c1 v1 + c2 v2 . (4.4.2)
y
That is, in component form,
(4/3, 4/3)
(1, 1) (x1 , x2 ) = c1 (1, 1) + c2 (2, −1).
(2, 1)
v1
v
Equating corresponding components in this equation yields the following linear system:
x
c1 + 2c2 = x1 ,
(2/3,1/3) c1 − c2 = x2 .
v2 (2,1)
In this system, we view x1 and x2 as fixed, while the variables we must solve for are c1
Figure 4.4.1: The vector and c2 . The determinant of the matrix of coefficients of this system is
v = (2, 1) expressed as a linear
combination of v1 = (1, 1) and 1 2
v2 = (2, −1). = −3.
1 −1
Since this is nonzero regardless of the values of x1 and x2 , the matrix of coefficients is
invertible, and hence for all (x1 , x2 ) ∈ R2 , the system has a (unique) solution according
to Theorem 2.6.4. Thus, Equation (4.4.2) can be satisfied for every vector v ∈ R2 , so the
given vectors do span R2 . Indeed, solving the linear system yields
c2v2 Hence,
v2
c2 (x1 , x2 ) = 13 (x1 + 2x2 )v1 + 13 (x1 − x2 )v2 .
v1
v2 c 1
v For example, if v = (2, 1), then c1 = and c2 = 13 , so that v = 43 v1 + 13 v2 . This is
v1 4
c1v1 3
x illustrated in Figure 4.4.1.
Figure 4.4.2: Any two More generally, any two nonzero and noncolinear vectors v1 and v2 in R2 span R2 ,
noncollinear vectors in R2 span since, as illustrated geometrically in Figure 4.4.2, every vector in R2 can be written as a
R2 . linear combination of v1 and v2 .
Example 4.4.3 Determine whether the vectors v1 = (1, −1, 4), v2 = (−2, 1, 3), and v3 = (4, −3, 5)
span R3 .
Solution: Let v = (x1 , x2 , x3 ) be an arbitrary vector in R3 . We must determine
whether there are real numbers c1 , c2 , c3 such that
v = c1 v1 + c2 v2 + c3 v3 (4.4.3)
c1 − 2c2 + 4c3 = x1 ,
−c1 + c2 − 3c3 = x2 ,
4c1 + 3c2 + 5c3 = x3 .
i i
i i
i i “main”
2007/2/16
page 260
i i
z
v c1v1 c2v2 c3v3
v1
c3v3
c1v1
v3 c2v2 v2
y
Notice in the previous example that the linear combination (4.4.3) can be written as
the matrix equation
Ac = v,
where the columns of A are the given vectors v1 , v2 , and v3 : A = [v1 , v2 , v3 ]. Thus,
the question of whether or not the vectors v1 , v2 , and v3 span R3 can be formulated as
follows: Does the system Ac = v have a solution c for every v in R3 ? If so, then the
column vectors of A span R3 , and if not, then the column vectors of A do not span R3 .
This reformulation applies more generally to vectors in Rn , and we state it here for the
record.
Theorem 4.4.4 Let v1 , v2 , . . . , vk be vectors in Rn . Then {v1 , v2 , . . . , vk } spans Rn if and only if, for
the matrix A = [v1 , v2 , . . . , vk ], the linear system Ac = v is consistent for every v in
Rn .
i i
i i
i i “main”
2007/2/16
page 261
i i
Example 4.4.6 Determine a spanning set for P2 , the vector space of all polynomials of degree 2 or less.
Solution: The general polynomial in P2 is
p(x) = a0 + a1 x + a2 x 2 .
If we let
p0 (x) = 1, p1 (x) = x, p2 (x) = x 2 ,
then
p(x) = a0 p0 (x) + a1 p1 (x) + a2 p2 (x).
Thus, every vector in P2 is a linear combination of 1, x, and x 2 , and so a spanning set
for P2 is {1, x, x 2 }. For practice, the reader might show that {x 2 , x + x 2 , 1 + x + x 2 } is
another spanning set for P2 , by making the appropriate modifications to the calculations
in this example.
i i
i i
i i “main”
2007/2/16
page 262
i i
span{v1 , v2 , . . . , vk } = {v ∈ V : v = c1 v1 + c2 v2 + · · · + ck vk , c1 , c2 , . . . , ck ∈ F }.
(4.4.5)
For example, suppose V = C 2 (I ), and let y1 (x) = sin x and y2 (x) = cos x. Then
u = a1 v1 + a2 v2 + · · · + ak vk and v = b1 v1 + b2 v2 + · · · + bk vk ,
u + v = (a1 v1 + a2 v2 + · · · + ak vk ) + (b1 v1 + b2 v2 + · · · + bk vk )
= (a1 + b1 )v1 + (a2 + b2 )v2 + · · · + (ak + bk )vk
= c1 v1 + c2 v2 + · · · + ck vk ,
ru = r(a1 v1 + a2 v2 + · · · + ak vk )
= (ra1 )v1 + (ra2 )v2 + · · · + (rak )vk
= d1 v1 + d2 v2 + · · · + dk vk ,
Remarks
i i
i i
i i “main”
2007/2/16
page 263
i i
y
(—c1, c1)
c1v1
The subspace of ⺢2 spanned
by the vector v1 (1, 1)
(1, 1)
v1
x
Example 4.4.9 If V = R3 , v1 = (1, 0, 1), and v2 = (0, 1, 1), determine the subspace of R3 spanned by
v1 and v2 . Does w = (1, 1, −1) lie in this subspace?
Solution: We have
span{v1 , v2 } = {v ∈ R3 : v = c1 v1 + c2 v2 , c1 , c2 ∈ R}
= {v ∈ R3 : v = c1 (1, 0, 1) + c2 (0, 1, 1), c1 , c2 ∈ R}
= {v ∈ R3 : v = (c1 , c2 , c1 + c2 ), c1 , c2 ∈ R}.
Since the vector w = (1, 1, −1) is not of the form (c1 , c2 , c1 + c2 ), it does not lie in
span{v1 , v2 }. Geometrically, span{v1 , v2 } is the plane through the origin determined by
the two given vectors v1 and v2 . It has parametric equations x = c1 , y = c2 , z = c1 + c2 ,
which implies that its Cartesian equation is z = x + y. Thus, the fact that w is not
in span{v1 , v2 } means that w does not lie in this plane. The subspace is depicted in
Figure 4.4.5.
z
The subspace of ⺢3 spanned
by v1 (1, 0, 1), v2 (0, 1, 1)
v2
v1
Figure 4.4.5: The subspace of R3 spanned by v1 = (1, 0, 1) and v2 = (0, 1, 1) is the plane
with Cartesian equation z = x + y.
i i
i i
i i “main”
2007/2/16
page 264
i i
span{A1 , A2 , A3 } = {A ∈ M2 (R) : A = c1 A1 + c2 A2 + c3 A3 , c1 , c2 , c3 ∈ R}
1 0 0 1 0 0
= A ∈ M2 (R) : A = c1 + c2 + c3
0 0 1 0 0 1
c1 c2
= A ∈ M2 (R) : A = , c1 , c2 , c3 ∈ R .
c2 c3
Next, we will show that {p1 , p2 } is not a spanning set for P2 . To establish this, we need
give only one example of a polynomial in P2 that is not in span{p1 , p2 }. There are many
such choices here, but suppose we consider p(x) = 1 + x. If this polynomial were in
span{p1 , p2 }, then we would have to be able to find values of c1 and c2 such that
1 + x = c1 + (3c1 + c2 )x + c2 x 2 . (4.4.6)
Since there is no x 2 term on the left-hand side of this expression, we must set c2 = 0.
But then (4.4.6) would reduce to
1 + x = c1 (1 + 3x).
Equating the constant terms on each side of this forces c1 = 1, but then the coefficients of
x do not match. Hence, such an equality is impossible. Consequently, there are no values
of c1 and c2 such that the Equation (4.4.6) holds, and therefore, span{p1 , p2 } = P2 .
Remark In the previous example, the reader may well wonder why we knew from
the beginning to select p(x) = 1 + x as a vector that would be outside of span{p1 , p2 }.
In truth, we only need to find a polynomial that does not have the form p(x) = c1 +
(3c1 + c2 )x + c2 x 2 and in fact, “most” of the polynomials in P2 would have achieved
the desired result here.
i i
i i
i i “main”
2007/2/16
page 265
i i
• Be able to determine whether a given set of vectors 10. A spanning set for the vector space P2 must contain a
S spans a vector space V , and be able to prove your polynomial of each degree 0, 1, and 2.
answer mathematically.
11. If m < n, then any spanning set for Rn must contain
• Be able to determine the linear span of a set of vec- more vectors than any spanning set for Rm .
tors. For vectors in Rn , be able to give a geometric
description of the linear span. 12. The vector space P of all polynomials with real coef-
ficients cannot be spanned by a finite set S.
• If S is a spanning set for a vector space V , be able to
write any vector in V as a linear combination of the Problems
elements of S.
For Problems 1–3, determine whether the given set of vectors
• Be able to construct a spanning set for a vector space spans R2 .
V . As a special case, be able to determine a spanning
set for the null space of an m × n matrix. 1. {(1, −1), (2, −2), (2, 3)}.
3. If S is a spanning set for a vector space V and W is a {(1, 2, 3), (3, 4, 5), (4, 5, 6)}
subspace of V , then S is a spanning set for W .
does not span R3 , but that it does span the subspace
4. If S is a spanning set for a vector space V , then every
of R3 consisting of all vectors lying in the plane with
vector v in V must be uniquely expressible as a linear
equation x − 2y + z = 0.
combination of the vectors in S.
8. Show that v1 = (2, −1), v2 = (3, 2) span R2 , and ex-
5. A set S of vectors in a vector space V spans V if and
press the vector v = (5, −7) as a linear combination
only if the linear span of S is V .
of v1 , v2 .
6. The linear span of two vectors in R3 is a plane through
the origin. 9. Show that v1 = (−1, 3, 2), v2 = (1, −2, 1), v3 =
(2, 1, 1) span R3 , and express v = (x, y, z) as a linear
7. Every vector space V has a finite spanning set. combination of v1 , v2 , v3 .
i i
i i
i i “main”
2007/2/16
page 266
i i
10. Show that v1 = (1, 1), v2 = (−1, 2), v3 = (1, 4) span For Problems 22–24, determine whether the given vector v
R2 . Do v1 , v2 alone span R2 also? lies in span{v1 , v2 }.
11. Let S be the subspace of R3 consisting of all vectors 22. v = (3, 3, 4), v1 = (1, −1, 2), v2 = (2, 1, 3) in R3 .
of the form v = (c1 , c2 , c2 − 2c1 ). Show that S is
spanned by v1 = (1, 0, −2), v2 = (0, 1, 1). 23. v = (5, 3, −6), v1 = (−1, 1, 2), v2 = (3, 1, −4) in
R3 .
12. Let S be the subspace of R4 consisting of all vectors
of the form v = (c1 , c2 , c2 − c1 , c1 − 2c2 ). Determine 24. v = (1, 1, −2), v1 = (3, 1, 2), v2 = (−2, −1, 1) in
a set of vectors that spans S. R3 .
13. Let S be the subspace of R3 consisting of all solutions
to the linear system 25. If p1 (x) = x − 4 and p2 (x) = x 2 − x + 3, determine
whether p(x) = 2x 2 − x + 2 lies in span{p1 , p2 }.
x − 2y − z = 0.
26. Consider the vectors
Determine a set of vectors that spans S.
1 −1 0 1 30
For Problems 14–15, determine a spanning set for the null A1 = , A2 = , A3 =
2 0 −2 1 1 2
space of the given matrix A.
in M2 (R). Determine span{A1 , A2 , A3 }.
1 2 3
14. A = 3 4 5 .
27. Consider the vectors
5 6 7
12 −2 1
1 2 3 5 A1 = , A2 =
−1 3 1 −1
15. A = 1 3 4 2 .
2 4 6 −1
in M2 (R). Find span{A1 , A2 }, and determine whether
16. Let S be the subspace of M2 (R) consisting of all sym- or not
metric 2 × 2 matrices with real elements. Show that S B=
3 1
is spanned by the matrices −2 4
1 0 0 0 0 1 lies in this subspace.
A1 = , A2 = , A3 = .
0 0 0 1 1 0
28. Let V = C ∞ (I ) and let S be the subspace of V
17. Let S be the subspace of M2 (R) consisting of all skew- spanned by the functions
symmetric 2 × 2 matrices with real elements. Deter-
mine a matrix that spans S. f (x) = cosh x, g(x) = sinh x.
18. Let S be the subset of M2 (R) consisting of all upper (a) Give an expression for a general vector in S.
triangular 2 × 2 matrices.
(b) Show that S is also spanned by the functions
(a) Verify that S is a subspace of M2 (R).
(b) Determine a set of 2 × 2 matrices that spans S. h(x) = ex , j (x) = e−x .
For Problems 19–20, determine span{v1 , v2 } for the given For Problems 29–32, give a geometric description of the sub-
vectors in R3 , and describe it geometrically. space of R3 spanned by the given set of vectors.
19. v1 = (1, −1, 2), v2 = (2, −1, 3).
29. {0}.
20. v1 = (1, 2, −1), v2 = (−2, −4, 2).
30. {v1 }, where v1 is any nonzero vector in R3 .
21. Let S be the subspace of R3
spanned by the vectors
v1 = (1, 1, −1), v2 = (2, 1, 3), v3 = (−2, −2, 2). 31. {v1 , v2 }, where v1 , v2 are nonzero and noncollinear
Show that S also is spanned by v1 and v2 only. vectors in R3 .
i i
i i
i i “main”
2007/2/16
page 267
i i
33. Prove that if S and S are subsets of a vector space V span{v1 , v2 , v3 } = span{v1 , v2 }
such that S is a subset of S , then span(S) is a subset
of span(S ). if and only if v3 can be written as a linear combination
of v1 and v2 .
Example 4.5.1 Observe that {(1, 0), (0, 1)}, {(1, 0), (1, 1)}, and {(1, 0), (0, 1), (1, 2)} are all spanning
sets for R2 .
As another illustration, two different spanning sets for V = M2 (R) were given in Exam-
ple 4.4.5 and the remark that followed. Given the abundance of spanning sets available
for a given vector space V , we are faced with a natural question: Is there a “best class
of” spanning sets to use? The answer, to a large degree, is “yes”. For instance, in Exam-
ple 4.5.1, the spanning set {(1, 0), (0, 1), (1, 2)} contains an “extra” vector, (1, 2), which
seems to be unnecessary for spanning R2 , since {(1, 0), (0, 1)} is already a spanning set.
In some sense, {(1, 0), (0, 1)} is a more efficient spanning set. It is what we call a mini-
mal spanning set, since it contains the minimum number of vectors needed to span the
vector space.3
But how will we know if we have found a minimal spanning set (assuming one
exists)? Returning to the example above, we have seen that
span{(1, 0), (0, 1)} = span{(1, 0), (0, 1), (1, 2)} = R2 .
Observe that the vector (1, 2) is already a linear combination of (1, 0) and (0, 1), and
therefore it does not add any new vectors to the linear span of {(1, 0), (0, 1)}.
As a second example, consider the vectors v1 = (1, 1, 1), v2 = (3, −2, 1), and
v3 = 4v1 + v2 = (7, 2, 5). It is easily verified that det([v1 , v2 , v3 ]) = 0. Consequently,
the three vectors lie in a plane (see Figure 4.5.1) and therefore, since they are not collinear,
the linear span of these three vectors is the whole of this plane. Furthermore, the same
plane is generated if we consider the linear span of v1 and v2 alone. As in the previous
example, the reason that v3 does not add any new vectors to the linear span of {v1 , v2 }
is that it is already a linear combination of v1 and v2 . It is not possible, however, to
generate all vectors in the plane by taking linear combinations of just one vector, as we
could generate only a line lying in the plane in that case. Consequently, {v1 , v2 } is a
minimal spanning set for the subspace of R3 consisting of all points lying on the plane.
As a final example, recall from Example 1.2.16 that the solution space to the differ-
ential equation
y + y = 0
3 Since a single (nonzero) vector in R2 spans only the line through the origin along which it points, it cannot
span all of R2 ; hence, the minimum number of vectors required to span R2 is 2.
i i
i i