Exercise Part 1

From numbers to vectors

Prof.Dr. Filippo Riccio

Department of Computer Science and Mathematics
OTH Regensburg
Version 1.3

1 Vectors and linear combinations

Exercise 1.
   
c a
Under what conditions on a, b, c, d is a multiple m of ? Assume no zeros
d b
in these numbers.

Exercise 2.
Describe geometrically all linear combinations of
             
1 3 1 0 2 0 2
(a) 2 and 6 , (b) 0 and 2 , (c) 0 and 2 and 2
3 9 0 3 0 2 3

Tutorial 3.
   
4 −2
Draw v = and w = and v + w and v − w in an xy-plane.
1 2

Tutorial 4.
   
5 1
If v + w = and v − w = , compute and draw the vectors v and w.
1 5

Tutorial 5.
   
2 1
From v = and w = , find the components of 3v + w and cv + dw.
1 2

Exercise 6.
Given u, v, w as follows
     
1 −3 2
u = 2 v= 1  w = −3 .
3 −2 −1

1
Compute u + v + w and 2u + 2v + w. How do you know u, v, w lie in a plane?

Exercise 7.
How could you decide if the vectors u = (1, 1, 0)T and v = (0, 1, 1)T and w =
(a, b, c)T are linearly independent or dependent ?

Exercise 8.
Draw vectors u, v, w so that their combinations cu + dv + ew fill only a line.
Find vectors u, v, w in 3D so that their combinations cu + dv + ew fill only a
plane.

Tutorial 9.
     
1 3 14
What combination c +d produces ?
2 1 8

2 Lengths and angles from dot products

Tutorial 10.
For the vectors v = (3, 4)T and w = (4, 3)T test the Schwarz inequality on v · w
and the triangle inequality on ∥v + w∥. Find cos θ for the angle between v and
w.

Exercise 11.
Which v and w give equality |v · w| = ∥v∥∥w∥ and ∥v + w∥ = ∥v∥ + ∥w∥?

Exercise 12.
Find a unit vector u in the direction of v = (3, 4)T . Find a unit vector w that
is perpendicular to u. Note that there are two possibilities for w.

Tutorial 13.
Calculate the dot products u · v and u · w and u · (v + w) and w · v, where
     
−0.6 4 1
u= v= w= .
0.8 3 2

Tutorial 14.
Using the vectors in exercise 13 compute the lengths ∥u∥ and ∥v∥ and ∥w∥ of
those vectors. Check the Schwarz inequalites |u · v| ≤ ∥u∥∥v∥ and |v · w| ≤
∥v∥∥w∥.

Exercise 15.
Find unit vectors in the direction of v and w from exercise 13, and find the
cosine of their angle θ. Choose vectors a, b, c that make 0°, 90° and 180° angles
with w.

2
Exercise 16.
Find unit vectors u1 and u2 in the directions of v = (1, 3)T and w = (2, 1)T .
Fidn unit vector u′1 and u′2 that are perpendicular to u1 and u2 .

Tutorial 17.
Find the angle θ between these pairs of vectors
   
1 1
(a) v = √ and w =
3 0
   
√1 −1
(b) v = and w = √
3 3
   
2 2
(c) v =  2  and w = −1
−1 2
   
3 −1
(d) v = and w =
1 −2

Exercise 18.
1. Describe every vector w = (w1 , w2 ) that is perpendicular to v = (2, 1).
2. All vectors perpendicular to v = (1, 1, 1)T lie on a ................. in 3 dimen-
sions.

3. The vectors perpendicular to both (1, 1, 1)T and (1, 2, 3)T lie on a .................

Exercise 19.
With v = (1, 1)T and w = (1, 5)T choose a number so that w − cv is per-
pendicular to v. Then find the formula for c starting from any nonzero v and
w.

3 Matrices
Tutorial 20.
Multiply A times v using dot products
    
1 0 0 1   4
(a) 1 1 0 2 (b) 1 2 3 5
1 1 1 1 6

3
Tutorial 21.
Multiply A time v by using dot product (row picture) and linear combination
(column picture)
        
1 0 0 1 2 0 0 1 1 2 5 1
(a) 0 1 0 4 (b) 0 4 0 4 (c) 0 1 −1 4
0 0 1 3 0 0 5 3 0 0 1 3
  
2 1 −4 1
(d)  1 1 3  4
−4 3 1 3

Exercise 22.
Describe the column space of these matrices: a point, a line, a plane, all of 3D.
       
2 2 1 0 0 1 5 0 0
A1 = 1 1 A2 = 1 1 0 A3 = 2 10 A4 = 0 0
5 6 1 1 1 1 5 0 0

Exercise 23.
Find a combination of the columns that produces (0, 0, 0)T : column space =
plane. The trivial combination (zero times every column) is not allowed. Which
columns are dependent on earlier columns?
   
1 2 3 1 4 7
A1 = 4 5 6 A2 = 2 5 8
7 8 9 3 6 9

Exercise 24.
Describe the column spaces in R3 of B and C
 
1 2  
B = 2 1 C = B −B
3 3

Tutorial 25.
Multiply Ax and By using dot products
     
2 1 2 1 1 0 0 4
Ax = 4 2 4 2 By = 1 1 0  4 
0 1 0 5 1 1 1 10

4
Tutorial 26.
Multiply the same Ax and By as in the exercise 25 using combinations of the
columns.

Tutorial 27.
In Exercise 25, how many independent columns does A have? How many inde-
pendent columns in B? How many independent columns in A + B?

Exercise 28.
Describe the column spaces in R3 of A and B and C
     
1 0 0 2 4 1 0 1 2
A = 0 1 0 B = 1 2 C = 0 2 2 4
0 0 1 2 4 0 2 2 4

Exercise 29.
Complete A and B so that they are rank one matrices. What are the column
spaces of A and B? What are the row spaces of A and B?
   
3 1 2 −5
A= B=
5 15 4

Tutorial 30.
Which numbers q would leave A with two independent columns?
     
1 0 2 1 4 7 1 1 2
A = 3 1 9 A = 2 5 8 A = 2 2 4
5 0 q 3 6 q 0 0 q

Exercise 31.
Suppose Ax = b. If you add b as an extra column of A, explain why the rank
r (number of independent columns) stays the same.

Tutorial 32.
The three rows of this square matrix A are dependent. Check for it! Then the
linear algebra says that the three columns must also be dependent. Find x ̸= 0
that solves Ax = 0  
1 2 3
A = 3 5 6
4 7 9

5
Exercise 33.
Which numbers c give dependent columns?
     
1 1 0 1 0 c c c c  
3 2 c 1
1 1 1 0 2 1 5
4 c
7 4 c 0 1 1 3 3 6

Exercise 34.
Multiply AB using dot products
      
1 0 0 1 0 0   4 4  
1 1 0 −1 1 0 1 2 3 5 5 1 2 3
1 1 1 1 −1 1 6 6

Tutorial 35.
Test the truth of the associative law (AB)C = A(BC)
     
  1   1 2 1 3 1 4
1 1 1 1 1
1 0 1 0 1 0 1

Exercise 36.
Going from left to right, put each column of A into the matrix C if that column
is not a combination of earlier columns
   
2 −2 1 6 0 2
A = 1 −1 0 2 0 C = 1 
3 −3 0 6 1 3

Exercise 37.
Find R in Exercise 36 so that A = CR. If your C has r columns, then R has
r rows. The 5 columns of R tell how to produces the 5 columns of A from the
columns in C.

Exercise 38.
Factor these matrices into A = CR.
   
1 2 3 0 1 2 3
A1 = A2 =
1 3 4 0 1 3 5
   
2 1 3 1 0 0 4
A3 = A4 =
6 3 9 0 2 2 0

6
Tutorial 39.
Complete these 2×2 matrices to meet the requiriments printed on the parentesis
 
3 6
(rank one)
5
 
6 7
(orthogonal columns)
7
 
2
(rank 2)
3 6
 
3 4
(A2 = I)
−3

Exercise 40.
Create your own example of a 4 × 4 matrix A of rank r = 2. Then factor A into
CR, where C ∈ R4×2 and R ∈ R2×4

Exercise 41.
Test the column-row matrix multiplication to find AB and BA
   
  1 1 1 1 1 1  
1 0 0  1 0 0
0 1 1  0 1 1
AB = 1 1 0  0 0 1 BA = 0
   1 1 0
0 1
1 1 1 1 1 1
0 0 1 0 0 1

4 Solving linear equations

Tutorial 42.
What multiple ℓ21 of equation 1 should be subtracted from equation 2?
2x + 3y = 11
10x + 9y = 11
After elimination, write down the upper triangular system and circle the two
pivots. Use back substitution to find x and y.

Tutorial 43.
What multiple of equation 1 should be subtracted from equation 2?
2x − 4y = 6
− x + 5y = 0
After this elimination step, solve the triangular system. If the right side changes
to (−6, 0)T , what is the new solution?

7
Exercise 44.
What multiple ℓ of equation 1 should be subtracted from equation 2 to remove
c?

ax + by = f
cx + dy = g

The first pivot is a (assumed nonzero). Elimination produces what formula for
the second pivot? What is y? The second pivot is missing when ad = bc.

Exercise 45.
Choose a right side which gives no solution and another right side which gives
infinitely many solutions. What are two of those solutions?

3x + 2y = 10
6x + 4y = .....

Tutorial 46.
Choose a coefficient b that makes this system singular (zero second pivot). Then
choose a right side g that makes it solvable. Find two solutions in that singular
but solvable case.

2x + by = 16
4x + 8y = g

Tutorial 47.
For which numbers a does elimination break down (1) permanently (2) tem-
porarily? Solve for x and y after fixing the temporary breakdown by a row
exchange.

ax + 3y = −3
4x + 6y = 6

Exercise 48.
For which three numbers k does elimination break down? Which is fixed by a
row exchange? Is the number of solutions 0 or 1 or ∞? Draw the 3 row pictures.

kx + 3y = 6
3x + ky = −6

8
Exercise 49.
What test on b1 and b2 decides whether these two equations allow a solution?
How many solutions will they have? Draw the column pictures for b = (1, 2)T
and (1, 0)T .
3x − 2y = b1
6x − 4y = b2

Tutorial 50.
Reduce to upper triangular form by row operations. Then find x, y, z.
2x + 3y + z = 8 2x − 3y = 3
4x + 7y + 5z = 20 4x − 5y + z = 7
− 2y + 2z = 0 2x − y − 3z = 5

Exercise 51.
Which number d forces a row exchange, and what is the triangular system (non
singular) for that d? Which d makes this system singular (no third pivot)?
2x + 5y + z = 0
4x + dy + z = 2
y−z =3

Tutorial 52.
Which number b leads to a row exchange? Which b leads to a missing pivot?
In that singular case find a nonzero solution x, y, z.
x + by = 0
x − 2y − z = 0
y+z =0

Exercise 53.
For which two numbers a will elimination fail on
 
a 2
A= ?
a a

Exercise 54.
For which three numbers a will elimination fail to give three pivots?
 
a 2 3
A = a a 4
a a a

9
Tutorial 55.
Write down the 3 × 3 matrices that produce these elimination steps:
1. E21 subtract 5 times row 1 from row 2
2. E32 subtract -7 times row 2 from row 3
3. P exchange rows 1 and 2, then rows 2 and 3

Exercise 56.
Which three matrices E21 , E31 , E32 put A into triangular form U ?
 
1 1 0
A =  4 6 1
−2 2 0

and E32 E31 E21 A = EA = U . Multiply those E’s to get one elimination matrix
E. What is E −1 = L

Exercise 57.
Include b = (1, 0, 0)T as a fourth column in Exercise 56 to produce [A b].
Carry out the elimination steps on this augmented matrix to solve Ax = b.

Tutorial 58.
For these permutation matrices find P −1 by trial and error (with 1’s and 0’s):
   
0 0 1 0 1 0
P = 0 1 0 and P = 0 0 1
1 0 0 1 0 0

Exercise 59.
Solve for the first column (x, y)T and second column (t, z)T of A−1 . Check
AA−1 .
           
10 20 10 20 x 1 10 20 t 0
A= = and =
20 50 20 50 y 0 20 50 z 1

Exercise 60.
Find an upper triangular U (not diagonal) with U 2 = I. Then U −1 U = 1.

Exercise 61.
If A has row 1 + row 2 = row 3, show that A is not invertible:
1. Explain why Ax = (0, 0, 1)T cannot have a solution.
2. Which right sides (b1 , b2 , b3 )T might allow a solution to Ax = b?
3. In the elimination process, what happens to equation 3?

10
Exercise 62.
If A has column 1 + column 2 = column 3, show that A is not invertible:
1. Find a nonzero solution x to Ax = 0. The matrix is 3 by 3.
2. Elimination keeps columns 1 + 2 = 3. Explain why there is no third pivot.

5 Factorization A = LU
Tutorial 63.
Use the Gauss-Jordan elimination method to find the inverse matrix of
   
1 3 1 4
A1 = A2 =
2 7 3 9

Exercise 64.
Apply the Gauss-Jordan elimination method to find the inverse matrix of
 
1 a b
U = 0 1 c 
0 0 1

Tutorial 65.
What matrix E puts A into triangular form EA = U ? Multiply by factor A
into LU :  
2 1 0
A = 0 4 2
6 3 5

Tutorial 66.
What two elimination matrices E21 and E32 put A into upper triangular form
−1 −1 −1 −1
E32 E21 A = U ? Multiply by E32 and E21 to factor A into LU = E21 E32 U :
 
1 1 1
A = 2 4 5
0 4 0

Exercise 67.
What three elimination matrices E21 , E31 , E32 put A into its upper triangular
−1 −1 −1
form E32 E31 E21 A = U ? Multiply by E32 , E31 and E21 to factor A into L
times U :  
1 0 1
A = 2 2 2
3 4 5

11
Exercise 68.
A and B are symmetric across the diagonal. Find their triple factorizations
LDU and say how U is related to L for these symmetric matrices
 
  1 4 0
2 4
A= B = 4 12 4
4 11
0 4 0

Tutorial 69.
Solve the triangular system Lc = b to find c. Then solve U x = c to find x:
     
1 0 2 4 2
L= U= b=
4 1 0 1 11

For safety multiply LU and solve Ax = b as usual. Circle c when you see it.

Exercise 70.
Solve the triangular system Lc = b to find c. What was A?
     
1 0 0 1 1 1 4
L = 1 1 0 U = 0 1 1 b = 5
1 1 1 0 0 1 6

Tutorial 71.
Find AT , A−1 , (A−1 )T and (AT )−1 for the following matrices
   
1 0 1 c
9 3 c 0

Tutorial 72.
Verify that (AB)T equals B T AT but those are different from AT B T :
     
1 0 1 3 1 3
A= B= AB =
2 1 0 1 2 7

Show also that AAT is different from AT A. But both of those matrices are?

Exercise 73.
Compute the number
 
  0
 1 2 3  
xT Ay = 0

1 1
4 5 6
0

12
Exercise 74.
Which permutation makes P A upper triangular? Which permutations make
P1 AP2 lower triangular?  
0 0 6
A = 1 2 3
0 4 5

Exercise 75.
Factor these symmetric matrices into S = LDLT
 
    2 −1 0
1 3 1 b
S= S= S = −1 2 −1
3 2 b c
0 −1 2

Exercise 76.
Find the P A = LU factorizations (and check them) for
   
0 1 1 1 2 0
A = 1 0 1 A = 2 4 1
2 3 4 1 1 1

13