Elementary Linear Algebra

Howard Anton ＆ Chris Rorres

Chapter Contents
 1.1 Introduction to System of Linear
Equations
 1.2 Gaussian Elimination
 1.3 Matrices and Matrix Operations
 1.4 Inverses; Rules of Matrix Arithmetic
 1.5 Elementary Matrices and a Method for
Finding A1
 1.6 Further Results on Systems of Equations
and Invertibility
 1.7 Diagonal, Triangular, and Symmetric
Matrices
1.1 Introduction to
Systems of Equations
Linear Equations
 Any straight line in xy-plane can be
represented algebraically by an equation of
the form:
a1 x  a2 y  b
 General form: define a linear equation in the n
variables x1 , x2 ,..., xn :
a1x1  a2 x2  ...  an xn  b
 Where a1 , a2 ,..., an , and b are real constants.
 The variables in a linear equation are sometimes
called unknowns.
Example 1
Linear Equations
1
 The equations x  3 y  7, y  x  3z  1, and
x1  2 x2  3x3  x4  7 are linear. 2
 Observe that a linear equation does not involve any
products or roots of variables. All variables occur only to
the first power and do not appear as arguments for
trigonometric, logarithmic, or exponential functions.
 The equations x  3 y  5, 3x  2 y  z  xz  4, and y  sin x
are not linear.
 A solution of a linear equation is a sequence of n numbers
s1 , s2 ,..., sn such that the equation is satisfied. The set of
all solutions of the equation is called its solution set or
general solution of the equation
 Example 2
Finding a Solution Set (1/2)
 Find the solution of (a ) 4 x  2 y  1

 Solution(a)
we can assign an arbitrary value to x and solve for y ,
or choose an arbitrary value for y and solve for x .If
we follow the first approach and assign x an arbitrary
value ,we obtain x  t , y  2t  1 or x 
1
t 
1
, y  t2
1 1 2
2 2 4
 arbitrary numbers t1, t 2 are called parameter.
 for example 11 11
t1  3 yields the solution x  3, y  as t 2 
2 2
Example 2
Finding a Solution Set (2/2)
 Find the solution of (b) x1  4 x2  7 x3  5.

 Solution(b)
we can assign arbitrary values to any two
variables and solve for the third variable.
 for example

x1  5  4s  7t , x2  s, x3  t
 where s, t are arbitrary values
 Linear Systems (1/2)
 A finite set of linear equations in
the variables x1 , x2 ,..., xn a11x1  a12 x2  ...  a1n xn  b1
is called a system of linear
equations or a linear system . a21x1  a22 x2  ...  a2 n xn  b2
   
 A sequence of numbers am1 x1  am 2 x2  ...  amn xn  bm
s1 , s2 ,..., sn is called a solution
of the system.
An arbitrary system of m
linear equations in n unknowns
 A system has no solution is said
to be inconsistent ; if there is at
least one solution of the system,
it is called consistent.
 Linear Systems (2/2)
 Every system of linear equations has either
no solutions, exactly one solution, or
infinitely many solutions.

 A general system of two linear equations:

(Figure1.1.1) a1 x  b1 y  c1 (a1 , b1 not both zero)
a2 x  b2 y  c2 (a2 , b2 not both zero)
 Two lines may be parallel -> no solution
 Two lines may intersect at only one point
-> one solution
 Two lines may coincide
-> infinitely many solution
 Augmented Matrices
 The location of the +’s, a11x1  a12 x2  ...  a1n xn  b1
the x’s, and the =‘s can a21x1  a22 x2  ...  a2 n xn  b2
be abbreviated by writing
   
only the rectangular array
of numbers. am1 x1  am 2 x2  ...  amn xn  bm
 This is called the
augmented matrix for the 1th column
system.
a11 a12 ... a1n b1  1th row
 Note: must be written in a a ... a 
 21 22 b2 
the same order in each 2n

equation as the unknowns      

and the constants must be  
 m1 m 2
a a ... a mn b m
on the right.
Elementary Row Operations
 The basic method for solving a system of linear equations is to
replace the given system by a new system that has the
same solution set but which is easier to solve.

 Since the rows of an augmented matrix correspond to the

equations in the associated system. new systems is generally
obtained in a series of steps by applying the following three
types of operations to eliminate unknowns systematically. These
are called elementary row operations.
1. Multiply an equation through by an nonzero constant.
2. Interchange two equation.
3. Add a multiple of one equation to another.
 Example 3
Using Elementary row Operations(1/4)

x  y  2z  9 add - 2 times x  y  2z  9 add -3 times

the first equation the first equation
2 x  4 y  3z  1 2 y  7 z  1 7
3x  6 y  5 z  0

to the second
3x  6 y  5 z  0

to the third

é 1 1 2 9 ù add - 2 times 1 1 2 9  add -3 times

ê ú the first row 0 2  7  17 the first row
ê 2 4 -3 1 úto
the second
  
êë 3 6 -5 0 úû 3 6  5 0  
to the third
 Example 3
Using Elementary row Operations(2/4)

x  y  2z  9 multiply the second x  y  2z  9 add -3 times

1 the second equation
2 y  7 z  17 y  72 z   172
equation by

3 y  11z  27
2
    to the third
3 y  11z  0

1 1 2 9  multily the second 1 1 2 9  add -3 times

0 2  7  17  row by
1 0 1  7  17  the second row
   2    
0 3  11  27  
2 2 to the third
0 3  11  27
 Example 3
Using Elementary row Operations(3/4)

x  y  2z  9 Multiply the third x  y  2z  9 Add -1 times the

second equation
y  72 z   172 
   
equation by -2

7 17
y 2 z 2
to the first
z 3
 12 z   32

1 1 2 9  Multily the third 1 1 2 9  Add -1 times the

0 1  7  172  0 1  7
 
row by - 2
  172  second row
3   
2 2 to the first
0 0  12  32  0 0 1
 Example 3
Using Elementary row Operations(4/4)
Add - 121 times
x  112 z  35
2 the third equation x 1
to the first and 72 times
y  72 z   172 the third equation y  2
z 3 

to the second
z 3

Add - 121 times

the third row
1 0 112 35
2  to the first and 72 1 0 0 1
0 1  7  
17 times the third row 0 1 0 2
 2 2
 
0 0 1 3     

to the second
0 0 1 3

 The solution x=1,y=2,z=3 is now evident.

1.2 Gaussian Elimination
 Echelon Forms
 This matrix which have following properties is in reduced row-
echelon form (Example 1, 2).
1. If a row does not consist entirely of zeros, then the first
nonzero number in the row is a 1. We call this a leader 1.
2. If there are any rows that consist entirely of zeros, then they are
grouped together at the bottom of the matrix.
3. In any two successive rows that do not consist entirely of zeros,
the leader 1 in the lower row occurs farther to the right than the
leader 1 in the higher row.
4. Each column that contains a leader 1 has zeros everywhere else.
 A matrix that has the first three properties is said to be in row-
echelon form (Example 1, 2).
 A matrix in reduced row-echelon form is of necessity in row-
echelon form, but not conversely.
Example 1
Row-Echelon & Reduced Row-Echelon form
 reduced row-echelon form:
0 1 2 0 1
1 0 0 4  1 0 0 
 0 1 0 7  , 0 1 0  ,  0 0 0 1 3 0 0
0 0 0
    0 ,
0 0 0 
0 0 1  1 0 0 1  
0 0 0 0 0

 row-echelon form:
1 4  3 7 1 1 0 0 1 2 6 0
0 1 6 2, 0 1 0, 0 0 1  1 0
     
0 0 1 5 0 0 0 0 0 0 0 1
Example 2
More on Row-Echelon and Reduced
Row-Echelon form
 All matrices of the following types are in row-echelon
form ( any real numbers substituted for the *’s. ) :
0 1 * * * * * * * *
1 * 1 * 1 * 
*
* * * * * *
0 1 * * 0 1 * * 0 1 * * 
0 0 0 1 * * * * *
 , , , 0 0 0 0 1 * * * * *
0 0 1 * 0 0 1 *  0 0 0 0  
      0 0 0 0 0 1 * * * *
0 0 0 1 0 0 0 0  0 0 0 0 
0 0 0 0 0 0 0 0 1 *

 All matrices of the following types are in reduced row-

echelon form ( any real numbers substituted for the *’s. ) :
0 1 * 0 0 0 * * 0 *
1 0 0 0 1 0 0 * 1 0 * 
*
*
0 1 0 0  0 1 0 * 0 1 * * 
0 0 0 1 0 0 * * 0
 ,  , , 0 0 0 0 1 0 * * 0 *
0 0 1 0  0 0 1 *  0 0 0 
0  
      0 0 0 0 0 1 * * 0 *
 0 0 0 1  0 0 0 0  0 0 0 0 
0 0 0 0 0 0 0 0 1 *
Example 3
Solutions of Four Linear Systems (a)
Suppose that the augmented matrix for a system of
linear equations have been reduced by row operations to
the given reduced row-echelon form. Solve the system.

1 0 0 5 
(a) 0 1 0  2
0 0 1 4 

Solution (a)
the corresponding system x  5
of equations is : y  -2
z 4
 Example 3
Solutions of Four Linear Systems (b1)
1 0 0 4  1
(b) 0 1 0 2 6 
0 0 1 3 2 

Solution (b)
free variables
1. The corresponding x1  4 x4  - 1
system of equations is : x2  2 x4  6
x3  3x4  2

leading
variables
 Example 3
Solutions of Four Linear Systems (b2)

x1  - 1 - 4 x4 2. We see that the free variable can be

x2  6 - 2 x4 assigned an arbitrary value, say t, which
then determines values of the leading
x3  2 - 3 x4 variables.

3. There are infinitely many

x1  1  4t ,
solutions, and the general
solution is given by the x2  6  2t ,
formulas x3  2  3t ,
x4  t
 Example 3
Solutions of Four Linear Systems (c1)
1 6 0 0 4  2
0 0 1 0 3 1 
(c) 
0 0 0 1 5 2
 
0 0 0 0 0 0

Solution (c)
1. The 4th row of zeros leads to
the equation places no x1  6 x2  4 x5  - 2
restrictions on the solutions x3  3x5  1
(why?). Thus, we can omit
this equation. x4  5 x5  2
 Example 3
Solutions of Four Linear Systems (c2)
Solution (c)
x1  - 2 - 6 x2 - 4 x5
2. Solving for the leading x3  1 - 3x5
variables in terms of the free
variables: x4  2 - 5 x5

3. The free variable can be x1  - 2 - 6 s - 4t ,

assigned an arbitrary x2  s
value,there are infinitely
many solutions, and the x3  1 - 3t
general solution is given by x4  2 - 5t ,
the formulas.
x4  t
Example 3
Solutions of Four Linear Systems (d)
1 0 0 0
(d) 0 1 2 0
0 0 0 1

Solution (d):
the last equation in the corresponding system of
equation is
0 x1  0 x2  0 x3  1

Since this equation cannot be satisfied, there is

no solution to the system.
Elimination Methods (1/7)
 We shall give a step-by-step elimination
procedure that can be used to reduce any
matrix to reduced row-echelon form.

0 0  2 0 7 12 
2 4  10 6 12 28
 
2 4  5 6  5  1
Elimination Methods (2/7)
 Step1. Locate the leftmost column that does not consist
entirely of zeros.
0 0  2 0 7 12 
2 4  10 6 12 28
 
2 4  5 6  5  1
Leftmost nonzero column

 Step2. Interchange the top row with another row, to

bring a nonzero entry to top of the column found in Step1.
2 4  10 6 12 28
0 0  2 0 7 12  The 1th and 2th rows in the
  preceding matrix were
2 4  5 6  5  1 interchanged.
Elimination Methods (3/7)
 Step3. If the entry that is now at the top of the column
found in Step1 is a, multiply the first row by 1/a in order to
introduce a leading 1.
1 2  5 3 6 14 
0 0  2 0 7 12 
  The 1st row of the preceding
2 4  5 6  5  1 matrix was multiplied by 1/2.

 Step4. Add suitable multiples of the top row to the rows

below so that all entires below the leading 1 become zeros.
1 2  5 3 6 14 
0 0  2 0 7  -2 times the 1st row of the
 12  preceding matrix was added to
0 0 5 0  17  29 the 3rd row.
Elimination Methods (4/7)
 Step5. Now cover the top row in the matrix and begin
again with Step1 applied to the submatrix that remains.
Continue in this way until the entire matrix is in row-
echelon form.
1 2  5 3 6 14 
0 0  2 0 7 12 
 
0 0  5 0  17  29 Leftmost nonzero
column in the submatrix

1 2  5 3 6 14 
0 0 1 0  7  6  The 1st row in the submatrix
 2  was multiplied by -1/2 to
0 0 5 0  17  29 introduce a leading 1.
Elimination Methods (5/7)
 Step5 (cont.)
-5 times the 1st row of the
1 2  5 3 6 14  submatrix was added to the 2nd
0 0 1 0  72  6 row of the submatrix to introduce
 a zero below the leading 1.
0 0 0 0 12 1 
1 2  5 3 6 14  The top row in the submatrix was
0 0 1 0  7  6 covered, and we returned again Step1.
 2 
0 0 0 0 12 1 
Leftmost nonzero column in
the new submatrix
1 2  5 3 6 14 
0 0 1 0  7  6 The first (and only) row in the
 2  new submetrix was multiplied
0 0 0 0 1 2  by 2 to introduce a leading 1.

 The entire matrix is now in row-echelon form.

Elimination Methods (6/7)
 Step6. Beginning with las nonzero row and working upward, add
suitable multiples of each row to the rows above to introduce
zeros above the leading 1’s.
1 2  5 3 6 14 7/2 times the 3rd row of the
0 0 1 0 0 1  preceding matrix was added to
  the 2nd row.
0 0 0 0 1 2 
1 2  5 3 0 2
0 0 1 0 0 1  -6 times the 3rd row was added
  to the 1st row.
0 0 0 0 1 2
1 2 0 3 0 7
0 0 1 0 0 1 5 times the 2nd row was added

0 0 0 0 1 to the 1st row.
2
 The last matrix is in reduced row-echelon form.
Elimination Methods (7/7)
 Step1~Step5: the above procedure produces a
row-echelon form and is called Gaussian
elimination.
 Step1~Step6: the above procedure produces a
reduced row-echelon form and is called Gaussian-
Jordan elimination.
 Every matrix has a unique reduced row-
echelon form but a row-echelon form of a given
matrix is not unique.
Example 4
Gauss-Jordan Elimination(1/4)
 Solve by Gauss-Jordan Elimination
x1  3x2  2 x3  2x 5  0
2 x1  6 x2  5 x3  2 x4  4 x5  3x6  1
5 x3  10 x4  15 x6  5
2 x1  6 x2  8 x4  4 x5  18 x6  6
 Solution:
The augmented matrix for the system is
1 3 -2 0 2 0 0
2 6 -5 -2 4 - 3 - 1

0 0 5 10 0 15 5 
 
2 6 0 8 4 18 6 
Example 4
Gauss-Jordan Elimination(2/4)
 Adding -2 times the 1st
row to the 2nd and 4th rows gives
1 3 -2 0 20 0
0 0 -1 - 2 - 3 - 1
0

0 0 5 10 15 5 
0
 
0 0 4 8 18 6 
0
 Multiplying the 2nd row by -1 and then adding -5 times the
new 2nd row to the 3rd row and -4 times the new 2nd row
to the 4th row gives
1 3 - 2 0 2 0 0
0 0 1 2 0 - 3 1 
 
0 0 0 0 0 0 0 
 
 0 0 0 0 0 6 2 
 Example 4
Gauss-Jordan Elimination(3/4)
 Interchanging the 3rd and 4th rows and then multiplying the 3rd
row of the resulting matrix by 1/6 gives the row-echelon form.
1 3 - 2 0 2 0 0
0 0 - 1 - 2 0 - 3 - 1
 
0 0 0 0 0 1 1 
3
 
 0 0 0 0 0 0 0 
 Adding -3 times the 3rd row to the 2nd row and then adding 2
times the 2nd row of the resulting matrix to the 1st row yields the
reduced row-echelon form.
1 3 0 4 2 0 0
0 0 1 2 0 0 0 
 
0 0 0 0 0 1 13 
 
 0 0 0 0 0 0 0 
Example 4
Gauss-Jordan Elimination(4/4)
 The corresponding system of equations is
x1  3 x2  4 x4  2 x 5 0
x3  2 x4 0
x6  13
 Solution
The augmented matrix for the system is
x1  3 x2  4 x4  2 x 5
x3  2 x4
x6  1
3

 We assign the free variables, and the general solution is

given by the formulas:
x1  3r  4s  2t , x2  r , x3  2s, x4  s, x5  t , x6  13
Back-Substitution
 It is sometimes preferable to solve a system of linear
equations by using Gaussian elimination to bring the
augmented matrix into row-echelon form without
continuing all the way to the reduced row-echelon
form.
 When this is done, the corresponding system of equations
can be solved by solved by a technique called back-
substitution.
 Example 5
 Example 5
ex4 solved by Back-substitution(1/2)
 From the computations in Example 4, a row-echelon form from
the augmented matrix is
1 3 -2 0 2 0 0
0 0 -1 -2 0 -3 - 1
 
0 0 0 0 0 1 1 
3
 
0 0 0 0 0 0 0
 To solve the corresponding system of equations
x1  3x2  4 x4  2 x 5  0
x3  2 x4 0
x6  13
 Step1. Solve the equations for the leading variables.
x1  3 x2  2 x3  2 x 5
x3  1  2 x4  3 x6
x6  1
3
 Example5
ex4 solved by Back-substitution(2/2)
 Step2. Beginning with the bottom equation and working upward,
successively substitute each equation into all the equations above it.
 Substituting x6=1/3 into the 2nd equation

x1  3 x2  2 x3  2 x 5
x3  2 x4
 x6  13
Substituting x3=-2 x4 into the 1st equation

x1  3 x2  2 x3  2 x 5
x3  2 x4

x6  1
Step3. Assign
3 free variables, the general solution is given by the
formulas.

x1  3r  4s  2t , x2  r , x3  2s, x4  s, x5  t , x6  13
Example 6
Gaussian elimination(1/2)
 Solve x + y + 2z = 9 by Gaussian elimination and
2x + 4y - 3z = 1 back-substitution. (ex3 of
3x + 6y - 5z = 0
Section1.1) 1 1 2 9
2 3 1
 Solution  4 
 We convert the augmented matrix 
3 6 5 0

1 1 2 9 
0 1  7  172 
to the row-echelon form  2
0 0 1 3 


x  y  2 z  9, y  72 z   172 , z  3
 The system corresponding to this matrix is
Example 6
Gaussian elimination(2/2)
 Solution
 Solving for the leading variables x  9  y  2 z,
y   172  72 z,
z 3
 Substituting the bottom equation into those above
x  3  y,
y  2,
z 3
 Substituting the 2nd equation into the top

x  1, y  2, z  3
Homogeneous Linear Systems(1/2)
 A system of linear equations is said a11x1  a12 x2  ...  a1n xn  0
to be homogeneous if the constant a21x1  a22 x2  ...  a2 n xn  0
terms are all zero; that is , the    
system has the form :
am1 x1  am 2 x2  ...  amn xn  0
 Every homogeneous system of linear equation is
consistent, since all such system have x1  0, x2  0,..., xn  0
as a solution. This solution is called the trivial solution;
if there are another solutions, they are called nontrivial
solutions.
 There are only two possibilities for its solutions:
 The system has only the trivial solution.
 The system has infinitely many solutions in addition to
the trivial solution.
Homogeneous Linear Systems(2/2)
 In a special case of a
homogeneous linear
system of two linear
equations in two
unknowns: (fig1.2.1)

a1 x  b1 y  0 (a1 , b1 not both zero)

a2 x  b2 y  0 (a2 , b2 not both zero)
Example 7
Gauss-Jordan Elimination(1/3)
2 x1  2 x2  x3  x5  0
 Solve the following
homogeneous system of linear  x1  x2  2 x3  3x4  x5  0
equations by using Gauss- x1  x2  2 x3  x5  0
Jordan elimination. x3  x4  x5  0

 Solution 2 2 1 0 1 0
 The augmented matrix  1 1 2 3 1 0

1 1 2 0 1 0
 
0 0 0 1 0 0

 Reducing this matrix to 1 1 0 0 1 0

reduced row-echelon form 0 0 1 0 1 0

0 0 0 1 0 0
 
0 0 0 0 0 0
 Example 7
Gauss-Jordan Elimination(2/3)
Solution (cont)
 The corresponding system of equation x1  x2  x5  0
x3  x5  0
x4 0
 Solving for the leading variables is x1   x2  x5
x3   x5
x4  0
 Thus the general solution is
x1   s  t , x2  s, x3  t , x4  0, x5  t
 Note: the trivial solution is obtained when s=t=0.
Example7
Gauss-Jordan Elimination(3/3)
 Two important points:
 Non of the three row operations alters the final column of
zeros, so the system of equations corresponding to the
reduced row-echelon form of the augmented matrix must
also be a homogeneous system.
 If the given homogeneous system has m equations in n

unknowns with m<n, and there are r nonzero rows in

reduced row-echelon form of the augmented matrix, we
will have r<n. It will have the form:
 xk 1   ()  0 xk1   ()
 xk 2   ()  0 xk 2   ()
  
xr   ()  0 (1) xr   () (2)
Theorem 1.2.1
A homogeneous system of linear
equations with more unknowns than
equations has infinitely many solutions.

 Note: theorem 1.2.1 applies only to

homogeneous system
 Example 7 (3/3)
Computer Solution of Linear System
 Most computer algorithms for solving large
linear systems are based on Gaussian
elimination or Gauss-Jordan elimination.
 Issues
 Reducing roundoff errors
 Minimizing the use of computer memory space
 Solving the system with maximum speed
1.3 Matrices and
Matrix Operations
Definition

A matrix is a rectangular array of numbers.

The numbers in the array are called the
entries in the matrix.
Example 1
Examples of matrices
 Some examples of matrices entries

 1 2    2
 3 0, 2 1 0   1
  - 3, 0 1
2 1 , 3, 4
 1 4 0 0 0   

row matrix or row vector column matrix or
 Size column vector

3 x 2, 1 x 4, 3 x 3, 2 x 1, 1x1
# columns
# rows
Matrices Notation and Terminology(1/2)
 A general m x n matrix A as a11 a12 ... a1n 
a a22 ... a2 n 
A  21 
    
 
am1 am 2 ... amn 

 The entry that occurs in row i and column j of matrix

A will be denoted aij or  Aij . If a ij is real
number, it is common to be referred as scalars.
Matrices Notation and Terminology(2/2)
 The preceding matrix can be written as
a 
ij mn or a 
ij

 A matrix A with n rows and n columns is called a square

matrix of order n, and the shaded entries a11, a22 ,, ann
are said to be on the main diagonal of A.

a11 a12 ... a1n 

a a2 n 
 21 a22 ... 
    
 
am1 am 2 ... amn 
Definition
Two matrices are defined to be equal
if they have the same size and their
corresponding entries are equal.

   
If A  aij and B  bij have the same size,
then A  B if and only if aij  bij for all i and j.
Example 2
Equality of Matrices
 Consider the matrices
2 1  2 1  2 1 0
A  , B  , C 
3 x  3 5  3 4 0 

 If x=5, then A=B.

 For all other values of x, the matrices A and B are not
equal.
 There is no value of x for which A=C since A and C
have different sizes.
 Operations on Matrices
 If A and B are matrices of the same size, then the
sum A+B is the matrix obtained by adding the entries
of B to the corresponding entries of A.
 Vice versa, the difference A-B is the matrix obtained
by subtracting the entries of B from the
corresponding entries of A.
 Note: Matrices of different sizes cannot be added or
subtracted.
 A  B ij  ( A)ij  ( B)ij  aij  bij
 A  B ij  ( A)ij  ( B)ij  aij  bij
Example 3
Addition and Subtraction
 Consider the matrices
2 1 0 3  4 3 5 1
1 1
A   1 0 2 4, B   2 2 0  1, C   
 4  2 7 0  3 2  4 5   2 2 

 Then
  2 4 5 4  6 2 5 2 
A  B   1 2 2 3, A  B   3  2 2 5 
 7 0 3 5  1  4 11  5
 The expressions A+C, B+C, A-C, and B-C are undefined.
Definition
If A is any matrix and c is any scalar,
then the product cA is the matrix
obtained by multiplying each entry of
the matrix A by c. The matrix cA is
said to be the scalar multiple of A.

 
In matrix notation, if A  aij , then
cAij  c Aij  caij
Example 4
Scalar Multiples (1/2)
 For the matrices
 2 3 4 0 2 7  9  6 3 
A  , B  , C 
1 3 1   1 3  5  3 0 12 

 We have
4 6 8  0  2  7 3  2 1
2A    , -1B    , 1
C 
1  3 5 
3
 2 6 2 1 0 4 

 It common practice to denote (-1)B by –B.

Example 4
Scalar Multiples (2/2)
Definition
 If A is an m×r matrix and B is an r×n matrix,
then the product AB is the m×n matrix whose
entries are determined as follows.
 To find the entry in row i and column j of AB,
single out row i from the matrix A and column j
from the matrix B .Multiply the corresponding
entries from the row and column together and
then add up the resulting products.
Example 5
Multiplying Matrices (1/2)
 Consider the matrices

 Solution
 Since A is a 2 ×3 matrix and B is a 3 ×4 matrix,
the product AB is a 2 ×4 matrix. And:
Example 5
Multiplying Matrices (2/2)
Examples 6
Determining Whether a Product Is Defined
 Suppose that A ,B ,and C are matrices with the following
sizes:
A B C
3 ×4 4 ×7 7 ×3

 Solution:
 Then by (3), AB is defined and is a 3 ×7 matrix; BC is
defined and is a 4 ×3 matrix; and CA is defined and is a 7 ×4
matrix. The products AC ,CB ,and BA are all undefined.
 Partitioned Matrices
 A matrix can be subdivided or partitioned into smaller matrices
by inserting horizontal and vertical rules between selected rows
and columns.

 For example, below are three possible partitions of a general 3 ×4

matrix A .
 The first is a partition of A into
four submatrices A 11 ,A 12,
A 21 ,and A 22 .
 The second is a partition of A
into its row matrices r 1 ,r 2,
and r 3 .
 The third is a partition of A
into its column matrices c 1,
c 2 ,c 3 ,and c 4 .
 Matrix Multiplication by columns
and by Rows
 Sometimes it may b desirable to find a particular row or column of a
matrix product AB without computing the entire product.

 If a 1 ,a 2 ,...,a m denote the row matrices of A and b 1 ,b 2, ...,b n

denote the column matrices of B ,then it follows from Formulas
(6)and (7)that
 Example 7
Example5 Revisited
 This is the special case of a more general procedure for
multiplying partitioned matrices.
 If A and B are the matrices in Example 5,then from (6)the
second column matrix of AB can be obtained by the
computation

 From (7) the first row matrix of AB can be obtained by the

computation
Matrix Products as Linear
Combinations (1/2)
 Matrix Products as Linear
Combinations (2/2)

 In words, (10)tells us that the product A x of a matrix

A with a column matrix x is a linear combination of
the column matrices of A with the coefficients coming
from the matrix x .
 In the exercises w ask the reader to show that the
product y A of a 1×m matrix y with an m×n matrix A
is a linear combination of the row matrices of A with
scalar coefficients coming from y .
Example 8
Linear Combination
Example 9
Columns of a Product AB as
Linear Combinations
 Matrix form of a Linear System(1/2)

 Consider any system of m a11 x1  a12 x2  ...  a1n xn  b1

a21 x1  a22 x2  ...  a2 n xn  b2
linear equations in n unknowns.
   
am1 x1  am 2 x2  ...  amn xn  bm
 Since two matrices are equal if
a11x1  a12 x2  ...  a1n xn  b1 
and only if their corresponding a x  a x  ...  a x  b 
 21 1 22 2 2n n 
 2
entries are equal.       
   
a x 
 m1 1 m 2 2
a x  ...  a mn n 
x bm 
 The m×1 matrix on the left side a11 a12 ... a1n   x1  b1 
a a ... a   x  b 
of this equation can be written  21 22 2n   2 
 2
        
as a product to give:     
 m1 m 2
a a ... a mn   xm  bm 
Matrix form of a Linear System(1/2)
 If w designate these matrices by A ,x ,and
b ,respectively, the original system of m equations in n
unknowns has been replaced by the single matrix
equation
 The matrix A in this equation is called the coefficient
matrix of the system. The augmented matrix for the
system is obtained by adjoining b to A as the last
column; thus the augmented matrix is
Definition
 If A is any m×n matrix, then the transpose
T
of A ,denoted by A ,is defined to be the
n×m matrix that results from interchanging
the rows and columns of A ; that is, the
T
first column of
A is the first row of A ,the
second column of AT is the second row of
A ,and so forth.
Example 10
Some Transposes (1/2)
Example 10
Some Transposes (2/2)

 Observe that

 In the special case where A is a square matrix, the

transpose of A can be obtained by interchanging
entries that are symmetrically positioned about the
main diagonal.
Definition
 If A is a square matrix, then the trace
of A ,denoted by tr(A), is defined to be
the sum of the entries on the main
diagonal of A .The trace of A is
undefined if A is not a square matrix.
Example 11
Trace of Matrix