I) Eterminants Inversion: Matrix
I) Eterminants Inversion: Matrix
Inversion
Th,
cal
exl
sys
Coyley's matrices (1857) have fourished
and today constirute a very imponant
and useful instrument in mathematics.
Eves (19'79)
-Ho*-ard
for
sp,(
the
pr(
Ex
4
This chapter continues the sody of linear algebra. The fust topic discussed is
determinanrs. Though some economists have claimed that determinants are almost
useless. we shall see that they do in fact play an imponant role in several areas of
mathematics that are of interest to economists- Nc
After introducing determinants, we consider the fundamentaliy important con- gn
cept of the inverse of a square matrix and its main properties. Cramer's rule for lA
the solution of a system of n linear equations and n unknowns is discussed nexr lin
Although it is not efficient for solving systems of equations with more than three
unknowns, Cramer's rule is often used in theoretical studies. AI
438
Sec. 13.1 / Deteminants ol Order 2 439
Its associated coefficient marix is
A: ( alt dt?
ll3.2l
A?t 421 )
Solving the equation sysrem [l3.ll in the usual way (see Section A-9) yields
for any 2 x 2 matix A. Such a determinant is said to have order 2. For the
special case of order 2 determinants, the rule for calculatin_e lAl is: (a) multipiy
the diagonal elements, @) muidply the off-diagonal elements. and (c) subtract the
product of the off-diagonal elements from the product of the diagoaal elements.
Example 13.1
Ea! fi I atz
rl :4-2-3-l = 5, lb, : A1 bt
frn J lb, Qtt
brazz.-bzan, : bzatt-brazt
A2 b2
rrd
Nota.' Geomerically, each of the rwo equations represents [13.1] represents the
graph of a straight line. If lAl + 0, rhe two lines intersect at a unique point. If
lAl :
0, either the two lines are parallel and there are no solutions, or the rwo
trd lines coincide and there is an infinite number of solutions.
From Exampie 13.1, we see that the numerarors of the expressions for -r1
and;r2 in [3.3] can also be wriuen as.determinants. If lAl 10, then
b1 An att br
b2 A1) a2t b2
fl :
[13.s]
tAt lAt
This is a special case of a result referred to as Cramer's rule (named after the Swiss
mathematician G. cramer, 1704-1752). It turns out rhar a similar rule applies to
tuee equations wirh three unknowns (see the next secrion). Later in Section 13.g,
'* e shall generalize the rule to z equarions in n
unknowns.
440 Chapter 13 / Determinants and Matrix lnversion
Example 13.2
(azt
Use [3.5] to find the solutions of
2x1 + 1x.: 7
2x1 - 2-4: -2
Solution
11 21 FIGU
al
-6 I 2-2 -18 3 a
a
Xl: 24 _11 1
24 _1) )
aa
deter
A_ 2(b + Fr) b
-4(b+ErXb+ F)-b2
b 2(b + P2)
,,
a-dt b
a?
a-a? 2(b+fr2) : 2(b+F)@-ar)-b(a-uz)
.A
A
4
A Geometric lnterPretation
in Fig' I 3 ' I '
Determinants of order 2 have anice geometric interpretation. as shown
in Fig. 13.1. then the determinant is equal to tbe
If the two vectors are situated as
shaded area of the parallelogram. If we interchange the two row vectors in the
Sec. 13. I/ Determinants of Order 2 441
a2t
a0+a1i t-,
T1
(at
422
T2
T7
lr. at:)
T1
a| I att
RGURE 13.1 Area = FIGURE 13.2
-lar
l4t
arz
?dl
I
Problems
a.
30 b. la al a+b a-b 3', 2t
26 la bi c.
a-b a*b d.
3r-r Z,-l
2. Illustrate the geometric interpretation in Fig. l3.l for the determinant in
koblem 1(a).
3' use cramer's rure [13.5] to solve rhe fonowing sysrems of equations for .r
and y. Test the answers by substirution.
u 3x1- 12:8 b. r+3y:l c- ax_br.:l
xr-Zxz-5 3x-2y=l! bx*ay:2
4. l*t
att ap
A_ ( a2t and B- ( bl bn
Aaa
) bzt bzz )
Show thar lABl = lAl . lBl.
5. Find two 2 x 2 matrices A and B such that iA+Bl# lAl+lBi.
6. Use Cramer's ruie to find y and C when
y:C*/s*G6 C:a*by
:s- -i "
)'r : Cr * Xt - Mr.
* Ar Cr: ctYt, M1= mtYr
Yz = Ct -l- A: -F X:. - Mt. Ct: czYz. M:.: mzYz.
a, lo'r,t b'u) | I
atrxt*apx2*a1ix3:b1
ayxl * arx2 * a*g - b2 tl3.6l
a31x1ia3?x2ia33x3=[3
:
b1a17a31 - b1a7a32 - b2apa3i * b2apa32* hanaZ: - b3a22a3
fl
at.crai. - a)tQ2:\a3Z* apa2;A31 - a2A2ta3j j a6A21A32 - a1a2?a)l
Sec. 13.2 / Determinants of orcler 3 443
n ; hich We shall not triple the demands on the reader's patience and eyesight by grv-
cii more ing the corresponding expressions for x2 and x3. However, we do claim that
these expressions share the same denominator as that given for x1. This com-
mon denomioator is called the determinant of A, denoted by det(A) or lAl. It is
defined as
Iarr an att I
J
"r, ";, ,;; I
tr3.7)
ar a2a13,
I - at ta23a32 * apaVa3l
rgenous) { - anq2taJ3 * aga21a37 - aga7ra3l
lrons of
Expansion by Cofactors
Consider the sum of the six terms in [3.7]. It looks quite Eessy, but the method
urlibrium
of expansion by cofactors makes it easy to write down all the terms. First, note
that each of the ttree elements a1, otz, and a13 in the first row of A appears in
exactly two tenns of u3.71. In fact, lAl can be wrinen as
422 a.^
* I 1 a., a", I
-' " I o.,
I -'
a". I
IAI :3 Ir
l,
ol ^ I
-1 ol-r.i -l 1l
"l-u'l I
5 il'-
-tt I 5 ?l
-3 3-0+2-(-2-5):-5
444 Chapler 13 / Determinants and Matrix lnversion
Exa:
ExamPle 135
Use [13'8] to Prove that
laa?
lAl = tb6z
\cc2
: (b-a)(c-a)k-b)
Solution
An bz
b7 o.'= azt
azt
,;l
|
bz azz a?3
bt a3t a\z bt (azt
bt 432 433
x?: x3
rt: lal lAl
la t13.91
2xt * 2xz X3 -J
4xt + 2x3 8
6xz 3xt 2
t- 2-r :
t')
3€ ,*T1EeD 1 -32 -l : 2 -3 -1 2? -3
- ; llc -
r 80 2 -12, 482 -
t, 40 8
1a
(ay, atz,
.{
r1i Q'
a3)
- t. azzi,
)
r-. -r I-iiCl (a11, a12, ar1)
r,\. _a Lr-,/
3
++-+
--'rz.
First.multiplyalongthethreelinesfaliingtotheright,givingalltheseproductsaplussign:
Thenmultiplyalongthethreelinesrisiogtotheright'givingalltheseproducsaminussign:
- a3lazlal? [**]
-a3t anaB - a3za2iarl
Thesumofthetermsin[*]and[**lisexactlyequaltoiA|.(Itisimponanttonotethatthis
rule.knownasSarnrs,rule,doesnotgeneralizetodeterminantsoforderhigherthan3.)
Problems
13.3 l
1 1+D I :abc*ab+ac+bc
1 1 1*c
Sec. 13.3 / Determinants of Oder n 447
xe I:l: 3'i
a2t Aa) AB a3t alz 433
: th-- l (lhus, interchangrng rows 2 and 3 of the determinant changes its sign.)
q lp. .4. t- J.
7- f
D
Y1
d. .l / 'a{
l+
o J /V
\JI c ld ( l
I
FIGURE 13.4
lnversion
448 ChaPter 13 / Determinants and Matrix
where:
lAl is a sum of n'! terms
element
elements of the mauix' with one
1. Each term is &e product of n column' Moreover' every u3.l2l
from each .o* *J onc clement from each
which each row and each column is
oroduct of exac-Uf z factors' in
;;;;;; once' must aPPcar in.this sum'
"**tivt",* is found by apptying the sign rule [13.11].
2. The sign of """t,
m
unusual way Howevcr' ir is cquivaleo:
lThe sigo nrlc in [13'i I] is dcscribcd in a llcwhat
thcsignrulcbascdono""oo."poofcvenandoddpcrmuationsrharisusedinmostbooksonlrg
algcbra-
Sec. 13.3 / Dcterminants of Order n 449
rEg In symbols, one has
att aD aln
a2t 4n
tAt : a2!r
[13. l3]
Onl an2 ann
=L(*)at,,a2^ anrn
I
Example 13.7
Consider the determinant of an arbirary 4 x 4 matrix A = (o4)r*,
lAl: aul
"rt @ ort oto
fis.. aq atz at3 @ I
I
:: d=
: 4 .3 .2. I = 24 terms. One of these terms is aBa2ta3?a41,
It consists of 4!
ctt and the co*espoDding facrors are the boxed erements in the array--what
sign
@ should this term have? According to the sign rule
[13.11], thaterm shourd
have a plus sign because there are exactly two lines that rise to the right.
E([ check that rhe four indicated terms in the following sum have been given
the correct sign:
tr,EE
.@ lAl : a,arraSax - a72a21ayd4a+ . .. + a!aZta32a$_ ... + a1aa2ia31a41
Note that there are 20 other terms that we have left out.
a\ an tlln
oan Ar1
= AllAZ2...Ann ll3.l4I
00 dnn
lilD
ri.l'' Here all the elements below rhe main d.iagonal are 0, and rhe determinant
is
the product of all the elemenrs on rhe main diagonal. Tb see why, note
that
450 chapter 13 / Determinants and Matrix lnversion
Fromcolumn2,wecannotchoose@l2,becausewehavealreadypickedanei-
emenr from the fust row (a11). Hence, from column 2'
we have to pick a22
in order to have a tenn different from 0. From the third column, we have to
pick a33, and so on. Thus, only the t€rrrl 41141 "'ann c?trt be * 0- The sign
of this term is plus because none of the lines between the elements in the
term
rises.
triangular' The<
The matrix whose determinant is given in t13.14] is called upper
If a marix is a transpose of an upper triangular matrix, so tbat all elements above
the diagonal are 0, then the marix is lower riangular. The determinant
of a I
lower triangular matrix is also equal to the product of the elemenu on its main
.,
diagonal.
3.
Problems
4.
1. Use the definirion of determinant to compute the following:
1000 0 0 0 ll
0200 0 0 r 0l
a.
0030
b.
0 1 0 0l 6.
0004 I 0 0 0l
1001 I 0 02
0100 d.
0 I 0-3 8.
C-
0010 U 0 14
abcd 2 3 4 1l
2.Thedeterminantofthefoliowing5x5matrixconsistsof5l:l20terms.
with its
one of &em is the product of the boxed elements. write this term
correct sign. 9,
rhe term indicated by ttre boxes with ia colrect sign. (See the previous
3. write
problem.)
arr an aB aA @
azt aaa a73 @ a2s
a3r lZrl a33 ala a3s
aqr Z; @ au a4s
E asz 4$ a54 ass
Sec. 13.4 / Easic Rutes for Determinants 451
LIi.i-. - 13.4 Basic Rutes for Determinants
:.ii 3--
Based on definirion [13.12] of the determinanr
of an n x r matnx A, one can
"a.' : !: prove a number of imponant propertiel.
certainiy, many of these are m"inry or
theoredcal interesq but they also make it simprer
to determinanr.
"rutrar.
laAf - 6v'141
[13.16]
lA+Bl +lAl+lBl
An exampiie of this geaeral inequaliry was asked
for iu hoblem 5 of Section r3.1.
hoofs for most of these propenies are given at
the end of this secdon- First,
however, let us illustrate them in iome ,p""ill
"u."r,
Rute t: l"d, ? = ari .o - arz .o :o
l
452 Chapter 13 / Determinants and Matrix lnversion
We see that lA'l has exactly the same tentrs as lAl' ln particular' lA'l : lAl
atl atz : afi(aaz) - an(aau)
Rule 3:
da2t da??
att at7
: d(attaz. - 417a21) = s A?t All
SU
AD
Rule 4:
a2l : A2lAlZ - Att,!: -(A1ya-t - AnAZt): - l::j Z';\
A1 atz Ex
A1 a : altat? - :
Rule 5 a12411 Q
A1 a 1
[,et us a]so see how rule 5 helps to confirm the result in Example 13.5
of sec-
tion 13.2. Notethattheproduct (b-a)(c -o)(c-b) is0if b: a'c: a'or
c : b, and in each of these tlree cases, two rows of the matrix are equal.
l1
Rule !'= \: at(flan) - an(Fat) - F(arap -
6: I l" Parz 411a12) = 0
I Fart I
Rule7: Multiply each entry in the first row of a determinant of order 2 by cr and
add the results pairwise to the entries in &e second row. Then the determinant Rr,
does not cuange its value. (Note careftrlly how we indicate
this operation.)
tic
in'
ati 412 d. att alT
a2t aD J aT+dar1 a2*aap Er
: att(al2 * aap) - an(azt * aa11)
Example 13.8
I 5 -l 1 I 5 -1 ll s -l2 -3
-1 13 .l_
-l+l l+5 3 + (-l) :lo 6
j 2l 2 I l: 2 | --l
15 -l r 5 -l
06 2 J,/6 0 6 2l I
Rr
0 -13 4 <-J 0 0 25/31
:r.6.T=to
Sec. 13.4 / Basic Rules for Determinants 453
Here, I times the first row has been added to the second in orcier ,. ,arn a
zero in the fint column. Then (-3) times &e firsr row has been addcd ro the
third, which gives a second zero in the firsr column. Thereafter. l3i6 times
the second row has been added to the third, which adds a zero ro the sec-
ond column. Note the way in which we have indicated these operations. [n
the end, they produce an upper riangular matrix that we evaluate by means
of U3.l4l.
ln the next example, the first two steps involve more than one operation
simultaneously.
Example 13.9
a +b
a
a
a*b
a
a
-i'l : 3a* b 3a*b 3a*b
a+b a
icc-
a a a*b I a a a +b
;6 1 I I -a -a 1l I
:(3a*b) a a*b a :(3a*b) 0b 0
a a a*b 1__l 00 b
Rule 8: This is also an important properry. If you have done hoblem 4 of Sec-
tion l3-1, you have already proved it for 2 x 2 matrices. Here is an example
involving 3 x 3 matrices.
Example 13.10
Check that lABl : lAl . lBl when
I 5 -l 30
A- -1 I 3 B_ -1 I
3Z I 52 3)
Solution Here lAl = 50 (as in Example 13.8) and lBl : -5. But
-t J -l
AB: 11 7 7
-T 124 9
t
454 Chapter 13 / Delermnants and Matrix lnversion
Theorem 13.1 exhibits some of the most imponant rules for determinants' Confi-
dence in dealtng with them comes only from doing many problems'
lAl: a3t
444 aqs
a5t as2 asl as5
dlt a)t a
a1 ac2 asz
The term at?a73a35a4'1a51 appears in both lAl and in lA'l' Of rhose lines
joining pairs of enries in lAl, the number thar rise to the right is 4, as is the
conespooding number of lines in lA'1. This is true in general. Transposing
means reflection about rhe main diagonal afiaa1 ...ano. fr the line I
jorning
any rwo enEies in one of the terms of lAl rises to the right (as it does bcrween
a4l and a35 in the iliustration)' then the mirror image L' of this line, which
joins the same rwo entries in the corresponding telTn in lA'1, will also rise to
the nght and vice versa.
Rule 3: F-achrerm in rhe sum defining lBl is a mulciplied by &e corresponding
term in the sum defining lAl- Hence, lBl : alAl'
Ruk 4: Ftsc consider the case in which two adjacent rows of lAl are inter-
changed. namely, rows i andi + I' in order to obain lA.l as indicated in dre
following displaY:
att atz
ait arn
lAl: at+r.l ai+t2 ai+ln
anl an! a@
Sec. 13.4 / Basic Rules for Determinants 455
r:ir Confi-
dlt atz
ies ar
ai*t.t ai*l ai*ln
lA.l= ail ain
ra;i r
Anl An2 aM
Using the definitions of lAl and lA"l, it is clear that any rerm appearing in
lAl
also appears in lA"l. and vice versa_ Whar about the sign? Think of the pos!
tions of the individual entries of a term in lAl and of the corresponding term
in lA.l. All the lines joining enries that have nor changed their positioni have
the same slope as before. The same is rue for lines joining enuies whose posi-
tions do not change to entries in the two rows that are interchanged.
6t_ooi, for
example, at the line joining arn to a;2 in the rwo previously displayed determi-
nans-) It remains to consider the lines joining wo entries in the rows rhat are
interchanged. They must clearly change from rising to falling as one gocs to the
right. Because each rcrm in lAl and in lA.l contains exacdy one pair of enries
from these rwo rows, and because the line joining these rwo entries has changed
from rising to fallin-s as one soes to the righg the number of lines that rise to the
right in these two determinants must differ by exactly l. Hence, lAl
= _l{1.
Suppose next that rwo non-adjacent rows are to be interchanged. Smn
by interchanging the upper one of these rows with the row immed.iately below
it, then with the row next down. and so on. Suppose that s interchanges are
needed to bring the previous upper row into its new position. The second of
(::ng the two rows to be interchanged is now immediately above its original position.
Interchange it successively with rhe row directly above it exactly (s 1) times
)-lL: i -
to bring it to irs final new position. In all, we bave perforrned s +s _ I : 2s _ I
,'i €i:
, L. ^- interchanges of neighboring rows. Each of these interchanges changes the sign
15€ t:. of the determinant, and in all. we have an odd number of sign changes- Hence,
the determinant /ras changed its sign by interchanging two rows.
Rule 5: If we inrcrchange the two rows that are equal, the dercrminant will
be exactly the same. But according to rule 4. the dercnninant has changed its
sign. Hence, lAl = -lAl, which means thar lAl 0.
=
m fie Rule 6: This follows immediately from nrles 3 and 5.
Rule 7: Symbolically. the proof of this rule is as follows. for the case when
the scalar multiple a of row i is added to row j:
Problems
10.
2\ - I
t.LetA=\l/t 4) B:( 1)
\) ol_ .
Compute
\r
X'X and lX'Xl''
ii)
6. I-et A and B be 3 x 3 matrices with lAl
:3 and lBl : -4' Where possibir*
I - 2Bl' lAl + lBl, and lA *
3lAl, Bl'
f,nd the numerical values of lABl,
T.Showthatanorthogonalmamx(seeProblemTofSectionl2.9)musrhatt
determinant I or -1.
13.5 Expar
8. A square matrix A of order n is called involutive if Al = I''
iUo* that the determilant of an involutive matrix is I or -l'
". / o\ ,oo (i , - o') are involurive (for aII a Accor
b.Showrhar(-16 _,/*-\r _a )--- sum (
- A)(I' + A) :0'
^
c- Show that A is involufrve c+ (I, from
Sec. 13.5 / Expansion by Cofaaors 457
Harder Problems
b2+c2 ab ac u c ba
ab a2+c? bc c 0 ol
ac bc a2+b2 b a 0l
10. Prove that
a*b a a
a a*b a
D,: = bn-t (na + b)
:
a a a +h
(.Fllzt; Sody Example i3.9.)
11. a. l*t
lAt : dtt
a2t
at2
a2 tBt : brr
bzt
br.
b==1
I
Prove that
afi an 00 +-
tAt .tBl: A?t 412 00
-r0 brr be a aTl
0-l hr bZ An 412
: lABl
flffe have indicated the operations you should use to obtain the second
equality.)
b. Try to generalize the method in part (a) so that it applies *'hen A and
iiil B are arbitrary z x z matrices, and &us give a proof of rule 8 in Theo-
rem 13.1.
TG
have a;1 as a factor, then atl terms that have a;2 as a factor, and so on. Because
all the terms have one and only one element from row i. in this way we get all the
terms of lAl. So we can wrire
where lines have been drawn through row i and column j, which are to be deletec
from the matrix.
A proof of [13.19] will be given ar the end of this section. If we look back
at [3-8] in Section 13.2, however, it confirms tl3.l9l in a special case. Indesn
Put lAl : anCtt * apCp -f c13C13. Then [13.8] implies that
: (-t)'*r
l-tr
' iI |u
a:r a't I c',: (-l)'- ,=.lo', a-
ai2 1'
afi l.
C,, C,= = 1-1;r+z I "
I I a:t ,3, l' ,;_ lo;;
precisely In 3eqelrlanss with [13.19].
Generally, formula [13.19] is rather complicated. Test your understanding cr
it by studying the following sxample.
Exampte 13.12
3 -l 2 3 -l 2
0-l -l 0-l -l 1,,,i -l -l
6l 2 03 _.> j ='J 3-2 =3(2* 3) = t5
To derive the equetiry labelled (l),
I it 3rr+fl expand by column I
Example 13.13
a ,:.:(. :U,i&,
Lia tl*T 2 0 3 -1
0 400 (l)
: (-l)i+- .4
:5 -l -7t')
0 1-l 2 0-l 2
J 25-? -3
ta
l1 3 -I
4 lo -l 2 o l-r 1 r
i<:r:ru m
lo l/2 -?/) 'l ,,, -i,rl:8 (3 - . ) : +
Example 13.14
If A : (aij):,t, then the expansion of lAl in terms of the elements in the
second row is
Suppose we change the elemens a2t, ar, and a5 to a, b, and c. Then C21.
C::, and Cr Ne unchanged. So, the Dew determinant is
A1 At2 AD
abc - aCu * bCr, * cCv [*]
a3t a33 a-33
a11Cy*ypCn*arcCx=0
a31Cy*432Cn*atsCt-0
Thus, the sum of the products of the elements in either row I or row 3
The signs of the terms in Cy1 are the same as the signs of the corrcsponding
terms in attcl.The signs of the terms in a11C11 are determincd by tle oum-
EE" ber of lines joining pairs of eiements that rise as they go to the righr" including
all those that rise up to a1i. However. there cannot be any lines drat rise up
to all, so C11 is equal to the deterrn:nant [*J.
Consider next C,j. Move row to row I by i i I interchanges of two
-
adjacent rows. Tbe i I prcvious rows, while rctaining their old order, arc
-
moved one position down. By pcrforming j I interchanges, the new column
n$ j is moved left to the position of column l.- Because we have inrcrchanged
i - 1+J - I = i+"r -2 rows and columns in all, the determinanthas
changed sign i * j - 2 times. Because (-l)i+i-2 : (-l)i+j, lAl must bc
G given by
:il
ai1 ai. j
-l ai. j+t ain
At; atl at.j-l at. j+t aln
: :
Problems
t
rl
1. Use the method in Examples 13.12 and 13.13 to compute the following
a
determinants:
t2 J 4 213 3 :
12 4
a. 13 9 b.
0-1 0 1l 32 r 6 n
t416 2-l 0 3
c.
r 30 9
-20 I 241t2 E
2. Compute the following determinants:
000a 0000 i
00a 00b0 00051
a- 0b0 b.
0c00 c. 00312
c00 d000 04 0 34
62 312
Harder Problems
main diagonal and 0's elsewhere) is the matrix equivalent of I in the real numb< 3.
system.a This makes the following terminology seem narural.
Given matrix A. if rhere exiss a matrix X such that As f(
an lr
AX:;1L -1 trAI lAxt
matri
4From no* on. we writc I instead of r, whencver the dimcnsion n of the idcntiry ,.r- I
obvious.
Sec. tg.6 / The lnverse of a Matrix 463
then we say that x is an inverse of A. Moreover,
A is said to be invertible in
this case. Because XA AX I, the marix A is also
= = an inverse of X_that is, A
and X are inverses of each other. Note &at both the
two matrix products AX and
XA are defined and can also be equar onry if A and X are square
marices of the
same order- Thus, onry square marices can have inverses.
Bui not even alr square
matrices have inverses, as the following example shows.
Example 13.15
56
A= ( 510 and X= ( r/2 -3/r0
) -r /4 r/4 )
are inverses of each otber,
(b) l0
Show that A = ( 00 ) has no inverse
Solution
We conclude from this equation that lAl I 0 is a necessary condition for A to have
an inverse, because IAI : 0 would violate [*]' As we shall see in the next section,
the condition lAl + 0 is also szffcient fot A to have an inverse- Hence:
Example 13.16
Nor
Find the inverse of A : (a b
(when it exists)
Ev
d )
Solution We shall find a 2 x 2 matrix X such that AX - XA: I. lh:
requires looking for numbers x, ), a, and u; such that
: (l 0\
(: :) (: l,) t) Prt
Matrix multiplication implies that W-e
ax*bz:1. ay*bw:0
cx*dz:0, cy*dw:7 Tbeorem 13
- lEut_
Note that we have two systems of equarions here. one given b.v &e
equations on the left, and the other given by the two equations on the s .a -:
Both systems have A as a co[lmon coefficient matrix. If lAl = ad - i: = ':, .{B rs :
solving them using Cramers' rule ([3.5] of Section 13.1) or other*'i-
- ..,-
-i
) -c -b - --{
*-
ad-bc' '- ad - bc'
t- ad-bc' U=-
Sec. 13.6 / The lnverse ol a Matix 465
A: ( a b d-b
d) ==:+ A-l ad-bc ( -ca 113.24)
C
)
tr -.- -
For square matrices of order 3, one can use Cramers' rule [I3.9] to derive
rlar l: -{ = a formula for the inverse. Again, the requirement for the inverse to exist is
..r o 6^d _af that the deterrninant of the coefficient matrix is not 0. Full details wiil be
grven rn Secuon lJ. /.
;er_{Y=I:cr
Some Useful lmplications
If A-! is the inverse of A. then A-lA : I and A,A-t = I. Actua'ly, each of these
e4uations implies the other, in the sense that
r.ve.se o.l A :
;. 11 9 q41 *'n'i
I :::+ x-A-r
AX = Ir 3.25]
Nofes
1. It is imponant ro *unk carefully through the implications of the four rul*
in Theorem 13.3 and to understand their uses. A somewhat dramatic stot-:
might help you to appreciate nrle (c)' Some years ago a team of
(huma'o t
P
calculators was working in a cenu'al bureau of statistics. After 3 weeks b.
of hard work, they finally found the inverse A-r of a 20 x 20 matrix 'l c{
Then the boss came along and said: "Sorry, I was really rnterested in ti* dr
tc
inverse of the transpose of A-" Panic-until they realized that propen-v-
s€
would save them from having to redo all the calculations. They simpi;u
n
transposed the inverse matrix that it had taken 3 wecks to fiod, becau-*
to (c), the inverse of the transpose is the transPose of the tr- Examp
"".oiding
verse. S
2.SupposethatAisinvertibleandalsosymmetrlc-{hatis'A':A'Thenru€
(ciimplies that (A-r)': (A')-t : A-1, so A-l is symmetric' The inver:e
of a symmetic nwtrix is sytrunetric'
3. Rule (b) can be extended to products of several matric€s. For instance' t- '{
B, and C are all invenible n x n matrices' then I
(ABC)-r : linrlc)-r : c-' (AB)-r
: C-r (B-rA-t ; : 6-t3-ta-t
T]
where rule (b) has been used twice. Note the assumption in @) that A
2"tI m
In and ecooometrics. we often cons,js 1I
B are both n x n matrices. statistics
products of the form XX" where X is n x rn- Then )o(' is n x n. lf the
o*
ie.minant IXX'I is not 0, then G(X'1-r exists, but (b) does not apply be'er;a
X-r and X'-l are onlY defined rf n : m'
4. It is a collrmon fallacy to misinrcrpret (d). For instance, a colrect applicas:u T1
AX=B tU
YA: B p.l
In case [I], the rnarix B must hav: n rows, and in case
[2], B must have z columns.
Provided these condirions are satisfied, we have the following result:
A: ( 22 t) X: ( x
) ,: (i)
Then [l] is equivalent to &e matrix equation AX = B. Because lAi : 2 * 0,
-{ ,rilr matrix A has an inverse, and according to Theorem 13.4, X : A-rB. The
Esfu inverse of A is found from tl3.Z4),66d r,tls efnin
EiE c-
E:3@E
(;)=^-'(i) :(_l -'n (i) =(l)
iic@--@ The solution of [l] is, t]rerefore, x : l, ] = 1. (Check by substitution that
this really is the correct solurion.)
468 Chapter 13 / Determinants and Matix lnversion
Problems
2-l -1 /l 2 4\
a 114 ,=(?
[:
r18 t/8 -r18 )
b and
\r)
4. Solve the following systems of equations by using Theorem l3'4' (Sec
Example 13.18.)
a.2x:31:3 b.7x-3y= 8 c 7x-3Y:0
3x-4y=J 3x*4Y:ll 3x-4Y=Q
| /-l - 6r Show ttrat A3 : I' use this to find A-r'
s. r.et A :
; (; l')-
10 l0\ 1
6.GivenmatrixA:(O I 1)
\l o t)
a. Compute lAl, A2, and A3. Show that A3 -ZAz +A -I =0, where I is
the identiry marix of order 3, and 0 is the zero matrix'
b. Show rhat A has an inverse and A-l : (A - D2' 13.7 A G
c- Find a matrix P such that 1l2 : A. Are therc other matrices with thit
properry? Th,
an(
7. .. *, n: (3 -l 1) .o*n"* AA', IAA'1, and (AA')-r' imr
(AA';-t
b. The matices AA' and (a) are both symmeric' Is this a
in Part of
coincidencc?
E. Suppose that A, P, and D are square matrices such that A: PDFI' nor
cor
a. Show thar A2 : PilFt. tlus
b. Show by induction that A' = PDUFI for any positive inrcger m' coi
_1ttL t) (
9. Given B = ( t14 , compute Bz + B, 83 - 28 * I, and then B-r
) -r/2 (the
11. a. Suppose that X is an m x n matrix and that lX'Xl I 0' Show that the
mabax
A=I.-x(x'x)-tx'
is idempotent--+hat is, A2 = A. (See Problem 7 of Section 12.8.)
ll
Check the result in part (a) for the particuiar matrix X = 2
h.
I )
12. lathe matrices A and T be defined by
) 3 '1 t3
T=fr
^: (i
1 I J and (? -83
_1 1) 2 r-3
where s and t are real numbers'
rem l3'4' (s€r a. Prove that T : A-l for suitable values of s and r'
b. Suppose that the matrix X satisfies tbe equation 31 : 2X * C' wbere
_ =0
.: (lr2
_1."-
/5 2 J 3 0
-ir =0 s:lz 3 5
)
and 0 J I
\s 2 3 5 4
) nnd A-l
Use the result in Part (a) to find X'
13. kt D be an n x n marrix such that DP = 2D+3I' Prove tloat D3
: aD*bl
for suitable values of a ad b. lipd 5imil21 exprcssions for D6 and D-t (that
is, expressed in the form qD+ 0l)'
-l=0,whereI*
h.
'3,7 A General Formula for the lnverse
r raarrices wltb =u: facts about the i-nverse
The prcvious section certainly Presents tle most important
ana its properties, and as such is "what every economist should
know." It is less
to the inverses
important io, *ort economists to know a lot about how
compute
r.$'r-1.
are available'
of iarge marices, because powerful comPuter ryograms
srmmetric. ls us o the inYerse of any
Nevertbeless, this secdon Presents an explicit formula for
inefficient for
nonsingular n x n matrix A. Though this formula is extremely
ft dT: theoretical inrcrest. The key to
r-{ = PDF .olnpr"uog inverses of large marices, have
ll-Z rt Section 13.5 on the expansion of dercrminans by
rh.is formula is Theorem
i.gve rntege; 'r: cofactors.
Let Crr, .... Cnndenote the cofactors of the elemena in A' Then by U3'20I
B - I. and
-ia D-' the rule for expansion by cofactors), one has
The sums on rhe left-hand side look very rnuch iike those appearing
in rnan-ix
products. ln fact, the n2 different equations in [*] reduce to the single mauix
equadon
:
Crn Ctn Cnn ):(: 0 lAl
atl anT ann
Theorem 135 (General pslnule for the Inverse) Any square mamx
A : (a,j) with determinant lAl I 0 has a unique inverse A-t satisfuing
^*n
AA-r : A-lA = I, which is given by
Example 13.19
Let
2 )
l: 4 J
I 2 i)
Show that A has arr inverse aod flnd the inverse-
Sec. 13.7 / A Geneal Formula lor the tnverse 411
: in lnamx Solution Accordins ro Theorem 13.5. A
has an mverse itr lAi
,gie matrix 0.
X;:t,:H."alculation
shows thar lAi-:'-j,"ro the
inverse exists. =
'The
t-
cr = |lJ" 4l
I
. l: l0
I
C
4 II ^ lt rl
l- 2
I . l: -15 Ln=l- 5
lr 1t
-l
i: 4l 2 4l la
:) 12 4i- -4 Czz = 1 4l 4 L:r=-l- J I
lr 2 - -l
CJ
J
)
4 _ _9. C;:: _ lz 4 l't ?l
denote tre
I
l+ r =14 I I:-6
rl
:-hand side
Hence, the inverse of A is
s. rt is tbe
ienoed t'r
A-'= a
tAl
Ctt
Cn
Ctt
Cz:.
Ctr
Cy
(
l0 -1 *9
*15 4 t4
'l:
- tJ C3 Cst 5
5 -r -6 )
':
(Check the resuh by showing
that AA-r _ L)
Finding lnverses by Elementary
Row Operations
I. ir --"a-r
Theorem l3-5 presented a general
rci li: formula for tl
Although.r,irio.,,ur"isimportant,il;;d""d:,I,::tJr'rlH:x11*LllT
matrices much larger than 2 x 2. w.
,ha,;;;y discuss ;*;;;;; inding tire
is very efficient. Versions or i,
iil:::r:- *. i"n"rally used by computers to find
I
I
472 Chapter 13 / Detenninants and Matrix lnversion
ExamPte 13-20
)
/r 3 3\
Find the inverse of A = (l '^ \) 3
6 matrix whose first three columns
Solution Firsq write down the 3 xtlree columns are the columns of the
are the columns of I and wtrose next 4,
3x3identitYmatrix:
/l 3 3 l0 0\
(r 3 4 o I o)
\t 4 3 0 0 rl
use elementary operadons on this matnx
The idea is now sysrematically to
sothat,intheend,thethreefirstcolumnsconstituteanidentitymatrix.Then
three columns constitute the inverse
of A'
the last
the result to the second row'
First, multiPly tn" first row by -1 and {d
column' You should be able
This gives a zero in th" ;;; row and the first
used and why they are chosen'
then to understand the other operations
/l 3 3 I 0 0\ -l /t 331 10 -1
(r 3 4 o I o) --J (o 0ll-l
\l 431 00 ?)
I
.-l
\r 4 3 0 0 r/
/l 3 3 1 00 0 3" 4 0
oI
-lo\oro -1 10 I (s 0lr-l
I 0 I -l
1
i)
-l 0t )
0
-3
/r 0 0 r 'l
-3 31
-
rl 0
[o o
0
I -1
-3 -3
1 0 <-l [o I o ", -l 0 ll
\o I o -l 0 I ) *l \oori-l 1 o)
We conclude that
1 -?
-7, 13.8 Cram
A-r -r01 1 0 )
-1 Cram
(Check that AA-r = I') of rhe
the sr
Problems
l.UseTheoreml3.5tocomputetheinversesofthefollowingmatrices'ifd*:t
exist: rl
)a 102 0 0tt
r)
a. ( 45 ) b. ( 2-r 0
o 2 -t ) ' (-i a
-; 8/
*c. 13.8 / Camels Rute 473
/-2 3 2r
2. Find the inverse of le o 3)
\ + t -t)
0.2 0.6 0.2 r
e
3. Let A: 0 0.2 0.4 ). Find (r-A)-l
aoiuITInS
rES of &e
0.2 0.2 o)
4. consider the following problem. Repeated observations of a phenomenon
lead to a number of equarions with the same square coefficient marix (ai;),
but with different right-hand sides:
A11X1 *...*A1nXn=[i,
eaa'nd :o'* Explain how to find the solutions of all the systems by using row operadons
,r.iC be ab'L: to get
"rts Cramer'sRule
cramer's rulc for solving n linear equations in n unknowns is a direct generalization
of the same rule for systcms of equations with rwo or three unknowns. consider
the system Ax: b, or
_-ffi,
a11X1 * apx2 * * atoxn - bt
aztxt * atzx2 * * a4xn - b2
[13.31]
where the cofactors c;i ue given by ti3.l9l of Section 13.5. Now we can proE
the following result:
lfi' "'
D2
x, = x"=lri [ 13.3i-
lli'
where Dr, Dz, ..., Dn ate defined by [13.32]'
Using formula [3.30] for thc invene of the cefficient matrix A yields
I.^ Di (j=l-2.....n)
x1=fr;Gtibrr...*C^ib)=-tl
.
t3l
Sec. ,3.8 / Cramels Rule 475
whcrc the last egualiry follows from the previous equadon [*]' This proves
: 7th column Ir 3.33].
Thus,
Example 1321
has solu-
ixamine for which values of p the following system of equations
[ 13.32] tions, and find these solutions.
px+ y -l
x- y*::0
,,.-,-?
[*l -J
pl 0
A I -l I =l-p
02 .l
]J
r r:elds when p I 1- When P :1, however' adding the last two of ttre original
which
equations impties that x * y = 3- Tbis conEadicts the first eguation'
becomes x * ! = l- So there is no solution in rhis casc-
trl
Homogeneous S4stems of Equations
we end this chaprcr by studying thc special case in which the right-band side of
From [2]. wc rhe system of equations [i3-i1] consists only of zeros' The sysrcm
is then called
homogeneous. A homogeneous sysem will always have the so-called trivid so-
lu6on x1 = x? : ' ' ' :-x^ = 0' In many problems' one is intercsted in loowing
t3_ when a homogeneous system has nonfivial solutions'
476 Chapter 13 / Determinants and Matix lnversion
Partial Argumenr: Suppose that lAl # 0- Then' by Cramer's rule, x1' ' - ', ru are
given by t13.331. But the numerator in each ofthese fractions is 0, because each of
tbe determinants Dt, . . . , D^ contains a colunn consistitrg endrely of zeros. Then
the system only has the rivial solution. ln other words: System [13.34] can onlv
luve nontrivial solutions if thc determinant lAl vanishes. One can also Prove tbat
if lAl :0, then system tf3.34l does have nontrivial solutions'6
Example 1322 3.
Examine for which values of .tr the following system of equations has norr'
trivial solutions:
5x*2Y*z=l-x
2x* y :ly tl:
Y ! r 1-
-
Problems
i r.De equatroB!
:x: :. ao: }u