Shiller - Efficient Mkts
Shiller - Efficient Mkts
Shiller - Efficient Mkts
Robert J. Shiller
A
cademic nance has evolved a long way from the days when the ef cient
markets theory was widely considered to be proved beyond doubt. Behav-
ioral nance—that is, nance from a broader social science perspective
including psychology and sociology—is now one of the most vital research pro-
grams, and it stands in sharp contradiction to much of ef cient markets theory.
The ef cient markets theory reached its height of dominance in academic
circles around the 1970s. At that time, the rational expectations revolution in
economic theory was in its rst blush of enthusiasm, a fresh new idea that occupied
the center of attention. The idea that speculative asset prices such as stock prices
always incorporate the best information about fundamental values and that prices
change only because of good, sensible information meshed very well with theoret-
ical trends of the time. Prominent nance models of the 1970s related speculative
asset prices to economic fundamentals, using rational expectations to tie together
nance and the entire economy in one elegant theory. For example, Robert
Merton published “An Intertemporal Capital Asset Pricing Model” in 1973, which
showed how to generalize the capital asset pricing model to a comprehensive
intertemporal general equilibrium model. Robert Lucas published “Asset Prices in
an Exchange Economy” in 1978, which showed that in a rational expectations
general equilibrium, rational asset prices may have a forecastable element that is
related to the forecastability of consumption. Douglas Breeden published his
theory of “consumption betas” in 1979, where a stock’s beta (which measures the
sensitivity of its return compared to some index) was determined by the correlation
y Robert J. Shiller is the Stanley B. Resor Professor of Economics and also afliated with the
Cowles Foundation and the International Center for Finance, Yale University, New Haven,
Connecticut. He is a Research Associate at the National Bureau of Economic Research,
Cambridge, Massachusetts. His e-mail address is [email protected] .
84 Journal of Economic Perspectives
of the stock’s return with per capita consumption. These were exciting theoretical
advances at the time. In 1973, the rst edition of Burton Malkiel’s acclaimed book,
A Random Walk Down Wall Street, appeared, which conveyed this excitement to a
wider audience.
In the decade of the 1970s, I was a graduate student writing a Ph.D. dissertation
on rational expectations models and an assistant and associate professor, and I was
mostly caught up in the excitement of the time. One could easily wish that these
models were true descriptions of the world around us, for it would then be a
wonderful advance for our profession. We would have powerful tools to study and
to quantify the nancial world around us.
Wishful thinking can dominate much of the work of a profession for a decade,
but not inde nitely. The 1970s already saw the beginnings of some disquiet over
these models and a tendency to push them somewhat aside in favor of a more
eclectic way of thinking about nancial markets and the economy. Browsing today
again through nance journals from the 1970s, one sees some beginnings of
reports of anomalies that didn’t seem likely to square with the ef cient markets
theory, even if they were not presented as signi cant evidence against the theory.
For example, Eugene Fama’s 1970 article, “Ef cient Capital Markets: A Review of
Empirical Work,” while highly enthusiastic in its conclusions for market ef ciency,
did report some anomalies like slight serial dependencies in stock market returns,
though with the tone of pointing out how small the anomalies were.
1
A good discussion of the major anomalies, and the evidence for them, is in Siegel (2002).
Robert J. Shiller 85
2
The present value, constant discount rate, is computed for each year t as p *const, t 5 ¥ `t 5 t1 1 r ( t 2 t) D t ,
where r is a constant discount factor, and D t is the real dividend at time t. An assumption was made
about real dividends after 2002. See note to Figure 1.
86 Journal of Economic Perspectives
Figure 1
Real Stock Prices and Present Values of Subsequent Real Dividends
(annual data)
10000
1000
PDV, Interest Rates
Price
10
1860 1880 1900 1920 1940 1960 1980 2000 2020
Notes: The heaviest line is the Standard & Poor 500 Index for January of year shown. The less-heavy
line is the present value for each year of subsequent real dividends accruing to the index discounted
by the geometric-average real return for the entire sample, 6.61 percent. Dividends after 2002 were
assumed equal to the 2002 dividend times 1.25 (to correct for recent lower dividend payout) and
growing at the geometric-average historical growth rate for dividends, 1.11 percent. The thin line is
the present value for each year of subsequent real dividends discounted by one-year interest rates
plus a risk premium equal to the geometric average real return on the market minus the geometric
average real one-year interest rate. The dashed line is the present value for each year of subsequent
real dividends discounted by marginal rates of substitution in consumption for a representative
individual with a coef cient of relative risk aversion of 3 who consumes the real per capita
nondurable and service consumption from the U. S. National Income and Product Accounts.
Real values were computed from nominal values by dividing by the consumer price index (CPI-U
since 1913, linked to the Warren and Pearson producer price index before 1913) and rescaling to
January 2003 5 100. Some of the very latest observations of underlying series were estimated based
on data available as of this writing; for example, the consumer price index for January 2003 was
estimated based on data from previous months. Source data are available on http://www.econ.yale.
edu/ shiller , and the further descriptions of some of the data are in Shiller (1989). See also
footnotes 1, 5 and 6.
the aggregate stock market, relative to the present value implied by the ef cient
markets model. Our work launched a remarkable amount of controversy, from
which I will recall here just a few highlights.
The principal issue regarding our original work on excess volatility was in
regard to thinking about the stationarity of dividends and stock prices. My own
work in the early 1980s had followed a tradition in the nance literature of
From Efcient Markets Theory to Behavioral Finance 87
assuming that dividends uctuated around a known trend.3 However, one might
also argue, as do Marsh and Merton (1986), that dividends need not stay close to
a trend and that even if earnings followed a trend, share issuance or repurchase
could make dividends depart from a trend inde nitely. In addition, if business
managers use dividends to provide a smoothed ow of payouts from their busi-
nesses, then the stock prices might be expected to shift more rapidly than divi-
dends. Marsh and Merton argued that such dividend smoothing could make stock
prices unstationary in such a way that in nite samples prices appear more volatile
than the present values.
Thus, the challenge became how to construct a test for expected volatility that
modeled dividends and stock prices in a more general way. As such tests were
developed, they tended to con rm the overall hypothesis that stock prices had
more volatility than an ef cient markets hypothesis could explain. For example,
West (1988) derived an inequality that the variance of innovations (that is, surprises)
in stock prices must be less than or equal to the variance of the innovations in the
forecasted present value of dividends based on a subset of information available to
the market. This inequality is quite general: it holds even when dividends and stock
prices have in nite variances so long as the variance of the innovation (the
unexpected change) in these is nite. Using long-term annual data on stock prices,
West found that the variance of innovations in stock prices was four to 20 times its
theoretical upper bound. 4 John Campbell and I (1988) recast the time series model
in terms of a cointegrated model of real prices and real dividends, while also
relaxing other assumptions about the time series, and again found evidence of
excess volatility.5 Campbell (1991) provided a variance decomposition for stock
returns that indicated that most of the variability of the aggregate stock market
conveyed information about future returns, rather than about future dividends.
Another contested issue regarding the early work on excess volatility ques-
tioned the assumption of the early work that the ef cient markets model was best
conveyed through an expected present value model in which the real discount rate
is constant through time. The assumption of a constant discount rate over time can
only be considered a rst step, for the theory suggests more complex relationships.
3
It should be pointed out that dividend payouts as a fraction of earnings have shown a gradual
downtrend over the period since 1871 and that dividend payouts have increasingly been substituted by
share repurchases. Net share repurchases reached approximately 1 percent of shares outstanding by the
late 1990s. However, share repurchases do not invalidate the theoretical model that stock prices should
equal the present value of dividends. See Cole, Helwege and Laster (1996).
4
In more technical terms, this argument is over whether dividends could be viewed as a stationary series.
The discussion was often phrased in terms of the “unit root” property of the time series, where a unit
root refers to notion that when a variable is regressed on its own lags, the characteristic equation of the
difference equation has a root on the unit circle. West (1988) can be viewed as a way of addressing the
unit root issue. In our 1988 paper, Campbell and I handled nonstationarity by using a vector autore-
gressive model including the log dividend-price ratio and the change in log dividends as elements.
5
Barsky and De Long (1993), however, later showed that if one assumes that real dividends must be twice
differenced to induce stationarity (so that dividends are even more unstationary in the sense that
dividend growth rates, not just levels, are unstationary), then the ef cient markets model looks rather
more consistent with the data.
88 Journal of Economic Perspectives
One such ef cient markets model makes the discount rate correspond to
interest rates. The line in Figure 1 labeled “PDV, Interest Rates” illustrates this
concept.6 However, allowing time-varying interest rates in the present value for-
mula does little to support the ef cient markets model. The actual price is still
more volatile than the present value, especially for the latest half century. More-
over, what changes through time there are in the present value bear little resem-
blance to the changes through time in the stock prices. Note for example that the
present value is extremely high throughout the depression years of the 1930s, not
low as was the actual stock market. The present value is high then because real
interest rates were at extreme lows after 1933, into the early 1950s, and since real
dividends really did not fall much after 1929. After 1929, real Standard & Poor’s
dividends fell to around 1925 levels for just a few years, 1933–1935 and 1938, but,
contrary to popular impressions, were generally higher in the 1930s than they were
in the 1920s.7
An alternative approach to the possibility of varying real discount rates looks at
the intertemporal marginal rate of substitution for consumption, which is shown in
Figure 1 with the line labeled “PDV, Consumption.”8 The models of ef cient
nancial markets from the 1970s like Merton (1973), Lucas (1978) and Breeden
(1979) concluded that stock prices are the expected present value of future
dividends discounted using marginal rates of substitution of consumption, and in
these models the equations for stock returns were derived in the context of a model
maximizing the utility of consumption. Grossman and Shiller (1981) produced a
plot of that present value since 1881, using Standard & Poor dividend data and
using aggregate consumption data to compute the marginal rates of substitution as
discount factors, and this plot is updated here, and this is what is shown in Figure 1. We
6
The present value, discounted by interest rates, is a plot for each year t of
O
2002 t 2002
O
2002
where C t is real per capita real consumption at time t. This expression is inspired by Lucas (1978) and
derived in Grossman and Shiller (1981) assuming a coef cient of relative risk aversion of 3. See note to
Figure 1.
Robert J. Shiller 89
found, as can also be seen here in Figure 1, that the present value of dividends as
discounted in this model had only a tenuous relation to actual stock prices, and did
not appear volatile enough to justify the price movements unless we pushed the
coef cient of relative risk aversion to ridiculously high levels, higher than the value
of three that was used for the plot.
Grossman and Shiller (1981) stressed that there were some similarities be-
tween the present value and the actual real price, notably the present value peaks
in 1929 and bottoms out in 1933, close to the actual peak and trough of the market.
But the present value does this because consumption peaked in 1929 and then
dropped very sharply, bottoming out in 1933, and the present value takes account
of this, as if people had perfect foresight of the coming depression. But in fact it
appears very unlikely that people saw this outcome in 1929, and if they did not, then
the ef cient model does not predict that the actual real price should have tracked
the present value over this period.
Actually, the consumption discount model, while it may show some comove-
ments at times with actual stock prices, does not work well because it does not justify
the volatility of stock prices. I showed (1982) that the theoretical model implies a
lower bound on the volatility of the marginal rate of substitution, a bound which is
with the U.S. data much higher than could be observed unless risk aversion were
implausibly high. Hansen and Jagannathan later generalized this lower bound and
elaborated on its implications, and today the apparent violation of this “Hansen-
Jagannathan lower bound” is regarded as an important anomaly in nance.9
Some very recent research has emphasized that, even though the aggregate
stock market appears to be wildly inef cient, individual stock prices do show some
correspondence to ef cient markets theory. That is, while the present value model
for the aggregate stock market seems unsupported by the data, there is some
evidence that cross-sectional variations in stock prices relative to accounting measures
show some relation to the present value model. Paul Samuelson some years ago
posited that the stock market is “micro ef cient but macro inef cient,” since there
is considerable predictable variation across rms in their predictable future paths
of dividends but little predictable variation in aggregate dividends. Hence, Sam-
uelson asserted, movements among individual stocks make more sense than do
movements in the market as a whole. There is now evidence to back up this
assertion.
Vuolteenaho (2002) showed, using vector-autoregressive methods, that the
ratio of book-to-market-value of U.S. rms explains a substantial fraction of changes
in future rms’ earnings. Cohen, Polk and Vuolteenaho (2002) concluded that 75
to 80 percent of the variation across rms in their book-to-market ratios can be
explained in terms of future variation in pro ts. Jung and Shiller (2002) show that,
cross-sectionally, for U.S. stocks that have been continually traded since 1926, the
price-dividend ratio is a strong forecaster of the present value of future dividend
9
See, for example, John Cochrane’s (2001) book Asset Pricing, which surveys this literature. Much of the
older literature is summarized in my 1989 book Market Volatility.
90 Journal of Economic Perspectives
In the 1990s, a lot of the focus of academic discussion shifted away from these
econometric analyses of time series on prices, dividends and earnings toward
developing models of human psychology as it relates to nancial markets. The eld
of behavioral nance developed. Researchers had seen too many anomalies, too
10
Other factors are considered by McGrattan and Prescott (2001), who emphasize tax rate changes, and
Siegel (2002), who considers not only tax rate changes but also changes in the volatility of the economy,
changes in the in ation rate, and changes in transactions costs. Neither of these studies shows a “ t”
between present value and prices over the long sample, however. Notably, the factors they use do not
go through sudden changes at the time of the stock market booms and crashes surrounding 1929 and
2000.
From Efcient Markets Theory to Behavioral Finance 91
Feedback Models
One of the oldest theories about nancial markets, expressed long ago in
newspapers and magazines rather than scholarly journals, is, if translated into
academic words, a price-to-price feedback theory. When speculative prices go up,
creating successes for some investors, this may attract public attention, promote
word-of-mouth enthusiasm, and heighten expectations for further price increases.
The talk attracts attention to “new era” theories and “popular models” that justify
the price increases.1 2 This process in turn increases investor demand and thus
generates another round of price increases. If the feedback is not interrupted, it
may produce after many rounds a speculative “bubble,” in which high expectations
for further price increases support very high current prices. The high prices are
ultimately not sustainable, since they are high only because of expectations of
further price increases, and so the bubble eventually bursts, and prices come falling
down. The feedback that propelled the bubble carries the seeds of its own destruc-
tion, and so the end of the bubble may be unrelated to news stories about
fundamentals. The same feedback may also produce a negative bubble, downward
price movements propelling further downward price movements, promoting word-
of-mouth pessimism, until the market reaches an unsustainably low level.
Such a feedback theory is very old. As long ago as 1841, Charles MacKay in his
11
For a list of our programs since 1991, with links to authors’ websites, see http://cowles.econ.
yale.edu/beh n .
12
Descriptions of new era theories attending various speculative bubbles are described in my book
(2000). Popular models that accompanied the stock market crash of 1987, the real estate bubbles
peaking around 1990 and various initial public offering booms are discussed in my paper in this journal
(1990).
92 Journal of Economic Perspectives
in uential book Memoirs of Extraordinary Popular Delusions described the famous
tulipmania in Holland in the 1630s, a speculative bubble in tulip ower bulbs, with
words that suggest feedback and the ultimate results of the feedback (pp. 118 –119):
Many individuals grew suddenly rich. A golden bait hung temptingly out
before the people, and one after another, they rushed to the tulip marts, like
ies around a honey-pot . . . . At last, however, the more prudent began to see
that this folly could not last forever. Rich people no longer bought the owers
to keep them in their gardens, but to sell them again at cent per cent pro t.
It was seen that somebody must lose fearfully in the end. As this conviction
spread, prices fell, and never rose again.13
The feedback theory seems to be even much older than this. Note of such feedback,
and the role of word-of-mouth communications in promoting it, was in fact made
at the time of the tulipmania itself. One anonymous observer publishing in 1637
(the year of the peak of the tulipmania) gives a ctional account of a conversation
between two people, Gaergoedt and Waermondt, that illustrates this author’s
impression of the word-of-mouth communications of that time:
Gaergoedt: “You can hardly make a return of 10% with the money that you
invest in your occupation [as a weaver], but with the tulip trade, you can make
returns of 10%, 100%, yes, even 1000%.
Waermondt: “ . . . . But tell me, should I believe you?”
Gaergoedt: “I will tell you again, what I just said.”
Waermondt: “But I fear that, since I would only start now, it’s too late, because
now the tulips are very expensive, and I fear that I’ll be hit with the spit rod,
before tasting the roast.”
Gaergoedt: “It’s never too late to make a pro t, you make money while
sleeping. I’ve been away from home for four or ve days, and I came home
just last night, but now I know that the tulips I have have increased in value
by three or four thousand guilder; where do you have pro ts like that from
other goods?”
Waermondt: “I am perplexed when I hear you talking like that, I don’t know
what to do; has anybody become rich with this trade?”
Gaergoedt: “What kind of question is this? Look at all the gardeners that used
to wear white-gray out ts, and now they’re wearing new clothes. Many weav-
ers, that used to wear patched up clothes, that they had a hard time putting
13
Garber questions MacKay’s facts about the tulipmania in his 1990 article in this journal and in his
book Famous First Bubbles. For example, the crash was not absolutely nal; Garber documents very high
tulip prices in 1643. The actual course of the bubble is ambiguous, as all contracts were suspended by
the states of Holland in 1637 just after the peak, and no price data are available from that date.
Robert J. Shiller 93
on, now wear the glitteriest clothes. Yes, many who trade in tulips are riding
a horse, have a carriage or a wagon, and during winter, an ice carriage, . . . .”14
Casual observations over the years since then are plentiful evidence that such talk,
provoking a sense of relative futility of one’s day-to-day work and envy of the
nancial successes of others, and including some vacuous answer to doubts that the
price rise may be over, is effective in overcoming rational doubts among some
substantial number of people and tends to bring successive rounds of them into the
market.
In my book Irrational Exuberance, published (with some luck) at the very peak
of the stock market bubble in March 2000, I argued that very much the same
feedback, transmitted by word-of-mouth as well as the media, was at work in
producing the bubble we were seeing then. I further argued that the natural
self-limiting behavior of bubbles, and the possibility of downward feedback after the
bubble was over, suggested a dangerous outlook for stocks in the future.
One might well also presume that such simple feedback, if it operates so
dramatically in events like the tulip bubble or the stock market boom until 2000,
ought often to recur at a smaller scale and to play an important if lesser role in
more normal day-to-day movements in speculative prices. Feedback models, in the
form of difference equations, can of course produce complicated dynamics. The
feedback may be an essential source of much of the apparently inexplicable
“randomness” that we see in nancial market prices.
But the feedback theory is very hard to nd expressed in nance or economics
textbooks, even today. Since the theory has appeared mostly in popular discourse,
and not in the textbooks, one might well infer that it has long been discredited by
solid academic research. In fact, academic research has until recently hardly
addressed the feedback model.
The presence of such feedback is supported by some experimental evidence.
Psychologists Andreassen and Kraus (1988) found that when people are shown real
historical stock prices in sequence (and which they knew were real stock prices) and
invited to trade in a simulated market that displays these prices, they tended to
behave as if they extrapolate past price changes when the prices appear to exhibit
a trend relative to period-to-period variability. Smith, Suchanek and Williams
(1988) were able to create experimental markets that generated bubbles that are
consistent with feedback trading. Marimon, Spear and Sunder (1993) showed
experiments in which repeating bubbles were generated if subjects were precon-
ditioned by past experience to form expectations of bubbles.
The presence of such feedback is also supported by research in cognitive
psychology, which shows that human judgments of the probability of future events
show systematic biases. For example, psychologists Tversky and Kahneman have
shown that judgments tend to be made using a representativeness heuristic,
14
Anonymous (1637). Bjorn Tuypens translated this passage.
94 Journal of Economic Perspectives
whereby people try to predict by seeking the closest match to past patterns, without
attention to the observed probability of matching the pattern. For example, when
asked to guess the occupations of people whose personality and interests are
described to them, subjects tended to guess the occupation that seemed to match
the description as closely as possible, without regard to the rarity of the occupation.
Rational subjects would have chosen humdrum and unexceptional occupations
more because more people are in these occupations. (Kahneman and Tversky,
1974). By the same principle, people may tend to match stock price patterns into
salient categories such as dramatic and persistent price trends, thus leading to
feedback dynamics, even if these categories may be rarely seen in fundamental
underlying factors.
Daniel, Hirschleifer and Subramanyam (1999) have shown that the psycho-
logical principle of “biased self-attribution” can also promote feedback. Biased
self-attribution, identi ed by psychologist Daryl Bem (1965), is a pattern of human
behavior whereby individuals attribute events that con rm the validity of their
actions to their own high ability and attribute events that discon rm their actions
to bad luck or sabotage. Upon reading the above passage from the time of the
tulipmania, one easily imagines that Gaergoedt is basking in self-esteem and
relishing the telling of the story. Many readers today can probably easily recall
similar conversations, and similar ego-involvement by the spreaders of the word, in
the 1990s. Such human interactions, the essential cause of speculative bubbles,
appear to recur across centuries and across countries: they re ect fundamental
parameters of human behavior.
There is also evidence supportive of feedback from natural experiments, which
may be more convincing than the lab experiments when they occur in real time,
with real money, with real social networks and associated interpersonal support and
emotions, with real and visceral envy of friends’ investment successes, and with
communications-media presence. Ponzi schemes may be thought of as represent-
ing such natural experiments. A Ponzi scheme (or pyramid scheme or money
circulation scheme) involves a super cially plausible but unveri able story about
how money is made for investors and the fraudulent creation of high returns for
initial investors by giving them the money invested by subsequent investors. Initial
investor response to the scheme tends to be weak, but as the rounds of high returns
generates excitement, the story becomes increasingly believable and enticing to
investors. These schemes are often very successful in generating extraordinary
enthusiasms among some investors. We have seen some spectacular Ponzi schemes
recently in countries that do not have effective regulation and surveillance to
prevent them. A number of Ponzi schemes in Albania 1996–1997 were so large that
total liabilities reached half a year’s GDP; their collapse brought on a period of
anarchy and civil war in which 2000 people were killed ( Jarvis, 1999). Real world
stock-market speculative bubbles, I argued in my 2000 book Irrational Exuberance,
resemble Ponzi schemes in the sense that some “new era” story becomes attached
to the bubble and acquires increasing plausibility and investor enthusiasm as the
market continues to achieve high returns. Given the obvious success of Ponzi
From Efcient Markets Theory to Behavioral Finance 95
schemes when they are not stopped by the law, we would need a good reason to
think that analogous phenomena of speculative bubbles are not also likely.
The stock market boom that ended in early 2000 is another relevant episode.
According to my survey data, now expressed in the form of stock market con dence
indexes produced by the Yale School of Management and available at http://
icf.som.yale.edu/con dence.index , the con dence of individual investors that the
stock market will go up in the next year, and will rebound from any drop, rose
dramatically 1989 –2000. As in the tulipmania centuries before, there was a focusing
of public attention and talk on the speculative market and a proliferation of
wishful-thinking theories about a “new era” that would propel the stock market on
a course that, while uneven, is relentlessly upward, theories that were spread by
word of mouth as well as the media.
It is widely thought that there is a problem with the feedback theories: the
theories would seem to imply that speculative price changes are strongly serially
correlated through time, that prices show strong momentum, continuing uniformly
in one direction day after day. This seems inconsistent with the evidence that stock
prices are approximately a random walk.
But simple feedback models do not imply strong serial correlation, as I stressed
in Shiller (1990). There, I presented a model of the demand for a speculative asset
as equaling a distributed lag with exponentially declining weights on past price
changes through time (the distributed lag representing feedback distributed over
time), plus other factors that affect demand. The model asserts that people react
gradually to price changes over months or years, not just to yesterday’s price
change. A history of price increases over the last year may encourage buying today
even if yesterday’s price change was down. Also, the model recognizes that there are
other shocks, besides feedback, in uencing price.
In such a model, a disturbance in some demand factor other than feedback
can in certain cases be ampli ed, at least for a time, because it changes the price
and thus affects future prices through the distributed lag.15 However, unless we
know something about the other factors that drive demand, such a distributed lag
model does not imply anything at all about the serial correlation properties of
speculative price changes. The feedback model does not imply that there is much
serial correlation in day-to-day stock price changes, since the noise in the other
factors feeds directly into short-run changes, and the effect on today’s price of
lagged other factors operates at a low frequency that is essentially unrelated to
day-to-day changes and has effects that can be observed only from its cumulative
effect after a long period of time.
Thus, the approximate random walk character of stock prices is not evidence
15
The feedback model is p t 5 c t2 ` e 2 g ( t2 t ) dp t 1 p t, 0 , c , 1, 0 , g. Here, p t is price at time
t, and p t is the combined effect of other factors on demand. It follows that pt 5 pt 1 (c/(1 2 c))(pt 2
pt), where pt 5 (g/(1 2 c)) t2 ` e 2 ( g / ( 1 2 c) ) ( t2 t ) p t dt is a weighted average of lagged p. See Shiller
(1990, p. 60). Such a model does not imply that price behaves smoothly through time: price can look
much like a random walk if, for example, p t is a random walk.
96 Journal of Economic Perspectives
against feedback. Moreover, even if feedback did imply some momentum, we can
also note that the random walk character of stock prices is really not fully supported
by the evidence anyway, and that in fact there has been more than a little momen-
tum to stock prices. Jegadeesh and Titman (1993) found that winning stocks, stocks
that showed exceptionally high six-month returns, beat losing stocks, stocks that
showed exceptionally low six-month returns, by 12 percent over the following year.
In contrast, over longer periods of time this momentum seems to reverse itself. De
Bondt and Thaler (1985) nd that over the period 1926 to 1982, stocks represented
on the Center for Research in Security Prices data set of the University of Chicago
whose returns had been in the top decile across rms over three years (thus,
“winner” stocks) tended to show negative cumulative returns in the succeeding
three years. They also found that “loser” stocks whose returns had been in the
bottom decile over the prior three years tended to show positive returns over the
succeeding three years. Thus, there is a tendency for stock prices to continue in the
same direction over intervals of six months to a year, but to reverse themselves over
longer intervals. Campbell, Lo and Mackinlay (1996) document this fact carefully.16
A pattern like this is certainly consistent with some combination of feedback effects
and other demand factors driving the stock market largely independently of
fundamentals.
16
Grinblatt and Han (2001) have argued that this tendency of stock prices to show momentum for a
while and then reverse themselves might be related to the phenomenon that investors tend to hold on
to losers and sell winners (Statman and Shefrin, 1985; Odean, 1998).
Robert J. Shiller 97
feedback traders in anticipation of the price increases they will cause (De Long,
Shleifer, Summers and Waldman, 1990b). In a related model, rational, expected-
utility-maximizing smart money never chooses to offset all of the effects of irrational
investors because they are rationally concerned about the risk generated by the
irrational investors and do not want to assume the risk that their completely
offsetting these other investors would entail (De Long, Shleifer, Summers and
Waldman, 1990b).17
Often, speculative bubbles appear to be common to investments of a certain
“style,” and the bubbles may not include many other investments. For example, the
stock market bubble that peaked in the year 2000 was strongest in tech stocks or
Nasdaq stocks. Barberis and Shleifer (2002) present a model in which feedback
traders’ demand for investments within a particular style is related to a distributed
lag on past returns of that style class. By their budget constraint, when feedback
traders are enticed by one style, they must move out of competing styles. The smart
money are rational utility maximizers. Barberis and Shleifer present a numerical
implementation of their model and nd that smart money did not fully offset the
effects of the feedback traders. Style classes go through periods of boom and bust
ampli ed by the feedback.
Goetzmann and Massa (1999) provided some direct evidence that it is reason-
able to suppose that there are two distinct classes of investors: feedback traders who
follow trends and the smart money who move the other way. Fidelity Investments
provided them with two years of daily account information for 91,000 investors in
a Standard and Poor’s 500 index fund. Goetzmann and Massa were able to sort
these investors into two groups based on how they react to daily price changes.
There were both momentum investors, who habitually bought more after prices
were rising, and contrarian investors, or smart money, who habitually sold after
prices were rising. Individual investors tended to stay as one or the other, rarely
shifted between the two categories.
Recent research has focused on an important obstacle to smart money’s
offsetting the effects of irrational investors. The smart money can always buy the
stock, but if the smart money no longer owns the stock and nds it dif cult to short
the stock, then the smart money may be unable to sell the stock. Some stocks could
be in a situation where zealots have bought into a stock so much that only zealots
own shares, and trade is only among zealots, and so the zealots alone determine the
price of the stock. The smart money who know that the stock is priced ridiculously
high may well use up all the easily available shortable shares and then will be
standing on the sidelines, unable to short more shares and pro t from their
knowledge. Miller (1977) pointed out this aw in the argument for market ef -
ciency, and his paper has been discussed ever since.
It seems incontrovertible that in some cases stocks have been held primarily by
zealots and that short sellers have found it very dif cult to short. One example is the
17
Shleifer and Summers (1990) present a nice summary of these themes in this journal.
98 Journal of Economic Perspectives
3Com sale of Palm near the peak of the stock market bubble (Lamont and Thaler,
2001). In March 2000, 3Com, a pro table provider of network systems and services,
sold to the general public via an initial public offering 5 percent of its subsidiary
Palm, a maker of handheld computers. 3Com announced at the same time that the
rest of Palm would follow later. The price that these rst Palm shares obtained in
the market was so high, when compared with the price of the 3Com shares, that if
one subtracts the implied value of the remaining 95 percent of Palm from the
3Com market value, one nds that the non-Palm part of 3Com had a negative value.
Since the worst possible price for 3Com after the Palm sale was completed would
be zero, there was thus a strong incentive for investors to short Palm and buy 3Com.
But, the interest cost of borrowing Palm shares reached 35 percent by July 2000,
putting a damper on the advantage to exploiting the mispricing.18 Even an investor
who knew for certain that the Palm shares would fall substantially may have been
unable to make a pro t from this knowledge. The zealots had won with Palm and
had control over its price, for the time being.
The Palm example is an unusual anomaly. Shorting stocks only rarely becomes
so costly. But the example proves the principle. The question is: How important are
obstacles to smart money’s selling in causing stocks to deviate from fundamental
value?
Of course, in reality, the distinction between zealots and smart money is not
always sharp. Instead, there are sometimes all gradations in between, especially
since the objective evidence about the fundamental value of individual stocks is
always somewhat ambiguous. If selling short is dif cult, a number of individual
stocks could become overpriced. It would also appear possible that major segments
of the stock market, say the Nasdaq in 1999, or even the entire stock market, could
wind up owned by, if not zealots, at least relatively optimistic people. Short-sale
constraints could be a fatal aw in the basic ef cient markets theory.
The problem with evaluating Miller’s (1977) theory that a lack of short selling
can cause nancial anomalies like overpricing and bubbles is that there has been
little or no data on which stocks are dif cult to short. There are long time series
data series on “short interest,” which is the total number of shares that are shorted.
Figlewski (1981) found that high levels of short interest for individual stocks
predicts low subsequent returns for them, a direction that would be predicted by
Miller’s theory. But the predictability was weak. On the other hand, differences in
short interest across stocks do not have an unambiguous connection with dif culty
of shorting. Stocks differ from each other in terms of the fraction of shares that are
in accounts that are shortable. Differences across stocks in short interest can also
re ect different demand for shorting for hedging needs. Thus, there is a signi cant
18
Put option prices on Palm also began to re ect the negative opinions and became so expensive that
the usual relation between options prices and stock price, the so-called “put-call parity,” failed to hold.
One must remember that options markets are derivative markets that clear separately from stock
markets, and overpriced puts have no direct impact on the supply and demand for stock unless
arbitrageurs can exploit the overpricing by shorting the stock.
From Efcient Markets Theory to Behavioral Finance 99
against the bene ts in terms of peace of mind to investors. Various alternatives were
considered or experimented with, including unlimited liability, unlimited propor-
tional liability (where individual investors in a company are limited to their pro-
portionate share of the company’s losses according to their share in the company),
and double liability (where individual investors are accountable for the capital
subscribed once again). By around 1830, it was apparent from experiments in New
York and surrounding states that investors found it very appealing that they could
put money down to buy a stock today, and from that day forward face no further
losses beyond what they already put down. It allowed them, once having purchased
a stock, to concentrate their emotions on the small probability of the stock doing
extremely well, rather on the small probability that someone would come after
them for more money. People have always been very attracted to lottery tickets, and
the invention of limited liability, Moss concludes, turned stock investments psycho-
logically into something a lot like lottery tickets. By the same theory, then, investors
will not nd shorting stocks very attractive.
Remarkably few shares are in fact sold short. According to New York Stock
Exchange data, from 1977 to 2000 year-end short interest ranged from 0.14 percent
to 1.91 percent of all shares. According to Dechow, Hutton, Muelbroek and Stone
(2001), less than 2 percent of all stocks had short interest greater than 5 percent of
shares outstanding 1976 –1983. Given the obviously large difference of opinion
about and difference of public attention to different stocks, it is hard to see how
such a small amount of short selling could offset the effect on stock price of the
extra demand of investors who develop an irrational xation on certain stocks.
Conclusion
The collaboration between nance and other social sciences that has become
known as behavioral nance has led to a profound deepening of our knowledge of
nancial markets. In judging the impact of behavioral nance to date, it is impor-
tant to apply the right standards. Of course, we do not expect such research to
provide a method to make a lot of money off of nancial market inef ciency very
fast and reliably. We should not expect market ef ciency to be so egregiously wrong
that immediate pro ts should be continually available. But market ef ciency can be
egregiously wrong in other senses. For example, ef cient markets theory may lead
to drastically incorrect interpretations of events such as major stock market
bubbles.
In his review of the literature on behavioral nance, Eugene Fama (1998)
found fault for two basic reasons. The rst was that the anomalies that were
discovered tended to appear to be as often underreaction by investors as overre-
action. The second was that the anomalies tended to disappear, either as time
passed or as methodology of the studies improved. His rst criticism re ects an
incorrect view of the psychological underpinnings of behavioral nance. Since
there is no fundamental psychological principle that people tend always to over-
102 Journal of Economic Perspectives
References
Andreassen, Paul and Stephen Kraus. 1988. “Style Investing.” NBER Working Paper No.
“Judgmental Prediction by Extrapolation.” Un- w8039.
published paper, Department of Psychology, Barsky, Robert and J. Bradford De Long.
Harvard University. 1993. “Why Does the Stock Market Fluctuate?”
Anonymous. 1637. Samen-spraeck tusschen Waer- Quarterly Journal of Economics. May, 108, pp. 291–
mondt ende Gaergoedt nopende de opkomste ende on- 311.
dergangh van ora. Haerlem: Adriaen Roman, Bem, Daryl J. 1965. “An Experimental Analysis
reprinted in Economisch Historisch Jaarboek. 1926, of Self-Persuasion.” Journal of Experimental Social
12:20 – 43, pp. 28 –29. Psychology. 1, pp.199 –218.
Barberis, Nicholas and Andrei Shleifer. 2000. Breeden, Douglas T. 1979. “An Intertemporal
From Efcient Markets Theory to Behavioral Finance 103
Asset Pricing Model with Stochastic Consump- kets: II.” Journal of Finance. December, 46:5,
tion and Investment Opportunities.” Journal of pp. 1575– 617.
Financial Economics. 7:2, pp. 265–96. Fama, Eugene F. 1998. “Market Ef ciency,
Campbell, John Y. 1991. “A Variance Decom- Long-Term Returns, and Behavioral Finance.”
position for Stock Returns.” Economic Journal. Journal of Financial Economics. September, 49:3,
March, 101:405, pp. 157–79. pp. 283–306.
Campbell, John Y. and Robert J. Shiller. 1988. Figlewski, Stephen. 1981. “The Informational
“Stock Prices, Earnings, and Expected Divi- Effects of Restrictions on Short Sales: Some Em-
dends.” Journal of Finance. July, 43:3, pp. 661–76. pirical Evidence.” Journal of Financial and Quan-
Campbell, John Y. and Robert J. Shiller. 1989. titative Analysis. November, 16:4, pp. 463–76.
“The Dividend-Price Ratio and Expectations of Figlewski, Stephen and Gwendolyn P. Webb.
Future Dividends and Discount Factors.” Review 1993. “Options, Short Sales, and Market Com-
of Financial Studies. 1:3, pp. 195–228. pleteness.” Journal of Finance. June, 48:2, pp.
Campbell, John Y., Andrew W. Lo and A. 761–77.
Craig MacKinlay. 1996. The Econometrics of Finan- Garber, Peter M. 1990. “Famous First Bub-
cial Markets. Princeton: Princeton University bles.” Journal of Economic Perspectives. Spring, 4:2,
Press. pp. 35–54.
Chen, Joseph, Harrison Hong and Jeremy C. Garber, Peter M. 2000. Famous First Bubbles.
Stein. 2000. “Breadth of Ownership and Stock Re- Cambridge: MIT Press.
turns.” Unpublished paper, Stanford University. Goetzmann, William N. and Massimo Massa.
Cochrane, John H. 2001. Asset Pricing. Prince- 1999. “Daily Momentum and Contrarian Behav-
ton: Princeton University Press. ior of Index Fund Investors.” Unpublished pa-
Cohen, Randolph, Christopher Polk and
per, Yale University.
Tuomo Vuolteenaho. 2002. “The Value Spread.”
Grinblatt, Mark and Bing Han. 2001. “The
Unpublished paper, Harvard Business School.
Disposition Effect and Momentum.” Unpub-
Forthcoming, Journal of Finance.
lished paper, Anderson School, UCLA.
Cole, Kevin, Jean Helwege and David Laster.
Grossman, Sanford J. and Robert J. Shiller.
1996. “Stock Market Valuation Indicators: Is
1981. “The Determinants of the Variability of
This Time Different?” Financial Analysts Journal.
Stock Market Prices.” American Economic Review.
May/June, pp. 56 – 64.
May, 71:2, pp. 222–27.
Daniel, Kent, David Hirshleifer and Avanidhar
Hansen, Lars P. and Ravi Jagannathan. 1991.
Subramanyam. 1998. “Investor Psychology and
“Implications of Security Market Data for Mod-
Security Market Under- and Overreactions.”
els of Dynamic Economies.” Journal of Political
Journal of Finance. December, 53:6, pp. 1839 –
885. Economy. April, 99:2, pp. 225– 62.
De Bondt, Werner F. M. and Richard H. Tha- Jarvis, Chris. 1999. “The Rise and Fall of the
ler. 1985.“Does the Stock Market Overreact?” Pyramid Schemes in Albania.” International
Journal of Finance. July, 40:3, pp. 793– 805. Monetary Fund Working Paper No. 99-98.
De Long, J. Bradford, Andrei Shleifer, Law- Jegadeesh, Narasimhan and Sheridan Titman.
rence H. Summers and Robert J. Waldmann. 1993. “Returns to Buying Winners and Selling
1990a. “Noise Trader Risk in Financial Markets.” Losers: Implications for Stock Market Ef -
Journal of Political Economy. August, 98:4, pp. ciency.” Journal of Finance. March, 48:1, pp.
703–38. 65–91.
De Long, J. Bradford, Andrei Shleifer, Law- Jones, Charles M. and Owen A. Lamont.
rence H. Summers and Robert J. Waldmann. 2001.“Short-Sale Constraints and Stock Re-
1990b. “Positive Feedback Investment Strategies turns.” NBER Working Paper No. 8494.
and Destabilizing Rational Speculation.” Journal Jung, Jeeman and Robert J. Shiller. 2002.
of Finance. June, 45:2, pp. 379 –95. “One Simple Test of Samuelson’s Dictum for the
Dechow, Patricia M., Amy P. Hutton, Lisa Stock Market.” NBER Working Paper No.
Muelbroek and Richard G. Stone. 2001. “Short- w9348.
Selling, Fundamental Analysis and Stock Re- Kahneman, Daniel and Amos Tversky. 1979.
turns.” Journal of Financial Economics. Forthcom- “Prospect Theory: An Analysis of Decision Un-
ing. der Risk.” Econometrica. March, 47:2, pp. 263–92.
Fama, Eugene F. 1970. “Ef cient Capital Mar- Lamont, Owen A. and Richard H. Thaler.
kets: A Review of Empirical Work.” Journal of 2001. “Can the Market Add and Subtract? Mis-
Finance. May, 25:2, pp. 383– 417. pricing in Stock Market Carve-Outs.” National
Fama, Eugene F. 1991. “Ef cient Capital Mar- Bureau of Economic Research Working Paper
104 Journal of Economic Perspectives
No. 8302, 2000. Forthcoming, Journal of Political Shefrin, Hersh. 2001. Behavioral Finance (The
Economy. International Library of Critical Writings in Financial
LeRoy, Stephen F. and Richard D. Porter. Economics), Volumes I through IV. Cheltenham,
1981. “The Present-Value Relation: Tests Based U.K.: Edward Elgar.
on Implied Variance Bounds.” Econometrica. May, Shiller, Robert J. 1982. “Consumption, Asset
49:3, pp. 97–113. Markets and Macroeconomic Fluctuations.”
Lucas, Robert E. 1978. “Asset Prices in an Carnegie-Rochester Conference Series on Public Policy.
Exchange Economy.” Econometrica. November, Autumn, 17, pp. 203–38.
46:6, pp. 1429 – 445. Shiller, Robert J. 1989. Market Volatility. Cam-
MacKay, Charles. 1996. “Memoirs of Extraor- bridge, Mass.: MIT Press.
dinary Popular Delusions,” 1841, in Extraordinary Shiller, Robert J. 1990a. “Speculative Prices
Popular Delusions and the Madness of Crowds and and Popular Models.” Journal of Economic Perspec-
Confusión de Confusiones. Martin Fridson, ed. New tives. Spring, 4:2, pp. 55– 65.
York: John Wiley. Shiller, Robert J. 1990b. “Market Volatility
Malkiel, Burton G. 1973. A Random Walk Down and Investor Behavior.” American Economic Re-
Wall Street. New York: W. W. Norton. view. May, 80:2, pp. 58 – 62.
Marimon, Ramon, Stephen E. Spear and Shiller, Robert J. 2000a. Irrational Exuberance.
Shyam Sunder. 1993. “Expectationally Driven Princeton, N.J.: Princeton University Press.
Market Volatility: An Experimental Study.” Jour- Shiller, Robert J. 2000b. “Measuring Bubble
nal of Economic Theory. October, 61:1, pp. 74 –103. Expectations and Investor Con dence.” Journal
Marsh, Terry A. and Robert C. Merton. 1986. of Psychology and Financial Markets. 1:1, pp.
“Dividend Variability and Variance Bounds Tests 49 – 60.
for the Rationality of Stock Market Prices.” Amer- Shiller, Robert J. 2002. “Bubbles, Human
ican Economic Review. June, 76:3, pp. 483–98. Judgment, and Expert Opinion.” Financial Ana-
McGrattan, Ellen R. and Edward C. Prescott. lysts Journal. 58, pp. 18 –26.
2001. “Taxes, Regulation, and Asset Prices.” Un- Shleifer, Andrei. 2000. Inefcient Markets. Ox-
published paper, Federal Reserve Bank of Min- ford: Oxford University Press.
neapolis. Shielfer, Andrei and Lawrence Summers.
Merton, Robert C. 1973. “An Intertemporal 1990. “The Noise-Trader Approach to Finance.”
Capital Asset Pricing Model.” Econometrica. Sep- Journal of Economic Perspectives. Spring, 4:2 pp.
tember, 41:5, pp. 867– 87. 19 –33.
Miller, Edward M. 1977. “Risk, Uncertainty Siegel, Jeremy J. 2002. Stocks for the Long Run.
and Divergence of Opinion.” Journal of Finance. Third Edition. New York: McGraw-Hill.
September, 32:4, pp. 1151–168. Smith, Vernon, Gerry Suchanek and Arlington
Moss, David A. 2002. When All Else Fails: Gov- Williams. 1988. “Bubbles, Crashes, and Endoge-
ernment as the Ultimate Risk Manager. Cambridge, nous Expectations in Experimental Spot Asset
Mass.: Harvard University Press. Markets.” Econometrica. September, 56:5, pp.
Odean, Terrance. 1998. “Are Investors Reluc- 1119 –153.
tant to Realize their Losses?” Journal of Finance. Statman, Meir and Hersh Shefrin. 1985. “The
October, 53:5, pp. 1775–798. Disposition to Sell Winners Too Early and Ride
Samuelson, Paul A. 1998. “Summing Up on Losers Too Long: Theory and Evidence.” Journal
Business Cycles: Opening Address,” in Beyond of Finance. July, 40:3, pp. 777–90.
Shocks: What Causes Business Cycles. Jeffrey C. Fu- Thaler, Richard. 2003. Advances in Behavioral
hrer and Scott Schuh, eds. Boston: Federal Re- Finance II. New York: Russell Sage.
serve Bank of Boston, pp. 33–36. Tversky, Amos and Daniel Kahneman. 1974.
Scherbina, Anna. 2000. “Stock Prices and Dif- “Judgment under Uncertainty: Heuristics and
ferences in Opinion: Empirical Evidence that Biases.” Science. 185:4157, pp. 1124 –31.
Prices Re ect Optimism.” Unpublished paper, Vuolteenaho, Tuomo. “What Drives Firm-
Northwestern University. Level Stock Returns?” Journal of Finance. Febru-
Shefrin, Hersh. 2000. Beyond Greed and Fear: ary, 57:1, pp. 233– 64.
Understanding Behavioral Finance and the Psychol- West, Kenneth D. 1988. “Dividend Innova-
ogy of Investing. Boston, Mass.: Harvard Business tions and Stock Price Volatility.” Econometrica.
School Press. January, 56:1, pp. 36 –71.