The Case Study What It Is and What It Does
The Case Study What It Is and What It Does
COMPARATIVE
POLITICS
Edited by
C A R L E SB O I X
qnd
S U S A NC . S T O K E S \ F
f l
n;1 rl
, U j T
io*t
OXTORD
\INIVERSITY PRESS
c H A P T E R 4
T H E C A S ES T U D Y :
WHAT IT IS AND
WHAT IT DOES
JOHN GERRING
Two centuries after Le Play's pioneering work, the various disciplines of the social
sciences continue to produce a vast number of case studies, many of which have
entered the pantheon of classicworks. fudging by the large volume of recent scholarly
output the case study research design plays a central role in anthropology, arche-
ology, business,education, history, medicine, political science,psychology, social
work, and sociology (Gerring 2oo7a, ch. r). Even in economics and political econ-
omy, fields not usually noted for their receptivenessto case-basedwork, there has
been something of a renaissance.Recent studies of economic growth have turned to
casestudies of unusual countries such as Botswana,Korea, and Mauritius.r Debates
on the relationship between trade and growth and the IMF and growth have likewise
combined cross-nationalregressionevidencewith in-depth (quantitative and quali-
tative) caseanalysis(srinivasan and Bhagwati ry99; vreeland zoo3). work on ethnic
politics and ethnic conflict has exploited within-country variation or small-N cross-
country comparisons (Abadie and Gardeazabal zoo3; chandra zoo4; posner zoo4).
By the standard of praxis, therefore, it would appear that the method of the case
study is solidly ensconced, perhaps even thriving. Arguably, we are witnessing a
movement away from a variable-centered approach to causality in the social sciences
and towards a case-basedapproach.
I Acemoglu,
lohnson, and Robinson (zoo3), chernoff and warner (zooz), Rodrik (zoo3). See also
studies focused on particular firms or regions, e.g. Coase 1959,2ooo.
THE CASE STUDY 91
2 ForgeneraldiscussionofthefollowingpointsseeAchen(1986),Freedman(r99r),Kittel(rggg,zooS),
Kittel and Winner (zoo5), Manski (1993),Winship and Morgan (rqqq), Winship and Sobel (zoo4).
92 JOHN GERRING
Bear Braumoeller, Gary Goertz, |ack Levy, and Harvey starr have defended the
importance of necessary-condition arguments in the social sciences,and have
shown how these arguments might be analyzed.(Braumoeller and Goertz 2ooo;
Goertz zoo3; Goertz and Lely forthcoming; Goertz and Starr zoo3). |ames Fearon,
Ned Lebow, Philip Tetlock, and others have explored the role of counterfactual
thought experiments in the analysis of individual case histories (Fearon r99r;
Lebow zooo; Tetlock and Belkin 1996). colin Elman has developed a typological
method of analyzing cases(Elman zoo5). David collier,Iack Goldstone, peter Hall,
|ames Mahoney, and Dietrich Rueschemeyerhave worked to revitalize the compara-
tive and comparative-historical methods (collier 1993;Goldstone r997i Hall zoo3;
Mahoney and Rueschemeyerzoo3). And scores of researchershave attacked the
problem of how to convert the relevant details of a temporally constructed narrative
into standardized formats so that casescan be meaningfully compared (Abell r9g7,
zoo4;Abbotttggzi Buthe zooz; Griffin 1993).while not all of these techniques are,
strictly speaking,casestudy techniques-since they sometimes involve a large num-
ber of cases-they do move us closer to a case-basedunderstanding of causation
insofar as they preserve the texture and detail of individual cases,features that are
often lost in large-N cross-caseanalysis.
A fourth factor concerns the recent marriage of rational choice tools with case
study analysis,sometimes referred to as an "analytic narrative" (Bates et al. r99g).
whether the technique is qualitative or quantitative, scholars equipped with eco-
nomic models are turning, increasingly,to casestudiesin order to test the theoretical
predictions of a general model, investigatecausal mechanisms, and/or explain the
featuresofa key case.
Finally, epistemological shifts in recent decadeshave enhanced the attractivenessof
the casestudy format. The "positivist" model of explanation, which informed work
in the social sciencesthrough most of the twentieth century, tended to downplay the
importance of causal mechanisms in the analysis of causal relations. Famously,
Milton Friedman (1953)argued that the only criterion of a model was to be found
in its accurateprediction of outcomes. The verisimilitude of the model, its accurate
depiction of reality, was besidethe point. In recent years,this explanatory trope has
come under challengefrom "realists," who claim (among other things) that causal
analysis should pay close attention to causal mechanisms (e.g. Bunge ry97; LittIe
1998).within political scienceand sociology, the identification of a specific mech-
anism-a causal pathway-has come to be seen as integral to causal analysis,
regardless of whether the model in question is formal or informal or whether the
evidenceis qualitative or quantitative (Achen zooz; Elster 1998;Georgeand Bennett
zoo5; Hedstrom and swedberg 1998).Given this new-found (or at least newly self-
conscious) interest in mechanisms,it is not surprising that social scientistswould
turn to casestudies as a mode of causalinvestigation.
For all the reasonsstated above, one might intuit that social scienceis moving
towards a case-basedunderstanding of causalrelations. Yet, this movement, insofar
as it exists, has scarcely been acknowledged, and would certainly be challenged by
many close observers-including some of those cited in the foregoing passages.
THE CASE STUDY 93
The fact is that the case study research design is still viewed by most methodol-
ogists with extreme circumspection. A work that focuses its attention on a single
"mere"
example of a broader phenomenon is apt to be described as a casestudy, and
is often identified with loosely framed and non-generalizabletheories, biased case
selection, informal and undisciplined researchdesigns,weak empirical leverage (too
many variables and too few cases),subjective conclusions, non-replicability, and
causal determinism. To some, the term case study is an ambiguous designation
"inferential
covering a multitude of felonies."3
The quasi-mystical qualities associatedwith the case study persist to this day. In
"scientists"
the field of psychology, a gulf separates engaged in cross-caseresearch
"practitioners"
and engaged in clinical research, usually focused on several cases
(Hersen and Barlow t976, zr). In the fields of political scienceand sociology, case
"soft"
study researchersare acknowledged to be on the side of hard disciplines. And
across fields, the persisting case study orientations of anthropology, education, law
social work, and various other fields and subfieldsrelegatethem to the non-rigorous,
non-systematic,non-scientific, non-positivist end of the academicspectrum.
The methodological status of the casestudy is still, officially, suspect. Even among
its defenders there is confusion over the virtues and vices of this ambiguous research
design. Practitioners continue to ply their trade but have difficulty articulating what
it is they are doing, methodologically speaking.The casestudy survivesin a curious
methodological limbo.
This leads to a paradox: although much of what we know about the empirical
world has been generatedby casestudies and casestudies continue to constitute a
large proportion of work generatedby the social sciencedisciplines, the casestudy
method is poorly understood.
How can we make senseof the profound disjuncture between the acknowledged
contributions of this genre to the various disciplines of social scienceand its mal-
igned status within these disciplines? If casestudies are methodologically flawed, why
do they persist?Should they be rehabilitated, or suppressed?How fruitful ls this style
of research?
In this chapter, I provide a reconstructed definition ofthe casestudy approach to
researchwith special emphasis on comparative politics, a field that has been closely
identified with this method since its birth. Basedon this definition, I then explore a
seriesofcontrasts between casestudy and cross-casestudy research.Thesecontrasts
are intended to illuminate the characteristic strengths and weaklesses ("affinities")
of these tvvo researchdesigns,not to vindicate one or the other. The effort of this
chapter is to understand this persisting methodological debate as a matter of
tradeoffs. Case studies and cross-casestudies explore the world in different ways.
Yet, properly constituted, there is no reason that case study results cannot be
3 Achen and Snidal (1989: 16o). See also Geddes (r99o, zoo3), Goldthorpe (1997), King, Keohane, and
Verba (rq9+), Lieberson (985: ro7-r5, t992, 1994), Lijphart l97t 6g-4), Odell (zoo4), Sekhon (zoo4),
Smelser G9n: 45,57). It should be noted that these rwiters, while critical of the casestudy format, are not
necessarily opposed to case studies per se (that is to say,they should not be classified as opponentsof the
casestudy).
94 JOHN GERRING
The key term of this chapter is, admittedly, a definitional morass. To refer to a work
"case
as a study" might mean: that its method is qualitative, small-N; that the
researchis holistic, thick (a more or lesscomprehensiveexamination of a phenom-
enon); that it utilizes a particular tyryeof evidence(e.g. ethnographic, clinical, non-
experimental,non-survey based,participant observation,processtracing, historical,
textual, or field research);that its method of evidence gathering is naturalistic (a
"real-life
context"); that the researchinvestigatesthe properties of a single observa-
tion; or that the research investigatesthe properties of a single phenomenon'
instance, or example. Evidently, researchershave many things in mind when they
talk about casestudy research.Confusion is compounded by the existence of a large
number of near-synonyms-single unit, single subject,single case,N:1, casebased,
casecontrol, casehistory, casemethod, caserecord, casework, clinical research,and
so forth. As a result of this profusion of terms and meanings, proponents and
opponents of the casestudy marshal a wide range of arguments but do not seem
any closer to agreement than when this debate was first broached severaldecadesago.
Can we reconstruct this concept in a clearer, more productive fashion? In order to
do so we must understand how the key terms-case and case study-are situated
within a neighborhood of related terms. In this crowded semantic field, each term is
defined in relation to others.And in the context of a specificwork or researchterrain,
they all take their meaning from a specificinference.(The readershould bear in mind
that any change in the inference, and the meaning of all the key terms will probably
change.)My attempt here will be to provide a single,determinate, definition of these
key terms. Of course, researchersmay choose to define these terms in many different
ways. However, for purposes of methodological discussion it is helpful to enforce a
uniform vocabulary.
Let us stipulate that a caseconnotes a spatially delimited phenomenon (a unit)
observedat a single point in time or over some period of time. It comprisesthe sort
of phenomena that an inference attempts to explain. Thus, in a study that attempts to
explain certain featuresofnation-states, casesare comprised ofnation-states (across
some temporal frame). In a study that attempts to explain the behavior of individ-
uals, individuals comprise the cases.And so forth. Each casemay provide a single
observation or multiple (within-case) observations.
For students of comparative politics, the archetlpal caseis the dominant political
unit of our time, the nation-state. However, the study of smaller social and political
THE CASE STUDY 95
I
f
96 IOHN GERRING
A sample consists of whatever casesare subjected to formal analysis; they are the
immediate subject of a study or casestudy. (Confusingly, the sample may also refer to
the observations under study, and will be so used at various points in this narrative.
But at present, we treat the sample as consisting of cases.)Technically, one might say
that in a casestudy the sample consists of the case or casesthat are subjected to
intensive study. However, usually when one uses the term sample one is implying
"sample-based
that the number of casesis rather large. Thus, work" will be under-
stood as referring to large-N cross-casemethods-the opposite of casestudy work.
Again, the only feature distinguishing the casestudy format from a sample-based(or
"cross-case")
researchdesign is the number of casesfalling within the sample-one
or a few versus many. Casestudies, like large-N samples,seekto represent, in all ways
relevant to the proposition at hand, a population of cases.A seriesof casestudies
might therefore be referred to as a sample if they are relatively brief and relatively
numerous; it is a matter of emphasisand of degree.The more casestudies one has,
the less intensively each one is studied, and the more confident one is in their
representativeness (of some broader population), the more likely one is to describe
them as a sample rather than a seriesof casestudies.For practical reasons-unless,
that is, a study is extraordinarily long-the case study research format is usually
limited to a dozen casesor less.A single caseis not at all unusual.
The sample restswithin a population of casesto which a given proposition refers.
The population of an inference is thus equivalent to the breadth or scope of a
proposition. (I use the terms proposition, hypothesis,inference, and argument inler-
changeably.) Note that most samples are not exhaustive; hence the use of the term
sample, referring to sampling from a population. Occasionally, however, the sample
equalsthe population ofan inference;all potential casesare studied.
For those familiar with the rectangular form of a dataset it may be helpful to
conceptualize observations as rows, variables as columns, and casesas either groups
of observations or individual observations.
forth as a minimal definition of the topic.a I now proceed to discuss the non-
definitional attributes of the casestudy-attributes that are often, but not invariably,
associatedwith the casestudy method. These will be understood as methodological
affinities flowing from a minimal definition of the concept.s
The case study research design exhibits characteristic strengths and weaknesses
relative to its large-N cross-casecousin. Thesetradeoffs derive, first ofall, from basic
research goals such as (r) whether the study is oriented toward hypothesis gener-
ating or hypothesis testing, (z) whether internal or external validity is prioritized,
(3) whether insight into causal mechanisms or causal effects is more valuable,
and (+) whether the scope of the causal inference is deep or broad. These tradeoffs
also hinge on the shapeof the empirical universe,i.e. (i) whether the population of
casesunder study is heterogeneousor homogeneous, (6) whether the causal rela-
tionship of interest is strong or weak, (Z) whether useful variation on key parameters
within that population is rare or common, and (A) whether available data are
concentratedor dispersed.
Along each of these dimensions, case study research has an affrnity for the
first factor and cross-caseresearchhas an affinity for the second,as summarized in
Table 4.r. To clari$., these tradeoffs represent methodological ffinities, not invariant
laws. Exceptions can be found to each one. Even so, these general tendencies are often
Affinity
Casestudy study
Cross-case
goals
Research
1. Hypothesis Generating Testing
2. Validity lnternal External
insight
3. Causal Mechanisms Effects
4. Scopeof proposition Deep Broad
Empiricalfactors
5. Population
of cases Heterogeneous Homegeneous
6. Causal
strength Strong Weak
7. Usefulvariation Rare Common
L Dataavailability Concentrated Dispersed
a My intention is to include only those attributes commonly associated with the case study method
that are always rmplied by our use of the term, excluding those attributes that are sometimes violated by
"ethnography"
standard usage. Thus, I chose not to include as a defining feature ofthe case study, since
many case studies (so called) are not ethnographic. For further discussion of minimal definitions see
Gerring (zoor, ch. 4), Gerring and Barresi (zoo3), Sartori (1976).
s These additional attributes might also be understood as comprising an ideal-type ("maximal")
definition ofthe topic (Gerring zoor, ch.4; Gerring and Barresi zoo3).
98 IOHN GERRING
noted in case study research and have been reproduced in multiple disciplines and
subdisciplines over the course of many decades.
It should be stressedthat each of these tradeoffs carries a ceteris paribus caveat.
Case studies are more useful for generating new hypotheses, all other things
being equal. The reader must bear in mind that many additional factors also
rightly influence a writer's choice of research design, and they may lean in the
other direction. Ceteris are not alwaysparibus. One should not jump to conclusions
about the research design appropriate to a given setting without considering
the entire range of issues involved-some of which may be more important than
others.
6 Popper (1969).
7 Karl Popper (quoted in King, Keohane, and Verba ry94, r4) writes: "there is no such thing as a logical
'an
method of having new ideas... Discovery contains irrational element,' or a'creative intuition."' One
recent collection ofessays and interviews takes new ideas as its special focus (Munck and Snyder zooT),
though it may be doubted whether there are generalizable results.
8 Gerring (zoor, ch. ro). The tradeoffbetween these two styles of research is implicit in Achen and
Snidal (rgSg), who criticize the case study for its deiicits in the latter genre but also acknowledge the
benefits of the case study along the former dimension (rq8q, 16z-8). Reichenbach also distinguished
"context "context
betlveen a ofdiscovery," and a ofjustification." Likewise, Peirce's concept of abduction
recognizesthe importance ofa generativecomponent in science.
THE CASE STUDY 99
s Bonoma (1985:r99). Some of the following examples are discussed in Patton (zooz, z4).
ro North and Weingast (rq8q); North and Thomas (1973).
rr Vandenbroucke (zoor,
33r).
12 For discussion of this tradeoffin the context of economic growth theory seeTemple (1999,oo).
Geddes (zoo3), King, Keohane, and Verba (1994),Popper (ty4lt969).
Ragin (1992).
100 IOHN GERRING
intervention is necessaryin the course of defining a case study topic, for there is a
"subjectivity"
great deal of evidentiary leeway. Yet, the of casestudy research allows
for the generation of a great number of hypotheses, insights that might not be
apparent to the cross-case researcher who works with a thinner set of empirical
data acrossa large number of casesand with a more determinate (fixed) definition of
cases,variables, and outcomes. It is the very fuzziness of casestudies that grants them
an advantage in researchat the exploratory stage,for the single-casestudy allows one
to test a multitude of hlpotheses in a rough-and-ready way. Nor is this an entirely
"conjectural"
process. The relationships discovered among different elements of a
single casehave a prima facie causalconnection: they are all at the sceneof the crime.
This is revelatory when one is at an early stageof analysis,for at that point there is no
identifiable suspect and the crime itself may be difficult to discern. The fact that A, B
and C are present at the expected times and places (relative to some outcome of
interest) is sufficient to establish them as independent variables. Proximal evidence is
"plausibility
all that is required. Hence, the common identification of casestudies as
"pilot "heuristic "exploratory" "theory-building"
probes," studies," studies," and
exercises.rs
A large-N cross-study, by contrast, generally allows for the testing of only a few
hypotheses but does so with a somewhat greater degree of confidence' as is appro-
priate to work whose primary purpose is to test an extant theory. There is less room
for authorial intervention because evidence gathered from a cross-case research
design can be interpreted in a limited number of ways. It is therefore more reliable.
Another way of stating the point is to say that while casestudies lean toward \pe r
errors (falsely rejecting the null hypothesis), cross-casestudies lean toward Type z
errors (failing to reject the false null hlpothesis). This explains why casestudies are
more likely to be paradigm generating,while cross-casestudiestoil in the prosaic but
highly structured field of normal science.
I do not mean to suggest that case studies never serve to confirm or disconfirm
hpotheses. Evidence drawn from a single case may falsifu a necessaryor sufficient
hlpothesis, as discussed below Additionally, case studies are often useful for the
purpose of elucidating causalmechanisms,and this obviously affectsthe plausibility
of an X/Y relationship. However, general theories rarely offer the kind of detailed and
determinate predictions on within-case variation that would allow one to reject a
hypothesis through pattern matching (without additional cross-caseevidence).
"crucial"
Theory testing is not the casestudy's strong suit. The selection of casesis
at pains to overcome the fact that the cross-caseN is minimal. Thus, one is unlikely
to reject a hypothesis, or to consider it definitively proved, on the basis of the study of
a single case.
Harry Eckstein himself acknowledges that his argument for casestudies as a form
of theory confirmation is largely hypothetical. At the time of writing, severaldecades
ago, he could not point to any social science study where a crucial case study had
performed the heroic role assignedto it.16I suspectthat this is still more or lesstrue.
"We
Indeed, it is true even of experimental case studies in the natural sciences. must
recognize," note Donald Campbell and Julian Stanley,
A single case study is still a single shot-a single example of a larger phenomenon.
The tradeoff between hlpothesis generating and hypothesis testing helps us to
reconcile the enthusiasm of case study researchers and the skepticism of case study
critics. They are both right, for the looseness ofcase study research is a boon to new
conceptualizations just as it is a bane to falsification.
Questions of validity are often distinguished according to those that are internql to
the sample under study and those that are external (i.e. applying to a broader-
unstudied-population). Cross-caseresearchis always more representativeof the
population of interestthan casestudy research,so long as some sensibleprocedure of
case selection is followed (presumably some version of random sampling). Case
study research suffers problems of representativenessbecause it includes, by defini-
tion, only a small number of casesof some more generalphenomenon. Are the men
chosen by Robert Lane typical of white, immigrant, working-class, American
males?l8Is Middletown representativeof other cities in America?le These sorts of
questions forever haunt case study research.This means that case study research is
generally weaker with respect to external validity than its cross-casecousin.
The corresponding virtue of case study research is its internal validity. Often,
though not invariably, it is easier to establish the veracity of a causal relationship
pertaining to a single case(or a small number of cases)than for a larger set of cases.
Casestudy researcherssharethe bias of experimentalists in this regard: they tend to be
17 Campbell and Stanley (rq6:: :). r8 Lane (1962). re Lynd and Lynd (tgzgltgS6).
JOHN GERRING
One of the advantages of the in-depth interview over the masssurveyis that it recordsmore
fully how subjectsarrive at their opinions. While we cannot actuallyobservethe underlying
mental processthat gives rise to their responses,we can witness many of its outward
manifestations.The way subjectsramble,hesitate,stumble,and meanderas they formulate
their answerstips us offto how they arethinking and reasoningthrough politicalissues.26
Similarly, the investigation of a single casemay allow one to test the causal implica-
tions of a theory, thus providing corroborating evidence for a causal argument. This
is sometimes referred to as pattern matching (Campbell rg88).
Dietrich Rueschemeyerand Iohn Stephens offer an example of how an examin-
ation of causal mechanisms may call into question a general theory based on cross-
case evidence. The thesis of interest concerns the role of British colonialism in
fostering democrary among postcolonial regimes.In particular, the authors investi-
"the
gate the diffusion hlpothesis, that democracy was enhanced by transfer of
British governmental and representative institutions and the tutoring of the colonial
Whether or not Rueschemeyer and Stephens are correct in their conclusions need not
concern us here. What is critical, however, is that any attempt to deal with this
question of causal mechanisms is heavily reliant on evidence drawn from case
studies. In this instance, as in many others, the question of causal pathways is simply
too diffrcult, requiring too many poorly measured or unmeasurable variables, to
allow for accuratecross-sectionalanalysis.28
To be sure, causal mechanisms do not always require explicit attention. They may
be quite obvious. And in other circumstances,they may be amenableto cross-case
investigation. For example, a sizeableliterature addressesthe causal relationship
between trade openness and the welfare state. The usual empirical finding is that
more open economies are associatedwith higher social welfare spending. The
question then becomeswhy such a robust correlation exists.What are the plausible
interconnections between trade opennessand social welfare spending?One possible
causalpath, suggestedby David Cameron,2eis that increasedtrade opennessleadsto
greater domestic economic vulnerability to external shocks (due, for instance, to
changing terms of trade). If so, one should find a robust correlation between annual
variations in a country's terms of trade (a measure of economic vulnerability) and
social welfare spending. As it happens, the correlation is not robust and this leads
some commentators to doubt whether the putative causalmechanism proposed by
David Cameron and many others is actually at work.3o Thus, in instances where
an intervening variable can be effectively operationalized across a large sample of
casesit may be possible to test causal mechanismswithout resorting to casestudy
investigation.3r
27 Rueschemeyerand Stephens(rggz,6z).
28 Other good examples ofwithin-case research that shed light on a broader theory can be found in
Martin (1992);Martin and Swank (zoo4); Thies (zoor); Young (1999).
2e Cameron (1978).
:o Alesina, Glaeser, and Sacerdote (zoor).
3r Foradditionalexamplesofthisnature,seeFeng(zoo3);PapyrakisandGerlagh(zoo3);Ross(zoot).
THE CASE STUDY 105
Even so, the opportunities for investigating causal pathways are generally more
apparent in a case study format. Consider the contrast between formulating a
siandardized survey for a large group of respondentsand formulating an in-depth
interview with a single subject or a small set of subjects, such as that undertaken by
Dennis Chong in the previous example. In the latter situation, the researcheris able
to probe into details that would be impossible to delve into, let alone anticipate, in a
standardized survey. She may also be in a better position to make judgements as to
the veracity and reliability of the respondent. Tiacing causal mechanisms is about
cultivating sensitivity to a local context. Often, these local contexts are essential to
cross-casetesting. Yet, the same factors that render casestudies useful for micro-level
investigation also make them less useful for measuring mean (average) causal effects.
It is a classic tradeoff.
6 Scops oF PRoPosITIoN:
Dsnp vERSUSBnoen
The utility of a casestudy mode of analysisis in part a product of the scope of the
causal argument that a researcherwishes to prove or demonstrate. Arguments that
strive for great breadth are usually in greater need of cross-caseevidence; causal
argumentsrestrictedto a small set of casescan more plausibly subsiston the basisof a
single-casestudy. The extensive/intensive tradeoff is fairly commonsensical.32A case
study of France probably offers more useful evidence for an argument about Europe
than for an argument about the whole world. Propositional breadth and evidentiary
breadth generally go hand in hand.
Granted, there are a variety of ways in which single-casestudies can credibly claim
to provide evidencefor causalpropositions of broad reach-e.g. by choosing cases
that are especiallyrepresentativeof the phenomenon under study ("typical" cases)or
by choosing casesthat representthe most difficult scenario for a given proposition
and are thus biased against the attainment of certain results ("crucial" cases).Even
so, a proposition with a narrow scopeis more conducive to casestudy analysisthan a
proposition with a broad purview, all other things being equal. The breadth of an
inference thus constitutes one factor, among many, in determining the utility of the
case study mode of analysis. This is reflected in the hesitancy of many case study
researchersto invoke determinate causal propositions with great reach -"covering
laws," in the idiom of philosophy of science.
By the same token, one of the primary virtues of the case study method is the
depth of analysis that it offers. One may think of depth as referring to the detail,
32 Eckstein (t975,o2).
106 JOHN GERRING
The choice between a casestudy and cross-casestyle ofanalysis is driven not only by
the goals of the researcher,as reviewed above, but also by the shape of the empirical
universe that the researcheris attempting to understand. Consider, for starters, that
the logic of cross-caseanalysisis premised on some degree of cross-unit compar-
ability (unit homogeneity). Casesmust be similar to each other in whatever respects
might affect the causal relationship that the writer is investigating, or such differences
"apples
must be controlled for. Uncontrolled heterogeneity means that casesare and
oranges;"one cannot learn anything about underlying causal processes by comparing
their histories. The underlying factors of interest mean different things in dififerent
contexts (conceptual stretching) or the X/Y relationship of interest is different in
different contexts (unit heterogeneity).
Case study researchersare often suspicious of large-sample research, which,
they suspect, contains heterogeneous caseswhose differences cannot easily be mod-
"Variable-oriented" "homogenizing
eled. researchis said to involve unrealistic as-
sumptions."37In the field of international relations, for example, it is common
to classify cases according to whether they are deterrence failures or deterrence
"the
successes.However, Alexander George and Richard Smoke point out that
separation of the dependent variable into only two subclasses,deterrence success
and deterrence failure," neglectsthe great variety of ways in which deterrence can fail.
Deterrence,in their view has many independent causalpaths (causal equifinality),
and these paths may be obscured when a study lumps heterogeneous casesinto a
common sample.38
Another example, drawn from clinical work in psychology, concerns heterogeneity
among a sample of individuals. Michel Hersen and David Barlow explain:
37 Ragin (zooo:35). Seealso Abbott (rg9o); Bendix (rq6:); Meehl (rgS+);Przeworski and Teune (r97o,
8-9); Ragin (t987; zoo4, n4); Znaniecki (rq:4, zlo-t).
38 George and Smoke (tgl+, St+).
3e Hersen and Barlow (tgl6, rt).
ro8 IOHN GERRING
ao Shalev (1998).
ar To be sure, if adjacent cases are identical" the phenomenon of interest is invariant then the
researcher gains nothing at all by studying more examples of a phenomenon, for the results obtained
with the first case will simply be replicated. However, virtually all phenomena of interest to social
scientistshave some degreeofheterogeneity (casesare not identical), some stochasticelement. Thus, the
theoretical possibility of identical, invariant casesis rarely met in practice.
THE CASE STUDY 109
are long-standing disputes about whether it makes sense to lump poor and rich
societiestogether in a singlesample,or whether theseconstitute distinct populations.
"developed" "undeveloped")
Again, the borderline betweenpoor and rich (or and is
blurry, and the notion of hiving off one from the other for separate analysis
questionable, and unresolvable on purely empirical grounds. There is no safe (or
"conservative")
way to proceed. A final sticking point concerns the cultural/historical
component of social phenomena. Many case study researchersfeel that to compare
societies with vastly different cultures and historical trajectories is meaningless.
Yet, many cross-case researchers feel that to restrict one's analltic focus to a
single cultural or geographic region is highly arbitrary, and equally meaningless. In
these situations, it is evidently the choice of the researcherhow to understand case
homogeneity/heterogeneityacrossthe potential populations of an inference.Where
do like casesend and unlike casesbegin?
Becausethis issue is not, strictly speaking, empirical it may be referred to as an
ontological element of researchdesign. An ontology is a vision of the world as it really
is, a more or lesscoherent set of assumptionsabout how the world works, a research
Weltanschauung analogous to a Kuhnian paradigm.a2 While it seems odd to bring
ontological issuesinto a discussionof social sciencemethodology it may be granted
that social science research is not a purely empirical endeavor. What one finds
is contingent upon what one looks fot and what one looks for is to some extent
contingent upon what one expectsto find. Stereotypically, casestudy researcherstend
"lumpy"
to have a vision of the world; they seecountries, communities, and persons
as highly individualized phenomena. Cross-caseresearchers,by contrast, have a less
dif[erentiated vision of the world; they are more likely to believe that things are pretty
much the same everywhere, at least as respects basic causal processes.These basic
assumptions, or ontologies, drive many of the choices made by researcherswhen
scoping out appropriate ground for research.
a3 Dion (1998).
aa Almond (1956);Bentley Q9o8lt967); Lipset (196o11963); Truman (r95r).
+s Lijphart (1968); see also Lijphart (rg6g). For additional examples of case studies disconfirming
general propositions of a deterministic nature see Allen (1961); Lipset, Trow, and Coleman (1956);
Njolstad (r99o); discussion in Rogowski (rSss).
a6 Znaniecki (1934).Seealso discussion in Robinson (r95r).
THE CASE STUDY lll
Noq let us now consider an example drawn from the other extreme. There is
generally assumed to be a weak relationship between regime type and economic
performance. Democracy, if it has any effect on economic growth at all, probably has
only a slight effect over the near-to-medium term, and this effect is probably
characterizedby many exceptions (casesthat do not fit the general pattern). This is
because many things other than democracy affect a country's growth performance
and because there may be a significant stochastic component in economic growth
(factors that cannot be modeled in a generalway). Becauseof the diffrrse nature of
this relationship it will probably be difficult to gain insight by looking at a single case.
Weak relationships are difficult to observe in one instance. Note that even if there
seems to be a strong relationship between democracy and economic growth in a
given country it may be questioned whether this caseis actually typical of the larger
population of interest, given that we have already stipulated that the typical magni-
tude of this relationship is diminutive and irregular. Of course, the weakness of
democracy's presumed relationship to growth is also a handicap in cross-case
analysis.A good deal of criticism has been directed toward studies of this type,
where findings are rarely robust.aTEven so, it seemsclear that if there ls a relationship
between democrary and growth it is more likely to be perceptible in a large cross-case
setting. The positive hypothesis, as well as the null hypothesis, is better approached in
a sample rather than in a case.
When analyzing causal relationships we must be concerned not onlywith the strength
of an X/Y relationship but alsowith the distribution of evidenceacrossavailablecases.
Specifically, we must be concerned with the distribution of useful variation-under-
stood asvariation (temporal or spatial) on relevantparametersthat might yield clues
about a causal relationship. It follows that where useful variation is rare-i.e. limited
to a few cases-the casestudy format recommends itself. Where, on the other hand,
useful variation is common, a cross-casemethod of analysismay be more defensible.
Consider a phenomenon like social revolution, an outcome that occursvery rarely.
The empirical distribution on this variable, if we count each country-year as an
observation,consistsof thousands of non-revolutions (o) and just a few revolutions
"revolutionary"
(r). Intuitively, it seemsclear that the few casesare of great interest.
We need to know as much as possible about them, for they exemplify all the variation
that we have at our disposal.In this circumstance,a casestudy mode of analysisis
47 Kittel (t999, zoo5); Kittel and Winner (zoo5); Levine and Renelt (rgsz); Temple (r9gq).
Lt2 JOHN GERRING
I have left the most prosaic factor for last. Sometimes,one's choice of researchdesign
is driven by the quality and quantity of information that is currently available, or
a8 Consider the following topics and their-extremely rare-instances of variation: early industrial-
ization (England, the Netherlands), fascism (Germany, Italy), the use ofnuclear weapons (United States),
world war (WWI, WWII), single non-transferable vote electoral systems (Jordan, Taiwan, Vanuatu,
pre-reform fapan), electoral system reforms within established democracies (France, Italy, Japan, New
"rareness"
Zealand, Thailand). The problem of is less common where parameters are scalar, rather than
dichotomous. But there are still plenty of examples of phenomena whose distributions are skewed by
a few outliers, e.g. population (China, India), personal wealth (Bill Gates, Warren Buffett), ethnic
heterogeneity (Papua New Guinea).
THE CASE STUDY r13
although our spendingand design numbers are of good quality, there are some missing
observationsand, evenwith all the observations,it is difficult to reducethe variety of elderly
subsidiesto one or two numbers.For this reason,casestudiesare an importantpart of our
analysis,since those studies do not require numbers that are comparableacrossa large
number of countries.Our casestudy analysisutilizes data from a variety of country-specific
"socialsecurity"or "democracy"to one singlenumber.sl
sources,sowe do not haveto reduce
ae Of course, what we know about the potential casesis not independent of the underlying reality; it is,
nonetheless, not entirely dependent on that reality.
50 Gerring (zoo7b) st Muliigan, Gil, and Sala-i-Martin (zooz, r3).
rr4 JOHN GERRING
other relevant concepts then our state ofknowledge about the subject is changed, and
a cross-caseresearchdesign is rendered more plausible.
Importantly, the state of evidence on a topic is never entirely fixed. Investigators
may gather additional data, recode existing data, or discover new repositories of data.
Thus, when discussing the question of evidence one must consider the quality and
quantity of evidence that couldbe gathered on a given question, given sufficient time
and resources. Here it is appropriate to observe that collecting new data, and
correcting existing data, is usually easier in a case study format than in a large-N
cross-caseformat. It will be diffrcult to rectifr data problems if one's casesnumber in
the hundreds or thousands.There are simply too many data points to allow for this.
One might consider this issue in the context of recent work on democrary. There is
general skepticism among scholars with respect to the viability of extant global
indicators intended to capture this complex concept (".g. by Freedom House and
by the Polity IV data project).s2 Measurement error, aggregation problems, and
questions of conceptual validity are rampant. When dealing with a single country
or a single continent it is possible to overcome some of these faults by manually
recoding the countries of interest.s3The casestudy format often gives the researcher
an opportunity to fact-check, to consult multiple sources, to go back to primary
materials, and to overcome whatever biases may affect the secondary literature.
Needless to say, this is not a feasible approach for an individual investigator if
one's project encompassesevery country in the world. The best one can usually
manage, under the circumstances, is some form of convergent validation (by which
different indices of the same concept are compared) or small adjustments in the
coding intended to correct for aggregation problems or measurement error.5a
For the same reason, the collection of original data is typically more diffrcult in
cross-case analysis than in case study analysis, involving Sreater expense' greater
difficulties in identiffing and coding cases,learning foreign languages,traveling, and
so forth. Whatever can be done for a set of casescan usually be done more easily for a
single case.
It should be kept in mind that many of the countries of concern to anthropolo-
gists,economists,historians, political scientists,and sociologistsare still terra incog-
nita. Outside the OECD, and with the exception of a few large countries that have
receivedcareful attention from scholars(e.g.India, Brazil, China), most countries of
the world are not well covered by the social scienceliterature. Any statement that one
might wish to make about, say,Botswana, will be difficult to veri$' if one has recourse
only to secondary materials. And these-very limited-secondary sources are not
necessarilyof the most reliable sort. Thus, if one wishes to say something about
political patterns obtaining in roughly 90 percent of the world's countries and if one
wishes to go beyond matters that can be captured in standard statistics collected by
the World Bank and the IMF and other agencies(and these can also be very sketchy
s2 Bollen (1993);Bowman, Lehoucq, and Mahoney (zoo5); Munck and Verkuilen (zooz); Treier and
fackman (zoo5).
53 Bowman, Lehoucq, and Mahoney (zoo5). sa Bollen (rqgt); Tieier and jackman (zoo5).
THE CASE STUDY 115
11 CoNcruSIoNS
At the outset, I took note of the severedisjuncture that has opened up between an
often-maligned methodology and a heavily practiced method. The case study is
disrespected but nonetheless regularly employed. Indeed, it remains the workhorse
of most disciplines and subfields in the social sciences.Hoq then, can one make
senseof this schizophreniabetween methodological theory and praxis?
The torment of the casestudy begins with its definitional penumbra. Frequently,
this key term is conflated with a set of disparate methodological traits that are not
definitionally entailed. My first objective, therefore, was to craft a narrower and more
useful concept for purposesof methodological discussion.The casestudy, I argued,is
best defined as an intensive study of a single casewith an aim to generalize across a
larger set of cases.It follows from this definition that casestudies may be small- or
large-N, qualitative or quantitative, experimental or observational, synchronic or
diachronic. It also follows that the case study research design comports with any
ss Stoecker(rggr,qr).
u6 IOHN GERRING
Rsrnnnhrcns
Aneorr, A., and G,tnosazaser,J. zoo3.The economic costs of conflict: a casestudy of the
Basque Country. American Economic Review, 93: 113-32.
Annorr, A. r99o. Conceptions of time and events in social science methods: causal and
narrative approaches.Historical Methods,4 (4): r4o-5o.
-1992.From causesto events: notes on narrative positivism. SociologicalMethods and
Research,zo (+): 428-55.
- 2oor. Time Matters: On Theory and Method. Chicago: University of Chicago Press.
THE CASE STUDY rr7
GeoncE, A. L., and BnNNBrr, A. zoo5. Case Studies and Theory Development. Cambridge,
Mass.: MIT Press.
-and Srrorr, R. 1974. Deterrence in American Foreign Policy: Theory and Practice.New
York: Columbia University Press.
GrnnrNc, l. zoor. Social ScienceMethodology: A Criterial Framework Cambridge: Cambridge
University Press.
-2oo5. Causation: a unified framework for the social sciences. Journal of Theoretical
Politics, 17 Q): tg-98.
-2oo7a. Case Study Research:Principles and Practices.Cambridge: Cambridge University
Press.
-2oo7b. Global justice as an empirical question. PS: Political Scienceand Politics (forth-
coming).
-and Be.nnEsr,P. A. zoo3. Putting ordinary language to work: a min-max strategy of
concept formation in the social sciences.Journal of Theoretical Politics, ry (z): zor-32.
-and Tuoves, C. zoo5. Comparability: a key issue in research design. MS.
Gresln, B. G., and Srneuss, A. L. t967. The Discovery of Grounded Theory: Strategiesfor
Qualitative Research.New York: Aldine de Gruyter.
Gosnrz, G. zoo3. The substantive importance of necessarycondition hypotheses.Ch. 4 in
NecessaryConditions: Theory, Methodology and Applications, ed. G. Goertz and H. Starr.
New York Rowman and Littlefield.
-and Lsw, I. eds. Forthcoming. Causal explanations, necessary conditions, and case
studies: World War I and the end of the Cold War. MS.
-and S:renn, H. eds. zoo3. NecessaryConditions: Theory, Methodology and Applications.
New York: Rowman and Littlefield.
GorosroNr, J. A. rggl. Methodological issues in comparative macrosociology. Comparative
Social Research,t6: rzt-32.
-Qgpp, T. R., Henrp, B., Lsvv, M. A., MansHarr, M. G., Berss, R. H., ErsrerN, D. L.,
Ke,nr, C. H., Sunro, P. T., UrrBroBR, ]. C., fr., and UNcEn, A. N. zooo. State Failure Task
Force report: phase III f,ndings. Available at www.cidcm.umd.edu/inscr/stfail/SFTFo/ozo
Phaseo/o zo I I Iolozo Reporto/ozo Final.p df
Gorornonpr,l. H. rggZ.Current issuesin comparative macrosociology: a debate on meth-
odological isates. Comparative Social Research,r6i r2r-32.
GnrpprN, L. l. rgSl. Narrative, event-structure analysis, and causal interpretation in historical
sociology. American Journal of Sociology,gS: ro94-r33.
GurrrNc, G. ed. r98o. Paradigms and Revolutions: Appraisals and Applications of Thomas
Kuhn's Philosoplry of Science.Notre Dame, Ind.: University of Notre Dame Press.
Harr, P. A. zoo3. Aligning ontology and methodology in comparative politics. ln Comparative
Historical Analysis in the Social Sciences,ed. J. Mahoney and D. Rueschemeyer.Cambridge:
Cambridge University Press.
Hnosrnov, P., and Sweonrac, R. eds. 1998. Social Mechanisms: An Analytical Approach to
Social Theory. Cambridge: Cambridge University Press.
HEnsnN, M., and Benrow, D. H. 19z6. Single-Case Erperimental Designs: Strategies for
Studying Behavior Change. Oxford: Pergamon Press.
HocnscHrro, J. L. r98r. What's Fair? American Beliefs about Distributive Justice. Cambridge,
Mass.: Harvard University Press.
Jtnvrs, R. 1989. Rational deterrence: theory and evidence. World Politics, 4r (z): t'83-2o7.
KeNNnov, P. zoo3. A Guide to Econometrics,5th edn. Cambridge, Mass.: MIT Press.
KrNc, C. zoo4. The micropolitics of social violence. World Politics,56 $): 4r-55.
tzo IOHN GERRING
KrNc, G., KEoHINE, R. O. and Vrnn4 S. 1994. Designing Social Inquiry: Scientific Inference in
Qualitatirte Research.Princeton: Princeton University Press.
Krtrrr, B.r99g.Sense and sensitivity in pooled analysisof political data. Europeanlournal of
/
Political Research,J5:225-53.
- 2ooi. A crazy methodology? On the limits of macroquantitative social science research.
Unpublished MS. University of Amsterdam.
KrrrBr, B., and WrNNan, H. zoo5.How reliable is pooled analysisin political economy?The
globalization-welfare state nexus revisited. European Journal of Political Research,44 (z):
269-93.
KunN, T. S. r96zlt97o. The Structure of Scientific Reyolutions. Chicago: University of Chicago
Press.
LINE, R. 1962.Political ldeology: Why the American Common Man BelieyesWhat He Does.New
York: Free Press.
LErow, R. N. zooo. What's so different about a counterfactual? World Politics,52t 1,50--85.
LEvrNE,,R., and Rturtl, D. ;.992.A sensitivity analysisof cross-country growth regressions.
American EconomicReyiew,Sz (4): 942-6.4'.
Lrsecap, G. D. 1993.Contracting for Property Rights.Cambridge: Cambridge University Press.
LrEsEnsoN, S. 1985.Making it Count: The Improvement of Social Researchand Theory. Berkeley
and Los Angeles: University of California Press.
Einstein, Renoir, and Greeley: some thoughts about evidence in sociology: r99r
Presidential Address. American SociologicalReyiew, 5z 0): vr5.
-1994.More on the uneasy case for using Mill-t1pe methods in small-N comparative
studies. Social Forces,Tz (4): nz5-37.
Lrynnenr, A. 1968. The Politics of Accommodation:Pluralism and Democracy in the Nether-
lands. Berkeley and Los Angeles: University of California Press.
-1969.Consociational democracy. World Politics,zr (z): zo7-25.
-797r. Comparative politics and the comparative method. American Political Science
Review,65$):682-93.
Lrpssr, S. M. 196o11963.Political Man: The Social Basesof Politics. Garden City, NY: Anchor
Books.
-TRow M. A., and CoreueN, |. S. 1956. Union Democracy: The Internal Politics of the
International Typographical Union. New York: Free Press.
LrrrrE, D. 1998.Microfoundations, Method, and Causation New Brunswick, NI: Transaction.
Lvr.ro, R. S., and LvNo, H.M. r929h956. Middletown: A Study in American Culture. New York:
Harcourt, Brace.
McKsowN, T. J. rq8:. Hegemonic stability theory and nineteenth-century tarifflevels. Inter-
national Organization,lZ Q,): ll-gt.
MeuoNey, f. zoor. Beyond correlational analysis:recent innovations in theory and method.
SociologicalForum, t6 $): 575-93.
- and RurscnsurvEn, D. eds. zoo3. Comparative Historical Analysis in the Social Sciences.
Cambridge: Cambridge University Press.
- and GoEntz, G. zoo4. The possibility principle: choosing negative casesin comparative
research. American Political ScienceReview, 98 ($: 69-69.
Maus<I, C. F. 1993.Identification problems in the social sciences.SociologicalMethodology, z3:
r-56.
MantrN, C. J., and SweNr, D. zoo4. Does the organization of capital matter? Employers and
active labor market policy at the national and firm levels.American Political ScienceReview,
98 \4: j%-6r2.
THE CASE STUDY T2T