Experimental Methods
Experimental Methods
METHODS
THE EXPERIMENTAL
METHOD
✖ The experimental method is just a systematic way of acquiring knowledge,
but it has played a pivotal role in helping us to understand the physical
world.
✖ correlation is no proof of causality.
✖ J.S Mill (1882) suggested to identify cause and effect relationship - ‘the
Method of Difference’
✖ In this design, one or more independent variables are manipulated by the
researcher (as treatments),
✖ subjects are randomly assigned to different treatment levels (random
assignment), and the results of the treatments on outcomes (dependent
variables) are observed.
✖ The unique strength of experimental research is its internal validity
(causality) due to its ability to link cause and effect through treatment
manipulation, while controlling for the spurious effect of extraneous
variable
✖ Experimental research is best suited for explanatory research (rather than
for descriptive or exploratory research), where the goal of the study is to
examine cause-effect relationships.
✖ Experimental research can be conducted in laboratory or field settings.
THE ADVANTAGES OF THE
EXPERIMENTAL
METHOD
✖ they enable us to determine causal relationships between variables.
✖ enables us to produce events to order, rather than waiting for them to occur
naturally, and allows us to control the circumstances in which they occur.
THE BASIC PRINCIPLES OF
THE EXPERIMENTAL
METHOD
✖ Manipulate one variable (IV)
✖ Measure the effects of these manipulations on other variable (DV)
✖ keeping all other variables as constant as possible.
✖ In the flu vaccine study that you are running, you have recruited several
experimenters to administer your vaccine and measure the outcomes of your
participants.
✖ If these experimenters knew which vaccines were real and which were fake,
they might accidentally reveal this information to the participants, thus
influencing their behavior and indirectly the results.
IMPORTANCE OF BLINDING
✖ Blinding helps ensure a study’s internal validity, or the extent to which you
can be confident any link you find in your study is a true cause-and-effect
relationship.
✖ Since non-blinded studies can result in participants modifying their
behavior or researchers finding effects that do not really exist, blinding is an
important tool to avoid research bias in all types of scientific research.
✖ Risk of unblinding
✖ Unblinding occurs when researchers have blinded participants or
experimenters, but they become aware of who received which treatment
before the experiment has ended.
✖ This may result in the same outcomes as would have occurred without any
blinding.
TYPES OF EXPERIMENTAL
DESIGN
✖ ‘Post-test only/control group’ design
✖ Pre-test/post-test control group’ design
✖ Solomon four-group design: The four groups in this design are (see figure
below):
1. A treatment group with both pre-intervention and post-intervention
measurements (a.k.a. pretest and posttest)
2. A control group with both pretest and posttest measurements
3. A treatment group with only a posttest measurement
4. A control group with only a posttest measurement
The objective is to assess the efficacy of the treatment (or intervention).
EXPERIMENTAL DESIGNS
AND THREATS TO
VALIDITY
MORE ADVANCED
EXPERIMENTAL DESIGNS
(DISCUSSION)
✖ LONGITUDINAL VERSUS CROSS-SECTIONAL DESIGNS
✖ MULTIFACTORIAL DESIGNS
✖ MULTIPLE DEPENDENT VARIABLES
✖ MIXED DESIGN
FACTORIAL RESEARCH
DESIGN
✖ A factorial research design is an experiment that has a minimum of two
factors. These factors, also known as independent variables, are what the
researcher controls.
✖ A 2x2 factorial design example would be the following:
✖ A researcher wants to evaluate two groups, 10-year-old boys and 10-year-
old girls, and how the effects of taking a summer enrichment course or not
affects math test scores.
✖ In this case, there are two factors, the boys and girls. There is also two
levels, those who do and do not take summer enrichment. Thus, this would
be written as 2x2, where the first factor has two levels and the second factor
has two levels