Internal and External Validity
Internal and External Validity
EXTERNAL
VALIDITY
Subtitle
Introduction to Internal Validity
Internal validity refers to the level of causality that is achieved through the research.
The relationship denotes a cause-and effect relationship
Confounding impacts the internal validity in unnatural manner and lower the levels
of confounding, higher will the internal validity of the study
Internal validity can also be referred to as the tool for establishing the trust
worthiness of the research answers being provided by the researcher for the
research questions.
If internal validity is compromised, it can occasionally be improved, for example, by
a modified plan of analysis. However, biases can be often fatal as, for example, if
double-blind ratings were not obtained in an RCT.
Common Threats to Internal Validity
Attrition: Attrition refers to the dropping out of the participants from the experiment
or quitting the experiment
Confounding: Confounding refers to the situation where the impact on dependent
variable seems to be because of some variables that are outside variables.
Diffusion: This refers to a situation where the interaction between two groups lead to
the impact being transferred to the other group.
Experimenter bias: An experimenter behaving in a different way with different groups
in a study, which can impact the results (and is eliminated through blinding)
Examples of Threat to Internal Validity
Blinding: this refers to the situation in which any or both participants and the
researcher are unable to identify and understand the intervention.
Experimental manipulation: Manipulating an independent variable in a study (for
instance, giving smokers a cessation program) instead of just observing an
association without conducting any intervention (examining the relationship between
exercise and smoking behavior)
Introduction to External Validity
Transferability refers to the situation where the researcher can transfer the result to
the settings with similar characteristics.
External validity answers the following questions
Do the findings apply to similar people, settings, situations, and time periods?
Two common threats to external validity.
Pre- and post-test effects: When the pre- or post-test is in some way related to the
effect seen in the study, such that the cause-and-effect relationship disappears
without these added tests
Selection bias: Also considered a threat to internal validity, selection bias describes
differences between groups in a study that may relate to the independent variable
Examples of Threats to Internal Validity
Pre- and post-test effects: A manager evaluates his employees based on a pre and
post test effect training. He selects a sample group and then gives them a particular
training in demand forecast management. The manager then evaluates the scores
post the training and compares them with the results before the trainings. The same
can be understood as pre and post test effects.
Selection bias: A selection of all employees in a particular area however this does
not count the self employed people with in the specific area.
Methods to Mitigate the External Validation Threats
Internal and External Validity play an important role in assessing the causality of
variables and how much can the study be generalized
There always exists a tradeoff between internal and external validity
Both internal validity and external validity are not "either/or" concepts
These are very much necessary to enhance the overall adaptability of the research
Reference
Pahus L, Burgel PR, Roche N, Paillasseur JL, Chanez P. Randomized controlled trials
of pharmacological treatments to prevent COPD exacerbations: applicability to real-
life patients. BMC Pulm Med. 2019;19(1):127. doi:10.1186/s12890-019-0882-y