Reliability and Validity
Reliability and Validity
Types of Reliability:
1- Test-retest reliability
It is used to ensure the consistency of measure over time. It is the stability of the results
from one test to another.
Related Question; Are you getting the same results when you repeat the measurement
overtime?
Limitations;
1- If the interval between two tests is too short, respondents might remember what was
on the first test.
2- During the period between the two test, respondents could have been exposed to
things that might have changed their opinions or behaviors
Used in real life at work; we use the Test-retest reliability for the Personality Index test (PI
test). The test is conducted in the hiring process and each time the candidate is suggested for a
new position to ensure the same results and personality profile is still the same,.
2- Alternative forms.
It is used to estimate reliability is similar to the test retest method, except that different
measures of a behavior (rather than the same measure) are collected at different times.
3- Interrater reliability
It measures the consistency of measure across raters or observers. Do you get the same
results when different people conduct the same measurement?
Related Question; Are you getting the same results when different people conduct the
same measurement?
4- Internal consistency
It measures the consistency of the measurement itself
Related Question; Do you get the same results from different parts of a test that are
designed to measure the same thing?
5- Split-half reliability
It measures the consistency between two halves of a construct measure. It assumes that a
number of items are available to measure a behavior. Half of the items are combined to
form one new measure and the other half is combined to form the second new measure.
The result is two tests and two new measures testing the same behavior.
Limitations; A disadvantage of the split-half method is that the tests must be parallel
measures – that is, the correlation between the two halves will vary slightly depending on
How the items are divided.
Validity
Refers to the extent to which a measure adequately represents the underlying construct that it is
supposed to measure.
Types of Validity
1- Statistical conclusion validity
Does a relationship exist between the two variables? Statistical conclusion validity
pertains to the relationship being tested.
2- Internal Validity
3- Construct Validity
The adherence of a measure to existing theory and knowledge of the concept being
measured
Used in real life at work; The employees engagement survey
4- Content Validity
The extent to which the measurement covers all aspects of the concept being measured.
5- Criterion Validity
The extent to which the result of a measure corresponds to other valid measures of the
same concept.
6- Translation Validity
Translation validity centers on whether the operationalization reflects the true meaning of
the construct.
7- Face Validity
Face validity is a subjective judgment on the operationalization of a construct
Reliability is necessary but not sufficient condition to test of goodness of a measure. As
Reliability is the consistency of measures. We can measure something frequently and it gives a
consistent measure, however we can still be measuring the wrong construct. In this case, the
measure is reliable as it’s highly stable, however it’s not valid as you are measuring the wrong
construct.