Edu 302 Lecture IV - PPTX Samples and Instruments
Edu 302 Lecture IV - PPTX Samples and Instruments
Data Analysis/Processing
Lecture IV –
Sampling and Instruments
Introduction
“ ... [E]very individual has the same
probability of being selected, and selection
of one individual in no way affects
selection of another individual” (Mills &
Gay, 2019; p. 149)
Population Sample
Census Survey
Parameter Statistics
• A population is the large group to which a researcher wants to
generalize the sample results. Also referred to as domain, universe,
• A sample is a set of elements taken from a larger population
• An element is the basic unit that is selected from the population
• A parameter is a numerical characteristic of population
• A statistic is a numerical characteristic of a sample.
• A census is a study based on data from the whole population rather
than a sample.
• A survey is a study based on data from the sample.
• Sampling is the process of drawing a sample from the population.
A representative sample is a sample that resembles the population
on all characteristics, except that it includes fewer people because it
is a part of the population.
Sampling Techniques
Simple random
Systematic random
Random /
Probability Stratified random
Cluster random
Sampling
Techniques Convenience
Nonrandom / Quota
Nonprobability Purposive
Snowball
Random (Probability) Sampling Techniques
• Simple Random Sampling: A sample drawn by a procedure in which
every member of the population has an equal chance of being selected.
• Systematic Random Sampling: A sample obtained by determining the
sampling interval (the population size divided by the desired sample
size which is symbolized by k), selecting a random starting point
between (and including) 1 and k, and then selecting every kth element.
• Stratified Random Sampling: A sample drawn by dividing the
population into mutually exclusive groups and then selecting a random
sample from each group.
Proportional Stratified Sampling
Disproportional Stratified Sampling
• Cluster Random Sampling: A type of sampling in which clusters (a
collective type of unit that includes multiple elements) are randomly
selected.
One-Stage Cluster Sampling
Two-Stage Cluster Sampling
Nonrandom (nonprobability) Sampling Techniques
Ordinal
Interval
Ratio
Identifying a Good Test or Assessment Procedure
Overview of Reliability and Validity
1. Reliability refers to the consistency or stability
of test scores.
2. Validity refers to the accuracy of the inferences
or interpretations we make from test scores.
These are the two most important psychometric
properties to think about with a test or assessment
procedure.
Reliability is a necessary but not sufficient condition
for validity. If you are going to have validity, you
must have reliability but reliability in and of itself is
not enough to ensure validity.
Reliability
The consistency or stability of test
scores.
Test–Retest Reliability
Equivalent-forms Reliability
Internal Consistency
Reliability
Split-half reliability
Cronbach’s alpha
Interscorer Reliability
Validity
The accuracy of the inferences, interpretations, or
actions made on the basis of test scores.
Face Validity
Content-related evidence
Construct validity
Convergent evidence
Discriminant evidence
Criterion-related evidence
Concurrent evidence
Predictive evidence
Educational and Psychological Tests
Educational and psychological tests have been developed to most