Lecture 7 Updated Data Collection and Measurement
Lecture 7 Updated Data Collection and Measurement
1 1
THE MEASUREMENT PROCESS
• How you measure your variables
• Two definitions
– Stevens (1946)—”assignment of numerals to
objects or events according to rules.”
– “…the assignment of values to outcomes.”
– The way you measure the variables in your
study determines whether you study is
qualitative or quantitative in nature
LEVELS OF MEASUREMENT
Level of
For example Quality of Level
Measurement
Ratio Rachael is 5’ 10” and Gregory is 5’ 5” Absolute zero
Interval Rachael is 5” taller than Gregory An inch is an inch
Ordinal Rachael is taller than Gregory Greater than
Nominal Rachael is tall and Gregory is short Different from
13 13
Sources of Data
• Primary data: information obtained firsthand by the
researcher on the variables of interest for the specific
purpose of the study.
14
Personal/Physical Interview
• Advantages
– Can clarify doubts about questionnaire
– Can pick up non-verbal cues
– Relatively high response/cooperation
– Special visual aids and scoring devises can be used
• Disadvantages
– High costs and time intensive
– Geographical limitations
– Response bias / Confidentiality difficult to be assured
– Some respondents are unwilling to talk to strangers
– Trained interviewers
15
Telephone/Online Interview
• Advantages
– Discomfort of face to face is avoided
– Faster / Number of calls per day could be high
– Lower cost
• Disadvantages
– Interview length must be limited
– Low response rate
– No facial expressions
16
Interview Questions
• Structured interview:
– A particular set of predetermined questions
are prepared by the researcher before
interview session.
• Unstructure interview:
– The questions to be asked to the respondents
are not set in advance/before the interview
session.
– The questions asked based from the
respondents answer.
• Semi-structured Interview:
– Combination between structured and
unstructured questions during interview
session
– The researcher prepare questions in advance
and at the same time asking other unprepared
questions during interview session based
from the respondens answer.
– Most commonly used in sosial science.
Self-administered Questionnaire
• Advantages
– Lowest cost option
– Expanded geographical coverage
– Requires minimal staff
– Perceived as more anonymous
• Disadvantages
– Low response rate in some modes
– No interviewer intervention possible for
clarification
– Cannot be too long or complex
– Incomplete surveys
19
Principles of Questionnaire Design.
20
Questionnaire Design
• Definition
A questionnaire is a pre-formulated, written set of
questions to which the respondent records his answers
• Steps
1. Determine the content of the questionnaire
2. Determine the form of response
3. Determine the wording of the questions
4. Determine the question sequence
5. Write cover letter
21
1. Questionnaire content
• Framework
Need information for all constructs in
framework
• Measurement: Operationalizing
– Objective construct:
• 1 element/items
=> 1 question
– Subjective construct:
• multiple elements/items
=> multiple questions
22
2. Response format
• Closed vs. Open-ended questions
– Closed questions
• Helps respondents to make quick decisions
• Helps researchers to code
– Open-ended question
• First: unbiased point of view
• Final: additional insights
• Complementary to closed question: for
interpretation purpose
• Social desirability
24
Question Wording
25
4. Question Sequence
• It includes:
– Identification of the researcher
– Motivation for respondents to fill it in
– Confidentiality
– Thanking of the respondent
27
Structured Observations
• Different types
– Personal observation
(e.g., mystery shopper, pantry audit)
– Electronic observation
(e.g., scanner data, people meter, eye tracking)
28
Guide to Identify the Relevant
Research Instruments
1. Explore the literature on available
questionnaires/instruments that has been developed to
measure the variables
2. Make sure the questionnaires consistent with the
operational definition of the variables under study
(unidimension or multidimension)
3. Determine the psychometric properties of the
questionnaires from the literature (validity, reliability,
long or short version (if any)). Choose the most
established and most recently validated questionnaires
(if any).
4. Might need to made some adjustment on the items and
its scale to make sure the chosen questionnaire is
relevant with the context of the research.
Guide to Write the Research
Instruments in Chapter 3
1. Write down the name (if any) of the questionnaire used in
the study and it’s main researher/s
2. The variable that will be measured
3. Explain the total items (for each dimension or reverse
items if any) and what are the elements being measured
4. The scale that will be used for the items in the
questionnaire
5. The reliability (Cronbach Alpha value) from past researcher
6. Sample of questionnaires (suggest to put in appendix)
Data Collection Procedure