ACFN3111 - Research Methods-Ch05-except Questionnaire
ACFN3111 - Research Methods-Ch05-except Questionnaire
1
Chapter outline
1. Introduction
6. Questionnaire Design
2
I. Introduction
We need to design strategies that would enable us to create meaningful and unbiased data,
that will not waste resources, and
that will appropriately protect human and animal subjects.
When selecting data we need to be clear on:
The data type (e.g., nominal, ordinal, interval or ratio measures).
Samples ("frames") and sample size, instruments.
Methodologies for collecting data, etc.
And, to ensure high quality output, data gathering should be well planned.
4
I. Introduction …
5
I. Introduction …
6
II. Data classification & sources
8
II. Data classification & sources…
These are data collected by the investigator (immediate user) for the 1st time.
11
III. Data measurement scales
Decide what statistical analysis is appropriate on the values that were assigned (e.g.
12
III. Data measurement scales…
Levels of measurement
The relationship between numerical values on a measure.
There is a hierarchy implied in the level of measurement idea.
At lower levels of measurement, assumptions tend to be less restrictive and data
analysis tend to be less sensitive.
At each level up the hierarchy, the current level includes all of the qualities of the one
below it and adds something new.
In general, it is desirable to have a higher level of measurement (such as interval or
ratio) rather than a lower one (such as nominal or ordinal).
13
III. Data measurement scales…
Population - Parameter
Sample - Statistic
Variable - Variate
Attributes
Values
14
III. Data measurement scales…
An attribute (variate) is a specific value on a variable. For instance, the variable sex or
gender has two attributes: male and female, or, the variable agreement might be
defined in a particular study as having five attributes:
1 = strongly disagree
2 = disagree
3 = neutral
4 = agree
5 = strongly agree
15
III. Data measurement scales…
Variables aren’t always quantitative or numerical and it’s not necessary to assign
numbers for something to be a variable.
Example: The variable gender consists of two values expressed in words: male and
female. These values of the variable gender can be called “text values” to
differentiate them from numeric values. However, if it is useful, quantitative values
like “1” for female and “2” for male can be assigned instead of (or in place of) the
words.
16
III. Data measurement scales…
17
III. Data measurement scales…
3. An ordinal variable (scale) uses numerical codes to identify the order or rank of each
category
Example: Order of preference (1st , 2nd, 3rd); Rating scales (eg where 5 = strongly agree, 4
= agree, 3 = neutral, 2 = disagree and 1 = strongly disagree) can be treated as ordinal or
interval variables
4. A nominal variable (scale) uses numerical codes to identify named categories
Example: Geographical location where 1 = England, 2 = Wales, 3 = Scotland, 4 = Northern
Ireland
As they are not measured on a mathematical scale, ordinal and nominal variables are
categorical variables.
19
III. Data measurement scales…
We can summarize our description of the four scales this way: If you can say that:
One object is different from another, you have a nominal scale;
One object is bigger or better or more of anything than another, you have an
ordinal scale;
One object is so many units (degrees, inches) more than another, you have an
interval scale;
One object is so many times as big or bright or tall or heavy as another, you have a
ratio scale.
20
III. Data measurement scales…
Other distinctions
1) A quantitative variable (i.e. all ratio and interval variables) can be
• A continuous variable where the data can take any value within a given range (e.g. time =
7 or 7½ hours)
• Or a discrete variable where the data can take only one of a range of distinct values (e.g.
Employees = 7 but not 7½)
2) A dichotomous variable has two groups and can be
• A categorical dichotomous variable with two categories (e.g. gender might be coded 1 if
female and 0 if not)
• Or a quantitative dichotomous variable known as a dummy variable (coded 1 if
characteristic is present and 0 if not)
21
III. Data measurement scales…
The measurement level of the variable determines which descriptive statistics are
appropriates
Your choice depends on your research questions, which may also require the use of
inferential statistics Exploratory Descriptive Measurement
analysis statistics level
Frequency Percentage frequency Ratio, interval, ordinal, nominal
distribution
Measures of central Mean Ratio, interval
tendency Median Ratio, interval, ordinal
Mode Ratio, interval, ordinal, nominal
Measures of Range Ratio, interval
dispersion Standard deviation Ratio, interval
Measures of Skewness Ratio, interval
normality Kurtosis Ratio, interval
22
III. Data measurement scales…
23
III. Data measurement scales…
24
III. Data measurement scales…
25
III. Data measurement scales…
26
III. Data measurement scales…
27
III. Data measurement scales…
Exercise 1. Solution
1.A ratio variable can be: Categorical/ Continuous/ Discrete/ Interval/ Quantitative
2.A categorical variable can be: Continuous/ Dichotomous/ Discrete/ Interval/ Nominal
3.A dummy variable can be: Categorical/ Continuous/ Dichotomous/ Quantitative
nA quantitative variable can be: Categorical/ Continuous/ Discrete/ Interval/ Ratio
nA dichotomous variable can be: Categorical/ Continuous/ Dummy/ Interval/ Quantitative
29
III. Data measurement scales…
2.A market researcher is studying the relationship between (a) a country’s average annual
relative humidity levels and (b) the number of raincoats sold in the country during the year.
What scales underlie the two variables in this study?
30
III. Data measurement scales…
Exercise 2…
3.A sports journalist in Spain wants to determine whether a football club’s fan club membership
correlates to the frequency with which the club has won in the Spanish football league during
the past five years. The researcher can easily obtain information about fan club membership
and wins from the club’s records. To simplify data collection, the researcher uses the following
coding scheme for the fan club membership: 1 = FC Barcelona, 2 = Real Madrid, and 3 = Atletico
de Madrid. What measurement scale(s) underlie (a) fan club membership and (b)
frequency of wins?
31
III. Data measurement scales…
Exercise 2…
4.A new audio system was installed in a theatre that has a seating capacity of 500 people. The
seating area has been divided into three distinct areas: platinum, gold, and silver. At the end of
every show in one week, the audience was asked to fill out a questionnaire to determine the
effectiveness of the new audio system. What measurement scale does the researcher’s
coding scheme for the seating area represent?
5.An advertiser is studying the impact of a chocolate commercial on different age groups. He
puts the age groups in four categories: Group 1 includes 3- to 12-year-olds, Group 2 includes
teenagers aged 13 to 19, Group 3 includes adults aged 20 to 49, and Group 4 includes people
aged 50 and above. What kind of scale is the classification of age groups in this study?
32
III. Data measurement scales…
Exercise 2…
6.A car manufacturer is studying sales patterns over five years of four different types of car that
vary in size and available utilities: hatchbacks (small cars with no trunk space), midsized
sedans (cars with limited trunk space and more utilities compared to hatchbacks), sedans
(proper trunk space and all utilities), and luxury sedans (big trunk space and luxurious
interiors). Based on size and available utilities, which measurement scale does the type of
car reflect?
33
III. Data measurement scales…
Exercise 2…
7.A child psychologist is developing an instrument designed to measure the social etiquette of
small children. The instrument includes 25 statements; for example, “wishes elders when they
meet them,” “courteous to their sibling,” and “says please when asking for something or thank
you when someone has helped.” Parents must rate each of these statements on a 5-point scale
as follows: 0 never; 1 rarely; 2 sometimes; 3 often; 4 always
Parents who answer “never” to each of the 25 questions get the lowest possible score
of 0 on the instrument. Parents who answer “always” to each of the 25 questions get the highest
possible score of 100 on the instrument. Thus, scores on the instrument range
from 0 to 100. What kind of scale do the scores represent?
34
IV. Data collection methods
Data collection
is the process of gathering and measuring information on the variables of interest.
The data source could be:
an area from where we can collect the data (i.e. geographic location),
persons to be interviewed,
an entity or organization,
discussions to be observed, etc.).
35
IV. Data collection methods…
Although data collection methods may vary by discipline and data types, the emphasis on
ensuring accurate collection remains the same.
Some of the consequences from improperly collected data may include:
Inability to repeat and validate the study.
Distorted and inaccurate findings.
Wasted resources.
Misleading other researchers.
Harm to human participants and animal subjects.
More importantly, poor data collection may cause harm to society when the results of the
flawed research are used to support public policy recommendations.
36
IV. Data collection methods…
37
IV. Data collection methods – Qualitative primary data
38
IV. Data collection methods – Qualitative primary data
39
IV. Data collection methods – Qualitative primary data
40
IV. Data collection methods – Qualitative primary data
The researcher creates a relaxed atmosphere and records in some way what is being
said (e.g. by use of a tape-recorder, video, note-taker, etc.).
41
IV. Data collection methods – Qualitative primary data
FGD…
Its purpose is to obtain in-depth information on concepts, perceptions and ideas of a
group.
Focus groups can be a useful way of finding out what the main issues and concerns of
any group are.
It is more than a question-answer interaction.
group members discuss the topic and interact among themselves with guidance from
the facilitator.
43
IV. Data collection methods – Qualitative primary data
FGD…
Why use focus groups?
The main purpose of a focus group research is to draw upon group’s attitudes,
feelings, beliefs, experiences and reactions.
attitudes, feelings and beliefs may likely be revealed via interaction in social
gatherings.
Compared to individual interviews, which aim to obtain individual attitudes, beliefs
and feelings, focus groups elicit a multiplicity of views.
44
IV. Data collection methods – Qualitative primary data
FGD…
Strengths and weakness of FGDs
It provides valuable information in a short period of time and at relatively low cost if
the groups have been well chosen, in terms of composition and number.
But, their use as a research tool is limited when it comes to measuring the results
objectively.
FGD should not be used for quantitative purposes, such as the testing of hypotheses
or the generalization of findings for larger areas
Which require more elaborate surveys.
In addition, the logistical complexity of focus group research is frequently cited as a
deterrent.
45
IV. Data collection methods – Qualitative primary data
FGD…
Strengths and weakness of FGDs…
In addition, it may be risky to use FGDs as a single tool because in:
group discussions, people tend to center their opinions on the most common
ones.
In case of very sensitive topics group members may hesitate to express their
feelings and experiences freely.
Therefore, it is advisable to combine FGDs with other methods (in-depth interviews).
46
IV. Data collection methods – Qualitative primary data
47
IV. Data collection methods – Qualitative primary data
f) Triangulation
refers to the use of more than one approach to the investigation of a research question in
order to enhance confidence in the findings.
Why use triangulation
the purpose of triangulation is to obtain confirmation of findings through
convergence of different perspectives.
By combining multiple methods, and empirical materials, researchers can overcome
the weakness or biases and problems that are associated with a single method.
48
IV. Data collection methods – Qualitative primary data
Taxonomy of triangulation…
1. Data triangulation: Involves gathering data at different times and situations, from
different subjects using different sampling techniques. Example: Using time series data.
2. Investigator triangulation: involves using more than one researcher to collect and
analyze the data. Example: organizing scientific experiments to replicate each other’s
work.
3. Theoretical triangulation: making explicit references to more than one theoretical
tradition to analyze data.
4. Methodological triangulation: combination of different research methods or different
varieties of the same method.
49
IV. Data collection methods – Qualitative primary data
Taxonomy of triangulation…
Within method triangulation involves making use of different varieties of the same
method. Example: making use of alternative econometric estimators
Between method triangulation involves making use of different methods. Example:
Using ‘quantitative’ and ‘qualitative’ methods.
50
IV. Data collection methods – Quantitative primary data
51
IV. Data collection methods – Quantitative primary data
52
IV. Data collection methods – Quantitative primary data
a) The Observation Method …
Advantages
It is less demanding and has less bias.
One can collect data at the time it occurs and need not depend on reports by others.
with this method one can capture the whole event as it occurs.
Weakness of the Method
The observer normally must be at the scene of the event when it takes place.
But it is often difficult or impossible to predict when and where an event might occur.
It is also a slow and expensive process.
Its most reliable results are restricted to data that can be determined by an open or
surface indicator.
Difficult to learn about past events and to gather information on intensions, attitudes,
opinions and preferences.
53
IV. Data collection methods – Quantitative primary data
54
IV. Data collection methods – Quantitative primary data
55
IV. Data collection methods – Quantitative primary data
b) The Survey Method…
Weakness of the Method
The quality of information depends heavily on the ability and willingness of the
respondents.
A respondent may interpret questions or concept differently from what was intended
by the researcher.
A respondent may deliberately mislead the researcher by giving false information.
People surveyed may not answer all questions.
Low response rate is common.
People can and do lie.
Can’t test knowledge with mailed surveys.
56
IV. Data collection methods – Quantitative primary data
b) The Survey Method…
Main modes of administration of a survey
57
IV. Data collection methods – Quantitative primary data
58
IV. Data collection methods – Quantitative primary data
i. Personal Face to face Interview …
Advantages of face to face Interview:
enhances respondent participation,
guiding the questioning process,
answering the respondent’s questions,
clarifying the meaning of questions and responses,
probing, clarifying and motivating the respondent to complete the questionnaire,
making sure that the questionnaire is answered in the pre-defined sequence and by
the respondent himself or herself.
In addition, visual aids are possible in face-to-face interviews but not in telephone
surveys.
59
IV. Data collection methods – Quantitative primary data
60
IV. Data collection methods – Quantitative primary data
61
IV. Data collection methods – Quantitative primary data
b) Telephone Interview
Telephone can be a helpful medium of communication in setting up interviews.
telephone numbers are picked, using some sampling technique, from a telephone
directory.
Then the survey will be administered by calling and interviewing those who are
selected in the sample via telephone.
Telephone surveys are the fastest method of gathering information from a relatively
large sample - generally last less than ten minutes.
62
IV. Data collection methods – Quantitative primary data
b) Telephone Interview…
Strengths of this method
Moderate travel and administrative costs
Faster completion of study
Responses can be directly entered on to the computer
Speed of administration; no geographic limitations; etc.
Limitations of this method
Respondents must be available by phone.
The length of the interview period is short.
limited in length and scope.
those interviewed by phone find the experience to be less rewarding than a personal
interview.
63
IV. Data collection methods – Quantitative primary data
Principles of Good Interviewing
• Have integrity, and be honest.
• Have patience and tact.
• Pay attention to accuracy and detail.
• Exhibit a real interest in the inquiry at hand, but keep your own opinions to yourself.
• Be a good listener.
• Keep the inquiry and respondents’ responses confidential.
• Respect others’ rights.
64
IV. Data collection methods – Quantitative primary data
c) Interviewing by mail (Solicited responses)
Self-administrated questionnaires may be used in surveys.
Questionnaires will be sent to respondents through their email or postal address.
Respondents are expected to fill out the questionnaires and send them back the same
way.
Self-administered surveys do not need interviewers.
Respondents mark, write or type the answers themselves.
They are ideal for large sample sizes, or when the sample comes from a wide geographic
area.
Questionnaires must be easily understandable since there is no possibility for
respondents to ask how to mark answers or what a question might mean.
65
IV. Data collection methods – Quantitative primary data
66
IV. Data collection methods – Quantitative primary data
67
IV. Data collection methods – Quantitative primary data
68
IV. Data collection methods – Quantitative primary data
69
V. Data management issues…
Integrity
Integrity refers to the trustworthiness of the information.
Researchers need to have sufficient skills to ensure the integrity of their data
collection efforts.
For instance, data collection requires a rigorous and detailed recruitment and
training plan for data collectors.
So, data should not be modified inappropriately, whether accidentally or
deliberately.
71
VI. Questionnaire design
72
End of Ch. 05 – Next Ch. 06 (Part covered in Ch. 02)
73