Data Collection Methods 2
Data Collection Methods 2
Validity of a Questionnaire
•To make appropriate decision we need accurate and consistent
data.
•To achieve this we use valid and reliable questionnaires.
•Validity means that the instrument/procedure used in research
is accurate, true & meaningful. Thus, validity of the results
depends on the quality of the instruments/questionnaire used
in data collection.
– Good questionnaires are difficult to construct; bad
questionnaires are difficult to analyze.
Reliability of a Questionnaire:
•Reliability of an instrument is defined as the ability of
the instrument to measure consistently the phenomenon
it is designed to measure.
•Reliability: if something was measured again using the
same instrument, would it produce the same (or nearly
the same) results?
•Questionnaire design should be done carefully because
the validity and reliability of the instrument used to
collect data depends to a large extent on the design of
the questions and the structure of your questionnaire.
Steps in designing a questionnaire:
1. Write out the aims of your study.
2. Write out concepts/information to be collected that
relates to these aims.
3. Review the current literature or identify already
validated questionnaires that measure your specific
variables.
4. Compose a draft of your questionnaire.
5. Revise the draft.
6. Assemble the final questionnaire.
The Questions or Items
• Are the focus on any survey questionnaire.
• It is crucial to know how to ask the questions in
written and spoken form.
• The way you ask the questions determines the
answers.
N.B. A pilot survey can be done using a small sample
to test the questionnaire (with the intention of
discarding and/or adding questions or clarifying
some questions which are not clear).
TYPES OF QUESTIONNAIRES AND QUESTIONS
Questionnaires can be structured, or unstructured.
1 Structured questionnaires (Closed Ended Questions) are
based predominantly on closed questions which produce data
that can be analyzed quantitatively for patterns and trends. The
agenda is entirely predetermined by the researcher and provides
little flexibility for respondents to qualify their answers as they
are restricted to choose among the given answers.
A closed question can be answered with either 'yes' or 'no'.
1.1 Yes/No Questions
a) Do you have a library membership card?
Yes ( )
No ( )
2 Multiple Choice Questions
What purpose do you visit the library? (Multiple choices)
( ) To read news papers
( ) To refer books
( ) To borrow and return books
( ) To browse Internet
3 Scaled questions - Responses are graded on a continuum
(example: rate the appearance of the product on a scale from 1 to 10,
with 10 being the most preferred appearance). Examples of types of
scales include the Likert scale and rank-order scale
A likert scale is commonly used in survey research it is
often used to measure respondents attitudes by asking the
extent to which they agree or disagree with a particular
question or statement.
Example: To what extent does the information obtained
from the web based resources are useful to you? (Likert
Scale)
1 E-books
2 E-journals
3 Discussion forums
4 Databases
2.2 Unstructured questionnaires (Open-ended)
Non-structured questions, or open-ended questions,
are questions where there is no list of answer
choices from which to choose. Respondents are
simply asked to write their response to a question.
Here is an example:
An open question is likely to receive a long answer.
Example of a Non-structured Question
1.What are the facilities and services do you expect from
your library?
_______________________________________________
_______________________________________
2. What mechanisms would you suggest to reduce
students’ failure in mathematics in Higher Learning
Institutions?
______________________________________________
____________________________________________
____________________________________________
____
It is best to use non-structured questions when you are
exploring new ideas and you don't really know what
you expect from the respondents.
3. Semi-structured questionnaires (Partially Structured
Question) take a mixed approach. In some situations, you
may have a partial list of answer choices, but you may still
have some doubt or uncertainty about other possible
responses. You can create a partially structured question
such as the following:
Example of a Partially Structured Question
What purpose do you use web based resources?
•For research work
•To write assignments
•To improve subject knowledge
•For the purpose of seminar presentation
Any other (Please specify): 1.________________
2. ________________
4. Contingency questions
A question that is answered only if the respondent gives a
particular response to a previous question. This avoids
asking questions of people that do not apply to them.
1. Do you have computer knowledge?
Yes ( )
No ( )
2. If ‘yes’ how long have you been using?
•From last 6 months ( )
•From last 1 year ( )
•From last 2 years ( )
•From last 3-4 years ( )
3. Cautions regarding Questions and Questionnaires Construction
1.Keep the questionnaire as short as possible.
2.Ask short, simple, and clearly worded questions.
3.Start with demographic questions to help respondents get started
comfortably.
4.Check the spellings of the question statements
5.Avoid double-meaning Questions
6.If there are any difficult terms in the questionnaire then do explain
them
7.Avoid unnecessary questions
8.Know the academic and mental capacities of the target population
9.If there are certain personal or emotional questions ask them in the
middle or at the end
10.Use polite language i.e. Do not use offensive language
11.Let the respondents know that their privacy will be ensured
Observation
• A research method that does not involve personal
interaction between interviewer and subject.
• Observational data are facts and figures obtained by
watching, either mechanically or in person, how
people actually behave.
• The use of observation requires the researcher to be
present to the field to observe the event.
• Certain kinds of research questions can best be
answered by observing how people act or how things
look.
Observation
• Involves all the 5 senses: sight, hearing, smell,
touch and taste.
- Observation includes more than just “seeing”.
- Observation is used to provide information
about real life situations and circumstances.
- To assess what is happening.
Types of observation
• There are two types of observations:
i. Participant observation
ii. Non-participant observation (structured
observation)
Participant Observation
• This is a method of data collection in which the
researcher is totally involved in the situation being
researched.
– The researcher is involved in the situation while
collecting data, he becomes part of the group, does
everything carried out and in the process he
examined what is going on.
– Participant observation can either covert or overt.
Participant Observation
• Covert- the subjects are not aware that they are
being observed and the researcher must be a
participant observer.
• Overt observation- the observer is visible to the
subjects who in turn know that they are being
observed.
Structured Observation
– The researcher observes and records behaviors but does
not interact or participate in the setting
– Attempts to observe people without interacting with them
i.e. „ Without their knowledge that they are being
observed.
– But, in this type the observer has a predetermined set of
categories of activities to be studied.
Advantages of observation method
• The researcher gets first hand information
• It overcomes language barriers experienced in interview
and questionnaires because communication with
respondent is not necessary
• Observation research provides the researcher the
opportunity to watch what people actually do rather
than relying on reports of what they say they do.
• This approach can avoid much of the biasing factors
caused by the interviewer and question structure
associated with the survey approach.
Advantages of observation method
• No need to rely on respondents memory
• Nonverbal behavior data may be obtained
• Certain data may be obtained more quickly
• May be combined with other research methods
to provide supplemental evidence
Disadvantages of Observation Method
– Only behaviour and physical personal
characteristics can usually be examined. The
researcher does not learn data related to mental
phenomena, such as motives, opinions, attitudes,
intentions, or feelings.
– Observation research can be time consuming
and costly if the observed behavior occurs rather
infrequently.
– Interpretation of data may be a problem
– Sometimes it is very risky and dangerous to the
observer especially when those who are being
observed are not willing to disclose their observation.
Experimentation
• Experiments - Attempts to determine a cause and
effect relationship between two or more variables.
• Research situation with at least one independent
variable, which is manipulated by the researcher.