Research Method For Project Managers
Research Method For Project Managers
Research Method For Project Managers
Project Managers
(MSPM 615)
Contents:
Introduction
Formulation of Research problem and
Hypothesis
Literature Review
Research Design and Methods of Research
Census and Sample Investigation
Data Collection Processing and Analysis
Writing the Research Report for Proposal
and Research Paper
Section One: - Introduction
1.1. Definition of Research
1.2. Philosophy of Research
1.3. Objective of Research
1.4. Motivation in Research
1.5. Characteristics of Research
1.6. Scientific Approaches
1.7. Classification of Research
1.7. Types of Research
1.8. Research Ethics
1.1. Definition of Research
1.1 Definition of Research
We all possess the vital instinct of
inquisitiveness.
When the unknown confronts us, we wonder
and probe to attain full understanding of the
unknown.
This inquisitiveness is the mother of all
knowledge.
The method, which we employ for obtaining the
knowledge of whatever the unknown is,
therefore, research.
Research is more than a reflection of our opinions
and prejudices.
Research is defined as:
a search for knowledge in a scientific manner.
“a careful investigation or inquiry specially
through search for new facts in any branch of
knowledge.”
a “systematized effort to gain new knowledge.”
a movement from the known to the unknown.
a voyage of discovery.
‘Research’ refers to the systematic method
consisting of:
enunciating the problem,
formulating a hypothesis,
collecting data,
analyzing the data and
reaching certain conclusions.
Social research should also fulfil the following requirements:
1. systematic, i.e. follows precise methods that are
logically consistent, transparent and open to scrutiny
2. non-discriminatory and non-exploitative to its
subjects, i.e. neither directly or indirectly should
discriminate against its subjects, physically or mentally
harm them, nor exploit them for own profit
3. open to criticism, i.e. research should be made public
through publications and be open to scrutiny both for
its procedures and its findings, and
4. independent, i.e. be free from direct or indirect
censorship
1.2 Philosophy of Research:
Epistemology vs. Ontology
Research is about acquiring new knowledge. Our study
of research methods should therefore at least partly be
concerned with study of knowledge and ways of
obtaining it.
Epistemology is the branch of philosophy that studies
knowledge. It attempts to answer the basic question:
what distinguishes true (adequate) knowledge from false
(inadequate) knowledge?
History of Epistemology:
Plutonian Epistemology: - Knowledge is merely an
awareness of absolute, universal Ideas or Forms, existing
independently of any subject trying to apprehend to them.
2. Aristotelian Epistemology: - Puts more emphasis
on logical and empirical methods for gathering
knowledge, yet he still accepts the view that such
knowledge is an apprehension of necessary and
universal principles .
3. Cartesian Rationalist Epistemology: - Sees
knowledge as the product of rational reflection
4. Reflection-Correspondence Theory: Knowledge
results from a kind of mapping or reflection of external
objects, through our sensory organs, possibly aided by
different observation instruments, to our brain or mind.
Though knowledge has no a priori existence, like in
Plato's conception, but has to be developed by
observation, it is still absolute, in the sense that any
piece of proposed knowledge is supposed to either
truly correspond to a part of external reality, or not.
5. Kantian Synthesis Theory: - According to Kant,
knowledge results from the organization of perceptual data
on the basis of inborn cognitive structures, which he calls
"categories". This epistemology does accept the subjectivity
of basic concepts, like space and time, and the impossibility
to reach purely objective representations of things-in-
themselves.Yet the a priori categories are still static or given.
6. Pragmatism: - Knowledge consists of models that attempt
to represent the environment in such a way as to simplify
problem-solving. No model can ever hope to capture all
relevant information, and even if such a complete model
would exist, it would be too complicated to use in any
practical way. Therefore we must accept the parallel
existence of different models, even though they may seem
contradictory. The model which is to be chosen depends on
the problems that are to be solved. The basic criterion is that
the model should produce correct (or approximate)
predictions (which may be tested) or problem-solutions, and
be as simple as possible. Further questions about the "Ding
an Sich" or ultimate reality behind the model are
meaningless.
1.2 Philosophy of Research: EPISTEMOLOGY
Epistemology is the branch of philosophy that deals
with how knowledge of such phenomena is acquired,
and what counts as knowledge.
What is (or should be) regarded as acceptable
knowledge in a discipline?
◦ Can (should) the social world be studied according to
the same principles as the natural sciences?
If the answer is YES, the research follows the
doctrine of the natural science epistemology:
Positivism (and also Realism)
If the answer is NO, the research follows the
opposite to positivism doctrine: Interpretivism
Three epistemological positions:
A) Positivism: -
• Positivism refers to the school of thought that the only
‘true’ or valid form of knowledge is that which is ‘scientific’.
• The principles and methods of the natural sciences (such as
chemistry or physics) are used to study human behaviour,
which in itself is objective and tangible in nature.
• The researcher can observe human behaviour and measure
‘facts’, and ‘laws’ or theories of behaviour can be developed.
• Concepts such as feelings, emotions, beliefs and so on have
no place in research as they cannot be directly observed or
measured, they are unreliable and they are not constant over
time.
• Measurements should be objective. This approach involves
precise measurements, which can be controlled or manipulated
by the researcher. Others could see the same evidence for
themselves and reach the same conclusions.
• Such exact measurement allows statistical analysis which
provides an impartial and precise answer. Careful research
designs can show causal relationships, for example X causes Y.
The researcher has no influence on the findings, and has no
personal influence on the results.
A) Exploratory or Formulative
You may be exploring new topic or issue in order to learn about it. If the issue was new or
the researcher has written little on it, you began at
the beginning.This is called exploratory research.
A researcher may need to know enough to design and execute a second, more systematic as
well as extensive study.
A) Basic Research
Basic research advances fundamental knowledge about
the human world.
It focuses on refuting or
supporting theories that explain how world operates
what makes things happen, why social
relations are a certain way, and why society changes.
Basic research is the source of most new scientific
ideas and ways of thinking about the world.
It can be exploratory, descriptive, or explanatory; ho
wever, explanatory research is the most common.
Basic research generates new ideas, principles and
theories, which may not be immediately utilized; though
are the foundations of modern progress and development
in different fields.
A new idea or fundamental knowledge is not generated
only by basic research. Applied research, too, can build
new knowledge. Nonetheless, basic research is essential
for nourishing the expansion of knowledge. Researchers at
the center of the scientific community conduct most of
the basic research
B) Applied Research
Applied researchers try to solve specific policy problems or help
practitioners accomplish tasks. Theory is less central to them than
seeking a solution on a specific problem for a limited setting.
Applied research is frequently a descriptive research, and its main
strength is its immediate practical use. Applied research is
conducted when decision must be made about a specific real-life
problem.
Applied research encompasses those studies undertaken to answer
questions about specific problems or to make decisions about a
particular course of action or policy.
For example, an organization contemplating a paperless office and a
networking system for the company's personal computers may
conduct research to learn the amount of time its employees spend
at personal computers in an average week
Types of Applied Research
i) Action research
ii) Impact Assessment Research
iii) Evaluation Research
C. Basic and Applied Research Compared
The procedures and techniques utilized by basic and
applied researchers do not differ substantially.
Both employ the scientific method to answer the
questions at hand.
The consumers of applied research findings are
practitioners. Often, someone other than the researcher
who conducted the study uses the results of applied
research. This means that applied researchers have an
obligation to translate findings from scientific technical
language into the language of decision makers or
practitioners.
The results of applied research are less likely to enter
the public domain in publications. Results may be
available only to a small number of decision makers or
practitioners, who decide whether or how to put the
research results into practice and who may or may not
use the results.
Applied and basic researchers adopt different orientations
toward research methodology.
Basic researchers emphasize high standards and try to
conduct near-perfect research.
Applied researcher make more trade-offs. They may
compromise scientific rigor to get quick, usable results.
Compromise is no excuse for sloppy research, however.
Applied researchers squeeze research into the
constraints of an applied setting and balance rigor against
practical needs.
Such balancing requires an in-depth knowledge of
research and an awareness of the consequences of
compromising standards
4) Research by Time Dimension:
1.Cross-Sectional Research
2.Longitudinal Research
3.The panel study
4.A cohort analysis
5)Research (data collection) Techniques Used
Quantitative: - Experiments, Surveys,
and Content Analysis and Using Existing Statistics
Qualitative :- Field Research, Case Study and
Focus Group Discussion
1.6. Scientific Approaches
1.6 Scientific Approaches
The general process called the scientific approach is
influenced by the philosophical views.
The approach can be characterized as having the following
general steps:
◦ Identifying the problem/issue/question.
◦ Defining the research objectives
◦ Develop approaches for achieving the objectives
◦ Conduct the analysis
◦ Interpret the result and draw conclusions.
Scientific Approaches:
Deductive and Inductive Thinking
The modern method of science is broadly of two types:
Induction and Deduction.
Deductive reasoning works from the more general to the
more specific.
◦ Also called a "top-down" approach.
◦ begin with a theory – to specific hypotheses – into
observations.
◦ test the hypotheses with specific data- a confirmation (or
not) of our original theories.
Deductive Reasoning
Scientific Approaches:
Deductive and Inductive Thinking
Inductive reasoning works the other way, moving from
specific observations to broader generalizations and
theories.
◦ this is a "bottom up" approach.
We begin with specific observations and measures, begin
to detect patterns and regularities, formulate some
tentative hypotheses, and finally end up developing some
general conclusions or theories.
Inductive Thinking
1.7.Types of Research
1.7.Types of Research
The basic types of research are as follows:
(i) Descriptive vs.Analytical:
Descriptive research includes surveys and fact-finding
enquiries of different kinds.
The major purpose of descriptive research is
description of the state of affairs as it exists at
present.
In social science and business research we quite
often use descriptive research.
In analytical research, the researcher analyzes
information to make a critical evaluation of the
material.
Types of Research
(ii) Applied vs. Fundamental: Research can either be
applied (or action) research or fundamental (basic
or pure) research.
Applied research aims at finding a solution for an
immediate problem facing a society or an
industry/organization,
Fundamental research is mainly concerned with
generalizations and with the formulation of a theory.
Types of Research
(iii) Quantitative vs. Qualitative:
Quantitative research is based on the measurement
of quantity or amount.
It is applicable to phenomena that can be
expressed in terms of quantity.
Qualitative research is concerned with qualitative
phenomenon whose aim is to discover the
underlying motives of human behaviour.
If you: Then Use:
• want to conduct statistical analysis
• want to be precise
Quantitative
• know what you want to measure
A. Researchers-researchers
o As a student writer,
Collect Data
Analyze Data
Interpret and
Report
2.1.Souces of Research Problem
A Research problem is a discrepancy
between what one knows and ought to
know to solve a problem. Sources are:
1. Experiences
2. Literatures
3. Theories
4. Reports
5. Technology
6. Inconsistence in past studies
2.2. Criteria of good research problem
1. Interests
2. Researchable
3. Feasible/practical
4. Significance
5. Economics
2.3. Formulating a Research Process
1. Defining a problem
2. Showing the severity of the problem with data
3. Showing the extent of the problem with data
4. Showing the gap in the previous studies and your
value-added
Defining the Research Problem
Knowing what to research and its purpose is key to the
first step in the research design.
A good research topic is broad enough to allow you to find
plenty of material, but narrow enough to fit within the size
and time constraints of your paper.
• To do a research a topic or a felt practical or theoretical
difficulty must be identified.
The problem identification affects the quality, usefulness,
effectiveness and efficiency of the research activity.
Defining the problem, showing the severity of the
problem, showing the extent of the problem, and showing
the gaps
Defining the Research Problem
What does one mean when he/she wants to
define a research problem?
The answer may be that one wants to state the
problem along with the bounds within which it is
to be studied.
It involves the task of laying down boundaries
within which a researcher shall study the
problem.
How to define a research problem is
undoubtedly a herculean/exceptional task.
Defining the Research Problem
However, it is a task that must be tackled
intelligently to avoid the perplexity encountered
in a research operation.
Defining a research problem properly and clearly
is a crucial part of a research study and must in
no case be accomplished hurriedly.
However, in practice this is frequently overlooked,
which causes a lot of problems later on.
Hence, the research problem should be defined in
a systematic manner, giving due emphasis to all
relating points.
The research problem and objectives
The researcher must know exactly what his/her
problem is before he/she begins working on it.
A problem clearly defined is a problem half solved.
◦ Problem definition or problem statement is a clear
and precise statement of the question or issue to
be investigated.
Laying down the boundaries within which a
researcher shall study the problem.
Helps to narrow the perspectives of the problem
to a set of issues on which new information is
sought.
The research problem and objectives
Defining the problem clearly will help to find
answers to questions like:
◦ What data are to be collected?
◦ What characteristics of data are relevant and
need to be studied
◦ What relations are to be explored
◦ What techniques are to be used for the
purpose
The research problem and objectives
In the formal definition of the problem the
researcher is required
to describe the background of the study, its
theoretical basis and underlying assumptions in
concrete, specific and workable questions.
The problem statement should make a
convincing argument that there isn’t sufficient
knowledge available to explain the problem or
◦ there is, at least, a need to test what is known
and taken as fact.
The research problem and objectives
Some ways to show that you are adding to the knowledge
in your field:
Gap: A research gap is an area where no or little
research has been carried out.
The research problem is defined by asking a question to
which the answer is unknown, and which you will
explore in your research.
◦ Counter-claiming: A conflicting claim, theory or
method is put forward.
◦ Continuing a previously developed line of
enquiry: Building on work already done, but taking it
further (by using a new sample, extending the area
studied, taking more factors into consideration, taking
fewer factors into consideration, etc).
The research problem and objectives
The researcher should be focused, and should single out
and clearly state the problem.
S/He should ask whether the problem is:
Amenable to empirical investigation or evaluation
through collection and analysis of relevant data
Brief, clear and precise
Researchable in respect to appropriate sources of
data/information that can provide solutions to the
problem identified
Solvable
Fitting itself well to established theories or concepts
76
The research problem and objectives
In defining the statement of the problem, the following
questions could be helpful:
Who is affected and how?
What is missing and where?
What went wrong and to what extent?
What are the notable effects, where, extent for whom?
Is the problem self-expressive or does it generate other
problems?
What have others to say about it? Establishing the gap!
77
The research problem and objectives
The problem is very important in the sense that it should
receive considerable and persuasive attention
Its importance is inevitably subjective and will vary from
researcher to researcher.
Objectivity can be injected by answering questions such
as:
Is the problem of current interest? Is it topical (up-to-
date)?
Is the problem likely to continue into the future?
Would the information about the problem have
practical application?
The research problem and objectives
Will the information about the problem have theoretical
importance?
How large is the population affected by the problem?
Would this study substantially revise or extend
existing knowledge?
Would this study create or improve an instrument of
some utility?
Would research findings lead to some useful change
in best practice?
Is there evidence or authoritative opinion from others to
support the need for this research?
The research problem and objectives
The problem statement could close with a question.
Typically, the question could contain two variables, a
measurable relationship, and some indication of
population.
A good example of research question:
"What is the relationship between farm productivity and
farmer use of fertilizer"?
The information needed is:
◦ Productivity levels
◦ Some measure of fertilizer use.
The research problem and objectives
Hazardous noise is an important occupational health problem
because it leads to hearing loss and may lead to increased
stress and other deleterious physiological effects. More than 30
million workers are exposed to hazardous noise on the
job…Use of hearing protection devices, specifically ear plugs is
known to reduce noise exposure and prevent noise – induced
hearing loss… there are, however, relatively few investigators
who have examined factors related to the low use of hearing
protection by workers.
C) Provided by a client
◦ Requests For Proposals (RFPs) are published by
government agencies and some companies.
These RFPs describe some problem that the agency
would like researchers to address -- they are virtually
handing the researcher an idea.
The RFP describes the problem that needs addressing,
the contexts in which it operates, the approach they
would like you to take to investigate to address the
problem, and the amount they would be willing to pay
for such research.
Identification of a Research Topic
d) Technological and Social Changes
◦ New developments bring forth new development
challenges for research.
e) Other Sources
Many researchers simply think up their research topic
on their own.
No one lives in a vacuum, so we would expect that the
ideas you come up with on your own are influenced by
your background, culture, education and experiences.
Identification of a Research Topic
1. Specify relationship
2. Testable
3. Justifiable
4. Concise
2.2.2. Difficulties in formulating
Hypothesis
The degree of challenges to the hypothesis depends
on the type of a problem and its importance. It can
range from just seeking a good enough solution to a
much more rigorous challenges.
The terms challenging may include:
1. Verification
2. Justification
3. Refutability
4. Validity
5. Rectification
6. Repeatability
7. Falsification
2.2.3. Hypothesis Testing
There are four procedures:
1. Stating the hypothesis
2. Setting the criteria for a decision
3. Collecting data
4. Evaluate the H0
Problem: Type I (When Ho is wrongly rejected) and Type II
accept Ho wrongly when it is false in fact)
Decision
Reject Ho Accept Ho
Truth Ho Type I Right Decision
H1 Right Decision Type II
2.2.4. Criteria for Good Hypothesis
1. Identify Y and X variables
2. Specify the nature of relationship
3. Simple and concise, better to have several hypothesis
that one complicated hypothesis
4. Does not included reference to specific measure
5. Does not refer to specific statistical procedures that
will be used in analysis
6. Implies the population you are going to study
7. Is falsifiable and testable
Chapter Three: Research Design
3.1. Definition and Components of Research Design
3.2. Related literature review
3.2.1. Characteristics of Related Literature
3.2.2. Recording of Reading for Literature
3.2.3. Note taking: Reviewing the literature
3.2.3.1. Paraphrasing
3.2.3.2. Incorporating Direct Quotes
3.2.4. Proper Citation Style
3.3. Research Proposal
3.5.1. Importance of Research Proposal
3.5.2. Elements of a Research Proposal
3.1. Definition and Components of Research Design
The formidable problem that follows the task
of defining the research problem is the
preparation of the research design.
Decisions regarding what, where, when, how
much, by what means concerning an inquiry
or a research study constitute a research
design.
“A research design is the arrangement of
conditions for collection and analysis of data
in a manner that aims to combine relevance
to the research purpose with economy in
procedure.”
It is the conceptual structure within which
research is conducted; it constitutes the
As such the design includes an outline of what
the researcher will do from writing the
hypothesis and its operational implications to
the final analysis of data
i. What is the study about?
ii.Why is the study being made?
iii.Where will the study be carried out?
iv.What type of data is required?
v.Where can the required data be found?
vi.What periods of time will the study include?
vii.What will be the sample design?
viii.What techniques of data collection will be
used?
ix.How will the data be analyzed?
x. In what style will the report be prepared?
In short, research design consists of:
(i) The plan that specifies the sources and
types of information relevant to the
research problem.
(ii) The strategy specifying which approach
will be used for gathering and analyzing
the data.
(iii) The time and cost budgets since most
studies are done under these two
constraints.
3.2. Related literature review
Once the problem is formulated, the researcher should
undertake an extensive literature survey connected with
the problem.
Others have conducted research that is related to
the topic.
The purpose of the literature survey is to provide
the researcher with an understanding of the
literature as it relates to the current project.
The literature survey enables you to learn as much
as you can from the efforts of others.
Like most aspects of research it needs thoughts and
planning.
Literature Review
It “is a written summary of journal articles, books and
other documents that describes the past and current
state of information, organizes the literature into topics
and documents a need for a proposed study.”
Well-written analytical narrative that brings a reader up-
to-date on what is known on a given topic, but also
provide fresh insights that advance knowledge
Resolve conflicts between studies
Identify new ways to interpret research results
Creating a path for future research
109
Literature Review
Academic journals, conference proceedings, dissertations,
government reports, policy reports, publications of
international organizations, books, etc. must be tapped
depending on the nature of the problem.
◦ Usually one source leads to the next and the best
place for the survey is the library.
The main goal is:
◦ to familiarize yourself with the issue and prevent
duplication of what had already been done.
Literature Review
Several articles can be summarized in one mention
◦ E.G- There have been numerous studies attempting to
measure the return to education (see Becker (1963);
Mincer (1968); Angrist and Krueger (1988); Bound et al.
(1991)).”
Steps to Conduct a Literature Review
• Step 1: Identify Key Terms or “Descriptors”
• Extract key words from your title (remember, you may
decide to change the title later)
• Use some of the words other authors reported in the
literature
• Scan both electronic and library journals from the past
10 years and look for key terms in the articles
pqz 2 0.15*0.85*(1.96)2
n 2 2
196
u 0.05
For Quantitative Variable
Suppose the same researcher is interested in knowing
average systolic blood pressure of children of the same
city then below mentioned formula should be used as
blood pressure is a quantitative variable.
SD * z1 / 2 2
n
d2
Where Z is the standard normal variate as mentioned
before. SD is the standard deviation of variable. It can
be taken from previous done study. d is the absolute
error or precision as mentioned before. Let SD=25
25*1.962
n 2
96
5
Problems in Sampling
Two types of errors:
Non sampling errors
Sampling errors
1. Non Sampling errors: are biases or errors due to fieldwork
problems, interviewer induced bias, clerical problems in
managing data, etc.
◦ These would contribute to error in a survey,
irrespective of whether a sample is drawn or a census
is taken.
2. sampling errors are error which is attributable to sampling,
and which therefore, is not present in information gathered
in a census.
Problems in Sampling
1.Non-Sampling Error: refers to
◦ Non-coverage error
◦ Wrong population is being sampled
◦ Non response error
◦ Instrument error
◦ Interviewer’s error
Non-Coverage sampling error: This refers to sample frame
defect.
◦ Omission of part of the target population (for instance,
soldiers, students living on campus, people in hospitals,
prisoners, households without a telephone in telephone
surveys, etc).
Problems in Sampling
The wrong population is sampled
◦ Researchers must always be sure that the group being
sampled is drawn from the population they want to
generalize about or the intended population.
Non response error – Common in self-administered surveys
◦ This error occurs when you are not able to find those
whom you were supposed to study.
◦ Some people refuse to be interviewed because they are
ill, are too busy, or simply do not trust the interviewer.
◦ When one is forced to interview substitutes, an
unknown bias is introduced.
Problems in Sampling
Instrument error
◦ The word instrument in sampling survey means the
device in which we collect data- usually a
questionnaire.
◦ When a question is badly asked or worded, the
resulting error is called instrument error.
Example: leading questions or carelessly worded
questions may be misinterpreted by some
researchers.
Problems in Sampling
Interviewer error :
◦ Enumerator can distort the results of a survey by in-
appropriate suggestions, word emphasis, tone of voice
and question rephrasing.
◦ Cheating by enumerators -with only limited training and
under little direct supervision.
◦ Perceived social distance between enumerator and
respondent also has a distorting effect.
E.G: questions about sexual behavior might be
differently answered depending on the gender of the
interviewer.
Problems in Sampling
2 Sampling Errors
◦ Error which is attributable to sampling, and which
therefore is not present in a census.
◦ Sampling errors can be calculated only for probability
samples.
◦ Increasing the sample size is one of the major
instruments to reduce the extent of the sampling error.
◦ Sampling error is related to confidence intervals.
A narrower confidence interval means more precise
estimates of the population for a given level of confidence.
Recap: Sampling
The sampling process
Step 1: Define the population, sampling units, extent and
time.
Step 2: Get a research permit if this is required in the
place you work in.
Step 3: Construct the sampling frame.
Step 4: Determine the sample size.
Step 5: Select a sampling procedure.
Step 6: Select the sample.
158
Chapter Five: Data Collection
and Management
/Data Processing and Analysis/
Integrity
Integrity refers to the trustworthiness of the
information.
Data should not be modified inappropriately,
whether accidentally or deliberately.
The right information is used.
Data Collection Techniques
Disadvantages:
◦ Very biased toward wealthy - in Ethiopia
◦ Biased toward young everywhere – even the very poor
have less online access in industrialized world
the demographic profile of the internet user does not
always represent the general population.
◦ Therefore, before doing an e-mail or internet survey,
carefully consider the effect that this bias might have on
the results.
Questionnaire Design
Actual instrument design begins by drafting specific
measurement questions in the form of a questionnaire.
Questionnaires are easy to analyze.
Data entry and tabulation can be easily done with
many computer software packages.
Questionnaires are familiar to most people.
Nearly everyone has had some experience
completing questionnaires and they generally do not
make people apprehensive.
Questionnaire Design
Questionnaires
reduce bias.
There is uniform question presentation.
The researcher's own opinions will not influence the
answer.
Mailed questionnaires are less intrusive.
When a respondent receives a questionnaire by mail,
he/she is free to complete the questionnaire on
his/her own time-table.
Questionnaire Design
The main Components of a questionnaire
◦ Identification data: respondent’s name, address, time and
date of interview, code of interviewer, etc.
◦ Instruction: Include clear and concise instructions on
how to complete the questionnaire.
◦ Information sought: major portion of the questionnaire
◦ Covering letter: brief purpose of the survey, who is doing
it, time involved, etc.
Questionnaire Design
When the goals of a study can be expressed in a few clear
and concise sentences, the design of the questionnaire
becomes considerably easier.
Hence, ask only questions that directly address the study
goals.
◦ Avoid the temptation to ask questions because it would
be "interesting to know".
Questionnaire Design
As a general rule, long questionnaires get less response
than short questionnaires.
◦ Hence, keep your questionnaire short to maximize
response rate – essentials.
Minimizing the number of questions is highly desirable,
but we should never try to ask two questions in one.
Questionnaire Design
In developing a survey instrument the following issues
need to be considered carefully:
Question content
Question wording
Response form
Question sequence
Questionnaire Design
1. Question Content
Question content depends on the respondent’s:
◦ ability, and
◦ willingness to answer the question accurately.
a) Respondents’ ability:
◦ The respondent information level should be
assessed.
Questions that overtax the respondent’s recall
ability may not be appropriate.
Questionnaire Design
b) Willingness of respondent to answer
◦ Even if respondents have the information, they may be
unwilling to give it.
◦ Some of the main reasons for unwillingness:
The situation is not appropriate for disclosing the
information – embarrassing or sensitive
Disclosure of information is a potential threat to the
respondent
topic is irrelevant and uninteresting for them.
Questionnaire Design
to secure more complete and truthful information
Use indirect statements i.e., “other people”
Change the design of the questioning process.
Apply appropriate questioning sequences that will lead
a respondent from „safe“ question gradually to those
that are more sensitive.
Begin with non-threatening and interesting
questions.
Questionnaire Design
Different types of questions
Types of questions depend on research question and
affect the nature of analysis
◦ Attributes – characteristics of respondents (e.g., age,
sex, etc.)
◦ Behaviour – what people do
◦ Beliefs – what people believe
◦ Knowledge – what people know
◦ Attitudes – what is desirable
Questionnaire Design
Questions should be
◦ Relevant
◦ reliable – same response by same individual and
different people should understand the question the
same way
◦ discriminating – should capture sufficient variation
◦ increasing response rates – sensitive questions and
poor survey administration can reduce response rates
Questionnaire Design
Questions should be
◦ Simple and short
◦ About issues respondents have knowledge of
◦ With same meaning to all
Questions should not be
◦ Double-barrelled – do not ask two questions
◦ Leading – push people to answer in a certain way
◦ Avoid words like usually, often, sometimes, occasionally,
seldom, etc.
Questionnaire Design
2. Question Wording: Using Shared Vocabulary
In a survey the two parties must understand each
other and this is possible only if the vocabulary used
is common to both parties.
So, don’t use uncommon words or long sentences
or abbreviations and make items as brief as possible.
And, don’t use emotionally loaded or vaguely
defined words.
Questionnaire Design
3. Response structure or format -
Refers to the degree and form of the structure imposed
on the responses.
◦ Open-ended or closed questions
a) Open Ended Questions
◦ In open-ended questions respondents can give any
answer.
They may express themselves extensively.
The freedom may be to choose a word in a “fill in “
question.
Questionnaire Design
Advantage
◦ Permit an unlimited number of answers
◦ Respondents can qualify and clarify responses
◦ Permit creativity, self expression, etc.
Limitations
responses may not be consistent.
Some responses may be irrelevant
Comparison and statistical analysis difficult.
Articulate and highly literature respondents have an
advantage, etc.
Questionnaire Design
b) Closed Questions
◦ Generally preferable in large surveys.
dichotomous or multiple-choice questions.
Advantages
◦ Easier and quicker for respondents to answer
◦ Easier to compare the answers of different respondents
◦ Easier to code and statistically analyze
◦ Are less costly to administer
◦ reduce the variability of responses
◦ make fewer demands on interviewer skill, etc.
◦ don’t discriminate against the less talkative
Questionnaire Design
Limitations
◦ Can suggest ideas that the respondents would not
otherwise have
◦ too many choices can confuse respondents
During the construction of closed ended questions:
The response categories provided should be exhaustive.
They should include all the possible responses that
might be expected.
The answer categories must be mutually exclusive.
Questionnaire Design
4) Question Sequence – the order of the questions
The order in which questions are asked can affect the
overall data collection activity.
Grouping questions that are similar will make the
questionnaire easier to complete, and the respondent
will feel more comfortable.
◦ Questions that use the same response formats, or
those that cover a specific topic, should appear
together.
Questionnaire Design
Questions that jump from one unrelated topic to another
are not likely to produce high response rates.
Each question should follow comfortably from the
previous question.
Transitions between questions should be smooth.
Questionnaire Design
5) Physical Characteristics of a Questionnaire
An improperly laid out questionnaire can lead respondents
to miss questions, can confuse them.
So, take time to design a good layout
◦ ease to navigate within and between sections
◦ ease to use the questionnaire in the field; e.g., questions
on recto and codes on verso sides of the questionnaire
◦ leave sufficient space for open-ended questions
◦ questionnaire should be spread out properly.
Questionnaire Design
Putting more than one question on a line will result in
some respondents skipping the second question.
Abbreviating questions will result in misinterpretation
of the question.
Formats for Responses
◦ A variety of methods are available for presenting a
series of response categories.
Boxes
Blank spaces
Questionnaire Design
Providing Instructions
◦ Every questionnaire whether to be self administered by
the respondent or administered by an interviewer should
contain clear instructions.
General instructions: basic instructions to be followed in
completing it.
Introduction: If a questionnaire is arranged into subsections
it is useful to introduce each section with a short
statement concerning its content and purpose.
Questionnaire Design
Specific Instructions: Some questions may require special
instructions.
Interviewers instruction: It is important to provide clear
complementary instruction where appropriate to the
interviewer.
Questionnaire Design
6) Reproducing the questionnaire
A neatly reproduced instrument will encourage a higher
response rate, thereby providing better data.
◦ Pilot Survey: The final test of a questionnaire is to try it
on representatives of the target audience.
◦ If there are problems with the questionnaire, they
almost always show up here.
Data Management
Data analysis ranges from very simple summary statistics
to extremely complex multivariate analyses.
Data Preparation and Presentation
Data processing starts with the editing, coding,
classifying and tabulation of the collected data.
Data Management
i) Editing
◦ Editing of data is the process of examining the
collected raw data to detect errors and omissions.
◦ In general one edits to assure that the data are:
Accurate
Consistent with other information/facts gathered
Uniformly entered
Data Management
The editing can be done at two levels
a) Field level Editing
After an interview, field workers should review
their reporting forms, complete what was
abbreviated, translate personal shorthand, rewrite
illegible entries, and make callback if necessary.
b) Central editing
when all forms have been completed and returned
to the office data editors correct obvious errors
such as entry in wrong place, recorded in wrong
units, etc.
Data Management
ii) Coding
Coding refers to the process of assigning numerals to
answers so that responses can be put into a limited
number of categories or classes -coding sheet.
iii) Classification and Tabulation
large volume of raw data must be reduced into
homogenous groups if we are to get meaningful
relationships.
Classification is the process of arranging data in groups or
classes on the basis of common characteristics.
Data Management
Tabulation is the orderly arrangement of data in columns
and rows.
Simple or complex tables.
◦ Simple tabulation gives information about one variable.
◦ Complex tabulation shows the division of data into two
or more categories.
SPSS, R, excel, STATA, etc.
Data Management
Tabulation provides the following advantages:
It conserves space and reduces explanatory and
descriptive statement to a minimum.
It facilitates the process of comparison
It facilitates the summation of items and the detection
of errors and omissions
It provides a basis for various statistical computations
such as measures of central tendencies, dispersions, etc.
Data Measurement
•Data Measurement
•Measurement of the data is the first step in the
process that ultimately guides the final analysis.