Research Methods Lecture 1
Research Methods Lecture 1
METHODS
WHAT IS RESEARCH?
Exploration:This is done when you are trying to generate ideas about something.
Description: This is done when you want to describe the characteristics of something or some
phenomenon.
Explanation: This is done when you want to show how and why a phenomenon operates as it
does. If you are interested in causality, you are usually interested in explanation.
Prediction: This is your objective when your primary interest is in making accurate predictions.
Note that the advanced sciences make much more accurate predictions than the newer social
and behavioral sciences.
Influence: This objective is a little different. It involves the application of research results to
impact the world. A demonstration program is an example of this.
Best and Khan (1995) define research as the systematic and objective analysis
and recording of controlled observations that may lead to the development of
generalisations, principles or theories, resulting in prediction and possibly
ultimate control of events. Due to the abstract nature of this definition, they stated
a summary of characteristics of research which according to Best and Khan
(1995) may help to clarify its meaning.
The characteristics are summarised below. Research:
emphasises the development of generalisations, principles or theories that will be
helpful in predicting future occurrences;
is based upon observable experience or empirical evidence;
involves gathering of new data from primary or first-hand sources or using
existing data for a new purpose;
is often characterised by carefully designed procedures that apply rigorous
analysis;
requires expertise;
strives to be objective and logical, applying every possible test to validate the
procedures employed, the data collected and the conclusions reached;
involves the quest for answers to unresolved problems;
is characterised by patient and unhurried activity;
is carefully recorded and reported;
and sometimes requires courage.
CLASSIFICATION OF EDUCATIONAL RESEARCH
Basic reserch aims at obtaining empirical data to formulate and expand theory.
Aim is to expand the frontiers of knowledge without regard to practical
application.
Applied research aims at solving immediate problems
Tries to improve current practices
QUALITATIVE AND QUANTITATIVE RESEARCH;
When collecting and analyzing data, quantitative research deals with numbers and
statistics, while qualitative research deals with words and meanings. Both are
important for gaining different kinds of knowledge.
Quantitative research: Quantitative research is expressed in numbers and
graphs. It is used to test or confirm theories and assumptions. This type
of research can be used to establish generalizable facts about a topic.
Common quantitative methods include experiments, observations recorded as
numbers, and surveys with closed-ended questions.
Qualitative research: Qualitative research is expressed in words. It is used
to understand concepts, thoughts or experiences. This type of research
enables you to gather in-depth insights on topics that are not well
understood.
Common qualitative methods include interviews with open-ended questions,
observations described in words, and literature reviews that explore concepts
and theories.
Quantitative data collection methods
Surveys: List of closed or multiple choice questions that is distributed to a sample (online, in
person, or over the phone).
Experiments: Situation in which variables are controlled and manipulated to
establish cause-and-effect relationships.
Observations: Observing subjects in a natural environment where variables can’t be
controlled.
Qualitative data collection methods
Interviews: Asking open-ended questions verbally to respondents.
Focus groups: Discussion among a group of people about a topic to gather opinions that can
be used for further research.
Ethnography: Participating in a community or organization for an extended
period of time to closely observe culture and behavior.
Literature review: Survey of published works by other authors.
When to use qualitative vs. quantitative research
A rule of thumb for deciding whether to use qualitative or quantitative data is:
Use quantitative research if you want to confirm or test something (a
theory or hypothesis)
Use qualitative research if you want to understand something (concepts,
thoughts, experiences)
Quantitative research approach
You survey 300 students at your university and ask them questions such as: “on
a scale from 1-5, how satisfied are you with your professors?”
You can perform statistical analysis on the data and draw conclusions such as:
“on average students rated their professors 4.4”.
Qualitative research approach
You conduct in-depth interviews with 15 students and ask them open-ended
questions such as: “How satisfied are you with your studies?”, “What is the most
positive aspect of your study program?” and “What can be done to improve the
study program?”
Based on the answers you get you can ask follow-up questions to clarify things.
You transcribe all interviews using transcription software and try to find
commonalities and patterns.
Mixed methods approach
You conduct interviews to find out how satisfied students are with their studies.
Through open-ended questions you learn things you never thought about before
and gain new insights. Later, you use a survey to test these insights on a larger
scale.
It’s also possible to start with a survey to find out the overall trends, followed by
interviews to better understand the reasons behind the trends.
HOW TO ANALYZE QUALITATIVE AND
QUANTITATIVE DATA
1. Generally uses only one group for treatment which makes observation
simple and easy.
2. Validates the experiment in the preliminary phase itself.
3. Pre-experimental design tells the researchers how their intervention
will affect the whole study.
4. As they are conducted in the beginning, pre-experimental designs give
evidence for or against their intervention.
1. It does not involve the randomization of the
participants.
2. It generally does not involve the control group, but
in some cases where there is a need for studying
the control group against the treatment group,
static-group comparison comes into the picture.
3. The pre-experimental design gives an idea about
how the treatment is going to work in case of actual
true experiments.
ADVANTAGES OF PRE-EXPERIMENTAL
DESIGNS
1. Cost-effective due to its easy process.
2. Very simple to conduct.
3. Efficient to conduct in the natural environment.
4. It is also suitable for beginners.
5. Involves less human intervention.
6. Determines how your treatment is going to affect the
true experiment.
DISADVANTAGES OF PRE-EXPERIMENTAL
DESIGNS
Higher external validity than most true experiments, because they often involve
real-world interventions instead of artificial laboratory settings.
Higher internal validity than other non-experimental types of research, because
they allow you to better control for confounding variables than other types of
studies do.
Lower internal validity than true experiments—without randomization, it can
be difficult to verify that all confounding variables have been accounted for.
The use of retrospective data that has already been collected for other
purposes can be inaccurate, incomplete or difficult to access.
TRUE EXPERIMENTAL RESEARCH DESIGN
For psychologists and behavioral biologists, for example, there can never be
any guarantee that a human or living organism will exhibit ‘normal’ behavior
under experimental conditions.
True experiments can be too accurate and it is very difficult to obtain a
complete rejection or acceptance of a hypothesis because the standards of
proof required are so difficult to reach.
Examples of Experimental Research
Experimental research examples are different, depending on the type of
experimental research design that is being considered. The most basic example
of experimental research is laboratory experiments, which may differ in nature
depending on the subject of research.
Administering Exams After The End of Semester
During the semester, students in a class are lectured on particular courses and an exam is
administered at the end of the semester. In this case, the students are the subjects or
dependent variables while the lectures are the independent variables treated on the
subjects.
Only one group of carefully selected subjects are considered in this research, making it a
pre-experimental research design example. We will also notice that tests are only carried
out at the end of the semester, and not at the beginning.
Further making it easy for us to conclude that it is a one-shot case study research.
Employee Skill Evaluation
Before employing a job seeker, organizations conduct tests that are used to
screen out less qualified candidates from the pool of qualified applicants. This
way, organizations can determine an employee's skill set at the point of
employment.
In the course of employment, organizations also carry out employee training to
improve employee productivity and generally grow the organization. Further
evaluation is carried out at the end of each training to test the impact of the
training on employee skills, and test for improvement.
Here, the subject is the employee, while the treatment is the training conducted.
This is a pretest-posttest control group experimental research example.
Evaluation of Teaching Method
Let us consider an academic institution that wants to evaluate the
teaching method of 2 teachers to determine which is best. Imagine
a case whereby the students assigned to each teacher is carefully
selected probably due to personal request by parents or due to
stubbornness and smartness.
This is a no equivalent group design example because the samples
are not equal. By evaluating the effectiveness of each teacher's
teaching method this way, we may conclude after a post-test has
been carried out.
However, this may be influenced by factors like the natural
sweetness of a student. For example, a very smart student will
grab more easily than his or her peers irrespective of the method of
teaching.
WHAT ARE THE CHARACTERISTICS OF
EXPERIMENTAL RESEARCH?
Variables
Experimental research contains dependent, independent and extraneous
variables. The dependent variables are the variables being treated or
manipulated and are sometimes called the subject of the research.
The independent variables are the experimental treatment being exerted on the
dependent variables. Extraneous variables, on the other hand, are other factors
affecting the experiment that may also contribute to the change.
Setting
The setting is where the experiment is carried out. Many experiments are carried out in the
laboratory, where control can be exerted on the extraneous variables, thereby eliminating
them.
Other experiments are carried out in a less controllable setting. The choice of setting used
in research depends on the nature of the experiment being carried out.
Multivariable
Experimental research may include multiple independent variables, e.g. time, skills, test
scores, etc.
WHY USE EXPERIMENTAL RESEARCH DESIGN?
It is highly prone to human error due to its dependency on variable control which may
not be properly implemented. These errors could eliminate the validity of the
experiment and the research being conducted.
Exerting control of extraneous variables may create unrealistic situations. Eliminating
real-life variables will result in inaccurate conclusions. This may also result in
researchers controlling the variables to suit his or her personal preferences.
It is a time-consuming process. So much time is spent on testing dependent
variables and waiting for the effect of the manipulation of dependent variables to
manifest.
It is expensive.
It is very risky and may have ethical complications that cannot be ignored. This is
common in medical research, where failed trials may lead to a patient's death or
a deteriorating health condition.
Experimental research results are not descriptive.
Response bias can also be supplied by the subject of the conversation.
Human responses in experimental research can be difficult to measure.
WHAT ARE THE DATA COLLECTION METHODS
IN EXPERIMENTAL RESEARCH?
Observational Study
This type of study is carried out over a long period. It measures and observes the
variables of interest without changing existing conditions.
Simulations
This procedure uses mathematical, physical, or computer models to replicate a
real-life process or situation. It is frequently used when the actual situation is too
expensive, dangerous, or impractical to replicate in real life.
Surveys
A survey is a tool used to gather relevant data about the characteristics of a
population and is one of the most common data collection tools. A survey
consists of a group of questions prepared by the researcher, to be answered by
the research subject.
Not much control
WHAT ARE THE DIFFERENCES BETWEEN
EXPERIMENTAL AND NON-EXPERIMENTAL RESEARCH
Historical research enables you to explore and explain the meanings, phases and
characteristics of a phenomenon or process at a particular point of time in the past. We
differentiate historical research as a research strategy from the research of history, which refers
to research in the discipline of history.
The variable focus of your research is time. Your essential aim is to identify appearances of your
chosen phenomenon in a temporally defined situation and environment. The strategy of
historical research is also suitable in other disciplines as it enables you to focus on exploring the
historical appearances of phenomena.
The strategy of historical research is linked to the strategy of hermeneutics, as defining and
explaining events in the past are based on interpretations. You can, as in hermeneutic research,
use various approaches. You can use a variety of methods of analysis. Qualitative analysis is
the norm, but quantitative analysis can also explain the past.
Ethnographic research is a qualitative method where researchers observe and/or
interact with a study’s participants in their real-life
environment. Ethnography was popularised by anthropology, but is used across a
wide range of social sciences.
Within the field of usability, user-centred design and service design, ethnography is used
to support a designer’s deeper understanding of the design problem –
including the relevant domain, audience(s), processes, goals and context(s) of use.
The aim of an ethnographic study within a usability project is to get ‘under the skin’ of a
design problem (and all its associated issues). It is hoped that by achieving this, a
designer will be able to truly understand the problem and therefore design a far better
solution.
THANK YOU