Data Collection Methods Chapter 5
Data Collection Methods Chapter 5
Collection
Methods
L. Daniel
Chapter 5 Summary
J. Johnson
H. Ford
Value of Data
Quantitative
Data
Qualitative Data
Example
Oil Painting
Qualitative data:
blue/green color, gold frame
smells old and musty
texture shows brush strokes of oil paint
peaceful scene of the country
masterful brush strokes
Oil Painting
Quantitative data:
picture is 10" by 14"
with frame 14" by 18"
weighs 8.5 pounds
surface area of painting is 140 sq. in.
cost $300
Scientific Rigor
Quantitative Methods of Data
Collection
More Objective and Accurate Information
with Standardized Methods
Can be Replicated
Summative Friendly
Both are affected to some degree by the perceptions and beliefs of investigators and data collectors.
Philosophical
Distinction &
Credibility of
Findings
Philosophical Distinction
Within the world of educational researchers and scholars, many differ on their
approaches to data and its use within educational circles. This, according to our
reading, is due to ...the nature of knowledge and how it is best acquired. (p.53)
This debate affects how research designs are created, and which form, qualitative
or quantitative, might be used.
Qualitative Research
versus
qualitative
research
Though distinction is
now being made between Qualitative work (large
Q) which relies on ethnographic fieldwork and actual observation, while
qualitative work (little q) focuses to open-ended data collection such as
interviewing embedded in structured research (Kidder and Fine, 1987).
Credibility of Findings
Evaluation and designs are created for a plethora of audiences. For this
reason, the creator of the evaluation needs to keep in mind the
audience that will be scrutinizing or using this evaluation.
For example, many stakeholders for NSF projects or within the State
favor a more qualitative approach, while those in the educational
community such as parents might be intimidated by heavy numbers or
statistical data.
*All Clipart retrieved from: http://www.bing.com/images/search?q=free%20credible%20clipart&qs=n&form=QBIR&pq=free%20credible%20clipart&sc=0-19&sp=-1&sk=
Staff Skills
-Qualitative methods require
staff to be highly skilled and
takes considerable training of
the staff involved.
Costs
-It is difficult to generalize which research
methods approach is more costly.
-Small studies are cheaper, but they
provide limited data (use of surveys and
questionnaires).
-True experiments (large scale) with
participants in treatment and control groups
collect more robust findings, but are
much more costly.
Time Constraints
-Any good evaluation will require time to
implement.
design and
Mixed-Methods Approach
-When using different methods and sources to collect data and
throughout the evaluation process, the research team can focus on the
strengths of each type of data collection.
-Using the mixed-methods approach helps minimize the weaknesses of
any one singular approach.
-The mixed-methods approach increases the validity and reliability of
evaluation data.
Triangulation
Triangulation is when researchers use more than one method to study
the same phenomenon.
Advantages:
-improved instrumentation for all data
approaches
-sharpens the evaluators understanding
findings
collection
of the
Disadvantages of
-Triangulation can cause problems during a
Triangulation
-Sometimes different sources yield different
they may even be
contradictory).
research study.
information (sometimes
Question:
How is data
collected at
your school
and how
does that
data drive