Action Research
Uploaded by
Bekuretsion H/SilassieAction Research
Uploaded by
Bekuretsion H/Silassieebook
THE GUILFORD
PRESS
Action ReseARch in educAtion
Action ResARch
in Education
A PRActicAl Guide
Sara Efrat Efron
Ruth Ravid
the GuilFoRd PRess
York London
© 2013 The Guilford Press
72 Spring Street, New York, NY 10
012
www.guilford.com
All rights reserved
No part of this book may be reprodu
ced, translated, stored in a retrieval
system,
microfilming, recording, or otherwi
se, without written permission from
the publisher.
digit print 8 3 2
Printed in the United States of Amer
ica
This book is printed on acid-free pa
per. cm
Last is 9 76 5 4 1
mber:
Library of Congress Cataloging-in-
Publication Data
Efron, Sara Efrat.
2012050760
pages
ISBN 978-1-4625-0961-4 (pbk. :
alk. paper)—ISBN 978-1-4625-
0971-3 (cloth :
alk. paper)
LB1028.24.E34 2013
Preface
T
his book was written for
practicing and prospectiv
ners who would like to carry out action research in their current or future
e educators. Our main go
al
in writing this book was
to provide practical guid
elines for school practiti
o-
based studies, they strive to question taken-for- educational settings. Acti
on research has been em
braced by a growing nu
mber of
teachers, administrators,
counselors, specialists, s
chool aides, and other
school
personnel as a viable co
mponent of their professi
onal practice. They belie
ve that
action research can enha
nce their ability to grow
professionally, to tackle
v
class-
assume responsibility for
their own practice. As sc
hool practitioners who c
onduct
granted
choices available to the
m and the meanings an
d implications of their
choices.
Thus, action research is
a powerful strategy for e
nhancing educators’ prof
ession-
alism and improving the
quality of their students’
learning, thereby empow
ering
educators to become acti
ve partners in leading sch
ool change and powerful
agents
of educational renewal.
courses that prepare novi
ce school- based research
ers to conduct action rese
arch in
their educational settings
. The book is also useful
for practicing classroom
teach-
who are interested in con
ducting action research f
or the first time, as part o
f their
vi Preface
professional development. Additionally, the book can be used as a self-study text
by educators who are interested in conducting action research projects in con-
junction with their everyday instructional practices and activities in schools and
classrooms.
which stems from our focus on meeting the needs of beginning researchers and
introducing them to the knowledge, understandings, and skills necessary for con-
ducting classroom and school investigations. The practical orientation has also
emerged from our long and extensive experience with teaching and conducting
action research and our close collaboration with teacher researchers. Teachers and
other educators may find two distinct aspects of the book particularly beneficial
for incorporating action research into their practice: an evenhanded account of
methods approaches and a chapter devoted
to assessment. While qualitative research methods (e.g., observations, interviews,
and rich narratives) enhance the sensitivity of action researchers to the nuanced
world of the school, the classroom, and the students, numerical data (e.g., test
scores and attendance records) provide an effective tool to assess, describe, and
analyze other aspects of school life. The decision about which approach to use—
ing to the nature of their research questions, the focus of their studies, the par-
ticular settings in which the research occurs, and their interests and dispositions.
Therefore, in this book, qualitative and quantitative approaches are balanced and
given equal weight. Each step of the action research process is described from the
methods approaches, and we
explain how they differ in viewing school reality, and how the different methods
The same practical approach and emphasis on the needs of educational practi-
tioners led us to also include a chapter devoted to assessment, even though it is not
usually included in books on action research, because we believe that assessment
has an essential role in the process of action research. Assessment information can
be a valuable data source as educators assess the effectiveness of their practice,
examine their teaching strategies, explore a new curriculum unit, or appraise a
schoolwide program. In the book we describe how to design and evaluate multiple
assessment tools and the role assessment plays in educators’ quest to improve their
practice through action research. We discuss the contributions of each method for
insight into each student’s learning and growth.
Preface vii
The Book’s organizaTion
The book’s organization has grown out
of the actual cycle of action research. T
he
discussion of each step presents three
perspectives: it starts with the qualitat
ive
method, continues with the quantitativ
e method, and ends with mixed meth
ods.
While in reality action research investi
gation is a dynamic and fluid process,
X the
beginning researchers to undertake an
action research project. However, at ti
mes,
action researchers or students and the
X ir instructors may feel that their rese
arch
projects require them to skip around a
chapter and go back and forth between
dif-
X
ferent steps of the action research proc
ess. They are invited to do that. Follow
ing
is a brief overview of the content of eac
h chapter:
X
X Chapter 1: Introduction to Ac
tion Research. This chapter presents
an
overview of educational research, exp
laining the differences between traditi
X
onal
as researchers in their own settings. Th
e chapter also explores the theoretical r
oots
of action research and its historical bac
kground.
X Chapter 2: Choosing and Learn
ing about Your Research Topic. We s
tart
this chapter by looking at the process
of identifying a topic to be explored
and
research and for articulating the specifi
c questions, objectives, or hypotheses t
hat
the study aims to explore are also pres
ented.
X Chapter 3: Approaches to Actio
n Research. In this chapter we examin
e the
differences between action research an
d traditional research. We also explore
the
digms: qualitative methods, quantitativ
e methods, and mixed methods.
X Chapter 4: Developing a Plan
of Action. This chapter highlights the
key
decisions needed for designing qualitati
ve, quantitative, and mixed- methods pr
ac-
research plan. Issues related to the eth
ical considerations involved in conduct
ing
practitioner research are also discussed
.
X Chapter 5: Data Collection To
ols. This chapter describes the most c
om-
mon types of data collection strate
gies, both qualitative and quantitat
ive.
viii Preface
Practical guidelines and examples are provided for constructing myriad data
collection tools.
Chapter 6: Using Assessment Data in Action Research. This chapter dis-
X X
cusses the most common classroom assessment tools used in action research. Tra-
Chapter 7: Data Analysis and Interpretation. This chapter provides a step-
X X
by-step description of the process and techniques for qualitative, quantitative, and
methods data analysis and interpretation. We describe the most common
and practical approaches for organizing, analyzing, interpreting, and drawing con-
clusions for different types of data.
Chapter 8: Writing, Sharing, and Implementing the Research Findings. This
X X
chapter discusses various ways of reporting the research study. We highlight ways
used to improve their practice and be shared with other educators.
In writing this book, we had in mind the educational practitioners we have
had the privilege of teaching over the years. We avoided using academic and tech-
nical language and instead used language that is approachable and engaging. We
also included examples and vignettes drawn from our students’ experiences to
demonstrate the full cycle of action research. These examples were taken from a
variety of educational teaching and learning situations, school subjects, instruc-
tional topics, and age groups to authentically illustrate and bring to life the expe-
rience of action researchers. Pedagogical features that enhance the usefulness of
each chapter’s material include:
X Sample templates for assisting the development of research instruments at
X
each of the steps involved in the research process.
X Checklists of suggestions and guidelines that enable researchers to
X assess the
progress and quality of their own studies.
X Summary tables that highlight the particular aspects of different research
X
strategies.
X Example boxes that illustrate the different sections of practitioners’ action
X
research studies.
X Chapter summaries that review and highlight the main points discussed in
X
each chapter.
Preface ix
Exercises and activities that invite students to review, explore further, or
X X
apply the methods discussed in the chapter. These activities can be done
during or following the class, individually or in groups.
Additional readings that direct the students to sources beyond the many
X X
references cited throughout the text.
AcknowledGments
We would like to thank our editor at The Guilford Press, C. Deborah Laughton,
who provided us with support, guidance, and helpful advice. Her quick responses
to our inquiries, her trust in us, her professionalism, and her expertise ensured
the success of this book. We would also like to thank Editorial Assistant Mary
Beth Anderson for her timely and useful responses and for guiding us through the
process of the book’s production. Additionally, we want to express our apprecia-
tion to Louise Farkas, Senior Production Editor, and the production staff for the
meticulous and helpful editing of the book. We also offer our gratitude to graphic
designer Amy Charlson for her professional work and for her ability to understand
our intentions even before we expressed them and then translate our simple designs
into a work of art. Special thanks are due to Donna Rafanello, who read each draft
of the manuscript and offered excellent editorial comments and suggestions for
revisions. We also want to express our appreciation to the book reviewers, Lauren
B. Birney, Assistant Professor in the School of Edcuation at Pace University, and
Cheryl A. Kreutter, Assistant Professor in the Ella Cline Shear School of Educa-
tion at SUNY Geneseo, who devoted time and effort to a thorough reading of the
the final draft of the book. We want to recognize with gratitude and express our
appreciation to the many wonderful students we have had over the years. We are
forever indebted to each and every one of you. You have enriched us with your
experience, knowledge, sensitivities, and insight.
thank her husband, David, for his understanding, love, and support throughout
the writing process and would like to dedicate the book to her children, Noa,
Jesse, and Jonathan, who bring so much meaning to her life. Ruth would like to
into her life each and every day.
Brief contents
chAPteR 1
introductio 1
n to action
Research
xi
chAPteR 2 choosing and 1
Learning about Your Res 3
earch topic
chAPteR 3 3
approaches
to action R
esearch
chAPte 5
R 4 dev
eloping
a Plan of
action
chA
Pte
R 5
dat
a c
olle
ctio
n to
ols
chAPteR 6 using as 1
sessment data in ac
tion Research
chAPteR 7 1
data analysi
s and interp
retation
chAPteR 8 Writing, Sharing, a 225
nd implementing the Research
Findings
2
Re
fer
en
ce
s
a
S
a 2
b
o
u
t
t
h
e
a
u
t
h
o
r
s
Extended contents
chAPteR 1 introducti
on to Action Resear 1
ch
xiii
What Is Educational Research? 2
Practitioners as Researchers 3
Historical Perspectives 4
The Unique Characteristics of Action Research 7
Chapter Summary 9
Chapter Exercises and Activities 11
Additional Readings 12
chAPteR 2 choosing and learning a 13
bout Your Research topic
Choosing Your Research Topic 13
Framing the Research Problem Statement 15
B ox 2 .1. Research Problem Statement of a Sixth-Grade Teac
her
Conducting Research to Determine the Success of A
pplying
Differentiated Instruction in Her Classroom 16
Developing the Literature Review 17
Step 1: Locating Sources for the Literature Review 19
Step 2: Reading Literature to Identify Themes 21
Step 3: Constructing a Literature Review Outline 23
Step 4: Writing the Literature Review 25
Introduction 27
Main Section of the Review 27
xiv Extended contents
Box 2.2. An Opening Paragraph from the Main Section
of the Literature Review 28
Box 2.3. A Paragraph from the Literature Review 28
Summary and Concluding Remarks 29
Box 2.4. An Opening Paragraph from the Literature Review:
Moving from the General to the More Specific 29
Formulating Specific Research Question(s) 31
Questions in Qualitative Action Research 31
Questions in Quantitative Action Research 32
Questions in Mixed-Methods Action Research 33
Examples of Research Problems: From the General to the Specific 33
Chapter Summary 35
Chapter Exercises and Activities 37
Additional Readings 38
chAPteR 3 Approaches to Action Research 39
Educational Research Approaches 39
Qualitative Educational Research 40
Assumptions about School Reality 40
Research Purpose 40
Researcher Role 41
Research Process 41
Common Qualitative Methods 41
Case Study 41
Ethnographic Research 42
Narrative Research 42
Critical Research 42
Quantitative Educational Research 43
Assumptions about School Reality 43
Research Purpose 43
Researcher Role 43
Research Process 44
Common Quantitative Methods 44
Experimental Research 44
Causal– Comparative (Ex Post Facto) Research 4 4
Correlational Research 45
Descriptive Research 45
Extended contents xv
Mixed-Methods Research 45
Assumptions about School Reality 46
Research Purpose 46
Researcher Role 46
Research Process 46
Common Mixed Methods 46
Embedded-Design Research 46
Two-Phase Research 47
Integrated Research 47
Choosing an Approach for Your Resea
rch Project 47
Action Research Framework 49
Personal Worldview 49
Research Question 50
Chapter Summary 51
Chapter Exercises and Activities 52
Additional Readings 53
chAPt 5
eR 4 d
evelop
ing a
Plan o
f Actio
n
Considering Your Role as a Researche
r 56
B ox 4 .1. A Researcher Role Statement 5
8
Establishing the Research Scope 59
Identifying the Research Site and Parti
cipants 60
Research Site 60
Box 4.2. An Excerpt from a Research Site
Section 61
Research Participants 61
Box 4.3. A Description of Research Partici
pants 63
Choosing Data Collection Procedures
67
Ensuring the Study’s Validity and Tru
stworthiness 70
Qualitative Studies 70
Quantitative Studies 71
Mixed-Methods Studies 73
Developing Ethical Guidelines 74
Obtaining Permission to Conduct the Stu
dy 74
Confidentiality of Data Collected 74
Informed Consent 75
Respect toward the Research Site 75
Box 4.4. Sample Letter of Introduction 76
xvi Extended contents
Safety of the Participants 77
Box 4.5. Sample Informed Consent Form 77
Accurate Interpretation and Presentation of the Data 78
Creating a “To-Do” List 78
Finalizing the Research Plan 78
Chapter Summary 79
Chapter Exercises and Activities 82
Additional Readings 83
chAPteR 5 data collection tools 85
Observation 86
Qualitative Observation 87
The Process of Conducting Qualitative Observation 87
Observation Protocol 88
Observation Steps 90
Behavior Log 92
Photographs, Videotapes, and Audiotapes 93
Quantitative Observation 95
Tally Sheets 95
Checklists 96
Rating Scales 96
Interview 98
Unstructured, Semistructured, and Structured Interviews 98
Unstructured Interviews 98
Semistructured Interviews 98
Structured Interviews 99
The Interview Process 100
Developing the Interview Questions 101
Conducting the Interview 103
Before the Interview 103
During the Interview 104
After the Interview 104
Focus Group Interview 105
Online Interview 106
Surveys 107
The Process of Conducting Surveys 110
Extended Contents xvii
Writing the Survey Items: Types of Questions and Response Choices 111
Suggestions for Writing Survey Questions 112
Structured Responses 115
Unstructured (Open-Ended) Responses 121
Artifacts and Documents 123
Official and Personal Artifacts and Documents 123
Teacher Journals 125
Final Comments about Data Collection Tools 127
Chapter Summary 128
Chapter Exercises and Activities 131
Additional Readings 133
Websites for Survey Design 134
Chapter 6 Using assessment Data in action res 135
earch
Understanding Standardized Commercial Achievement Tests 137
Norm-Referenced Commercial Tests 137
Criterion-Referenced Commercial Tests 138
Te a c h e r - M a d e Te s t s , 1 39
Writing Instructional Objectives 140
Preparing a Table of Test Specifications 141
Constructing Teacher-Made Traditional Assessment Tools 142
Writing Test Items 142
Selection-Type Items 143
Supply-Type Items 147
Evaluating Traditional Teacher-Made Assessment Tools 149
Content Validity and Reliability of Tests 150
Looking at Students’ Response Choices 151
Using Teacher-Made Authentic Assessment Tools 152
Performance Assessment 153
Curriculum-Based Measurement 155
Using Rubrics to Assess Student Performance 156
Using Portfolios to Assess Students’ Performance 157
Final Comments about Classroom Assessment 161
Chapter Summary 161
Chapter Exercises and Activities 163
Additional Readings 164
xviii Extended contents
chAPteR 7 data Analysis and interpretation 165
Qualitative Data Analysis 166
Preparation for Analysis 168
Transforming Data into Readable Text 168
Sorting the Data into Files 168
Creating a Data File Organizer 168
Immersing Yourself in the Data 168
Analysis of the Data 169
Using Predetermined Categories 169
Using Emerging Categories 173
Synthesis and Interpretation of the Data 177
Identifying Patterns 177
Creating a Concept Map 180
Supporting the Findings with Evidence 182
Validating the Interpretation 182
Presentation of Data Analysis and Interpretation 184
Reporting on the Analysis Process 184
Reporting the Findings and Their Meanings 185
Quantitative Data Analysis 190
Entering, Organizing, Graphing, and Tabulating Data 191
Coding and Entering Data in Preparation for Data Analysis 191
Creating Frequency Distributions 192
Graphing Data 192
Tabulating Data 196
Computing Measures of Distribution Centers 197
Mode 197
Median 198
Mean 198
Outliers 199
Computing Measures of Distribution Variability 199
Range 199
Standard Deviation 200
Analyzing the Data 201
Measures of Association 201
Measures of Differences 203
Extended Contents xix
Evaluating the Statistical Findings 205
Statistical Significance 205
Practical Significance 207
Presenting the Findings 208
Mixed-Methods Data Analysis 210
Embedded Design 210
Two-Phase Design 211
Triangulation Design 212
Reporting the Study’s Results, Conclusions, a
nd Implications 215
Chapter Summary 217
Chapter Exercises and Activities 220
Additional Readings 223
Chapter 8 Writing, Sharing, and I 225
mplementing the research Finding
s
Writing a Formal Action Research Report 22
6
Introduction 226
Literature Review 227
Methodology 227
Researcher Role 227
Site and Participants 227
Data Collection Procedures 228
Data Analysis 228
Findings and Results 228
Discussion and Implications 229
References 229
Appendix 229
Developing Alternative Formats for Reporting
on Action Research 230
Poster Presentation 231
Research Portfolio 231
Electronic Media 232
Performance Presentation 232
Sharing the Research Findings 234
Implementing the Research Findings 238
Completing the Action Research Project 240
Becoming a Part of the Research Community
240
xx Extended Contents
Chapter Summary 241
Chapter Exercises and Activities 242
Additional Readings 243
Websites for Presenting Action Research 243
References 245
Author Index 257
Subject Index 260
About the Authors 268
chAPteR 1
introduction to
action Researc
h
A an option, rather than a requirement. Being aware of the important contri-
nn, a third-grade teacher, is frustra
ted. Several of her students fail to
do their
homework assignments on a regul
ar basis and seem to view home
work as
butions of homework to students’
achievements, Ann experiments wi
th different
kinds of homework, but to no ava
il. She seeks the help of the distri
ct curriculum
coordinator who directs her to a
well-known research article about
how to help
students develop positive attitude
s toward homework. Ann is imp
ressed by the
article but realizes that the recom
mendations offered are not releva
1
nt to her par-
ticular setting. The situation in h
er class is more complex and th
e article does
not address the challenges present
ed by her students. She understand
s that before
implementing any new strategy in
her classroom, she needs to gain a
better under-
also concludes that she needs to e
ducate herself by reading more ab
out different
approaches to homework.
implement appropriate strategies t
o improve her students’ attitudes t
oward home-
work and increase their homework
completion rate. She also decides t
o systemati-
cally analyze the results of her n
ew teaching strategies and determ
ine the effec-
tiveness of her new approach. Bas
ed on the outcomes of her assessm
ent, Ann will
decide whether to continue, modi
fy, or change the new strategies
she has been
using.
cal issues. Rather than trying to sol
ve the problem haphazardly or blin
dly following
strategies proposed by outside ex
perts, Ann conceptualized a differ
ent approach
2 action RESEaRcH in Education
tailored to her unique situation and the needs of her students. She decided that
to improve her students’ performance, a systematic approach was needed. Ann
designed a new approach to homework assignments and improved her students’
learning by following several steps: (1) gaining a better understanding of the causes
for her students’ reluctance to complete the homework assignments, (2) increas-
ing her knowledge of the topic of homework, (3) implementing new instructional
based actions. In fact, Ann was engaged in an action research study.
her research-
own settings in order to advance their practice and improve their students’ learn-
ing (e.g., D. M. Burton & Bartlett, 2005; Fox, Martin, & Green, 2007; Herr &
Nihlen, 2007; Jarvis, 1999; Menter, Eliot, Hulme, & Lewin, 2011). In education,
the terms action research and practitioner research are often used interchangeably
investigations in their classrooms and schools. You probably have come across
several other labels that describe this type of study, among them teacher research,
classroom research, and teacher as researcher. In this book, when we describe
we include other school members, such as administrators, specialists, counselors,
tutors, aides, and others who are involved in education. A growing number of
these practitioners have embraced action research and view it as a viable model
learning process. They feel
that action research enhances their ability to grow professionally, become self-
evaluative, and take responsibility for their own practice. Thus, action research
provides educators with a powerful strategy for being active partners in leading
Smith & Lytle, 2009; Hopkins, 2008).
traditional and action research, highlighting the important role of educational
practitioners as researchers in their own settings. Next, a brief historical perspec-
acteristics of action research. We end the chapter with our goals in writing the
book and present an overview of the book’s chapters.
whAt is educAtionAl ReseARch?
Before we explore action research, let’s examine what we mean by research and
specifically educational research. Research is an intentional, systematic, and
1. introduction to action Research 3
purposeful inquiry. Using an organized process of collecting and analyzing infor-
mation, the researcher seeks to answer a question, solve a problem, or understand
a phenomenon (Gall, Gall, & Borg, 2006; McMillan & Schumacher, 2010).
and learning. Traditional educational research is often conducted by university-
based researchers who carry out an investigation of others at the school setting.
The ultimate goal of this type of educational research is to develop universal theo-
ries and discover generalized principles and best strategies that ultimately improve
the quality of education.
the local population and are applicable in a wide variety of settings, investigations
are typically conducted on a carefully selected sample that represents a population
of interest. The researcher is usually an outsider, external to the particular context
being studied, and puts an emphasis on being uninvolved, objective, and unbiased
(Mertler & Charles, 2011).
a hierarchical process. The teachers and other school practitioners are seen as
recipients and consumers of knowledge produced by outside experts; their role is to
effectively implement the research findings in their schools and classrooms. Thus,
according to traditional educational research, there is a separation between theory
and action and between research and practice (Mertler, 2012).
PRActitioneRs As ReseARcheRs
For many years, school practitioners have recognized the value of traditional edu-
cational research and the contributions that it has made to the field of education.
Much of our understanding of the process of teaching and learning draws on stud-
ies done by researchers in the field of education, psychology, and other sciences.
As practitioners, we long for scientifically proven solutions when we encounter
problems that school life presents. When we confront an unruly group of students
or are frustrated by countless efforts to motivate an individual student, we wish
that we had a foolproof method that would allow us to solve our problems. As
practitioners we also realize the limitations of implementing generalized principles
and the shortcomings of applying universal theories to our practice. We recognize
tially similar. However, the uniqueness of each student and the particular histori-
cal, social, economic, and cultural context of each setting belie this viewpoint. As
4 action RESEaRcH in Education
educators we know from our experience in the complex dynamics of classrooms,
with their unpredictable interactions, that there is no single solution that will pro-
duce consistently successful results. What is effective in one situation may not be
productive in a different situation, and what works with one student may fail with
another (Elliott & Norris, 2012).
knowledge and have realized that there is no substitute for their familiarity with
the particular setting. Understanding of students’ social and historical circum-
stances and knowing their past and present successes and failures, fears, and
dreams enable the practitioners to gain insight into their students’ worlds. This
subjective insight provides practitioners with opportunities to explore systemati-
cally, and with care, multiple options for action, with sensitivity to the “here and
now.” Thus, action research offers a new relationship among the areas of practice,
theory, and research that blurs the boundaries between each of them.
researchers and study their own practice within their classrooms and schools. The
research questions arise from events, problems, or professional interests that the
educators deem important. The practitioners carry out their investigations system-
atically, reflectively, and critically using strategies that are appropriate for their
practice. Being insiders who are intimately involved and familiar with the con-
text, practitioners are inherently subjective and directly engaged. They are not
concerned whether the knowledge gained through their studies is applicable and
replicable in other settings. Their goal is to improve their practice and foster their
ing new skills. They put their newly emerging theories into practice and carefully
examine the resulting changes. From this perspective, changes in education occur
up, democratic process, led by practitioners who are self- directed,
ents a comparison of traditional research and action research.
histoRicAl PeRsPectives
The idea of action research in education is not new. The theoretical roots can be
traced to progressive educational leaders from the early parts of the 20th century
to conduct research in their own settings (Noffke, 1997). John Dewey (1929/1984)
recognized the central position of teachers in reforming education. He was critical
1. introduction to action Research 5
tABle 1.1. comparison of traditional and Action Research
Traditional research
Action research
The purpose of research is to develop
ories The purpose of research is to improve pra
and discover generalized principles. ctice.
Research is conducted by outside expe Research is conducted by insiders who
rts. are
involved in the context.
Researchers are objective, detached, remov
Researchers are subjective, involved, an
ed, d
and unbiased. engaged.
Educational researchers conduct researc
Action researchers study themselves and t
h on heir
others. practices.
The research questions are predeterminedResearch questions arise from local eve
and nts,
reflect outsiders’ research interests. problems, and needs.
Research participants are carefully selecte
Participants are a natural part of the inqu
d to iry
represent a population of interest. setting.
Generalized rules and practices are applicab
Every child is unique and every setting i
le s
in other educational settings. particular.
The researchers’ findings are implemented
The action researchers’ findings are dire
by ctly
practitioners. applied to their practice.
Educational changes occur top-down Educational changes occur bottom-up i
n a n a
hierarchical process. democratic process.
There is a separation between theory Boundaries among theory, research, a
nd
action, and between research and practicpractice are blurred.
e.
of the separation between knowledge and action and argued that ed
ucators need to
test their ideas and put their emerging theories into action. He enco
uraged teachers
to become reflective practitioners and make autonomous pedago
gical judgments
based on interrogating and examining their practice.
Collier, a commissioner of the Bureau of Indian Affairs from 193
3 to 1945, initi-
ated community education projects on Indian reservations in th
e United States
(Noffke, 1997). Criticizing government policies that assumed that
Native American
6 action RESEaRcH in Education
tribes all have the same needs, he described a form of research that emphasized
the specific local needs of each community (Hinchey, 2008). Kurt Lewin, a social
psychologist, however, is most often credited as the founder of action research. An
immigrant who fled from Nazi Germany, Lewin developed the methodology of
action research in the 1930s and 1940s as a means for democratic social change
(Herr & Nihlen, 2007; Somekh & Zeichner, 2009). He argued that action research
are part of the situation to be changed. The action research model he developed
was based on a cyclical process of fact finding, planning, action, and evaluation of
the results of the action (Lewin, 1946).
1950s. He was a dean and professor of education at Teachers College and worked
with schools on studies that involved teachers, parents, and students. In his semi-
nal book Action Research to Improve School Practice (1953), Corey contended
that educational change will not take place unless practitioners are involved in
developing curriculum and instructional practices, drawing on the experiential
knowledge they gain through inquiry. However, in the decade that followed, when
the emphasis was placed on top-down education, action research was pushed into
the background and teachers were again seen as merely conduits of curriculum
designed by outside experts (Hinchey, 2008; Noffke, 1997).
dom, coined the phrase “practitioner researcher” to describe teachers who were
engaged in action research to improve their practice. Stenhouse (1975) rejected the
way in which curriculum materials were typically created by experts and handed
down to teachers who were then blamed for the failure of these curricula. He
new innovations to their specific students and in modifying materials as necessary.
Stenhouse initiated the Humanities Curriculum Project, which encouraged teach-
analysis of their
school settings, their classrooms, and their teaching (Altrichter, Feldman, Posch,
& Somekh, 2008; Eliot, 1991/2002).
been growing in popularity since the 1980s in the United States, Australia, New
Smith & Lytle, 1999; Hendricks, 2012). In the
empowerment
movement, and action researchers facilitated the redefinition of teachers as profes-
sionals. Practitioners challenged the underlying hierarchical assumptions attached
to traditional educational research and insisted that inquiry validates their
1. introduction to action Research 7
knowledge and empowers them to become leaders who are involved in the process
Smith & Lytle,
1999, 2009).
the unique chARActeRistics oF Action ReseARch
Action research is a distinct kind of research that is different from other traditional
educational research. It is constructivist, situational, practical, systematic, and
cyclical.
Constructivist. Action researchers are perceived as generators of knowl-
X X
edge rather than receivers and enactors of knowledge produced by outside experts.
informed decisions based on their own inquiries and able to assume responsibility
based actions (Atweh, Kemmis, & Weeks, 1998; Cochran-
Smith & Lytle, 1993, 2009; Hendricks, 2012; Jarvis, 1999; Pine, 2008).
Situational. Action researchers aim to understand the unique context of their
X X
studies and the participants involved. The conclusions of these inquiries should be
settings in which their studies were conducted (Baumfield, Hall, & Wall, 2008;
Herr & Nihlen, 2007; Holly et al., 2009; Mertler, 2012).
Action researchers choose the questions that they plan to investi-
Practical.
X X
of their studies are immediately relevant to the improvement of their practice
Hoppey, 2009;
Marzano, 2003).
Systematic. Action research is intentional, thoughtfully planned, systematic,
X X
and methodical. The research process has to be systematic in order to produce
2008; McNiff & Whitehead, 2010; Stringer, 2007).
Cyclical. Action research starts with a research question and ends with the
X X
application of the knowledge gained that leads to new questions and a new cycle of
Following is a description of the six steps involved in carrying out a full cycle of
action research and an illustration of the cyclical steps (Figure 1.1).
8 action RESEaRcH in Education
X Step 1: Identifying an issue or problem the practitioner wants to explore
X
X Step 2: Gathering background information through a review of appropriate
X
literature and existing research on the topic
X Step 3: Designing the study and planning the methods of collecting data
X
X Step 4: Collecting data
X
X Step 5: Analyzing and interpreting data
X
X Step 6: Writing, sharing, and implementing the findings
X
In reality, action research is much more dynamic, fluid, and—at times—
messier than is implied by the linear description of the process presented in Figure
1.1. Nevertheless, to clarify the research procedures and enable you to undertake
STEP 1:
Identify
STEP 6: STEP 2:
Implement Gather
the findings
information
STEPS IN
ACTION RESEARCH
STEP 5: STEP 3:
Analyze and Design
STEP 4:
Collect data
FiGuRe 1.1. The six cyclical steps of action research.
FiGuRe 1.1.
1. introduction to action Research 9
an action research project, we divided this book into distinct and sequential steps.
cycle process often does not end with the implementa-
tion of findings. When the study’s results are put into action, you may need to
assess the outcomes and determine whether the desired changes have occurred or
other strategies are required. Thus, the cyclical process continues from one study
to the next as your practice improves incrementally.
is marked by a heated debate about the nature of educational knowledge and the
meaning of research in the context of education. Generally, the diverse approaches
to action research tend to be classified under two competing perspectives: the quali-
tative and quantitative approaches. However, this book de- emphasizes these tradi-
tional dichotomies and moves beyond the theoretical “either/or” choices. Instead,
we chose to focus on the practical ways that inquiry can be used to address the
complexities of the issues educators face in their practice day in and day out.
ourselves with qualitative research only, as is often done by many action research-
ers. Although we recognize that practitioners can never be objective observers,
neutral data collectors, or detached interpreters of school reality, we also recognize
the invaluable contributions of quantitative approaches to action research. While
qualitative research methods, such as observations, interviews, and rich narratives,
enhance the sensitivity of action researchers to the nuanced world of students and
others in the school setting, numerical data provide an effective tool to assess,
describe, and analyze other aspects of school life. The decision about which meth-
qualitative, quantitative, or mixed— should be made by practitioners
ticular settings in which the research occurs, and their interests and dispositions.
Therefore, in this book, qualitative and quantitative approaches are balanced and
are given equal weight.
Chapter Summary
1. Action research is usually defined as an inquiry conducted by practitioners in their own
educational settings in order to advance their practice and improve their students’ learn-
2. In education, the terms action research and practitioner research are often used inter-
changeably because both types of research emphasize the role of practitioners in con-
ducting investigations in their classrooms and schools.
10 action RESEaRcH in Education
3. Action research provides educators with a powerful strategy for being active partners in
leading school improvement.
4. Research is an intentional, systematic, and purposeful inquiry. Using an organized pro-
cess of collecting and analyzing information, the researcher seeks to answer a question,
solve a problem, or understand a phenomenon.
5. Traditional educational research is often conducted by university- based researchers who
carry out an investigation on others at the school setting. The ultimate goal of this type of
and best strategies that ultimately improve the quality of education.
6. According to traditional educational research, changes are mostly planned top-down in a
hierarchical process and there is a separation between theory and action, and between
research and practice.
7. In action research, teachers and other school practitioners take on the role of research-
ers and study their own practice; their research questions arise from events, problems,
or professional interests that the educators deem important.
8. The practitioners carry out their investigations systematically, reflectively, and critically,
using strategies that are appropriate for their practice.
9. The goal of action researchers is to engage in a study to find out how to improve their
practice and foster their professional growth by understanding their own students, solv-
ing problems, or developing new skills.
10. The idea of action research in education is not new. From the early parts of the 20th
century, educational leaders lauded the role of practitioners as intellectual leaders and
encouraged them to conduct research in their own settings.
11. Since the 1980s, action research has been growing in popularity in the United States.
empowerment movement, action researchers facilitated the
redefinition of teachers as professionals.
12. Action research is a distinct kind of research that is different from other traditional edu-
cational research; it is constructivist, situational, practical, systematic, and cyclical.
13. There are six steps involved in carrying out a full cycle of action research: (a) identifying
an issue or a problem the practitioner wants to explore, (b) gathering background infor-
mation through a review of appropriate literature and existing research on the topic, (c)
designing the study and planning the methods of collecting data, (d) collecting data, (e)
14. Although the diverse approaches to action research are often classified under two com-
this book focuses on the practical
qualitative and quantitative—
1. introduction to action Research 11
ways that inquiry can be used to address the complexities of the issues educators face
in their practice day in and day out.
15. While the qualitative research enhances practitioners’ sensitivity to the nuanced world
of school and classroom life, quantitative research offers an effective tool to assess,
describe, and analyze other aspects of school life. Educators can benefit from the con-
tributions of each.
16. The decision about which methods to use—
qualitative, quantitative, or mixed— should
their studies, their particular settings, and their interests and dispositions.
Chapter exerCiSeS and aCtivitieS
1. What are some of the advantages and disadvantages of traditional educational
research for teachers’ daily practice?
a. List one or two examples in which traditional research can contribute to your
practice or to your students’ learning.
b. List one or two examples in which traditional research on an issue, although
important to you, may have no immediate relevancy for your practice.
2. In your opinion, what are some advantages of conducting action research by school
practitioners and what are some of the barriers they may face?
a. List one or two examples of action research conducted in a classroom, school, or
other educational setting.
b. List one or two examples in which a practitioner may encounter barriers to
conducting action research in his or her own practice.
3. What are some of the ideas and themes that have underscored the history of action
research from the early parts of the 20th century? Do you see some of these themes
4. This chapter highlights some of the distinct characteristics of action research.
Consider these characteristics from the perspectives of a practitioner, an
5. Review the six steps involved in carrying out a full cycle of action research (Figure
1.1). Reflect on the issues and concerns that may arise with the implementation of
12 action RESEaRcH in Education
AdditionAl ReAdinGs
Adelman, C. (1993). Kurt Lewin and the origin of action research. Educational Action,
Research 1(1), 7–24.
Lankshear, C., & Knobel, M. (2004). A handbook for teacher research. New York: Open
University Press.
Reason, P., & Bradbury, H. (2008). The Sage handbook of action research: Participative
inquiry and practice (2nd ed.). London: Sage.
Rudduck, J., & Hopkins, D. (1985). Research as a basis of teaching: Readings from the
work of Lawrence Stenhouse. Oxford, UK: Heinemann Educational Books.
Whitehead, J., & McNiff, J. (2006). Action research living theory. London: Sage.
Winter, R. (1987). Action research and the nature of social inquiry: Professional innova-
tion and educational work. Averbury, UK: Aldershot.
chAPteR 2
choosing and L
earning about
Your
Research topic
A
research process starts by identifyi
ng the topic of your choice and be
coming
knowledgeable about it. This chap
ter helps you select an area of inte
rest and
articulate a problem statement tha
t will guide your research by prov
iding a
nizing literature related to your re
search around themes, followed b
y suggestions
on how to write the literature revie
w. With the knowledge gained thro
ugh develop-
ing the literature review, you will
13
be able to formulate a specific rese
arch question
choosinG YouR ReseARch t
oPic
The first step in the teacher resea
rch process is to identify a meani
ngful area of
interest. Your classroom and scho
ol are the best sources for your qu
estions, puz-
zles, and problems. Reflect on yo
ur daily practice: Is there anythin
g you want to
change, improve, or validate? For
example, are you considering chan
ging the way
you assess students’ knowledge? D
o you want to better understand the
problematic
policy will affect your own educat
ional setting?
14 action RESEaRcH in Education
Be sure to select a topic that is significant for your work. Action research is
time consuming and you need to feel that your time is well spent on something that
is worthwhile, that is personally meaningful and contributes to your personal and
professional growth. At the same time, be realistic. Choose a topic that you can
complete within your time constraints and available resources. Some examples of
research problems include:
1. What are the advantages and disadvantages of year-round schooling?
grade students deal with social conflict?
2. How do my second-
3. What is the impact of inclusion on my ELL (English language learner) stu-
dents?
4. How can I successfully integrate differentiated instruction into my lan-
guage arts classroom?
Brainstorming with a partner or in a small group will help you choose a mean-
ingful topic for your study and clarify its focus. Group members/partners should
ask questions and help each other refine and sharpen the research focus. You may
want to follow these steps prior to meeting with your group or research partner:
1. Jot down a list of issues that interest you.
2. Review the list and prioritize the items.
3. Choose the issue that you are most passionate about.
4. Share your issues with your group and explain your choice, noting the fol-
lowing:
a. Why is this topic significant for you personally or professionally?
b. How would exploring this issue be helpful to your students?
c. How will the investigation be helpful to others (e.g., peers, parents, and
the education field in general)?
d. What are some of the obstacles that may stand in your way (e.g., time,
resources, and access)?
Before you launch your investigation you may want to look for general infor-
mation on the topic you are considering. This will help you to make an informed
2. choosing and Learning about Your Research topic 15
FRAminG the ReseARch PRoBlem stAtement
The next step is to articulate, in writing, your research prob
lem. The problem
statement (often referred to as “the general statement of the p
roblem”) serves as
an introduction to the research and will guide the direction o
f your study. Your solving mathemat-
problem statement presents a clear purpose for your study. For
grade students’ motivation and success in master-
example:
1. The study is designed to explore the effects of problem-
ing basic math functions.
2. The purpose of the study is to investigate how a democratic class
room
influences students’ behavior in class.
The purpose of your study may consist of several researc
h questions. These
questions can be further divided into several subquestions (s
ee Figure 2.1). To
make your study manageable we suggest that you limit yourse
lf to no more than
three to five subquestions. In addition, the problem statement u
sually includes the
following:
1. Definitions of the central concepts and terms that may not
be familiar to
curriculum or
democratic classroom.
2. A description of the personal and professional context for t
he study. You
may describe a situation or concern that motivated you to ch
oose the topic.
FiGuRe 2.1. 3. An explanation of your role in the study. For example, clarif
y if you are the
teacher in the classroom where you will conduct the study.
4. An examination of who, besides yourself, might be interest
ed in the study
and who will benefit from the knowledge gained. For exam
ple, peers, col-
Purpose
research Question 1
research Question 2
Subquestion
SubquestionSubquestionSubquestionSubquestionSubquestion 3
FiGuRe 2.1. A schematic representation of purpose, research questio
ns, and subques-
tions.
16 action RESEaRcH in Education
For example, Polly, a middle school language arts teacher, is interested in
examining how to best implement differentiated instruction in her own classroom.
Box 2.1 presents Polly’s research problem statement.
study’s problem statement:
1. Have a clear rationale for conducting your study.
2. Narrow your broad topic of interest to a more refined focus. For example,
“How successful is inclusion in my class?” may be changed to “How do
Box 2 .1. Research Problem Statement of a Sixth-Grade Teacher Conducting
Research to Determine the Success of Applying Differentiated Instruction
InTegrATIng DIfferenTIATeD InsTrucTIon InTo The clAssroom
The range of abilities within today’s classrooms has grown significantly. Teachers have to be
responsive to learners with diverse academic, social, and emotional needs (Tomlinson, 2001;
Tomlinson & McTighe, 2006). As a sixth-grade teacher of language arts in an inclusive classroom,
I work with students who have varying skill levels. My students’ reading abilities range from the
10th to the 90th percentile of sixth-grade students nationwide based on the Measures of Aca-
demic Progress (MAP) tests administered annually to students in my district. The most challeng-
ing aspect of my work is to develop a responsive curriculum and educational environment that
effectively reaches each student in my classroom.
approach to planning curriculum and instruction for academically diverse learners” (Tomlinson
& Eidson, 2003, p. 3). This educational approach offers opportunities for each class member to
be engaged by providing “different avenues to acquiring content, to processing or making sense
of ideas, and to developing products so that each student can effectively learn” (Tomlinson,
2001, p. 1). I have found differentiating instruction to be an effective way to meet the needs
of the diverse learners in my class, keep them engaged, and enable them to perform better on
assessments. Additionally, my school district has, in recent years, stressed the importance of dif-
ferentiation and has made this approach a high priority for all of its teachers. However, many of
the teachers still struggle with finding the best ways to differentiate instruction, considering the
based knowledge that is drawn from our local setting and is appli-
will provide us with research-
2. choosing and Learning about Your Research topic 17
regular education students relate to students with special needs in my class-
room?”
3. Choose an issue that you are able to explore within the limited time and
resources that you have.
4. Choose a topic that is not too obscure or new to enable you to locate a suf-
ficient number of research articles on your topic.
5. Choose a research question that does not call for simple yes or no answers.
You may find that collaborating with others or with a partner will help you
refine and improve each other’s problem statements. Figure 2.2 provides a quick
checklist for you and your research partners to evaluate the research problem state-
ment.
develoPinG the liteRAtuRe Review
Action researchers aim to link theory to practice and connect what happens in
their educational settings with the broader knowledge about teaching and learn-
ing. After stating the research problem, the next step is to familiarize yourself
with what has been written about your topic and arrange this information into a
coherent essay called the literature review. A literature review is a summary and
synthesis of research put forward by others that is pertinent to your own inquiry.
In your synthesis you combine the relevant ideas and research reported in the
evaluation criteria
Is the problem clearly stated? Is it concise?
Is the problem researchable?
Is the significance of the problem discussed?
Are all the major terms defined and explained?
Is it clear who will benefit from the study besides yourself?
Is the proposed research feasible and doable within the constraints of your time, access,
and resources?
FiGuRe 2.2. A checklist to guide the self-evaluation of the research problem state-
FiGuRe 2.2.
ment.
18 action RESEaRcH in Education
different readings into a meaningful and coherent whole. The synthesis allows you
to gain a better understanding of the background and context of the study you are
about to undertake. In addition, the literature review can establish the rationale for
your study by highlighting the importance of your own research question. Often,
as a result of reviewing the literature, the purpose of your study may become more
focused or even shift.
reviewed journal articles, pro-
fessional books, conference papers, institutional publications, media reports, and
documents located on websites. We suggest that you consult your instructor for
specific guidelines as to what types of sources are acceptable for your literature
review.
prior to the data collection process may lead to bias and preconceived notions
about the investigated topic (Glaser, 1992). However, more and more qualitative
researchers see the value of conducting a literature review before starting the data
collection. These researchers claim that being informed about current research, the-
oretical positions, and potential methods of data collection helps action research-
ers clarify and refine their own studies (Corbin & Strauss, 2007). Therefore, take
time to immerse yourself in reading and summarizing what others have written on
your topic. Doing so will allow you to:
X Place your research project within an existing knowledge base.
X
X Trace the conceptual threads, themes, debates, and questions related to your
X
topic.
X Situate the study within a historical context or theoretical perspective.
X
X Identify the need for your research.
X
X Choose possible procedures and methods to use in your study.
X
X Narrow and further refine your research question.
X
Additionally, as you complete your study, you may want to return to the litera-
ture and compare and contrast the findings from your study with what you learned
from past research. Keep in mind that the literature review process is not complete
until you finish your study, as new research is constantly added and disseminated.
sequential steps: locating sources for the literature review, reading literature to
identify themes, and constructing a literature review outline.
2. choosing and Learning about Your Research topic 19
step 1: locating sources for the literature Review
The process of writing the literature review begins with loca
ting sources that allow
you to gather background information about your topic. Thi
s can be done by using
an Internet search engine to identify information related to
your topic quickly and
easily. However, although there is much excellent material
online, there is also a
lot of questionable, unsupported information and you must
examine the credibil-
and conference presentations are reviewed by peers before
being published. It is
important that you use references that have been subjected
to this review process.
sources are descriptions of the original research reported b
y the researchers who
conducted the study. Secondary sources are publications in
which authors describe
ideas, works, and studies done by others. An example of
a primary source is a
study conducted by Gort (2006) on bilingual students w
ho received instruction
in both their dominant language and second language. Bris
k (2011), in her article
that was published in the Handbook of Research in Seco
nd Language Teaching
and Learning, incorporated Gort’s study as she provided
an overview of current
age bilingual
learners in their second language. Thus, Brisk’s article is a
secondary source.
on text citations and summaries of reports done by others
without being able to
check the original or primary source. Nevertheless, when
your research time or
access to published research is limited, you may find that
using some secondary
sources is convenient and helpful.
Pro Quest, and JSTOR offer the full text of journal arti
cles that can be easily
downloaded. If an article you are looking for is not accessib
le online, it can still be
obtained from a university library or through an interlibrary
loan system. You may
ask the university librarian to help you locate and access
the sources needed for
your literature review. While most online databases are n
ot free, accessing them
through the university or a public library will yield a great
number of free full-text
articles. We recommend that for the most part you use arti
cles that were published
within the last 10 years. Nevertheless, make sure that you d
o not overlook seminal
works or major authors that have influenced and shaped th
e subject of your study
Before beginning your library search, transform the
problem statement into
library search terms by defining your research focus and d
eciding on the specific
20 action RESEaRcH in Education
issues to be included. The database search is conducted by using keywords or
descriptors. (Keywords and descriptors refer to the main words and terms that
describe your topic.) To increase the likelihood of accessing desired sources, it is
helpful to ensure that the terms you use are identical to the keywords used in the
educational databases. You may want to use the ERIC thesaurus to identify the
general descriptors or keywords used.
1. Identify the central terms and concepts in your topic. Write a list of key-
words based on these terms and concepts.
2. Develop a list of synonyms for your keywords. Most databases have a
thesaurus that you can use to find synonyms.
3. Create a list of keywords in order of importance to your research.
4. Conduct a database search by starting with the most important key-
word. If there are too many results, add a second or third term to narrow
5. Narrow or broaden the search as needed. Almost all databases use basic
Boolean commands to narrow or broaden searches. The command “and”
broadens the search by allowing synonyms.
Repeat the process if there are too many or not enough suggested articles and
books. You can narrow the search by omitting the least important keyword, or
broaden the search by adding different keyword descriptors or synonyms.
ine the references cited by the articles that you did obtain, especially if these arti-
cles are recent. As you identify and locate reference sources, first read the abstracts
or skim through the articles to determine whether they are relevant or useful for
your study. The articles you are looking for should:
X Be related to your topic of interest.
X
reviewed” research journal.
Be published in a “peer-
X X
X Be published within the last 10 years. However, you may choose to include
X
older references that are highly relevant to your study, have greatly impacted
the field, can provide a historical perspective, or are landmark studies.
2. Choosing and Learning about Your Research Topic 21
Include articles that discuss the theoretical framework, as well as articles
X X
that describe research studies on your topic.
Present different positions or viewpoints when the issue you study is con-
X X
troversial.
The review should be comprehensive but not overwhelming. Usually, time
constraints limit the number of articles that can be reviewed. The number of
ect guidelines or the course syllabus. It is a good idea to collect more articles than
are required so that you can choose the sources that have the greatest relevance to
your research topic.
focus. For example, the article may not discuss children of the same ages, research
strategies, or methods you are planning to investigate. Don’t despair; in these situ-
ations, you can use those articles that are most related to your topic. For example,
Leslie, a student teacher, wants to explore the benefits of teaching a foreign language
in the primary grades; however, she could only locate articles that describe research
conducted with middle school students. Her solution is to review the articles that
she found for the literature review, and in her own study, she plans to explore which
findings from the middle school studies also apply to younger students.
Step 2: Reading Literature to Identify Themes
Conducting a literature review requires you to read a bit differently than usual.
The purpose in reading research articles, books, or reports is to focus specifically
is organized around themes that are pertinent to your study. The themes are usu-
ally made up of perspectives, approaches, ideas, or results from relevant existing
studies. As you review the literature relevant to your investigation, you identify
the themes that drive your narrative. The references that you cite support your
themes and serve as evidence for the arguments and assertions that you have made.
Thus, the literature review is a topical essay consisting of analysis and synthesis
of your readings around themes, rather than an annotated bibliography (Machi &
To develop the literature review, start by discovering the relevant themes in
each study that you read. As you develop each theme, cite information from your
sources that serves as evidence material. Finally, present the themes in a logical
22 action RESEaRcH in Education
order according to the relationship among them and their importance to your own
investigation. Using headings to identify your themes makes the structure of the
literature review clearer for you and the reader.
sources and link them by using software packages such as Endnote®. The follow-
ing are steps that we’ve found useful for identifying themes to be discussed in the
literature review:
1. Begin by skimming quickly through each article (or other documents) to
get a general idea of its content. Identify and mark the paragraphs or sec-
2. Read the marked sections again, this time slowly and in depth, paying
attention to the themes that emerge. In the margin, write down these
3. Take notes on each article as soon as you finish reading it and write a nar-
rative summary of each relevant theme. We suggest that for each reference
4. Include the complete citation on the “index card.” If you obtained the
source via the Internet, note when the record was retrieved and the web
5. Summarize each theme on the card. The length and details of the descrip-
tion depend on the importance of the information for your study; the more
be. You may make notes about the different ways a theme is perceived by
different authors. For example, note agreement, disagreement, and con-
trasting or complementary findings.
6. Note whether the theme was already discussed by another author. Feel free
to add any other information that you find useful.
7. Read each article critically and record your response, agreement, or criti-
cism of each source. Consider the following issues: How was the research
information about the research setting, participants, data collection proce-
dures, and findings?
8. Be meticulous! If you identify a very strong or unique statement that
you want to quote, quote it precisely and don’t forget to include the page
2. choosing and Learning about Your Research topic 23
Title of article (follow APA style):
Author(s):
Journal:
Year of publication
Volume: Pages:
: Issue:
For electronic sources: Relevant issues/
themes: Web address:
Digital object identifier:
Summary of Theme I:
Summary of Theme II:
Summary of Theme III:
Quotes (including page numbers):
FiGuRe 2.3.
FiGuRe 2.3. Article thematic review
template.
Figure 2.3 shows a template for an
article thematic review.
step 3: constructing a literature
Review outline
After you’ve read and recorded a
ll of your assembled articles, you
may still be
uncertain about how to organize
the various issues into a theme-
based, coher-
integrated narrative.
You may find the following meth
od helpful in
constructing a thematic outline (
Mills, 2011). Transfer from the a
rticle thematic
review (Figure 2.3) those themes
that emerged from each article int
o a literature
than one article and some articles
may discuss several themes. Figure
2.4 may help
you choose which themes are most
pertinent to your research and whic
h are super-
fluous and can be eliminated.
ten in a narrative style or as a serie
s of bullets. Analyze the similaritie
s and differ-
ences between the themes and sub
themes and turn them into topics a
nd subtopics.
Make sure you record the name(s)
of the author(s) next to each theme
.
authors on the same topic or su
btopic, recognize points of agree
ment and dis-
agreement, and compare and cont
rast research findings and conclus
ions. Add the
author(s) you will use for each of t
he subtopics and the year(s) of pub
lication.
24 action RESEaRcH in Education
Date of
Author(s) Publication Themes Discussed in the Article
FiGuRe 2.4. Literature review theme organizer.
FiGuRe 2.4.
Decide on the logical order of your themes and subthemes. The rule of thumb
in constructing the literature review outline is that issues least related to your
own research focus are discussed first and the most related are discussed last.
Additionally, it makes sense to organize items from the general to the specific,
from historical to contemporary, from theory to practice, and from definitions to
examples. Suppose, for example, that you want to examine the role of homework
homework. Next, describe contemporary debates surrounding the issue, present-
ing the arguments proposed by those who support and those who object to assign-
ing homework. Finally, explore homework from the point of view of teachers,
students, and parents, concluding by pointing out the limited research on students’
perceptions of homework. Figure 2.5 illustrates an example of a linear outline of a
literature review on the topic of classroom as a democratic community.
of organizing graphically the topics and subtopics of their literature review. In a
literature topic map they display the central topic and subtopics as they relate to
and subtheme (Creswell, 2011; Hendricks, 2012). For example, Chris, a preservice
2. choosing and Learning about Your Research topic 25
classroom as a Democratic community
1. History of Democratic Education from the Turn
of the 20th Century to the Present (Spring, 2010;
Tozer, Senese, & Violas, 2009; Tyack, 1974)
2. Different Visions of Democratic Education (Pa
rker, 2003)
b. Diverse Contemporary Perspectives of Democr
atic Education (Banks et al., 2005; Kahne &
Westheimer, 2003; Mikel, 2011; Parker, 200
3)
3. Democracy in Practice
2009; Freire, 1970)
Goodlad, Soder, & McDaniel, 2008).
4. Problems and Critique (McQuillan, 2005; Sch
utz, 2008)
FiGuRe 2.5.
5. Examples of Implementations of Democratic E
ducation in the Classroom (Goodlad et al., 2008;
Michelli & Keiser, 2005). contained special
FiGuRe 2.5. Example of literature review.
student, who serves as a long-term sub
stitute teacher in a self-
education classroom. As he reviews the
literature he creates a topic map that illu
s-
trates the way he plans to structure the i
nformation he obtained from his readin
gs.
Figure 2.6 shows an excerpt from Chris
’s literature topic map that focuses on t
he
benefits of CL for students with special
needs in the general classroom.
to write the literature review. Follow th
e outline to construct the literature revi
ew
as a topical essay. (Your outline’s topi
cs and subtopics may become the form
al
subheadings of your essay.)
step 4: writing the literature Review
There is no single format for writing a
literature review, and the structure gen
er-
ally emerges from the nature of the parti
cular literature that is reviewed. Howev
er,
there are usually three main sections: (
1) an introduction, (2) the main section
of
research question(s). Remember, the ar
guments you make in the literature revi
ew
26 action RESEaRcH in Education
Improved understanding
(Gillies & Ashman, 2010)
Test score improvement
(Kuntz, McLaughlin, Enhanced motivation
SUBTHEME:
(Wolford, Heward,
McMaster & Fuchs, 2002; Academic benefits
Ryan, Reid, & Epstein, 2004)
THEME:
Benefits of CL in
classrooms
special needs
Gaining acceptance from Race, self-esteem,
general education peers SUBTHEME: and confidence
Social-emotional
Jenkins, Antil, & Vadasy, 2003) Wolford et al., 2001)
Improved
communication skills
Wolford et al., 2001)
FiGuRe 2.6.
FiGuRe 2.6. Excerpts from a literature map: The benefits of collaborative learning for special
education students.
2. choosing and Learning about Your Research topic 27
section of your research report cannot be based on your personal opinion and
beliefs. Every idea, proposition, or assertion needs to be supported by “evidence,”
such as a citation from a credible article. On the other hand, do not accept studies’
findings blindly. Read critically to ensure that your arguments are supported by
trustworthy theory and data. Where possible, assess the studies that you review
noting their strengths and weaknesses (Booth, Colomb, & Williams, 2008; Machi
Introduction
In the introduction to the literature review you may use an advanced organizer to
lay out the topics to be discussed. Terms are explained and defined, unless these
terms were introduced and clarified in the problem statement section.
Main Section of the Review
The main section of the review follows the outline structure and is organized the-
matically. Under each subtopic discuss the appropriate theories or studies. Depend-
ing upon the significance of the source to your own study, the discussion can be
brief or lengthy. In the beginning of the main section of your review, you may
briefly state a theme or propose an argument, and then cite references that support
your assertion. For example, a group of teacher researchers who study ethics and
moral education in the classroom begins the main section of their literature review
by briefly stating the essential role of moral education in the classroom and the
importance of teachers’ values in their teaching. Relevant references are used to
section of the literature review.
to your own research focus, you may want to elaborate and describe, at length,
a particular study, an idea, or a source that pertains to one of your themes. For
example, the teacher researchers discussed above review different approaches to
moral education and include a detailed description of care ethics, which is one of
these approaches. They analyze the work of Nel Noddings (1992, 2002, 2003),
one of the central proponents of this approach. Box 2.3 is an example of one of the
paragraphs from their literature review.
paragraphs to facilitate the organization of the literature review. Terms like in
28 action RESEaRcH in Education
Box 2.2. An Opening Paragraph from the Main Section of the Literature Review
Many educators and researchers agree that moral meanings pervade all aspects of the teacher’s
work (e.g., Campbell, 2003, 2008; Hansen, 2001; Richardson & Fenstermacher, 2001). It is
also agreed that teachers’ practice emerges from their values (Ayers, 2004; Brown, 2004; Efron
when teachers submit to the expectation that they’ll leave their personal self at the classroom
door, their moral identities are unintentionally revealed through their words and actions (Alsup,
2006; Brookfield, 2005; Osterman & Kottkamp, 2004).
addition, contrary to, other studies, and similarly signal the logical flow of ideas
in your review and the relationships among studies, theories, and ideas. Addition-
ally, it is your responsibility to point out to the reader where there are agreements,
inconsistencies, or gaps in the literature. You may want to use terms such as how-
ever, by comparison, contrary to findings reported by X, or similar findings were
reported in a study by X.
controversies, agreements, and disagreements among researchers in the field. When
different authors are in agreement, do not restate the point but present it once and
reference all the authors. If one of the authors expands on the issue and provides
Box 2.3. A Paragraph from the Literature Review
Nel Noddings (1992, 2002, 2003) viewed classroom relations and trust as the foundations of
ethics education. Her approach, named “care ethics,” proposed that the caring and trust relation-
ships between the teacher (the “caregiver”) and the students (the “cared for”) are at the heart
of moral education. In her book The Challenge to Care in Schools (1992) Noddings suggested
that the caring relationship is expressed in the attention (“engrossment”) given by the teacher to
the feelings, desires, and concerns of the students. The caring teacher responds to the students’
own perceptions of their needs and wants, and acts upon them while at the same time leading
the students toward a better set of values. Noddings proposed that caring relationships between
teachers and students and among the students are developed through demonstration of genuine
2. choosing and Learning about Your Research topic 29
additional information, start with what is common to all the authors before add-
ing the new information. For example, a paragraph in a literature review may start
with a sentence that offers general information, followed by specific information
reported by one of the sources cited in the first sentence (see Box 2.4).
educational studies, the Publication Manual of the American Psychological Asso-
ciation, Sixth Edition (APA, 2010), is often used. Make sure that your review does
not end up as a series of quotations from sources. As a rule, quotations should
be used sparingly and only when they highlight essential points or are particu-
larly well phrased. Don’t forget to reference each quotation, and, when available,
include the page number. Similarly, also report the page number when referring to
a specific table, figure, or equation in the text that you are reviewing. On the other
hand, when you paraphrase or summarize ideas presented by the author(s) of the
articles you review, you need to reference the source but you are not required to
include the page number.
Summary and Concluding Remarks
Provide closure for the review by writing a short summary. In the summary, the
major themes across all studies reviewed and their implications need to be high-
tices that have emerged that may contribute to your own research. You can also
point out the limitations of the current knowledge and recognize unresolved issues
or remaining questions. An existing gap in knowledge and practice would make
Box 2.4. An Opening Paragraph from the Literature Review:
Moving from the General to the More Specific
Scientific experiments are an essential part of science education. The use of multimedia in sci-
ence education has greatly enhanced and simplified students’ access to a variety of experiments
(Killdeer, 2004; Lows & Davies, 2012; O’Connor, 2011). According to Lows and Davies, electronic
websites allow students to participate in experiments that are too expensive, too complex, or too
dangerous to carry out in a school science laboratory.
Note. The sources for the literature review described in this example are fictitious references.
30 action RESEaRcH in Education
the case for the need for your own particular research. Your concluding remarks
provide the rationale for formulating your study’s specific questions by identifying
the need for your study. A concluding sentence might be “Although prior research
solving skills, not enough is known
about the ways high school students incorporate those skills into the study of his-
tory. Therefore, this study will explore the following questions. . . . ” Another
recess in grades 3–5, very little research has explored this issue from the children’s
point of view. For that reason, my research question is. . . . ”
1. The literature review is devoted to a review of published studies conducted
by others. You may express your opinion and criticize studies; however, the
2. Every idea presented in the review must be attributed to someone, using a
citation that indicates the author’s last name and the publication date.
3. To avoid plagiarism, be sure to cite the sources for your ideas and argu-
ments rather than present them as your own.
4. Every citation you make in the text of your review must appear in full
in the reference list at the end of the paper. Similarly, no references may
5. Follow a standard citation format, such as APA style. The reference section
at most public libraries will own a copy of the APA Publication Manual
6. Abbreviations should be explained and defined when they are first intro-
duced. Write out the full term first and enclose the abbreviations in paren-
time you use the term NCLB, write it as follows: “No Child Left Behind
(NCLB).” Subsequently, you can use the abbreviation NCLB alone.
It is a good idea to have another “set of eyes” read the first draft of your lit-
erature review. Someone unfamiliar with your topic will be able to point out gram-
matical errors, confusing statements, missing but necessary explanations, and any
that you can use for a critical reading of the literature review.
2. choosing and Learning about Your Research topic 31
Assessment
Is there an introduction to the r
eview that indicates how the lite
rature review is organized?
Is the organization of the literatu
re review clear?
Is the literature review organize
d around themes?
Do the ideas flow logically and
smoothly from one paragraph t
o the next?
Are there transitions between t
opics and from topics to subtopi
cs?
Are the ideas presented in the c
ontext of relevant research and
theory?
FiGuRe 2.7.
Are different or contrasting posi
tions on the topic reported?
Are the ideas and arguments su
pported and properly reference
d?
Does the literature review adher
e to APA writing standards?
Are the quotations properly use
d and the page numbers of quot
ations indicated?
Does the review end with a mea
ningful summary of the main ide
as discussed?
FiGuRe 2.7. A checklist of
questions for assessing the l
iterature review.
FoRmulAtinG sPeci
Fic ReseARch quest
ion(s)
You have already formul
ated a broad focus in the
general problem stateme
nt that
identified the overall pu
rpose of your study. No
w that you have becom
e more
knowledgeable about you
r topic, it is time to refi
ne the questions that wil
l guide
your inquiry.
what you want to investi
gate. This usually means
translating the general pr
oblem
statement into more spec
ific and focused questio
ns. A good question sho
uld be
clearly stated and formul
ated in researchable term
s. The way the specific r
esearch
questions are constructed
indicates the methods yo
u are going to use in your
study.
Are these methods going
to be qualitative, quantit
ative, or mixed?
questions in qualitative
Action Research
Questions in qualitative r
esearch are usually open
-ended. The most comm
on way
to state research question
s is by using the words
how and what, rather t
han to
32 action RESEaRcH in Education
The question should identify who or what you are going to investigate in the
study. For example, you may choose to focus your research on (1) individuals or
groups (e.g., students, teachers, or administrators); (2) actions, interactions, behav-
iors, attitudes, and feelings; (3) curricula, programs, and teaching strategies; or (4)
your own values, beliefs, and educational philosophy, and their impact on practice.
Following are two examples of questions in qualitative action research:
1. How do my preschool students resolve problems on the playground during
recess time?
2. What are the social and emotional impacts of standardized testing on the
students in my school?
Qualitative research by its nature is evolving; therefore, it is acceptable to
change or refine the focus of the specific research questions as your study pro-
ceeds, if you find it necessary to do so.
questions in quantitative Action Research
Research questions that are concerned with measuring variables that can be quan-
tified are usually specific and involve assessing “how much” or “how many.” These
research questions are often followed by hypotheses, especially in experimental
t he s t udy.
able. For example, do not state that a new teaching method is “good” or that
positive attitudes toward inclusion are “important,” because terms such as good or
important are too vague and open to many interpretations, and cannot be quanti-
fied, observed, or measured. Your hypothesis should guide the design of the study
whose results will allow you to conclude whether the hypothesis was confirmed.
(Note: In research, we do not say that we “prove” the hypothesis. Instead, we use
the term confirm because there is always a margin of error involved in any decision
about the hypothesis.)
of variables that are being tested. For example, a hypothesis may predict that there
will be a positive correlation between students’ math and science scores or that
there will be no difference in the attitudes of boys and girls toward their school.
Following are two examples of questions in quantitative action research:
2. choosing and Learning about Your Research topic 33
1. Is there a correlation between middle school students’ scores on math and
science tests?
2. What is the impact of integrating technology into the classroom on stu-
dents’ achievement test performance?
questions in mixed-methods Action Research
In Mixedmethods research study you may want to pose several specific research
lead to qualitative data and others to quantitative data. For example, in a study
about year-round schools, one question may call for numerical data, such as stu-
such as in-depth interviews to explore students’ motivation or parents’ attitudes.
methods research:
grade
1. What is the effectiveness of differentiated instruction on my fourth-
(qualitative interviews)? Is there an improvement in their end-of-unit test
scores (quantitative data)?
mentoring program at the high school level help motivate
2. How does a peer-
their homework and participate in class activities (qualitative data based
on observations and interviews)? Is there an increase in attendance for the
at-risk students and a decrease in their behavior problems and referrals
examples of Research Problems: From the General to the specific
In writing the research questions, start with the general research topic that is of
interest to you. For example, you may wish to study the topic of bullying in ele-
mentary school. Next, narrow your focus as you articulate your problem state-
ment. For example, you can focus on different types of bullying with an emphasis
on cyberbullying. After conducting the literature review, narrow your statement
playing method
impact the incidence of bullying within a fifth-grade classroom? If you plan to
conduct a quantitative study, you may add a hypothesis, such as “The number of
34 action RESEaRcH in Education
cyberbullying incidents reported will be significantly lower after the role- playing
provides a diagram of this process.
methods research-
ers may start with the same general research topic and problem statement, their
research questions and approaches are different and reflect their chosen para-
to three different types of research questions. Each of these questions suggests
the type of procedures that will be used to collect the data needed to answer the
research question. Are the methods going to be qualitative, quantitative, or mixed?
Figure 2.9 summarizes the process of starting with a general research topic, fol-
lowed by a general problem statement, which then leads to specific qualitative,
methods questions.
Re se arch Topic
Problem Statement
Research Question(s)
Hypothesis
FiGuRe 2.8. The process of moving from a general topic to the specific research ques-
FiGuRe 2.8.
tion and hypothesis.
2. choosing and Learning about Your Research topic 35
RESEARCH FOCUS:
Parents reading
GENERAL PROBLEM
STATEMENT:
reading to their preschool
children have on the children’s
1. QU 1. MIX
ALITATI ED-
QU
VE METHO
RESEAR ANT DS
ITA
CH QUE RESEAR
STION: TIV CH QUE
E STION:
RES
EAR
CH
QUE
STI
ON:
to their
eschool to their pr
ildren here eschool c
influence relation hildren
a) the chil ship influence
FiGuRe 2.9. dren’s betwe the childre
en the n’s
amoun
t of
e
(b) the
ren’s motiv (measure Is there a rel
ation d as ationship bet
to reades per ween
on their ) the amount
n? and of time paren
e children’
ts
s attitudes
on a survey
children and th
attitudes)?
ese children’s
HYPOTHESIS reading re
: adiness?
correlation between the amoun
t
of time that parents read to
attitudes toward reading.
FiGuRe 2.9. General res
earch topic, problem state
ment, qualitative research
question,
quantitative research que
stion and hypothesis, and
mixed-methods research
question.
Chapter Su
mmary
1. The first step in the te
acher research process i
s to identify a meaningful
area of inter-
est that is significant
for the action researcher
work; classroom and sch
ool are the best
sources for research
questions, puzzles, and pr
oblems.
2. Brainstorming with a
partner or in a small grou
p often helps action rese
archers choose
a meaningful topic fo
r their study and clarify its
focus.
36 action RESEaRcH in Education
3. The research problem statement (often referred to as “the general statement of the prob-
lem”) presents a clear purpose for the study, serves as an introduction to the research,
and guides the direction of the study.
4. The problem statement often includes definitions of the central concepts and terms, a
description of the personal and professional context for the study, an explanation of the
researcher’s role in the study, an examination of who, besides the researcher, might be
5. Although qualitative, quantitative, and mixed- methods researchers may start with the
approaches are different and reflect their chosen paradigm.
6. The purpose for the study may consist of several research questions; these questions
can be further divided into several subquestions.
7. A literature review is a summary and synthesis of research put forward by others that
is pertinent to the researcher’s own inquiry; it establishes the rationale for the study by
highlighting the importance of the research question.
8. Sources for the literature review include peer- reviewed journal articles, professional
located on websites.
9. The process of preparing to write the literature review usually follows several sequential
steps: locating sources for the literature review, reading literature to identify themes, and
constructing a literature review outline.
10. When possible, use primary sources (descriptions of the original research reported by
the researchers who conducted the study) rather than secondary sources (publications
11. Before beginning your library search, transform the problem statement into library search
terms (called descriptors) by defining your research focus and deciding on the specific
issues to be included.
12. The literature review is organized around themes that are pertinent to your investigation.
The themes are usually made up of perspectives, approaches, ideas, or results from
relevant existing studies.
13. The outline for the literature review can be written in a narrative style or as a series of
bullets.
14. The review should be organized logically around themes and subthemes going from
issues that are least related to the study to the most related, from the general to the
specific, from historical to contemporary, from theory to practice, and from definitions to
examples.
2. Choosing and Learning about Your Research Topic 37
15. Visual mapping is an effective means of graphically organizing and displaying the topics
and subtopics of the literature review.
16. While there is no single format for writing a literature review, there are usually three main
sections: (a) an introduction, (b) the main section of the report, and (c) a summary and
concluding remarks that end with the specific research question(s).
17. The introduction to the literature review may include an advanced organizer to lay out
the topics that are going to be discussed.
18. The main section of the review follows the outline structure and is organized themati-
cally; the length of the discussion of each source depends on its significance to your
study.
19. You should communicate to the reader how the studies fit together, pointing out contro-
versies, agreements, and disagreements among researchers in the field.
20. Provide closure for the review by writing a short summary in which the major themes
across all studies are reviewed and their implications are highlighted.
21. A specific research question begins with a precise description of the goals of the inves-
tigation by translating the general problem statement into more specific and focused
questions.
22. Questions in qualitative research are usually open-ended, using words such as how and
what, rather than questions that lead to yes or no answers.
23. Research questions that are concerned with measuring variables that can be quantified
are usually specific and involve assessing “how much” or “how many”; these research
questions are often followed by hypotheses, especially in experimental studies.
methods research study there are usually several specific research questions;
24. In a mixed-
Chapter exerCises and aCtivities
1. Write two or three possible topics for your investigation and explain briefly why they
are of interest to you. Follow the steps outlined at the beginning of the chapter to
2. Using the checklist in Figure 2.2, assess your problem statement. If working with a
group, evaluate each other’s statement.
38 ACTION RESEARCH IN EDUCATION
3. Develop an outline of your literature review using the format in Figure 2.5, or create a
visual topic map (see example in Figure 2.6).
4. Using the checklist in Figure 2.7 read critically a draft of your literature review.
thoughtfully to his or her writing. Point out what is done well but also highlight what
needs to be revised, added, edited, or changed to refine the writing.
5. Choose a topic of interest for a study and develop three research questions for
exploring the topic: one research question to be based on the qualitative approach,
AdditionAl ReAdings
Berry, R. (2004). The research project: How to write it (5th ed.). New York: Routledge.
Blaxter, L., Hughes, C., & Tight, M. (1996). How to research. Berkshire, UK: Open Uni-
versity Press.
Boote, D. N., & Beile, P. (2005). Scholars before researchers: On the centrality of the dis-
sertation literature review in research preparation. Educational Researcher, 34(6),
3 –15.
Fink, A. (2009). Conducting research literature reviews: From the Internet to paper (3rd
ed.). Thousand Oaks, CA: Sage.
Hart, C. (2003). Doing the literature search: Releasing the social science research imagina-
tion. London: Sage.
Rumsey, S. (2008). How to find information: A guide for researchers (2nd ed.). Berkshire,
UK: Open University Press.
Trimmer, J. F. (2004). The new writing with a purpose (14th ed.). Boston: Houghton Mif-
flin.
Zerubavel, E. (1999). The clockwork muse: A practical guide to writing theses, disserta-
tions, and books. Cambridge, MA: Harvard University Press.
chAPteR 3
approaches to
action Researc
h
s educators, teachers, administrators, and school support personnel, we all
want to improve how we work with our students and advance the way edu-
decisions are often offered as the way to achieve these goals. However, in the
A cation is practiced in our cla
ssrooms and schools. Research an
d data-
changing, and, at times, chaotic e
nvironments of
schools, we are required to make
constant and important decisions,
and some-
times research is far removed from
our thinking. If you consider the w
ord research,
39
you realize that it means searchin
g again and again to answer our q
uestions or to
find solutions to our problems.
tative, and mixed—and provide a
brief overview of the elements th
at distinguish
researcher role, (4) research proces
s, and (5) common research metho
ds. We end the
chapter with helpful suggestions f
or how to choose your own resear
ch approach.
educAtionAl ReseARch APP
RoAches
Action research draws from a wid
e range of educational research ap
proaches and
is implemented in a variety of form
s. Underlying the different approac
hes are alter-
native assumptions and sets of b
eliefs about knowledge, school re
ality, and the
made by practitioners about the qu
estions that they pose, the way the
y collect and
40 action RESEaRcH in Education
analyze their data, and the type of conclusions derived from the data. Kuhn (1970)
defined these alternative sets of assumptions and perspectives, or worldviews as
“paradigms.”
it is important that you understand the differences between three paradigms that
have informed and helped shape contemporary action research. Clarifying the dif-
ferent assumptions that underlie each perspective and the practical implications
associated with each one will assist you in developing your own inquiry. Based on
this understanding, you will be able to make your own choices about the types of
questions you want to ask and about the strategies and techniques for collecting
and analyzing the data to answer your questions.
quAlitAtive educAtionAl ReseARch
Qualitative research is designed to study school situations and events as they unfold
naturally. The focus of the investigation is on the meanings of these experiences
for the individuals and groups in these settings. (Examples of books on qualitative
research include Bogdan & Biklen, 2006; Glesne, 2010; Marshall & Rossman,
2011; and Merriam, 2009.)
Assumptions about school Reality
Schools are complex, socially constructed institutions that comprise multiple reali-
ties. The meaning assigned to school experience is varied, shaped by individuals’
cal background. Actions, behaviors, expectations, norms, and beliefs are strongly
influenced by the uniqueness of each context and perceived differently by each
individual. Thus, qualitative research results cannot be generalized across time
and locations.
Research Purpose
Meaningful school change and the improvement of school experiences for students
should emerge from the perspective of those who are involved in each setting.
Therefore, the purpose of qualitative research is to gain insight into and under-
standing of how students, teachers, parents, and administrators make sense of
3. approaches to action Research 41
their educational experience. The knowledge and insight serve as a base for bring-
ing about needed change.
Researcher Role
Researchers often become immersed in the educational site where their studies take
place. Interactions with those under study enable researchers to acquire familiarity
with the situation and gain the trust of participants. Researchers must acknowl-
edge their own personal values and how these values shape their perceptions and
interpretations.
Research Process
The study emerges from broad open-ended questions. Researchers spend extended
time at the educational settings, observing and interviewing people through the
daily school routine. Researchers describe through rich narrative and visual media,
such as pictures and videos, the subjective meanings that individuals in the schools
ascribe to their actions and experiences. The focus is on a holistic understanding
of the complex interdependencies that distinguish the educational, social, and cul-
tural environments that are being examined. The data collected are analyzed and
organized into categories, trends, and patterns.
common qualitative methods
Case Study
Case study research aims to understand a particular phenomenon (such as a pro-
gram, process, event, organization, or concept) by selecting a particular example
of that phenomenon as the focus of the study. To shed light on the larger phe-
nomenon, the researcher explores in depth the selected entity, actions, and the
reasons for these actions. Although case study research usually focuses on a single
entity (e.g., an individual, a class, or a program), at times, two or more cases are
selected for comparison purposes. For example, in order to understand the reali-
functioning autistic children in mainstream classrooms, the
researcher describes the social, emotional, and learning experiences of one high-
student’s actions and interactions with peers and teachers. In a multiple case study,
functioning autistic
42 action RESEaRcH in Education
middle school students so he or she can compare and contrast the findings. (Exam-
ples of books on case study research include George & Bennett, 2004; Hancock,
2011; Merriam, 1998; Stake, 1995; and Yin, 2009.)
Ethnographic Research
Ethnographic research is focused on the cultural and social life of schools, class-
rooms, and communities. The researcher immerses him- or herself in the group
that is the subject of the study, exploring their lived experiences and identifying
their shared values and beliefs. For example, through many interactions and dis-
cussions with high school dropouts, their families, and their peers, the researcher
tries to understand how students who dropped out view education and its role
in shaping their economic future. (Examples of books on ethnographic research
include Denzin, 1997; Eisenhart, 2001; Firmin & Brewer; 2006; and Madison,
2011.)
Narrative Research
Narrative research presents stories of life experiences told by individuals in their
own words, accompanied by reflections on the meaning of these stories within
a broader educational context. The use of narrative complements the desire to
recapture past experiences and to describe the teacher’s professional and personal
self within the context of his or her practice. As an example, a researcher may
ask teachers to use storytelling narratives to share their experiences or memories.
The teachers then analyze how these past experiences have contributed to inform-
include Andrew, Squire, & Tamboukou, 2008; Clandinin, 2006; Clandinin &
Connelly, 2000; Holley & Colyar, 2009; and Webster & Mertova, 2007.)
Critical Research
Critical research centers on a social justice agenda. The purpose of the study is to
expose repression, domination, and inequities and bring about social change. To
raise the consciousness of those who are marginalized in society and seek a change
in these inequities, researchers often invite them to be involved in the inquiry.
cussion of school district testing policy to find out if this policy puts students
with limited English knowledge at a disadvantage. (Examples of books on critical
3. approaches to action Research 43
research include Anyon et al., 2009; Carr & Kemmis, 2009; Denzin, Lincoln, &
Smith, 2008; Steinberg & Cannella, 2012.)
quAntitAtive educAtionAl ReseARch
Quantitative research is designed to gather numerical data from individuals or
groups using statistical tests to analyze the data collected (Slavin, 2007). Cause-
effect relationships can be studied best in experimental studies (Mertler &
Charles, 2011). In nonexperimental quantitative studies, researchers study rela-
tionships between variables as they exist, without any attempt to change them
(Slavin, 2007). Statistical data can also be used in nonexperimental studies to
describe information related to occurrences of phenomena and to measure the
degree of association between phenomena. (Examples of books on quantitative
research include Gall et al., 2006; and Gay, Mills, & Airasian, 2011.)
Assumptions about school Reality
The social reality of school operates according to stable, fixed, and verifiable rules
and laws that are relatively constant across time and settings. This reality is objec-
tive and is separated from and independent of school participants’ feelings, per-
ceptions, and beliefs. Objective researchers can, through scientific methods, dis-
cover and measure these universal rules. This information then can be applied to
describe, explain, and predict behavior with a calculated degree of certainty.
Research Purpose
The goal of quantitative educational research is to produce an effective and effi-
cient educational system designed to improve the academic achievements of all
students. This goal can be achieved by discovering universal, scientifically based
rules or methods that are proven to enhance the quality of the teaching and learn-
ing process.
Researcher Role
Educational researchers take a neutral, objective, and dispassionate position, try-
ing to minimize their engagement with the study’s participants. Appropriate pro-
cedures are employed to prevent researchers’ personal biases from influencing or
44 action RESEaRcH in Education
affecting the investigation process in order to ensure scientifically accurate find-
ings.
Research Process
The process usually starts with research questions about a limited number of
clearly defined variables. In experimental research, researchers focus on answer-
effect relationships. The questions are followed
by hypotheses that make a prediction about the outcomes of the study. A research
study is then designed to test hypotheses by controlling the impact of all variables:
those being studied as well as outside variables that might influence the study’s out-
comes. In nonexperimental (sometimes called descriptive) research, the purpose is
to measure or numerically describe existing groups, settings, or phenomena, com-
pare two or more groups, or describe statistically the strength of the association
between two or more variables. In both types of quantitative studies, researchers
systematically choose the research participants and develop a set of procedures
and strategies for gathering, analyzing, and interpreting numerical data.
common quantitative methods
Experimental Research
Experimental research is designed to measure cause-and- effect relationships
interventions, called the independent variables, on groups or individuals. The
effect of the independent variable is assessed by gathering data on the outcome
efficacy of cooperative learning group work (the independent variable) on the read-
ing scores (the outcome, or dependent variable) of your students who have learning
challenges.
Causal–Comparative (ex Post Facto) Research
Causal–
(McMillan, 2011). There is no planned intervention because the independent vari-
ables have either occurred prior to the start of the study or are variables that can-
not be manipulated. For example, a researcher may want to compare the social
3. approaches to action Research 45
skills (outcome variable) of college freshmen who were home- schooled with those
variable in this study, type of schooling, has already occurred by the tim
e the study
is conducted.
Correlational Research
Correlational research investigates the degree of relationship between t
wo or more
variables in a given situation. The relationship can be quantified and it
s direction
(positive or negative) and strength (high, moderate, or low) can be as
sessed. For
example, a study may be carried out to measure the relationship betwee
n students’
administered math tests. Keep in m
ind, though,
that even when we find a correlation between variables, this does not
show that
one variable caused the other (Mertler & Charles, 2011).
Descriptive Research
Descriptive research represents the current conditions of the topic unde
r investiga-
tion without trying to change or manipulate them. These studies summ
arize exist-
ing phenomena by using numbers to describe groups or individuals (M
cMillan &
Schumacher, 2010). The most well-known large-scale descriptive study
conducted
in the United States is the one conducted by the U.S. Bureau of the Cen
sus (Dane,
2011). An example in education and public policy may be a study that i
s done in a
large metropolitan area to document the number of students who drop
out of high
school before graduating.
mixed-methods ReseARch
For years, a schism between qualitative and quantitative approaches do
minated the
field of educational research. The debate emphasized the differences b
etween the
methods research
methods
approach proposes to cross boundaries between worldviews and blen
d (or com-
bine) qualitative and quantitative research methods and techniques in
to a single
methods research include Cres
well & Plano
Clark, 2011; Hesse-Biber, 2010; Tashakkori & Teddlie, 2010; and
Teddlie &
Tashakkori, 2009.)
46 action RESEaRcH in Education
Assumptions about school Reality
Solutions to the problems that school presents are at the center of this pragmatic
mixed- methods approach, rather than philosophical discussions about school real-
ity. All approaches that contribute to understanding and solving school problems
are embraced and their value is judged by the consequences. The emphasis is on
finding out “what works” and acting upon it. From this perspective, the research
guide the study.
Research Purpose
methods research is to draw on the strength of both quanti-
The goal of mixed-
techniques in a single study enables the researcher to use multiple methods to
explore different aspects of the same question.
Researcher Role
The two paradigms, quantitative and qualitative, can live peacefully together in
one study. The researcher can assume an objective or subjective stance, or attitude,
depending on the question under investigation.
Research Process
The researcher employs both quantitative and qualitative data collection strate-
gies, methods, and analyses, either simultaneously or sequentially. Thus, the dif-
aspects of the same question. The workability of the methods and the usefulness
of the results are the most important factor in planning the study.
common mixed methods
Embedded-Design Research
Embedded- design research is used in studies in which both methods of data collec-
tion, quantitative and qualitative, are included, but one paradigm dominates the
study. One approach is nested within the larger method of data collection. Either
3. approaches to action Research 47
the nested or the dominating approach may be qualitative or quantitative. For
example, in an experimental districtwide study designed to assess the effects of
understanding skills, a qualita-
posttest
experimental study.
Two-Phase Research
Two-phase research addresses different questions within the research problem in
a two-phase study. The qualitative and quantitative methods are employed sepa-
rately, simultaneously, or sequentially, without much mixing, to investigate each
of these questions. An example might be the impact of early diagnosis and treat-
deficit/hyperactivity disor-
der (ADHD). The researcher assesses the social skills of these students through
qualitative observations, and uses quantitative procedures to evaluate the students’
school performance using standardized assessment tools.
Integrated Research
Integrated research combines quantitative and qualitative methods throughout the
research process to answer the same question. The methods are employed concur-
rently with equal weight. For example, in a study to assess the impact of inclusion
on relationships among students, two data collections tools are used, each yielding
numerical and narrative data: (1) a survey that contains numerical and open-ended
questions and (2) and an observation protocol that includes unstructured observa-
A summary of the characteristics that distinguish among qualitative, quantita-
methods approaches is presented in Table 3.1.
choosinG An APPRoAch FoR YouR ReseARch PRoject
quantitative, qualitative, and mixed methods—
The three paradigms— present
methods and strategies for inquiry. Action research draws upon each of these edu-
cational research paradigms. No approach is right or wrong, none is considered
48 action RESEaRcH in Education
tABle 3.1. characteristics of qualitative, quantitative, and mixed-methods
Approaches
Qualitative
Quantitative mixed methods
Assumptions
about school There are multiple School reality operates Solutions to problems
reality school realities and according to stable, that school presents
their meanings are fixed rules relatively are at the center rather
historical and cultural settings that can be discussions about
backgrounds. objectively discovered. school reality.
research purpose
Understand school Discover universal Draw on the strength of
experience from the rules and methods to both quantitative and
perspective of those improve education and qualitative approaches
involved to improve the quality of teaching to enhance school
schools. and learning. improvement.
researcher role
The researcher The researcher The researcher
interacts extensively maintains a neutral assumes both objective
with individuals at and objective stance and subjective
the study’s setting. to ensure scientifically
The researcher accurate findings. on the question under
acknowledges his or investigation.
her own subjectivity
and biases.
research process
The researcher is The researcher The researcher employs
immersed in the setting investigates both quantitative
and describes the relationships among
collection methods
that individuals place variables that are and analysis, either
upon their actions and measured, quantified, simultaneously or
experiences. and generalized. sequentially.
common methods
Case study reseaIntegrated Research
Integrated research combine
Experimental research
s quantitative and qualitativ Embedded research
e methods throughout the Correlational research Two-phase research
Descriptive research
research process to answer
he same question. The
ods are employed concur-
rently with equal weight
Ethnographic research
Narrative research
Critical research
3. approaches to action Research 49
“the best,” and each has contributed to practitioner knowledge and understanding.
However, these approaches differ in several ways. Each perspective (1) offers dif-
ferent kinds of questions or problems, (2) seeks different types of findings, (3) calls
for different strategies, and (4) is assessed by different criteria.
approaches will best serve as a model for your study. As you ponder your choices,
we suggest considering the following: action research framework, your personal
worldview, and your research question(s).
Action Research Framework
The inherent nature of action research affects the methods you choose for your
investigation. As mentioned before, action researchers study their work, and the
study’s findings contribute directly and immediately to their practices. Thus, the
purposes of the study they undertake, as well as the methods they choose for their
investigations, are influenced by the possibilities and limitations of conducting
research in their own classrooms and schools. For example, conducting experi-
mental research is possible and at times desirable. However, generalization of the
findings to other settings cannot be done with a high degree of confidence, because
of the small size of most action research projects, the limitations in selecting a rep-
resentative sample of participants, and the tenuous control practitioners have over
the variables in the study. Still, for action researchers, the focus is most likely not
on whether the inquiry’s findings can be generalized to other settings but rather
on whether the findings can be useful for improving their own practice. Similarly,
action researchers may choose to conduct critical research because of their desire
social justice and equity. In reality, though, the likelihood of change is greater
when the focus is on the local community. Action researchers are therefore advised
to conduct studies to explore and seek change within their local settings, class-
rooms, schools, and communities.
Personal worldview
We all bring distinct assumptions about school reality and the impact of research
on our practices that ultimately influence how we design and conduct our studies.
titioner you want to become aware of the tacit assumptions that undergird your
50 action RESEaRcH in Education
perspectives on school reality and implicitly shape your decisions throughout the
awareness is key to purposeful inquiry, in which the choices
you make regarding the questions, methods, and strategies best reflect your values
and professional needs.
Research question
The final factor to consider in choosing the approach for your study is the research
question you want to answer or problem that you want to solve. Certain questions
call for particular types of methodology; the research approach should match the
question you ask as the problem drives the choice of methods. For example, if
you want to evaluate the gains in students’ learning as a result of a new strategy
you have adopted, numerical test scores might be a good source of data. On the
other hand, if your question focuses on understanding the attitudes and feelings
of students toward this strategy and how it impacts their motivation, a qualitative,
in-depth interview might be your best approach. If your research focuses on under-
standing students’ perceptions of the new teaching strategy and how it impacts
methods approach might be the way to go.
As you choose your research approach, it is a good idea to brainstorm with a
(action research framework, personal worldview, and research question) and con-
template how they inform your choice of research method. The checklist of ques-
tions in Figure 3.1 may help guide your decision making.
Questions
1. What are my assumptions about the nature of school reality?
2. What are, from my perspective, the purposes for conducting action research?
3. How do I see my role as a researcher?
4. How will the action research framework affect my choice of a method?
5. How might my research question impact my choice of method for my study?
6. What research method is practical and doable within my situation?
FiGuRe 3.1. A checklist of questions to guide the choice of a research approach
FiGuRe 3.1.
3. approaches to action Research 51
Chapter Summary
1. Action research draws from a wide range of
educational research approaches and is
implemented in a variety of forms.
2. Alternative assumptions and sets of beliefs
about knowledge, school reality, and the
purpose of the research underlie the different
approaches to educational research.
3. Clarifying the different assumptions that und
erlie each perspective and the practical
implications associated with each will assist
you in developing your own inquiry and
choosing the types of questions you want to a
sk and the strategies and techniques for
collecting and analyzing the data to answer yo
ur questions.
4. There are three common worldviews (i.e., para
digms) that traditionally have shaped edu-
cational research. The three research paradigm
s are quantitative, qualitative, and mixed
methods.
5. Each research paradigm is discussed in this ch
apter in terms of (a) assumptions about
9. Qualitative, quantitative, and mixed-
school reality, (b) research purpose, (c) the res
earcher role, (d) research processes, and
(e) common research methods.
6. Common methods that are used in qualitative
research are case study, ethnographic,
narrative, and critical research.
7. Common methods that are used in quantita
tive research are experimental, casual–
comparative (ex post facto), correlational, and
descriptive research.
8. Common methods that are used in mixed- met
hods research are embedded design, two-
phase, and integrated research.
methods approaches differ in several ways. Each
of findings, (c) calls for different strategies, and (d)
is assessed by different criteria.
10. In choosing the method for their research proj
ect, action researchers may want to con-
sider their action research framework, persona
l worldview, and research question(s).
11. For action researchers, the focus is most likely
not on the ability to generalize the inqui-
ry’s findings to other settings but rather on the
usefulness of the findings for improving
their own practice.
12. As autonomous practitioners, action researche
rs need to be aware of the tacit assump-
tions that undergird their perspectives on sch
ool reality and implicitly shape their deci-
sions throughout the research process.
52 action RESEaRcH in Education
13. The purposes and methods of action research study are influenced by the possibilities
and limitations of conducting research in the practitioners’ own classrooms and schools.
14. The research approach should match the questions being asked as the research ques-
tions drive the choice of particular research approach and the type of methodology.
Chapter exerCiSeS and aCtivitieS
1. Clarify your own assumptions or deliberate with peers or colleagues the following
points.
a. The nature of school reality
b. The purpose of conducting research
c. The researcher role
d. The research processes
If working with a group, you may want to compare and contrast your different
perspectives.
2. Reflect on the qualitative, quantitative, and mixed-
discussed in the chapter.
a. Deliberate on the strengths and weaknesses of each of these approaches.
b. Consider the relations that these perspectives have to your personal experience as
a teacher (or as a learner).
c. What research approach seems to be most feasible in your current or future
educational settings and why?
3. As discussed in the chapter, each research approach—qualitative, quantitative, and
mixed methods—offers several research methods (e.g., case study, experimental
which method would be most appropriate for exploring your study’s question(s)?
Explain your choice.
3. approaches to action Research 53
4. Look for one or more published studies that discuss a topic relevant to your research
project, and answer the following:
a. Identify which research approach was used in the study—qualitative,
quantitative, or mixed method?
b. Which of the common research method(s) within the qualitative, quantitative,
c. How does the study question reflect the approach chosen by the writer(s) of each
of the chosen studies?
5. Revisit the research question(s) you have developed for your study. Consider whether
the research approach matches your questions.
AdditionAl ReAdinGs
Anfara, V. A., & Mertz, N. T. (Eds.). (2006). Theoretical frameworks in qualitative
research, Thousand Oaks, CA: Sage.
Ary, D., Jacobs, L. C., Sorensen, C. K., & Walker, D. (2013). Introduction to research in
education (9th ed.). Independence, KY: Wadsworth.
Creswell, J. W. (2012). Qualitative inquiry and research design: Choosing among five
approaches. Thousand Oaks, CA: Sage.
Denzin, N. K., & Lincoln. Y. S. (2011). The SAGE handbook of qualitative research.
Thousand Oaks, CA: Sage.
Guba, E. G. (1990). The paradigm dialogue. Newbury Park, CA: Sage.
Hoy, W. K. (2009). Quantitative research: A primer. Thousand Oaks, CA: Sage.
Johnson, R. B., & Christensen, L. B. (2010). Educational research: Quantitative, qualtita-
tive and mixed. Thousand Oaks, CA: Sage.
Krauss, S. T. (2005). Research paradigms as meaning taking: A primer. The Qualitative
Report, 10(4), 758 –7 70.
Morris, T. (2006). Social work research methods. Thousand Oaks, CA: Sage.
chAPteR 4
developing a Pl
an of action
A
ction research is a process of self-
on the development of a plan of action for your inquiry. By now, you have
reflection in which you have the ce
ntral role
selected the approach (qualitative,
quantitative, or mixed method) th
at will guide
your study based on your unders
tanding of the major paradigms
that underlie
action research and the methods
that each perspective entails. Yo
u have also
expanded your knowledge of the
topic you have chosen to investig
ate and have
formulated your research question(
s). It’s time now for the next step o
f your action
research project: developing the r
esearch plan with a focus on the d
ata collection
procedure.
55
step back before you launch your i
nvestigation and to carefully consi
der the essen-
tial issues involved. Consider ques
tions that will guide the procedure
s involved in
implementing your study. For exa
mple: How will you collect the da
ta? How will
you choose the participants for you
r study? What will be the scope of
the study and
how long will it last? What will
be your role as an action research
er throughout
the investigation? How will you e
nsure soundness of the data you pl
an to collect?
to respond to and accommodate
unexpected school circumstances.
For example,
you may have to schedule an inter
view with a colleague but the coll
eague’s plans
have changed, and he or she is n
o longer available or interested in
participating
collection plans. In another exam
ple, you may decide to survey a
nother group
56 ACTION RESEARCH IN EDUCATION
of students because of a low response rate from your first attempt to collect sur-
vey data. However, thinking ahead and identifying the steps involved in putting
together a practical, logical, and purposeful plan will prevent aimless and hap-
hazard inquiry. Carefully planning the study’s procedures in advance is especially
helpful for a novice action researcher.
research question. The question is a trigger for planning the process that will
enable you to find meaningful answers. The question guides your decisions regard-
ing the scope of the inquiry, the participants you choose, and the data collection
and analysis techniques you select. You should also pay attention to the practical
implications of conducting your inquiry within the context of your day-to-day
work and its effect on your practice. Consider issues such as What is your role
in the research setting? Are you a teacher, a specialist, or an administrator? Are
you a student teacher, parent, tutor, or a visitor? Additionally, be cognizant of the
amount of time you may be able to dedicate to the project and whether this study
is compatible with your other professional obligations and responsibilities. Also be
sure to get the proper permission to conduct the study from all involved.
a clear blueprint to guide your investigation. A meaningful and efficient research
plan usually necessitates reflecting on the following elements:
1. Considering your role as a researcher
2. Establishing the research scope
3. Identifying the research site and participants
4. Choosing data collection procedures
5. Ensuring the study’s validity and trustworthiness
6. Developing ethical guidelines
7. Creating a “to-do” list
Considering Your role as a researCher
At the center of the discussion about the researcher role is the question about the
subjective or objective stance you are assuming during the collection, analysis,
4. developing a Plan of action 57
quantitative researchers about how subjectivity should be addressed in educational
research. Qualitative researchers perceive subjectivity as an integral part of the
research process. They often reinforce the personal dimension of the study by
disclosing past and present involvement with the topic, as well as their personal
experiences during the research process. On the other hand, quantitative research-
ers view objectivity as essential for conducting educational research. They detach
and compromising the credibility of the findings.
tice is much more complex. Realistically, objectivity cannot be achieved as the
practitioners are intimately involved and building relationships with their students,
colleagues, administrators, and parents. By the same token, these ongoing relation-
ships may limit the practitioner’s ability to be open to new and different percep-
tions, viewpoints, and understandings.
and subjectivity. As a researcher, you should strive for a disciplined subjectivity,
acknowledging explicitly the following connections: (1) your own values, beliefs,
and commitments that are related to the study; (2) your past involvement and
experience with the topic; and (3) your relationship with the participants. Recog-
nizing these connections personally and publicly will mitigate your subjectivity
and prevent bias from creeping in and influencing the study. Understanding your
role as a researcher will also facilitate the process of understanding your findings.
acknowledging how the researchers’ perspectives and positions shape the research.
awareness and taking into account the potential impact
of one’s values, worldview, and life experience and their influence on the deci-
sions made and actions taken during the research process. Reflexivity suggests that
the action researchers acknowledge and disclose their subjectivity and monitor its
potential effect on their data collection and data interpretation (Guillemin & Gil-
lam, 2004; Rallis & Rossman, 2012; Rossman & Rallis, 2010).
teacher, who investigated the topic of differentiation. Mindy’s statement reveals
reflexivity as she reflects on her role, subjectivity, and bias and their impact on her
investigation. She deliberates on ways that will ensure her ability to contemplate
truthfully the perceptions and meaning her participants make of their experience
58 action RESEaRcH in Education
Box 4 .1. A Researcher Role Statement
The topic of differentiation has been a part of my professional teaching career since before I even
set foot in a classroom. I was introduced to the topic in one of the first courses I took for teacher
certification that focused on the issues pertaining to the education of children with disabilities. It
make up today’s inclusive classroom. The concept of adapting the practice to the different needs
of individual students has resonated deeply with me as it complements my perception of teaching
centered education. I also
know that, as a student, I flourished and thrived when I was taught by caring teachers who took
the time to see me as I am and tried to encourage me to shine, in spite of my shyness. I wanted
to provide such an experience to my own future students. As I continued my graduate studies,
and even more so during my substitute teaching and student teaching, the varied levels of learners
in any classroom became obvious to me as well as the complexities that are involved in teaching
curriculum that can be understood by all. Confronting such a reality led me to find ways to reach
each student in my classroom and to search for strategies for adapting my instruction to his or her
needs, strengths, and challenges.
ies, I am challenged by this aspiration each day and continually find myself searching for new
ways to meet students at their own varied level of learning. In any particular period during the
day, I can have a classroom of 25 students that will include special education students with indi-
vidualized education plans (IEPs), and students for whom English is a second language, students
who have been identified as gifted, as well as various levels of learners in between. More than
ever, I am convinced that in a diversified classroom of learners, a teacher cannot simply teach
the curriculum the same way to each student; different modalities of instruction can reach more
students. However, I have never explored systematically students’ and parents’ perspectives on
differentiation and whether they feel it affects the learning experience in the classroom. In this
I know that my personal convictions and passionate feelings toward this topic, as well as my
presence in the setting, may impact my research. I acknowledge my biases and am aware that my
preconceptions may enter into the data collection, analysis, and interpretation process and that
I need to take measures to monitor my bias and subjectivity. My goal is to hear and understand
students and parents and learn from them and from the way they make meaning of our class
reality and how they experience it. This requires me to listen carefully and with sensitivity to their
voices. Aware of the possibility of bias I will constantly and honestly reflect on how my subjectivity
shapes what data I collect, analyze, and interpret.
4. developing a Plan of action 59
estABlishinG the ReseARch scoPe
The scope of your study is determined by your res
earch question and the purpose
of your study. The scope affects decisions such as t
he length of time you will dedi-
cate to conducting the investigation, the number a
nd nature of the data collection
tools you will utilize, and the participants who will
be involved. For example, how
carry out? How many surveys will you administer
and to whom?
researcher is usually expected to carry out the study
for a prolonged period of time
using a variety of data collection techniques. Opti
mally, the research project con-
tinues until the practitioners feel they have obtaine
d all the information needed for
answering the research question and sense that the
continuation of the inquiry will
not yield any additional insight. By comparison,
in quantitative action research,
the scope of the study is more defined and pred
etermined, and the research is
planned ahead of time in greater detail. The invest
igation ends when the data are
collected and analyzed.
points such as Are you engaged in your research pr
oject to inform your practice or
enhance your professional growth and skills? Are
you motivated to undertake the
study to solve a particular problem you encounter i
n your work? Are you required
to conduct the study as part of formal coursewor
k? Are you contemplating pre-
senting your findings within your district or at a st
ate or national conference? Is
your intention to publish your findings or post the
m online? The answers to these
questions will influence the scope of your study.
conditions that are not within your control. These i
nclude issues such as the school
calendar, the length of the curriculum unit or progr
am that you plan to investigate,
standardized testing dates, or the due date of an assi
gnment you are completing for
a course. Other external concerns may be your abili
ty to access information within
your school (e.g., test scores and attendance reco
rds) and the district or school
policy pertaining to research conducted within th
e school. If, on the other hand,
the research project is part of your coursework, e
ducational degree program, or
teaching requirements, the course syllabus
may dictate the parameters of
your research project. Consult with your advisor,
mentor, or class instructor as to
The research project should always be manage
able and doable. Remember that
your first obligation is to your students, colleagu
es, parents, and administrators.
60 action RESEaRcH in Education
While your aim should be for an in-depth inquiry, be realistic as you plan and
implement the study within the framework of your practice. Identify the boundar-
ies and constraints of your proposed study and consider how they may affect your
ability to investigate effectively. Moreover, be sure that the process of conducting
your research does not negatively impact the quality of your practice.
conducting action research and are unfamiliar with the process. We suggest view-
long professional development process
as an action researcher. Use the experience of this study to become comfortable
with the process of being a researcher, to acquire the skills needed for conduct-
ing school research, and to learn to appreciate its potential for your professional
growth. The main focus is on the experience of being a researcher, rather than on
the specific results of the study.
identiFYinG the ReseARch site And PARticiPAnts
Since action research is embedded within the classroom and school setting and the
results of the inquiry have immediate local application, knowledge of the partici-
pants and the contextual factors is of particular importance.
Research site
Details about the overall school community offer a fuller description of the study
within its particular context. These details will include information about the
located. Depending on the specific focus of the study, additional information may
be required. For example, if your research focuses on gifted education, it will be
helpful if you also indicate the special programs and services available to gifted stu-
dents. Most of the school and district demographic information is easy to obtain
mandated websites. Additional details may be obtained
from the school’s administration office, as well as from publications such as school
newsletters and brochures.
student teacher in a middle school who is doing an action research project for the
research class he is taking. The study is focused on students’ and teachers’ perspec-
tives with regard to the use of a portfolios assessment system in science class.
4. developing a Plan of action 61
Box 4.2. An Excerpt from a Research Site Section
The middle school in which my study is conducted is one of six middle
schools in a public school
class socioeconomic
grade
students consisting of 48.2% African Americans, 3.5% Asian Ameri
cans, 23.9% Caucasians,
reduced-
Research Participants
The identification of who and how many participants will
be asked to take part
in your study depends on two factors: (1) determining wh
o will be able to provide
valuable information for your study, and (2) criteria for p
articipant sample selec-
tion. As is the case with all action research, practical co
nsiderations of what is grade
doable within your time constraints is a factor in your deci
sion.
by the issue under investigation. Their actions, behaviors
, or perceptions should
contribute valuable information that will enable you to ans
wer your research ques-
tion. For example, in an action research study that assesse
s the impact of a new
grade language arts textbook on students’ motivation, t
he fourth-
researcher may want to add complementary groups of part
icipants to obtain addi-
tional perspectives. For example, in this study of fourth g
raders’ motivation, the
Teachers’ perspectives may provide information about th
e students’ participation
in class discussions, while parents may share students’ in
formal views and their
willingness to do their homework.
investigation may be eligible to be included in the study,
you will probably need
to select a smaller sample for practical considerations. A s
et of criteria may guide
your choice of a suitable sample.
action research. Both are small-scale studies that involve a
relatively limited num-
ber of participants and are focused on local settings. Ho
wever, there are distinct
62 action RESEaRcH in Education
differences between the two approaches in terms of the number and identification
of the participant sample.
size of the sample or how it is selected. It is not uncommon to have a sample size
of one to four individuals who have experience and in-depth knowledge about the
topic being investigated. If, on the other hand, your inquiry is focused on an event,
spectrum and select more participants to ensure that diverse perspectives are repre-
sented. Sample selection is based on the relevancy of the participants’ experiences
regarding the topic of the study and their ability to enable you to obtain rich data
and valuable information that will contribute to the understanding of the issue
under investigation (Onwuegbuzie & Leech, 2007). Additional considerations may
include their willingness to participate, their knowledge of the issue, their ability to
articulate their opinions, and their ability to contribute to your understanding of
the topic. Some qualitative researchers assert that because participants in qualita-
tive research are not expected to represent anyone but themselves, it is more appro-
priate to talk about specific individuals or a group rather than about a “sample.”
However, others emphasize the specific purpose for choosing the participants for
the study (Cohen, Manion, & Morrison, 2011).
1. Selecting a purposive sample: The participants are chosen deliberately
according to a predetermined purpose (Maxwell, 2013). Some of the com-
a. Typical case sampling: Participants selected are judged to be typical of
the group under study.
b. Extreme case sampling: Particular individuals are judged to be the most
outstanding examples of a characteristic or behavior (at either end of the
c. Representative sampling: The participants are selected for possessing or
exhibiting the range of characteristics or behaviors in connection to the
2. Selecting a volunteer sample: When access to participants is difficult, the
researcher selects the participants from among volunteers, such as friends
3. Selecting a convenience sample: Participants are chosen from among the
nearest and most accessible individuals.
4. developing a Plan of action 63
For example, Jesse, a sixth-grade student teacher, may be experimenting with
a new, more democratic classroom management style and wants to find out how it
is perceived by his students. Jesse may choose students who represent the typical
behavior of the majority of the students in the class. On the other hand, he may
decide that it would be more beneficial to choose students who exhibit extreme
classroom behaviors, such as very disruptive and very quiet pupils. Yet another
room. At times, though, limiting circumstances may preclude the use of precon-
ceived selection criteria. For example, Jesse may not have a choice and will have to
study only students who volunteer to participate in the study. Moreover, time and
other constraints may lead him to choose a convenience sample, such as selecting
students because they are easily accessible during his free time.
explain the basis for your selection process. If you need to change your sample
selection during the course of the study, which can happen in evolving qualitative
research, be sure to explicitly present the reasons for the change in the final report
(Peshkin, 2001).
student teacher who investigated teachers’ and students’ perspectives on the use
of portfolio assessment in the science class. Box 4.3 presents an excerpt from his
description of his study participants
Box 4.3. A Description of Research Participants
The participants in my study included two female science teachers and 14 seventh- and eighth-
grade students. One of the teachers is in her thirties and has been teaching in the school for 2
years. The second teacher is in her forties and has 8 years’ teaching experience, 4 of them in the
current school. I chose these two teachers for my inquiry because I work with them as a student
teacher; they are a convenience sample.
grade students (6 males and 8 females), were chosen from the
two teachers’ science classrooms. The teachers who participated in the study assisted in the pro-
cess of selecting a representative sample as we worked together choosing students that the three
of us felt best represented the diverse range of achievements in science, motivation and attitude
toward the subject, and behavior in class. Two of the students were at the top of the class, four
whom English is a second language, two students with learning challenges, and two students with
behavior problems.
64 action RESEaRcH in Education
Quantitative action research relies on numerical data gathered in the study.
Although such research may aim at studying a large group of people, such as all
parents in a district, it is often difficult and impractical to study these large groups,
called populations. Instead, a sample is selected from the population of interest,
tion. That is, we make inferences about the population characteristics that are of
interest to us based on the data obtained using the sample (Myers, Well, & Lorch,
In most traditional educational research studies, a sample size of at least 30—and
ideally more—is required in order to use more robust statistical tests and to make
valid inferences (Mertler & Charles, 2011). Single-case experimental investiga-
effect relationships by studying
one individual or a small group.
tive studies:
1. Selecting a random sample. Every individual in the total population (e.g.,
teachers, students, or parents) has an equal chance of being selected. The
selected.
2. Selecting a systematic sample. The sample is selected in a systematic way
from the population. For example, every fifth or tenth person is selected.
3. Selecting a stratified sample. The population is first divided into subgroups
based on certain demographic characteristics, such as grade level or gender.
The final sample represents, proportionally, the demographic subgroups in
the population.
4. Selecting a convenience sample. This is the most common way to select a
sample for researchers, who study those who are most easily available and
In action research, most samples are chosen from a population that is of
interest to the researcher. For example, Valerie, a high school athletics director, is
interested in assessing athletes’ attitudes toward school. She constructs a 10-item
Because of school policies, she cannot ask the athletes to write their names on the
surveys. Out of the list of 200 athletes in the school, Valerie gives the survey to
4. developing a Plan of action 65
a random sample of 40 to 50 athletes. Valerie may also decide to give the survey
to every third or fourth student in her list of athletes; this would be an example
of a systematic sample. It is also possible that Valerie will have to use data from
vey and uses the results from their surveys. In all cases, because not all athletes
were included in the study, Valerie will have to take this into consideration as she
analyzes the survey data and be cautious in extending the findings to all athletes
at the school. She may want to look at the demographic information available
(gender, grade level, and sport) to determine how well they represent the total
population of athletes.
sizes and results are usually reported in terms of probabilities (“p value”) or level
of statistical significance. (The concept of probability and statistical significance is
discussed in Chapter 7.) In action research, unlike traditional educational research,
the study focuses on participants in the researcher’s own setting, and therefore
their number is often limited. For example, David, a first-grade classroom teacher
of 21 students, wants to examine the use of a computer software program by his
students to practice letter recognition. He uses a test to assess his students’ perfor-
mance before and after using the program. While David realizes that he does not
have a large enough class size to meet the expected minimum sample size require-
ments of traditional educational research, his goal is not to generalize his findings
to other classrooms but rather to improve his students’ reading skills.
to choose a representative sample that resembles the population within an accept-
able margin of error (Dane, 2011). The concept of representation in traditional
representative of the population at large. For example, let’s say that a university
solving strategy in math in high school.
The purpose is to demonstrate the value of using the strategy in schools all across
the country. The researcher selects a representative sample of high school class-
solving
strategy. Math scores of students in classes using the new strategy are compared
to scores of similar students in classrooms using the current strategy. If the scores
of the students in the pilot study are significantly higher than those of the other
students, there is evidence to document the effectiveness of the new strategy over
tation in all high schools. In contrast, in action research, the goal is to study the
researcher’s own classroom or school rather than to generalize the results to other
66 action RESEaRcH in Education
locations. For example, a high school math teacher who would like to test the
solving strategy will use it with students in his or
her own classroom, regardless of whether they represent some larger population
of students elsewhere.
are used in qualitative and quantitative action research.
ticipants depend on the particular research tools you plan to employ (Kemper,
Stringfield, & Teddlie, 2003). For the qualitative component of your study, you
may choose individuals who fit the selection criteria discussed above. For the
quantitative portion of your research, try to include as many of the available and
eligible participants as needed. For example, assume Suzanne, a preservice student
teacher con-
ferences in the fourth grade. She plans to collect her data using both qualitative
and quantitative tools that include observation, survey, and interview. For each
strategy, she selects a different number and type of participants, as appropriate.
For the observations, Suzanne selects three parents who represent different levels
of parental involvement. The second tool is an exit survey that Suzanne intends
to give to all parents after the conferences. After receiving the survey’s numerical
results, she plans to conduct phone interviews with five parents to further discuss
how they perceive the experience and benefits of the conferences. These parents
will be selected to represent children of different levels of academic performance.
Using the three data sources will provide Suzanne with a more complete perspec-
teacher conferences.
with people in the study setting. Your choice of participants from among students,
parents, and colleagues is made on the basis of your firsthand knowledge of who
among them is best suited for your study. If you are a guest in the setting, you may
tABle 4.1. selecting samples in qualitative
and quantitative Action Research
Qualitative studies
Quantitative studies
• Purposive (typical cases, • •
• Random
extreme cases, representative)
• •
• • •
4. developing a Plan of action 67
ask your mentor, advisor, or cooperating teacher to assist you in obtaining your
sample.
pants in the study are five students, indicate their age and grade level, gender,
services provided by the school, or any other relevant information that is approved
by the school administration to share and is not confidential. Additionally, explain
class.
about the participants and the setting. In such cases, you may want to indicate
what specific information you plan to gather later. As you develop the research
plan, provide the details you currently have and note what additional information
is still needed.
choosinG dAtA collection PRoceduRes
The research question guides your choice of inquiry procedures. The process of
constructing data collection tools, therefore, begins by contemplating your research
question, deciding what information you need to collect in order to answer this
question, and determining what kinds of strategies will be most effective in provid-
ing this information.
structured to be used in a variety of research studies and to yield both narrative
and numerical data. For example, surveys can be constructed with open-ended
numerical data.
for example, interview individuals or groups presenting questions face-to-face, by
telephone, or online. These interviews may be structured or unstructured. Each
strategy provides a different type of information; therefore, in order to get a fuller
picture it is suggested that you use more than one data collection tool. Using dif-
ferent sources will also increase your ability to compare and contrast the informa-
tion you collect. Using multiple data sources is referred to as triangulation and is
discussed in greater detail in this chapter in the section titled “Ensuring the Study’s
lection tools and their definitions and outlines their possible usefulness as well as
some of their limitations.
68 action RESEaRcH in Education
tABle 4.2. most common data collection tools: their definitions, usefulness,
and limitations
Tool
Definition usefulness limitations
Interview
Purposeful conversation Presents individuals’ May be time-consuming;
between two or more perspectives, expressed usually limited to a few
people in which an in their own words, on interviewees.
about a selected topic
occurs.
Observation Purposefully observing Provides an authentic Represents only
people, events, and view of what is taking observable behaviors and
interactions as they place, mostly within a requires other tools to
occur. natural context. determine the intentions
of the people being
observed.
Surveys Collecting information Easy to reach a large Self-report surveys
from a large number of number of participants may be sensitive to
people, mostly numerical; while maintaining
narrative data may also anonymity; allows for rate may be a problem.
diverse perspectives on
a topic.
Artifacts Documents and artifacts Provide personal, Obtaining some
and produced in the context demographic, and documents may be
documents of the class, school, or historical formal and difficult due to school
district. informal data that are policy and legal issues.
be used to represent
the setting, groups, and
individuals.
Assessment Teacher-made and Allows monitoring Assessment tools may
data standardized test scores of student progress not accurately capture
representing students’ student performance,
achievement. effectiveness of teaching the content taught, or
strategies, curriculum, or the effectiveness of the
programs. teaching strategy.
4. developing a Plan of action 69
As you plan your study and ponder which strategy to choose, we suggest that
you consider the following:
1. Which strategies will yield the information needed to gain deeper insight
about the issue you are exploring?
2. Which strategies will provide you with different perspectives on your topic?
3. Which strategies are most suitable for your particular situation and are
most likely to be enacted within your setting?
4. Which strategies will yield data within the boundaries of the time available
to you?
For example, let’s say that a school board is considering a proposal to provide
mandated standardized
achievement tests. A reduction in recess time seems to be the solution favored by
the majority of the board members. Jenny, a sixth-grade social studies teacher in
that school, is concerned about the effect of a shorter recess on her students. She
decides to conduct a study to explore the impact of recess on her students’ aca-
demic progress and classroom behavior. Jenny is considering five different strate-
gies to answer her research question: interviews, observations, student work, a
made tests. Interviews and surveys would allow her to obtain
the students’ perspectives on the value of recess. Observations would offer her an
opportunity to systematically watch and record her students’ behavior, class par-
objective data, and students’ work samples would reflect their ability to under-
stand the materials presented in class.
next school board meeting is in 4 weeks. An additional consideration that impacts
Jenny’s decision is how doable and practical these research strategies are within
the constraints of her teaching responsibilities. For example, will she be able to
conduct observations while fulfilling her duties as a classroom teacher? Will she be
able to conduct in-depth interviews of students of different ability levels and with
behavior issues and transcribe them? Can a numerical survey reflect the nuances
of students’ feelings and thoughts? What kinds of documents will Jenny choose
from among her students’ work that will reflect her students’ progress over time?
not to use interviews, since they would take too much of her limited time. Instead,
she will add five open-ended questions to her survey to allow students to express
70 action RESEaRcH in Education
their opinions in their own words. Jenny would also like to observe her students.
To avoid compromising her teaching responsibilities, she asks her colleague, Mari-
anne, to videotape the class while she is teaching. Jenny decides against including
samples of students’ work as part of her presentation to the school board because
of the short time she was given for her presentation. Finally, knowing the inclina-
tion of the school board to trust statistical test data, Jenny chooses to use her stu-
ensuRinG the studY’s vAliditY And tRustwoRthiness
You have to be confident that your research findings are valid in order for the
results of the study to be useful for your practice and to enable you to shape your
decisions and future actions. The term validity refers to the degree to which the
study, the data collection tools, and the interpretation of data accurately represent
the issue being investigated. Validity is valued in both qualitative and quantita-
tive research; however, it is addressed differently by each approach. In qualita-
tive studies, which are essentially subjective and focused on participants’ perspec-
tives, validity refers to the extent to which data reflect participants’ views of the
issue being explored. In fact, practitioners often prefer the term trustworthiness to
describe the kind of data used in qualitative inquiry. In quantitative studies, valid-
ity is most often an issue that relates to the appropriateness of the tools used to
collect data, the soundness of the study’s design, and the extent to which findings
can be generalized to other groups.
qualitative studies
The most common methods to enhance the trustworthiness of qualitative action
research studies are triangulation, disciplined subjectivity, thick description, mem-
ber checking, peer review, and data audit.
using multiple methods or obtaining varied perspectives. While the image of a
triangle suggests using three sources of information, using two or more methods
might be more feasible, depending on your particular research question or circum-
stances. For example, Julie, an assistant principal, seeks to obtain the perspec-
Obtaining data using different sources, such as interviews and surveys, would
4. developing a Plan of action 71
allow Julie to triangulate the information gathered and thus establish the trust-
worthiness and credibility of her interpretations (Richards, 2009).
ceived ideas with regard to the study and to monitor your biases. In our dis-
cussion about the researcher role in this chapter, we emphasized the value of
ledging the researcher’s own subjectivity. The trustworthiness of the study
reflection with regard to the setting, partici-
pants, and the topic as the researcher collects, analyzes, and interprets the data
(Guillemin & Gillam, 2004).
and a presentation of the participants’ perspectives in their own words. This thick
description allows the audience to perceive authentically the participants’ views
and “enter” into their world by seeing, hearing, and sensing their experiences.
Since qualitative research findings emerge from the participants’ perspectives, an
intense and detailed narrative allows your audience to better understand your
interpretation of the data, thereby enhancing the trustworthiness of the study.
spectives honestly and accurately. This can be accomplished by sharing with the
participants the interview and observation transcripts and discussing with them
your analytical thoughts and interpretation.
determine the credibility of your interpretation and the accuracy of your findings.
To achieve this, you can recruit a colleague, a friend, or a collaborative research
group member to review your data and interpretation and provide you with con-
Data audit is a process that records and lists the raw data: transcribed notes
from observations and interviews, original documents, photographs, and other
artifacts. This information allows your audience to assess whether the interpreta-
mation gathered throughout the study.
quantitative studies
Traditional experimental studies in educational research are designed to test
the effectiveness of an intervention (the independent variable) and the impact it
effect relationships and articulate their predictions about these
ing for cause-and-
72 action RESEaRcH in Education
relationships by stating their hypotheses prior to the start of the study. In most
cases, experimental and control groups are used and their scores on some mea-
sure are compared before and after the intervention. This is especially true with
traditional large-scale studies with important consequences, such as purchasing
new textbooks for the students in a district or training teachers how to use a new
instructional method. Researchers have to carry out tightly controlled studies in
variable (intervention) and not other causes, called extraneous variables (Ravid,
2011). Those extraneous variables are unplanned and uncontrolled variables that
may be related to and influence the study’s outcomes. For example, the time of day
that the study takes place, the quality of classroom teaching, or the type of tools
all of these can impact the outcomes and
mask the true effect of the planned intervention.
planned intervention and are not caused by other possible extraneous variables,
our study is said to have high internal validity. There may also be threats to the
eral population to which the results are generalized. As an example, problems
may be related to the fact that the group used in the pilot study is composed of
volunteers who are highly motivated and do not represent the general population.
In studies conducted by educational practitioners, though, the goal is not to gen-
eralize to other populations of participants, so the problems listed above generally
do not create serious issues that threaten the validity of the findings.
effect relation-
ships, you should try to control as many of the relevant variables as you can. For
grade teacher, wants to try a new method
to teach vocabulary. For one month, she tests the students every Friday on the 10
vocabulary words taught that week using the current instructional method. For
the next month, she uses a new teaching method and again tests the students at the
end of each week. After 2 months, Darlene compares the total number of correct
words achieved by each student. Ideally, the 2 months should be similar on several
relevant variables, such as the number of school days, the difficulty of the words
taught, and student attendance. If, for example, there is a flu epidemic in the sec-
ond month of the study, Darlene’s students may not do as well on their vocabulary
tests because they missed too many school days and not because of the instruc-
should consider them when she analyzes her data.
4. developing a Plan of action 73
Validity also depends on the quality and appropriateness of the measures used
to collect data and whether they measure what they purport to be measuring. This
is true in both traditional and action research in education. For example, a reading
comprehension test that measures students’ ability to read a passage and respond
to questions about the passage is not a valid test of reading fluency. Similarly, a
math test that includes computation exercises is not a valid indicator of students’
In quantitative research, the issue of reliability is also important. Reliability
refers to the consistency of the tools used to gather data. As a researcher, ask your-
self whether similar results would have been obtained if you were to repeatedly
use the same or equivalent data collection tools or procedures. In studies where
trained observers or raters participate in the data collection process, the agree-
ment between them can serve as an index of reliability and consistency (Mertler &
Charles, 2011). In other studies, results from repeated testing using the same tool
or using equivalent forms of the same test can be compared in order to determine
the reliability of the assessment tool. In general, longer tests are likely to be more
reliable. For example, a math test with only a few questions leaves too much room
for guessing and, therefore, may not be as reliable as a longer test. If your study
includes data gathered through the use of commercially available tests (such as
standardized achievement tests), it would be a good idea to include information
about their reliability. (See Chapter 6 for further discussion of reliability.)
teacher- made tests, let’s look at Travis, a middle school social studies teacher. Tra-
vis and the other social studies teachers in the district met in the summer to review
the curriculum, articulate their learning objectives, and write district assessments
tives ensured the validity of the assessment tools. The assessments that were con-
structed included at least three items to measure each learning objective. This was
done to increase the tests’ reliability by providing students with several opportuni-
ties to demonstrate their knowledge.
mixed-methods studies
The procedures for ensuring the trustworthiness and validity of qualitative and
quantitative approaches are different; therefore, make sure to describe the strate-
tion, thick description, peer review, and so on. In the quantitative methods portion
74 action RESEaRcH in Education
of your research, discuss the validity and reliability of the data collection tools, as
well as the threats to internal validity, when appropriate (Creswell, 2009).
develoPinG ethicAl Guidelines
Although action research is conducted by practitioners in their own practice, it
is still considered research and should be monitored and conducted by following
ethical guidelines. You should ensure the safety, confidentiality, and well-being
of those you study or those who may be affected by your study. Ethical consider-
ation of your students and your colleagues should be key elements of your action
research study (Mertler, 2012) and you should protect the interests and well-being
of all the study’s participants (Stringer, 2008). As you plan your inquiry, you need
to consider the following issues as they relate to your action research.
obtaining Permission to conduct the study
Check with the appropriate “gatekeepers” (e.g., teachers or administrators) and
obtain permission to conduct the study and collect data. Even if you carry out the
inquiry in your own classroom, you may need to get the approval of your adminis-
trators (Samaras, 2011). Make sure you document the exchange of messages giving
you permission for the study. In some cases, depending on the school policy and
the nature of your study, you will need to obtain parents’ permission as well. If the
inquiry is part of your academic course requirements, your instructor will provide
you with the necessary guidelines and advise you about the process. In many cases,
that involves submitting a proposal to an ethics and review committee (Denzin,
2009; Pritchard, 2002).
confidentiality of data collected
Whenever you collect data for your study, you need to ensure the confidentiality
of your findings. Regardless of the information you collect — observations, inter-
views, test scores, school records, and the like—the rights of participants should
be guaranteed. Avoid identifying by name or providing other identifying informa-
be sensitive to people’s desire to remain anonymous. You may use pseudonyms or
4. developing a Plan of action 75
general descriptions such as “suburban school in a large metropolitan area.” Use
group data when possible to protect individuals. For example, report test scores
for the class as a whole instead of scores for individual students. To protect the
anonymity of the study’s participants, names and other contact information need
to be removed from documents used in the study such as writing samples, surveys,
and tests. Additionally, with so much data currently stored in electronic formats,
informed consent
In many studies, participants (or their parents or legal guardians if they are minors)
have to consent to participate in the study. Don’t assume that you can design any
study or collect any data that you want just because you are investigating in your
own setting. Additionally, make sure you have the proper permission to record or
videotape the participants. Unless the data you collect are part of your professional
responsibilities, you have to notify the participants about your action research and
provide them with an opportunity to ask questions about it. We suggest sending
a letter of introduction to the participants or to their parents or guardians if they
are minors. In the letter identify yourself and your role in the school, describe the
purpose of your study, and outline what the research participants’ involvement
in the study will entail. You should also ensure the participants’ confidentiality
and privacy and explain that they can withdraw from the inquiry if they wish to,
without any negative consequences. This information may encourage the coop-
eration of the participants (or their parents or guardians) and will allow them
to make a thoughtful decision about whether to sign the informed consent form
ter of introduction and an informed consent form, respectively, that were sent by
Orin, the student teacher who investigated portfolio assessment, to the parents of
his students.
Respect toward the Research site
As an action researcher, respect the needs, goals, and priorities of the school or
classroom where you conduct your inquiry. The quality of your study depends, to
a large extent, on participants’ cooperation. Treat them with respect, share with
feedback. Acknowledge your appreciation and express your gratitude for their
76 action RESEaRcH in Education
Box 4.4. Sample Letter of Introduction
Dear Parents and Guardians,
My name is Orin ; I am a student teacher in school and a
student in the MAT (Master of Art of Teaching) program at the University of .
teaching practice I am working with Mrs. and
As part of my student-
work with your sons and daughters. As part of my graduate studies I am required to conduct
a research project and chose to focus my research on the portfolio assessment system in
the science class. This study is done with the permission of the school principal, and the
full cooperation and support of your child’s science teachers. The purpose of the study is
educational and the results will contribute to the knowledge and understanding of the value
of portfolios from the point of view of the students and their teachers.
The study involves (1) an observation of two sessions of science classes where portfolio
assessment system is practiced, (2) reading your son/daughter’s portfolio on the topic of
Earth, and (3) a 30-minute interview. During the interview, your child is free not to answer
any of the questions asked and you or your child may terminate the interview at any time.
I assure you that your child’s privacy and anonymity will be respected and protected
throughout the process and no real names or identifying information will be included in
my final research report. Participation in the study is voluntary. If you are not comfortable
with having your child participate in the study, you may at any time withdraw your child’s
participation.
I would like to formally ask for your permission to allow for your child’s participation in
this research project by filling out the Informed Consent Form attached. Thanks in advance
Please feel free to contact me if you have any questions about the study or your con-
sent.
Sincerely yours,
Orin
4. developing a Plan of action 77
contributions. When you present your findings, be sure that it’s done truthfully,
but with sensitivity, and with the greatest care not to hurt the participants’ feelings
and self-image.
safety of the Participants
Study participants should not be put in harm’s way or suffer in any way in the
name of research. If there is any possibility of a conflict between your research
goals and your professional responsibilities as a practitioner, your first concern
should be the welfare, well-being, and needs of your students, their parents, and
your colleagues. Be sure to inform participants (or their legal guardians) that they
can stop their participation in the study at any time.
Box 4.5. Sample Informed Consent Form
I give my consent to have my son/daughter, , participate in a research
project regarding the use of portfolio assessment in the science class. I understand that if I give
this consent my son/daughter will be interviewed and observed during two sessions of science
class, and his/her portfolio on the topic of Earth will be read by the researcher.
I understand that participation in this study is voluntary; I can withdraw my son/daughter
from the study at any time during the study without any negative consequences.
I further understand that my child’s anonymity will be protected, and the name of the school
or the teachers will not be revealed when reporting the results of the study.
Please sign and return the form.
Your name (please print):
Your child’s name:
Your signature:
Date
I understand the information above and A gree to allow my son/daughter to participate in
the research project.
I understand the information above and D o no gree to my son/daughter’s T A
participation in the research project.
78 action RESEaRcH in Education
Accurate interpretation and Presentation of the data
You should maintain the highest standards and be honest and accurate when gath-
ering and interpreting your study’s data. While it may be tempting at times, do not
overextend your findings and do not report as conclusive findings that you cannot
confirm with a high degree of certainty.
cReAtinG A “to-do” list
Creating a “to-do” list will help you to (1) carefully schedule the implementation
of your data collection plan, (2) assess the time required for each activity, and (3)
ensure the feasibility of completing your study within the time available. Figure 4.1
shows a section from a “to-do” list that includes an outline of the major activities
of the plan, the time and location of each activity, the people involved, and the
materials required for each activity.
seen delays that often occur in executing the plan. Remember that the plan you
have developed so far is focused on the data collection phase of the study. Be sure
to budget additional time to analyze and interpret the data gathered in the study
and to write the final report.
FinAlizinG the ReseARch PlAn
Once you have completed writing the research plan, reread it carefully and criti-
cally, preferably with a friend, a research colleague, or your advisor/instructor.
aspects of the plan will enable you to successfully answer your research question
Date Activity location Participants What Is required
Mrs. Smith
Monday, Interview A quiet place Recording
April 12, to talk in the (a fifth-grade device,
10:15–
teachers’ lounge teacher) interview guide,
11:00 paper, and pen
FiGuRe 4.1.
FiGuRe 4.1. A section from a “to-do” list.
4. Developing a Plan of Action 79
within your time frame and circumstances. Consider whether you have thought-
fully addressed the various elements of your research plan and made appropriate
choices that will allow you to efficiently and successfully carry out your investiga-
tion.
(on page 80) presents a series of questions for each of the seven elements that were
addressed in this chapter. As you review your plan, self-check and respond to the
questions below.
Chapter Summary
1. The research plan serves as a guide for the inquiry process; it allows the action researcher
to step back before launching the investigation, and to carefully consider the essential
issues involved. This is especially helpful for a novice researcher.
2. When implementing the research plan, the researcher may need to revise, adapt, and
modify it to respond to and accommodate unexpected school circumstances.
3. The research plan should be described in sufficient detail to provide the practitioner with
a clear blueprint to guide the investigation.
4. The research question is the key for developing a research plan that will enable the
researcher to find meaningful answers.
5. A meaningful research plan usually necessitates reflecting on the researcher’s role, the
scope of the study, the data collection techniques, the research participants, the study’s
validity and trustworthiness, and ethical guidelines.
6. Reflexivity means taking into account and openly discussing the potential impact of
the practitioner’s preconceptions, values, and personal and professional experiences on
decisions made and actions taken during the study.
7. The scope of the study affects the length of time dedicated to conducting the investiga-
tion, the number and nature of the data collection tools utilized, and the participants
who will be involved.
8. The process of constructing data collection tools begins by contemplating the research
question, deciding what information should be collected in order to answer this question,
and determining what kinds of strategies will be most effective in providing this informa-
9. Since action research is embedded within the classroom and school setting and the
results of the inquiry have immediate local application, knowledge of the participants
80 action RESEaRcH in Education
Your Research Question:
elements of Plan
Questions and choices to consider
Your role as a
• What values and preconceived notions do you have that may impact your
researcher
study?
• How will you address your subjectivity and biases?
•
•
Scope • What is the purpose of your study and with whom will you share it?
•
• Is the study manageable within your daily practice?
study?
•
Research site and •
participants Site:
Participants: •
• Does the sampling allow you to obtain multiple perspectives on the issue
•
• What are the demographics of the participants?
•
Data collection •
procedures • What and how many data collection techniques are you going to use?
your research question?
•
•
Validity and reliability • What methods will you use to ensure the trustworthiness of the findings?
•
• How will you secure triangulation or multiple sources?
data collection tools?
•
Ethical considerations
• How will you protect the confidentiality of the data collected?
obtain them?
• •
“To-do” list • • When and where will the different activities take place?
• Who will be involved in each activity?
FiGuRe 4.2.
FiGuRe 4.2. Summary of the elements of the data collection plans.
4. developing a Plan of action 81
10. The identification of who and how many participants will be asked to take part in the
study depends on who will be able to provide valuable information for the study and the
criteria for participant sample selection.
11. Details about the overall school community offer a fuller description of the study within
its particular context.
12. Qualitative action research does not have a formulated set of rules about the size of the
sample or how it is selected. Types of samples selected include typical extreme cases,
representative, available, and convenience.
13. Quantitative action research relies on numerical data and, therefore, sample size is an
important consideration. Types of samples selected include random, systematic, strati-
fied, and convenience.
14. In mixed-
15. When planning the study, the researcher may not have all the required information about
the participants and the setting. As the research plan is being developed, the researcher
needs to include the details currently available while also noting what additional informa-
16. Practitioners engaged in action research have to be confident that their findings are valid
in order for the results of the study to be useful for their practice and to enable them to
shape their decisions and the actions that follow.
17. The term validity refers to the degree to which the study, the data collection tools, and
the interpretation of data accurately represent the issue being investigated. Validity is
valued in both qualitative and quantitative research; however, it is addressed differently
18. Qualitative researchers prefer the term trustworthy over validity because they assert that
qualitative studies are essentially subjective, and the focus is on the researcher’s ability
to see and present the issue being explored through the eyes of the participants.
19. The most common methods for enhancing the trustworthiness of qualitative action
research studies are triangulation, disciplined subjectivity, thick description, member
checking, peer review, and data audit.
20. In quantitative studies, validity is most often an issue that relates to the appropriateness
of the tools used to collect data, the soundness of the study’s design, and the extent to
21. In quantitative studies, validity also depends on the quality and appropriateness of the
measures used to collect data and whether they accurately measure what they purport
to.
82 action RESEaRcH in Education
22. The procedures for ensuring the trustworthiness and validity of qualitative and quantita-
tive approaches are different; therefore, make sure to describe the strategies you will use
for each.
23. In quantitative research, the issue of reliability is also important. Reliability refers to the
consistency of the tools used to gather data.
24. It is essential that action researchers follow ethical guidelines when conducting their
studies; they should ensure the safety, confidentiality, and well-being of those they study
or those who may be affected by their study.
25. Action researchers may find it helpful to create a “to-do” list that includes an outline of
the major activities of the plan, when and where each activity will take place, the materi-
als required for each activity, and the people involved.
Chapter exerCiSeS and aCtivitieS
1. Write down your research question in a center of a page, circle it, and jot down
around it ideas triggered by the question. Write down the types of information,
Once you complete this visual map, review it with a practical eye and consider what
is doable within the context of your own professional and personal circumstances.
(This brainstorm activity may be done alone, with a peer, or with your research
group.)
2. Reflect on your role as a researcher and jot down your subjective connection to the
topic of your study. Consider the influence of your subjectivity on the decisions you
3. Identify the site and the participants for your study. Plan how to access this site and
obtain permission to conduct the study. Indicate how you will select your sample,
4. Explain the types of data that you plan to collect and how they will allow you to
answer your research questions. (Table 4.2 and the questions on page 69 may assist
5. Describe how you will ensure the validity and trustworthiness of your study. If you
are conducting a quantitative research or a mixed- methods study, be sure to include
numerical data.
4. developing a Plan of action 83
6. Reflect on the ethical issues related to your own study. Consider how to ensure the
safety, confidentiality, and well-being of those involved in the study and describe the
may be helpful in case you are required to use a consent form.)
7. Using the example in Figure 4.1, create a tentative “to-do” list for your study.
8. Using Figure 4.2, review all the elements of your proposed plan. Jot down potential
problems or challenges that you may encounter while implementing the research
group.)
AdditionAl ReAdinGs
Denzin, N. K., & Giardina, M. D. (Eds.). (2008). Qualitative inquiry and the politics of
evidence. Thousand Oaks, CA: Sage.
Hancké, B. (2010). Intelligent research design: A guide for beginning researchers in the
social sciences. Victoria, Australia: Oxford University Press.
Israel, M., & Hay, I. (2006). Research ethics for social scientists: Between ethical conduct
and regulatory compliance. London: Sage.
Merriam, S. B. (2009). Qualitative research: A guide to design and implementation. San
Francisco: Jossey-Bass.
Mills, G. E. (2011). Action research: A guide for the teacher researcher (4th ed.). Upper
Saddle River, NJ: Pearson.
Schram, T. H. (2006). Conceptualizing and proposing qualitative research (2nd ed.).
Upper Saddle River, NJ: Pearson Education.
Teddlie, C., & Tashakkori, A. (2008). Foundations of mixed methods research: Integrat-
ing quantitative and qualitative approaches in the social and behavioral sciences.
Thousand Oaks, CA: Sage.
Warin, J. (2011). Ethical mindfulness and reflexivity: Managing a research relationship
with children and young people in a 14-year qualitative longitudinal research (QLR)
study. Qualitative Inquiry, 17(9), 805 – 814.
chAPteR 5
data collection
tools
ur classrooms and schools are rich with data. As educators, we are continu-
ously bombarded with information and intuitively “collect data” every day.
O
students behave on the playground, when we try a new curriculum or revise an
When we listen to our stud
ents or to their parents, when we
observe how
an integral part of our work. We
do not consider them “research”
because they
seem to be natural elements of the
educational routine. But, in reality
, that is what
85
standing of the consequences of o
ur actions. These same activities a
re used when
we collect data for teacher action r
esearch. However, in teacher resea
rch, the data
collection effort is purposeful, deli
berate, organized, and systematic.
The informa-
tion we gather from our data may s
erve as evidence that confirms our
insights and
validates our intuition.
our research questions, rather than
from theoretical orientations (Che
ck & Schutt,
2011; Merriam, 2009). As you e
xplore the many types of data co
llection tools
detailed in this chapter, ask yourse
lf the following questions: What d
o I want to
and Can I obtain the information t
hat I am looking for? Do not limit
yourself to a
particular theoretical orientation;
rather, choose the data collection
methods that
86 action RESEaRcH in Education
will be most useful in understanding the research problem and answering the ques-
tions you raise. Therefore, ask yourself: Will qualitative data or quantitative data
methods approach—
collecting both quantitative and qualitative data—offer me a better understanding
of the research problem than either approach alone?
research tools and methods into qualitative and quantitative when carrying out
action research. The same tool may generate qualitative or quantitative data
depending on the strategy developed. For example, an open-ended observation may
structure obser-
vation, based on predetermined categories, like a checklist, will result in numerical
data. Similarly, artifacts may include qualitative data, such as those found in self-
reflective journals, as well as quantitative information, such as attendance records.
Therefore, unlike most of the chapters in the book, we did not organize this chap-
methods framework but rather
structured it around the major data collection tools.
like you have found to be most useful for gathering information in investigating
their practice. For each method, we provide some general guidance and practical
tips that, we hope, will contribute to the effectiveness of your data collection pro-
settings.
most appropriate to the classroom and school world: (1) observation, (2) interview,
(3) survey, and (4) artifacts and documents.
oBseRvAtion
Observation refers to looking at a setting purposely. The act of observation pro-
vides a powerful insight into the authentic life of schools and classrooms. You
can systematically observe the activities, people, and physical aspects of your edu-
cational setting. Observations allow you to view the school, the classroom, or
specific individuals in those settings and to see things that you may unconsciously
chaotic dynamics of teaching. In contrast with interviews, in
which the participants’ voices guide your understanding, observation allows you
to be aware of nonverbal behaviors, gestures, and body language (Good & Brophy,
2007; Wragg, 2012).
5. data collection tools 87
The observation strategies available to you as a teacher researcher lie on a con-
ended, from
unstructured to structured, and from holistic to preordained.
qualitative observation
During qualitative observation, you should look, listen, learn, ask, ponder, and
record your observations. The qualitative observation may be semistructured or
unstructured. In a semistructured observation, you start by developing a set of
issues such as students speaking out of turn and patterns of class participation.
The observation is designed to generate data that illuminate these issues as they
arise naturally in the classroom setting. An unstructured observation is usually
not based on a given agenda; rather, you will look at what is taking place in the
classroom setting before deciding what is significant in the situation for your
investigation (DeWalt & DeWalt, 2010). In the following section, we describe the
qualitative unstructured observation tools that are typically used by educators in
their educational settings: the observation protocol, the behavioral log, and tools
such as photographs, videotapes, and audiotapes. We based our description on our
experience as educational researchers and teachers of action research, as well as on
many sources that include DeWalt and DeWalt (2010), C. Frank (1999), Good and
Brophy (2007), LeCompte and Schensul (2010), O’Reilly (2012), Rodriguez and
Rayave (2002), and Wragg (2012).
The Process of Conducting Qualitative Observation
Overall, the focus of your observation should emerge from the research question(s),
but at the same time you should be cognizant of the general context of the setting.
Envision how the observation will help you in answering the research question.
You also need to make a decision about where, how often, and how long the obser-
vations will be (Hopkins, 2008). Ask yourself questions such as What am I going
to look for? and How will I describe the observation in words for future analysis
and interpretation?
conduct the observation at a distance, getting involved as little as possible with
the observed setting? Are you going to be a full participant/observer, engaged in
you observe? Or is your role going to be something in between, such as observ-
student interactions in another class or observing your own students
88 action RESEaRcH in Education
during lunchtime, or another situation in which you have no teaching responsibili-
ties? Keep in mind that even if you do not purposely intervene, your presence in the
classroom can affect the behavior of the people in the setting and change it. When
you observe your own class, consciously look from a perspective of an outsider.
Step back from the daily routine of your work and look at the setting as if you are
seeing it for the first time. Make the familiar and known new and unexpected. Be
2012; Hopkins, 2008; Rodriguez & Rayave, 2002).
with the environment and the people involved. Gradually narrow your focus and
zero in on the people, behavior, and interactions that are at the center of your study
and that are most relevant to your research question. Every now and then broaden
your observation to see the full picture before you zoom in, once more, on the spe-
cific activities or students directly related to your investigation. This will allow you
to be sensitive to the specifics without being blind to the broader picture.
Observation Protocol
The observation protocol contains field notes that are detailed descriptions of
what you see, hear, and sense during the observation, and the thoughts, feelings,
and understandings these observations provoked. The richer the description, the
more meaningful the observation. Through thick description narrative, the set-
ting should be “brought to life” and the reader should have the feeling of “being
there.” Observation protocol includes two kinds of field notes: descriptive and
reflective.
Descriptive Notes
Descriptive notes aim to record what happened during the observation without
inferring feelings or responses to what is happening. In the descriptive notes,
describe the physical setting; provide a verbal portrait of the participants; record
the acts, activities, and events that take place; and document conversations verba-
tim. Draw a classroom seating chart of the physical layout of the setting includ-
ing desks, tables, other furniture, computers, and other teaching tools, such as a
smartboard. Figure 5.1 shows an example of a classroom seating chart.
& DeWalt, 2010; Lofland, Snow, Anderson, & Lofland, 2005; H. F. Wolcott,
2005) suggest that before you start, you should concentrate on the aspects that
5. data collection tools 89
are directly connected to your own topic. Consider the following general ques-
tions:
1. Who is in the setting? For example, indicate the number of people present,
and their gender and age group.
2. When does the group meet together? For example, the time of the school
day and the length of the session.
3. Where is the meeting taking place? For example, the physical setting, the
ways the group uses the space, and the ambience of the room.
4. What is happening here? For example, what are the people in the setting
doing or saying to one another? In what events, activities, or routines are
5. How is the situation organized? For example, what rules or norms govern
the situation?
SMARTBOARD
COMPUTER
BOOKSHELF
STUDENTS
WORKTABLE
TEACHER
FiGuRe 5.1. Classroom seating chart.
FiGuRe 5.1.
90 action RESEaRcH in Education
As you focus your observation on the issues directly related to your own inves-
tigation, direct your attention to the following aspects:
1. Portray the individuals or groups that you chose to follow: for example,
their physical appearance, mannerisms, and gestures.
2. Describe activities: for example, provide a detailed depiction of activities
related to the focus of your study.
3. Note particular interactions: for example, who was involved and what
occurred?
dialogues: for example, direct quotes, unique phrases, and reveal-
4. Record
Reflective Notes
Reflective notes are used to record reflections and insights about what is happen-
ing in the setting. These notes may include:
1. Reflections on the meaning of what is observed: for example, your insights
and emerging interpretations.
2. Reflections on the observation methods: for example, reflect on procedures
and materials used in the process, and think of some suggestions for future
3. Reflections on problems encountered: for example, ethical dilemmas and
conflicts.
4. Reflections on your own frame of mind: for example, attitudes, expecta-
tions, and biases.
The reflective field notes are written in a way that clearly sets them off from
the descriptive notes. Some researchers use brackets or parentheses to indicate
their reflective notes, whereas others draw a line down the center of the observa-
Figure 5.2 for a sample observation protocol form.)
Observation Steps
The following are some guidelines and suggestions to help you plan and carry out
your classroom observations:
5. data collection tools 91
Research question(s):
D
a
t
e
o
f
o
b
s
e
r
v
a
t
i
o
n
:
FiGuRe 5.2.
i e
m
Location of observation:
Who are the foci of the observa
tion?
Activities:
Purpose of observation (behavi
ors, interactions, responses):
How does the observation refle
ct what I want to know?
What is important here?
What would I want to focus on
more closely if/when I return to
this setting?
Des refl
cript ecti
ive f ve f
ield ield
note not
s es
FiGuRe 5.2. Sample obse
rvation protocol form.
1. Find a place that prov
ides a good view of wha
t is going on, without be
ing
conspicuous.
2. Spend some time at t
he beginning of the obs
ervation without taking
notes
and then confine you
r attention to the general
characteristics of the sett
ing.
3. Identify the people,
activities, and interactio
ns that will be the foc
us of
your attention.
4. Draw a diagram of th
e classroom.
5. Record your descripti
ve and reflective field n
otes on the observation
proto-
col form.
6. Start with a broad s
weep and gradually nar
row your focus to parti
cular
participants or intera
ctions that are most valu
able for your research.
7. Record what happens
in the class. It would be
helpful to note the progr
es-
sion of the classroom
activities and topics disc
ussed.
92 action RESEaRcH in Education
8. Write down behavioral descriptions in the descriptive field notes section as
they occur; be sure to set them off from the reflective field notes.
9. After completing the observation, take some time to review your notes
and add any descriptions and reflections you may have missed. Respond to
on more closely if I return to this class?
Behavior Log
The behavior log is a useful observational tool for a more focused observation.
This type of log is a running record used to keep track of the behaviors exhibited
by an individual student or a small group of students during a given situation (e.g.,
student group work, playground). The running record enables the teacher to iden-
tify patterns of behavior. It provides an examination of the dynamic between what
preceded and followed the behaviors and allows for a comparison between an indi-
vidual’s conduct at different times or in different situations (Cohen et al., 2011).
and what followed the studied behavior. You may record a student’s inappropriate
behavior every time it occurs (see Figure 5.3).
is happening at regular intervals, such as every 5 minutes (see Figure 5.4). For
Child Grade Date Observed Setting
Time specific Behavior environmental reaction comments
FiGuRe 5.3. Sample behavior log.
FiGuRe 5.3.
5. data collection tools 93
Child Tina Grade 4 Date
12/7 Observed Setting Math Class
Time
specific Behavior environmental reaction comments
A math worksheet is The students are
9:05 the assignment?
Does Tina understand
Tina. She is fidgeting, sits next to Tina,
on the table in front of working. Laura, who
looks around. glances at her every
now and then. The
teacher grades papers.
Tina grabs Laura’s Laura pulls Tina’s book. Is the teacher aware
9:10 The teacher looks at
the floor.
pencil and drops it to Tina. Why doesn’t she get
of Tina’s behavior?
involved?
Tina bounces on the Laura calls out: “Tina
9:15
pushed aside. can’t work!” The
chair. Her worksheet is is making noises. I Tina needs help.
teacher recognizes that
teacher gets up.
Stands next to Tina.
Tina points angrily at
the worksheet. “It is
boring,” she exclaims.
FiGuRe 5.4.
FiGuRe 5.4. Sample interval behavior log.
example, let’s say you observe a child, who is diagnosed as having attention deficit
disorder, while he or she is working on math exercises. Every 5 minutes record
his or her behavior; note also the reaction of the people in the context (e.g., peers
interpretive comments.
Photographs, Videotapes, and Audiotapes
Observational tools like photographs, videotapes, and audiotapes can enhance
your capacity to capture student behaviors, attitudes, and social interaction
through images and sounds.
Photographs
Photographs provide a useful means of representing a setting and its members.
They offer powerful visual images that complement the observation protocol and
94 ACTION RESEARCH IN EDUCATION
reinforce the verbal descriptions. For example, if you investigate students’ interac-
tions during lunch, you may take a set of photographs of the lunchroom at 5-min-
ute intervals over a 30-minute time span for several days. Together the pictures
depict patterns of seating arrangements, behaviors, and interactions in that setting
on a typical day (Allen, 2012).
Videotapes and Audiotapes
Videotapes and audiotapes are useful when you want to observe your own teach-
ing and you lack the time or the ability to take observational notes while you teach
the class. The advantages of video- and audiotapes is that they provide a perma-
nent record you can review to notice, with greater accuracy, students’ behavior,
attitudes, and social interactions, and other aspects of the classroom dynamics
that are not easily captured or remembered (White, 2012) .
teacher enrolled in her practicum class. She is working on improving her skills
in engaging students in classroom discussions. As part of her effort she collabo-
rated with her supervisor in studying the effect of the strategies she has read about
while researching this topic. During the data collection phase, Sarita videotaped
provoking questions while working with a small group of
seventh-grade ESL students. To obtain students’ responses to Sarita’s questions,
teaching supervisor recorded students’ involvement in the conversation
using a behavior log. The combination of these two observation strategies enabled
Sarita and her supervisor to examine the effect of her teaching strategies on the
level and quality of students’ engagement in the discussion. The following are some
X As with every research activity that involves participants, ask the permis-
X
sion of the people in the setting, and in the case of young children, their
parents’ permission, before you tape them. (Follow the ethical guidelines
outlined in Chapter 4.)
X Test run the taping equipment to ensure that it works properly.
X
X Consider carefully where you are going to post the video- or audiotape
X
recorder. Is the focus going to be on a specific student, on a particular group
images and voices will be prioritized.
5. Data Collection Tools 95
Mark all tapes with dates, time, and participants’ identities and other per-
tinent information.
Record the observational notes from videotapes and transcription from
audiotapes following the observation protocol process described above.
Quantitative Observation
In contrast to the open-ended qualitative observation, structured closed-
ended
pre
determined categories. Whereas in qualitative observations the behavior is
or activities is listed in advance and checks are made to record them as they
occur. As a teacher observer you adopt a nonparticipant role, noting the fre-
quency or the level of the behavior being studied. Whereas qualitative observa-
tion techniques result in subjective narrative descriptions, quantitative observa-
tion techniques require that you systematically direct your attention to specific
measurable behavior that results in numerical data. Quantitative observations
allow a comparison among settings, individuals, and situations, and frequencies,
patterns, and trends.
Tally S heets
A tally sheet is used to track the frequency of a target behavior or event at a specific
point in time. Figure 5.5 is an example of a tally sheet showing how many times
during class Johnny raises his hand and asks for help.
Behavior Math Reading
Johnny raises his hand to answer
his teacher’s questions.
FIGURE 5.5. Tally sheet of recorded behavior.
FIGURE 5.5.
96 action RESEaRcH in Education
Checklists
A checklist is made up of a predetermined list of behaviors or activities that are
the focus of the observer’s attention. In order to develop a useful checklist, the
observed behaviors should be defined and be separated into their components (e.g.,
“The students concentrate on their work”; “The student sways on his chair.”).
Checklists allow you to track the development of behaviors over time or across
one of her students, during free-play time and record the way she interacts with her
peers. Stephanie does that by placing a checkmark next to the behaviors exhibited
by Mary. Mary’s behaviors might include pushing, cooperating, playing with other
children, or taking toys from others (see Figure 5.6 for a sample checklist).
Rating Scales
A rating scale is used to record the extent to which a specific behavior or situation
exists. The response choices range on a continuum from one end of the scale to the
other (e.g., strongly agree to strongly disagree). Rating scales are also called Likert
scales (named after Rensis Likert, the developer of the scale) or Likert-type scales.
Figure 5.7 shows a sample of a rating scale that is focused on a specific student’s
behavior.
you plan your qualitative or quantitative classroom observations.
Child Grade Date Observed Setting
Behavior observed
Mary is playing with other children.
Mary takes a toy from another child.
Mary is pushing another child.
Mary is talking with the teacher.
FiGuRe 5.6. Sample checklist. FiGuRe 5.6.
5. Data Collection Tools 97
Circle the appropriate response:
1. The work of student (name of student)
has improved throughout the semester.
Strongly Ag Und DisaStrongly Di
Agree re ecid greesagree
e ed FIGURE 5.7.
FIGURE 5.7. Sample behavior ratin
g scale.
Suggestions
1. Ask the permission of the people in th
e setting you observe.
2. Allow the focus of the observation to
emerge from the research question(s).
3. Decide where, how often, and how lo
ng the observations will be.
4. Determine how involved you will be i
n the setting during the observation.
5. Record your descriptive and reflectiv
e field notes in the observation protocol f
orm.
6. Start with a broad observation and gr
adually narrow your focus on particular p
articipants
and interactions in the setting that ar
e directly relevant to your question.
7. Describe in great details the participa
nts, interactions, and activities at the cent
er of your
study.
8. Write the descriptive notes without ev
aluation or judgment while your reflection
s in
FIGURE 5.8.
observe.
9. Draw a classroom seating chart of th
e physical layout of the setting.
10. Use a behavior log and interval beha
vior log for a more focused observation.
11. Decide on the focus of your observati
on: Will it be an individual student or the
whole class?
12. Decide whether you are looking for sp
ecific behaviors or will record any behavi
or that you
observe.
13. Decide whether you will focus only on
the teacher, on teacher–student interacti
on, or on
student–student interaction.
14. Capture the setting’s environment by
using photographs or video- or audiotape
s.
15. Mark all observation protocols, behav
ior logs, interval behavior logs, and tapes
with dates,
time, and participants’ identities and
other pertinent information.
FIGURE 5.8. A checklist of suggest
ions for planning and collecting data
using classroom obser-
vation.
98 action RESEaRcH in Education
inteRview
The interview is a major data collection strategy in teacher action research. It
provides an opportunity for in-depth conversations and allows teacher researchers
to ask questions of students, teachers, administrators, parents, and others con-
nected with school. This method of inquiry provides an understanding of the par-
their ideas, opinions, values, and knowledge on issues related to the investigation.
Interview data complement and substantiate observation data. The observation
can also serve as a springboard for the interview questions. For example, through
observation you can record student action and interaction during free time. Inter-
viewing some of the same students would allow you to gain an understanding of
their behavior from their own perspectives. Interview data can be collected in an
unstructured, semistructured, or highly structured process.
unstructured, semistructured, and structured interviews
Unstructured Interviews
The unstructured interview is an informal, though purposeful, conversation. The
questions are broad and are presented in a casual style; the interviewer lets the con-
versation proceed naturally on its own course. Following the conversation we sug-
gest that a brief summary of the exchange be jotted down, and important informa-
tion be highlighted. For example, Herald, a first-grade teacher, investigates the value
of daily homework. As part of a natural conversation, Herald asks the parents, when
they pick up their children from school, “How did your son or daughter’s homework
Semistructured Interviews
The semistructured interview is based on questions that were prepared prior to the
interview. These are open-ended questions. During the interviews, participants are
construct the narrative and raise and pursue issues that are related to
the study but were not included when the interview questions were planned. Addi-
tionally, when more clarification is needed or unexpected information is revealed,
up questions and probes further to encourage the
participant to extend and deepen his or her responses (Kvale & Brinkmann, 2009;
Seidman, 2012). For example, Ashley studies the activities provided to students in
school program at her school. She constructs a set of questions, but as she
5. data collection tools 99
interviews the different program instructors and tries to dig deeper into their experi-
ences, additional questions emerge. In interviewing the dancing club facilitator, for
example, she starts by asking a general question: “Tell me about the dance club you
facilitate.” But, through the teacher’s answer, she realizes that different students
wish to focus on different kinds of dance. Some want hip-hop dancing, others would
time on classic ballroom dancing. Ashley asks several questions exploring this issue,
though initially she was not aware of the fact that the instructor faced this problem
and therefore did not prepare any questions related to this issue.
Structured Interviews
The structured interview is also based on prepared questions. However, unlike
semistructured interviews, in the structured format the interviewers frame the
questions using an exact wording, replicating the order of the questions and pro-
viding identical questions to all participants (Seidman, 2012). For example, Norm,
a social studies teacher, considers purchasing a new computer software program
for his classroom. He interviews teachers from several school districts who cur-
rently are using the program. He uses the same questions to elicit their opinions
about the program. Using the same standardized set of questions allows Norm to
gain comparable data across people and sites.
(Opdenakker, 2006). In choosing an interview format, consider the fact that as
educators studying our own settings, we are familiar, in some way or another, with
the people we interview; more important, we aim to gain their trust and encourage
dard prepared questions is often unfeasible. Still, preparing a set of questions that
will elicit the information you need for your study is very helpful and will allow
you to relax and present the questions informally. Your participants will sense
your confidence, which will enhance their tendency to speak freely, and in depth,
about issues related to your study.
that you explored through other sources of data used in your study are repre-
sented. This will allow you to triangulate, compare, and contrast the data during
the analysis and interpretation phases. If the interview is poorly planned, the data
may be difficult to analyze.
completed before the interview and Section II immediately after. In Section I, start
10 0 action RESEaRcH in Education
with the research question and then provide concrete information about the inter-
view and the interviewee. Then outline a set of interview questions that you want
to explore. As each interview evolves, you may change the wording and order of
the questions, add questions, or extend the scope of the original questions. Section
I of the interview guide can also be used for note taking during the interview. Sec-
tion II provides a narrative description of the person you interview: for example,
(See Figure 5.9 for a sample interview guide form.) In the data-obtained section
you may want to reflect on the main ideas and insights gained through the inter-
view. Then reflect on the process: Do you want to change anything? Are there any
additional questions that you want to add in the future? (C. Frank, 2011; Rubin &
Rubin, 2012; Seidman, 2012).
the interview Process
In this section we discuss how to develop and conduct a successful interview and
how to facilitate an individual, a focus group, or an online interview. The sug-
gestions for the steps used in each stage of the interview are drawn from our
experience as well as from the following sources: C. Frank (2011), Gubrium and
section I:
Research Question(s):
Date and Setting:
Interviewee Demographic Information:
Interview Questions:
Notes:
section II:
Interviewee Description:
Data Obtained:
Reflections (on the Process):
FiGuRe 5.9. Sample interview guide form.
FiGuRe 5.9.
5. data collection tools 101
Hollstein (2002), Kvale and Brinkmann (2009), Rubin and Rubin (2012), and
Seidman (2012).
suggestions for the interview process, and we cover different types of interviews:
individual, focus group, and online.
Developing the Interview Questions
By using interviews as an inquiry method, you are looking for the participants’
perceptions, knowledge, opinions, experience, and beliefs with regard to your
research topic. The challenge in constructing interview questions is to phrase the
questions and order them in a way that elicits the information you need (Foddy,
1993). Remember to write the questions on the interview guide form (Figure 5.9).
Keep these ideas in mind as you construct your interview questions:
1. Brainstorm the concepts, topics, and ideas related to the focus of your
inquiry that you might want to explore.
2. Examine your written ideas, grouping similar topics together. These clus-
ters of ideas are categories from which you will develop the interview ques-
3. Select the categories that are most meaningful to your research focus.
4. Develop broad, as well as more focused, open-ended questions for each
selected category.
5. Sequence the categories; within each category sequence the questions in a
logical order. (Some suggestions can be found below.)
6. Prepare a draft of your interview guide, Section I.
7. Pilot test the interview questions with several people not involved in the
s t udy.
Patton (2002) presents six types of interview questions:
1. Background/demographic questions elicit respondents’ descriptions of
themselves. For example, ask questions about their age, education, years of
2. Sensory questions elicit how the respondents perceive their environment.
For example, ask, “Please describe your classroom.”
102 action RESEaRcH in Education
3. Knowledge questions elicit what the respondents know about a particular
topic. For example, ask, “Tell me what you know about. . . . ”
4. Experience/behavior questions help determine what the respondents do or
have done through descriptions of their experiences, actions, activities, and
trip?”
5. Feeling questions are used to understand the respondents’ emotions regard-
ing an experience or a situation. For example, ask, “Do you feel anxious,
6. Opinions/beliefs/values questions elicit the respondents’ beliefs, intentions,
and values as related to a certain issue. For example, ask, “What do you
Following are some suggestions for phrasing interview questions:
1. Develop interview questions that will provide you with the information
needed to answer your research questions.
2. Group the questions by topics and sequence them in a logical order. For
grade students about bullying, you should group
all the factual questions (when, where, how often, who is involved) in the first sec-
next section.
3. Start the interview with simple, uncontroversial topics before you address
more complex, more challenging, and potentially more sensitive issues. A common
respondents to be open and expansive in their answers.
4. Begin the interview with broad (“grand-tour”) questions, such as “What
were your first impressions about the reading program?” and follow up with prob-
responses. Broad questions are often rephrased more specifically as probes: for
example, “Describe what specifically made an impression on you.”
5. Phrase questions clearly and free of words, idioms, or syntax that will
interfere with respondents’ understanding. Questions that are too vague will fail
5. data collection tools 103
6. Ask open-ended questions that are not answered with a quick response
such as “yes” or “no” or can be answered by choosing between fixed alternatives.
“Did your friends suggest that you join the Karate Club?” or “Did you join the club
because your friends suggested it or because you like karate?”
7. Avoid asking leading questions. A leading question is one that implies the
preferred response or influences the direction of the response. For example, “Don’t
8. Choose the degree of directness you will use in asking questions when the
issue is sensitive and when respondents may hesitate to share their honest opinions.
question indirectly: “How do the teachers in your school feel about . . . ?” or “How
do some teachers feel about . . . ?”
9. Ask questions about one issue at a time and do not combine two or more
questions together. For example, the question “How do you feel during math and
10. Encourage respondents to be as specific in their answers as possible. Fol-
low up on abstract answers by probing and asking for concrete examples. For
add “Can you give me a specific example of how this style is demonstrated in your
teaching?”
conducting the interview
Before the Interview
Before you conduct the interview, choose your interviewee carefully. This person
should be knowledgeable, be verbally skilled, and be willing to be interviewed. The
issue of convenience should also be considered; often, teacher researchers choose
participants who are more readily available. Be sure to arrange a time and place
for the interview that is convenient for both you and the interviewee. Try to find a
quiet place where you are not likely to be interrupted and where you will be able
to record the interview. Don’t forget to bring with you a recording device (with an
extra blank tape if needed), your interview guide, a note pad, and a computer or
to you as you listen. We suggest testing your recording device before the interview.
10 4 action RESEaRcH in Education
During the Interview
Take notes during the interview, even if you use a recording device, to allow you
to capture the essence of the responses, note body language and any change of
up questions. It is important to take time to
develop rapport with your interviewee. Start the interview by introducing yourself;
thank the person for agreeing to be interviewed, and be attentive to the interview-
as an interviewee. Guarantee confidentiality, and request permission to record the
interview. (See Chapter 4 for a fuller discussion on the ethical aspects of interviews.)
sense of trust that will help your interviewee feel comfortable. Ask factual ques-
tions about his or her personal and professional background and make him or her
feel at ease and confident in talking with you. It is always helpful if the interviewer
is attentive to the interviewee’s responses; the more you listen with interest, the
more willing they are to talk! Additionally, be sensitive to the interviewee’s per-
ceptions of the questions and, if necessary, clarify the question by rephrasing it or
by adding examples for clarification (e.g., a question is not clear or its meaning
is misinterpreted). Based on the interviewee’s responses, you may probe or ask
additional questions that you did not think about when you initially planned the
interview guide.
asked or any additional information that you should know. Again, thank the inter-
viewee for participating in the study and ask permission to follow up if you need
to clarify answers or need more information. Clarify whether the interviewees
would like to read a transcript of the interview and don’t forget to send or e-mail
After the Interview
Immediately after the interview is completed, reflect on the process and the con-
tent of the interview. We suggest that you listen carefully, several times, to the
recorded interview. Ask yourself: What are the salient themes? What are the major
ideas? and Which sentences should be presented verbatim and which will be para-
phrased or summarized?
provide an accurate and authentic account of the interviewee’s words. Do not
edit the way the answers were phrased. Assess whether the interview yielded the
5. Data Collection Tools 105
information you need for the study. For example, consider whether additional
questions, rephrasing the wording of a question, or changing the order of the ques
tions will improve the next interview.
focusing on the following:
The interviewee description: Write a detailed description of the inter
X X
viewee’s background, sociodemographic information, physical appearance, tone of
Data obtained: Based on the interview’s major themes, report the informa
X X
tion you have obtained from the interview. Insert many direct quotes!
Reflections: Evaluate the interview process. For example, how comfortable
X X
and responsive was the interviewee? Did you ask the right questions? What could
Focus Group Interview
A useful interview technique is having a focus group with several individuals who
come together and share among themselves their ideas, thoughts, and experiences
about the topic of your study. You may convene groups of students, parents, or
teachers and serve as a facilitator while the participants interact with one another.
The data emerge from the conversation among the participants.
to be interviewed in a single session. Moreover, as the participants respond to
each other, they introduce varied points of views, and stimulate and extend each
particularly beneficial for interviewing children. Children often feel intimidated
during individual interviews and are reluctant to speak up. In the company of their
friends they feel emboldened to talk and express their views (Currie & Kelly, 2012;
Morgan, 1997; Robinson, 2012).
1. Form a focus group of four to seven participants.
2. Create a seating arrangement so that everyone can see and hear each other.
3. Present clear and openended questions to the group.
4. Provide an appropriate time limit for each question.
10 6 action RESEaRcH in Education
5. Facilitate an open and free discussion; however, keep the conversation on
track.
6. Ensure that all participants have an opportunity to express their views.
7. Make sure that all opinions are heard respectfully.
8. Prevent one or two participants from dominating the conversation.
9. Avoid a situation in which the majority opinion silences a contradicting
point of view.
online interview
The use of the Internet to interview participants can be a time- saving technique.
the interviewee are both online at the same time (synchronous interview) or it can
be via e-mail (asynchronous interview). Using e-mails, you can send a set of ques-
tions to respondents and they, in turn, send their answers back. Another option
is to send a series of back-and-forth exchanges, in which you expand your focus,
up questions, and ask for clarifications, examples, or additional details
(Kvale & Brinkmann, 2009; Salmons, 2010).
a teaching position. She is very excited at the prospect of having her own class.
However, although she is comfortable about her content knowledge and ability to
put into action many creative and fun activities that will enhance student learning,
she is not confident in her classroom management abilities. In fact, this was the
weakest point in her practicum experience. Lindsey decides to be proactive and
discipline while also having warm and democratic classrooms. Lindsey asks her
advisor for names of three outstanding middle school math teachers. She sends
each one of them a series of questions seeking their advice about their classroom
management techniques. After receiving their responses, Lindsey analyzes these
responses to the online interview.
advantage is the time saved as the interview is already in a text format and there is
no need to transcribe the answers. It also enables you to interview people who live
far away and are not easily accessible. Additionally, the online interview allows
for them. However, the major disadvantage with the use of online interviews is
5. data collection tools 107
that the immediacy of face-to-face verbal and nonverbal communication is lost.
Although online interviewing allows for respondents’ reflexivity, when you replace
mediated communication, your ability to “read”
between the lines, to gain deeper insight into the respondents’ feelings and inner
thoughts, and to respond spontaneously are diminished.
Figure 5.10 presents a checklist of practical suggestions and guidelines for you
as you plan and carry out your interviews.
suRveYs
Surveys are one of the most common and efficient ways to gather information.
They provide large-scale responses very fast and can be utilized very efficiently and
with minimal expense and can be easily and quickly analyzed. While a distinction
can be made between surveys and questionnaires, in this book we use these terms
interchangeably.
perceptions, and attitudes, and in planning and evaluating programs (Fink, 2009).
Surveys can also be used to identify and assess needs; document behaviors; sum-
marize outcomes; assess opinions, attitudes, beliefs, and perceptions; and gather
information. In the field of education, survey data can help educators and other
stakeholders make informed decisions. For example, you may want to assess your
students’ opinions after implementing a new teaching method or new curriculum
materials, or survey your students’ parents about their children’s homework and
your teachers about their preferences for professional development days, or ask
parents for feedback about the school website and the type or quality of informa-
tion it provides.
ongoing instruction. For example, you may quickly survey your students by ask-
ing for a show of hands in response to a simple set of questions about students’
attitudes; or, you may ask the students to use a clicker to show their understanding
of a new concept that you teach. These strategies allow you to obtain information
easily and quickly, as a natural part of the teaching process.
the response rate is not high and those who respond do not necessarily represent
108 action RESEaRcH in Education
suggestions
1. Arrange a convenient time and place for the interview.
2. Choose carefully who you will interview.
3. Consider whether you would like to conduct the interview one-on-one or as a focus
group, face-to-face, online, or via telephone.
4. Plan your timetable carefully, allowing time to secure the cooperation of those you
interviews.
5. Develop an interview guide consisting of (1) interview questions, and (2) reflections on
the process.
6. Ask clearly phrased, open-ended questions.
7. Begin with background factual questions.
8. Group the questions by topic.
9. Sequence the questions from simple to complex.
10. Avoid asking leading questions.
11. Do not combine two or more questions together.
12. Pilot test the interview questions with several people who are similar to your target
group of interviewees.
13. Bring your recording device and test it before the interview.
14. Take time to develop rapport with your interviewees and appear interested in what they
are saying.
15. Encourage respondents to be as specific in their answers as possible; if needed, ask for
further clarification.
16. Keep your personal opinions in check.
17. Listen attentively to the interviewees.
18. Transcribe the interview accurately and authentically.
19. Reflect and evaluate the interview process.
20. Reflect on the information shared and consider whether changes need to be made in
the interview process.
FiGuRe 5.10. A checklist of suggestions for planning and collecting data using inter-
FiGuRe 5.10.
views.
5. Data Collection Tools 109
the whole group of potential respondents (Fowler, 2009; Fraenkel et al., 2011).
Another major problem is that respondents may or may not be honest in their
responses. They may choose those response choices that they believe are expected,
rather than express their true opinions, attitudes, or beliefs. Regardless of the
response rate, it’s always a good idea to collect demographic information about the
survey respondents and report this information along with the response rate when
Survey questions and response choices can elicit various types of responses
and the data collected can be both numerical and narrative. The advantage of
questionnaires is that they can be administered directly (face-to-face) or indirectly
by distributing them to people and collecting them later on or by sending them to
the respondent via regular or electronic mail. On the other hand, surveys and ques-
tionnaires lack the richness of personal interviews and direct observation. Using
them, you will find it very difficult to form a relationship of trust with the partici-
pants and find out, in depth, how each feels about the issue you are investigating.
As a compromise, you may choose to use a questionnaire and then conduct follow-
up interviews with selected participants who provided written answers.
people are becoming proficient and comfortable using it. When designing items to
be used in e-mail, it’s easy to ensure that people do not skip important items (i.e.,
they cannot continue with the survey if they skip and are reminded to go back
and complete these items). Contingency items are also much easier to use in elec-
question format allows the researcher to establish
a sequence of questions for respondents based on their selected responses to ques-
tions (Fraenkel et al., 2011). For example, respondents may be asked a question
to another set of questions. If they respond “No” to the contingency question,
administered
surveys, drop-down response choices can be used, thereby limiting the amount of
know the month a person was born in, the drop-down menu can list all 12 months,
asking the respondents to choose one. Another advantage of electronic surveys is
that the responses can be downloaded into a spreadsheet for easier tabulation and
analysis.
not what they actually do or how they behave. When you interpret the survey
data, do not overextend your findings or treat them as factual information or
110 action RESEaRcH in Education
evidence. For example, if 75% of your survey respondents indicate that they dif-
ferentiate their instruction regularly, you should not cite this finding as a fact and
claim that the majority of teachers actually do so (i.e., regularly differentiate their
instruction).
review and the instruments used in other studies (Andres, 2012). It also depends
on your research questions and the type of data you need, as well as on your sched-
ule and timetable, access to participants, and level of expertise.
especially those in which respondents are asked to choose among several options,
or those that require brief responses (ranging from one word to one sentence).
the Process of conducting surveys
In writing, administering, and analyzing surveys, we suggest that you follow these
steps:
1. Clearly articulate to yourself the purpose of the survey and the research
questions you hope to answer.
2. Identify the type of information you want to collect and how you would
use that information to answer the research questions.
3. Decide what demographic information (e.g., gender and age) you need to
gather in your study.
4. Develop a plan to administer the survey (e.g., online, hard copies, or face-
to-face) and to gather the surveys.
5. Prepare a timetable for constructing, distributing, and collecting the sur-
veys, and for coding, analyzing, and interpreting the responses.
6. Determine the sample needed for the study. If you plan to survey students,
teachers, or parents, make sure that you have permission to administer the
rate.
7. Give a title to your survey (e.g., “Students’ Attitudes toward Extracurricu-
lar Activities,” as opposed to simply calling it “A Survey”).
8. Write the first draft of your survey items (questions, statements, and
response choices).
5. data collection tools 111
9. Pilot test the survey, if possible, or consult with colleagues and classmates
and ask them to review the items before you administer the survey to your
10. Prepare a cover letter or a brief explanation of the survey.
11. Provide clear directions to the survey respondents at the beginning of the
survey on how to complete the survey items.
12. Administer the surveys; collect the completed forms.
13. Code the data; enter the numerical data into a spreadsheet; or type the
open-ended responses.
14. Analyze and interpret the results. (See the guidelines in Chapter 7.)
writing the survey items: types of questions and Response choices
Survey items may be divided into two general categories: structured (also called
forced choice or fixed choice) and unstructured (open-ended). In structured items,
the respondents have to choose from a series of responses (Mertler, 2012) usually
by circling, checking off, rating, or rank ordering their response choices. The struc-
tured response choices that are presented to the respondents may be ordered (e.g.,
from never to always) or unordered (e.g., subject teaching or position in school). In
the respondents are asked to record their responses. An example might be a ques-
tion asking teachers to list the certifications they hold.
require more time and a greater level of expertise. Computer software programs
(such as Excel and SPSS) can make the task of analyzing data from structured
items faster and easier by summarizing the data and visually displaying the find-
ings. (See Chapter 7.)
of their time. Therefore, the response rate is usually higher for surveys using such
items, compared with open-ended items, especially those that require long answers.
over the responses chosen, compared with items for which respondents can write
in their responses. In addition, you may find that reading people’s handwriting can
the handwriting issue is no longer a problem).
112 action RESEaRcH in Education
Even though in responding to structured items the respondent is asked to
choose from a list of options, sometimes a choice of other is added to allow those
responding to add a choice that is not on the list.
Suggestions for Writing Survey Questions
The following are some suggestions that should help you write your survey ques-
tions. These suggestions pertain to both the “stems” (e.g., questions or statements)
and the response choices.
1. Write simple, concise, clear questions. Some experts suggest questions
of no more than 10 to 20 words, with shorter and simpler wording for younger
2. Make sure the response choices you provide are appropriate for that ques-
tion. For example, response choices of yes and no should be used with questions
On the other hand, response choices that are on a continuum (such as responses
that range from never to always, or from strongly disagree to strongly agree) are
example, “Most of my students like using the Internet,” with response choices of
strongly disagree to strongly agree.
3. Make sure the respondents are knowledgeable about the topics of the
questions you ask. Do not ask them, for example, to reflect on how to accommo-
with such students. Instead, ask them first what is known as a contingency ques-
tion (e.g., “Have you had a highly gifted student in your class?”). Those who say
they have had such an experience are then asked about it.
4. Avoid including two ideas or thoughts in the same item (called “double-
barreled” items; see Figure 5.11). For example, you may consider your instructor
on time.
5. Avoid using words, such as “sometimes” or “often.” Each respondent may
interpret these words differently. Figures 5.12 and 5.13 are examples of a poorly
worded item, respectively. For some of those responding
to the question in Figure 5.12, the word sometimes may mean three times a week,
offers more precise options in place of “sometimes” or “often.”
5. data collection tools 113
I believe my instructor is knowledgeable and returns assignments on time.
FiGuRe 5.11. Example of a “double-barreled” item.
FiGuRe 5.11.
How often do you download a movie to watch at home?
Never Sometimes Often Always
FiGuRe 5.12. Example of a poorly worded item.
FiGuRe 5.12.
How often do you download a movie to watch at home?
Five to seven times/week
Two to four times/week
Once a week
One to two times/month Never
FiGuRe 5.13. Example of a better-worded item.
FiGuRe 5.13.
6. Avoid questions that can bias the respondents (e.g., see
Figure 5.14). In
this example, stating that the majority of parents have a certain opini
on about year-
the other respondents, even if this does not reflect their opinion.
7. Avoid using words or stereotypes that might be offensive t
o some groups
of respondents, and avoid using clichés and slang words. For exam
ple, new teach-
8. Avoid presumptions in writing your questions. For examp
le: “How often
do you drink alcoholic beverages?” This question assumes that
the respondent
Strongly disagree
FiGuRe 5.14.
The majority of the parents in the district are opposed to year-round school; what is yo
ur opinion?
agree Agree Neutral Disagree Strongly
FiGuRe 5.14. Example of a biased question.
114 ACTION RESEARCH IN EDUCATION
9. Provide clear directions for answering the survey items (see Figure 5.15).
10. Make sure the survey looks attractive. (This is most important for surveys
that are administered as hard copies.) The layout of the survey is important and the
should be spaced properly and not appear too crowded. Figures 5.16 and 5.17 show
examples of good and poor layouts, respectively. The respondents will find it easy
to record their answers in the example shown in Figure 5.16. By comparison, the
response choices are too crowded together in the example in Figure 5.17.
11. Number the survey items. Number the questions consecutively; this will
help you later when you record the survey responses or enter your data on a spread-
12. Order the survey items. Group the items according to their content and
the response choices provided. For example, when surveying children about their
• Circle the response that best represents your opinion.
• Rank order the five reasons listed below, assigning 5 to the most important reason and 1 to the
• Circle all that apply.
FIGURE 5.15. Examples of good directions for answering survey items.
FIGURE 5.15.
Questions SD D A SA
1. In my opinion, parents should be held responsible for their
children’s homework completion.
2. I believe that most parents are knowledgeable about their
children’s homework assignments.
FIGURE 5.16. Example of a good survey layout.
FIGURE 5.16.
1. In my opinion, parents should be held responsible for their children’s homework completion.
Strongly agree Agree Disagree Strongly disagree
FIGURE 5.17. Example of a poor survey question layout.
FIGURE 5.17.
5. data collection tools 115
attitudes toward school, you may want to group items that measure attitudes
toward classmates, teachers, administrators, and the school in general. Within each
category, items that use the same response format should be grouped together. For
example, group together all the rating- scale items, or all the checklist items.
13. Determine the length of the survey. Depending on your respondents, some
may be willing to spend more time responding to the survey, while others may not
amount of time your respondents may be willing to spend completing the survey.
Most practitioners who are engaged in action research limit the length of surveys
to no more than two to three pages.
14. Gather relevant demographic data. There are two main reasons for you
to collect demographic data: (a) to describe your sample, and (b) for use in the
completely describe those who responded to the survey, thus providing informa-
tion about the sample and its characteristics. You can also use the demographic
information in analyzing the data. For example, you may be able to compare the
responses of female and male respondents, or the responses of parents, teachers,
and students. The decision as to what demographic information should be gath-
ered is up to you, as the teacher researcher, and may depend to a large extent on the
nature of the study and the research questions that you are investigating.
the survey. Such items are considered more sensitive and objectionable and most
people are more likely to answer them when they are placed at the end (Salant &
Dillman, 1994), after they have already completed the survey and have “gotten
used” to responding to questions. Additionally, after completing the other survey
and usefulness of providing demographic data, whereas this may not be evident at
the beginning.
15. Number each survey after it is completed, giving it an identification num-
ber (ID number). When you enter the data into a spreadsheet or transcribe the
Structured Responses
The response choices to structured items are divided into several categories: Rating
responses, yes/no responses, ordered responses, unordered responses, checklist,
ordered responses.
116 ACTION RESEARCH IN EDUCATION
Rating Responses
In this category, several (usually three to seven) graded responses are provided.
The responses are ordered from one end to the other and the respondents are asked
to choose the response that represents their opinion, attitude, or belief about the
question or statement provided. The most common rating scales are the Likert
scale and the Likert-type scale (Mertler & Charles, 2011). In a Likert scale, the
agree to strongly agree (Fink, 2009). Likert-type, or rating- scale, response options
excellent to poor); self- perception (e.g., from not like me at all to very much like
to clarify the middle points on the frequency choice scale. For example, while the
explanatory, you may want to clarify the middle
points on the scale. For example, you may indicate that “Sometimes = one to two
times per week”, and “Often = three to four times per week.” Figure 5.18 shows
examples of Likert-scale and Likert-type questions. Following are some points you
scale items.
THE NUMBER OF RESPONSE CHOICES. You have to decide whether you want to pro-
vide an odd or even number of response choices. The most common scale has five
options: strongly agree, agree, neutral, disagree, and strongly disagree. (The same
five choices can also range from strongly disagree to strongly agree.) The middle
point, neutral, is provided for those who do not have a clear opinion or attitude
one way or another. The disadvantage of providing a middle point is that respon-
dents have a tendency to choose the middle category (McMillan & Schumacher,
1. An example of a Likert-scale question:
I would be interested in spending more time being a friend to a student with special needs.
Strongly disagree
Disagree Uncertain Agree Strongly agree
2. An example of a Likert-type question:
I feel that I can do my homework by myself.
Never
1–2 times a week 3–4 times a week Always
FIGURE 5.18.
FIGURE 5.18. Examples of Likert-scale and Likert-type questions.
5. data collection tools 117
2010). Additionally, those who choose the middle category are often those who do
not want to take a stand or spend too much time considering each question. When
summarizing the responses, the neutral responses do not add much to our under-
standing of people’s attitudes and opinions. Including an even number of responses
(e.g., strongly disagree, disagree, agree, and strongly agree) is often referred to as
forced choice, because you force the respondents to indicate their opinion on the
dren, you may want to consider providing only three choices and using graphics
to indicate the response choices (Mertler, 2012). For example, you may use smiley
faces to represent agree, neutral, or disagree response choices (see Figure 5.19 for
a sample of response choices for young children).
tHE diREction oF tHE WoRdinG oF tHE itEMS. Consider including some statements
that present an opposing or negative view (Suskie, 2009). In such items, a positive
attitude is indicated by choosing the response of strongly disagree (SD). This will
prevent respondents from checking a certain response all the way through the sur-
vey without actually reading each statement and considering it carefully.
may have the two items shown in Figure 5.20. Those opposing standardized tests
I liked the field trip.
FiGuRe 5.19. Sample response choices for young people.
FiGuRe 5.19.
Strongly Strongly
Agree Agree Disagree Disagree
1. In my opinion, the time we spend on preparing for
and taking standardized tests is a waste of time.
2. I believe that the results from the standardized tests
taken by my students accurately reflect my students’
knowledge and skills.
FiGuRe 5.20. Measuring attitudes toward standardized tests.
FiGuRe 5.20.
118 ACTION RESEARCH IN EDUCATION
would respond to the first question by choosing strongly agree, while their response
to the second question is likely to be strongly disagree.
THE NUMBER OF POINTS ASSIGNED TO EACH RESPONSE CHOICE. When using Likert-scale
items in which the response options range from strongly agree (SA) to strongly dis-
agree (SD), or from strongly disagree to strongly agree, you may want to assign the
the most positive response to the items and the lowest number of points (1 point)
to the response choice that represents the most negative response to the item.
variety of extracurricular activities offered in your school. A higher score would
indicate a more positive attitude and a lower score would indicate a more negative
attitude (see Figure 5.21 for two samples of different directions of the scoring key).
Reversing the scoring key can be done as you enter the data onto a spreadsheet or
after entering the data.
Yes/No Responses
In this category, respondents are asked to indicate their responses by choosing one
of two choices only: yes or no. Yes/no responses are most appropriate for gathering
factual information (see Figure 5.22). Occasionally, a third choice, such as “don’t
know” or “not applicable” is added. You also can use true/false responses at times
in place of the yes/no responses. However, do not force people to choose either a
Example 1: In this question, 4 points would be given to the strongly agree (SA) response, and 1
point to the strongly disagree (SD) response:
1. I believe our school offers a great choice of extracurricular activities.
SA A D SD
Example 2: In this question, you will reverse the scoring key by assigning 1 point to strongly agree
(SA) and 4 points to the strongly disagree (SD) response:
2. I wish we had more choices of extracurricular activities at our school.
SA A D SD
FIGURE 5.21. Two examples with different directions for the scoring key.
FIGURE 5.21.
5. data collection tools 119
1. I have a driver’s license. Yes No
2. I plan to take at least one AP class next year. Yes No
FiGuRe 5.22. Examples of yes/no response choices.
FiGuRe 5.22.
yes or no response for items for which there are likely to be in-
between response
ing recess,” you should probably provide “frequency” options (e.g., “at least once
a day” or “never”), rather than yes/no responses.
Ordered Responses
This category is used when the responses can be presented in some logical order.
Figure 5.23 shows an example of choices that are ordered logically, from the lowest
to the highest level of education. Student age and grade level are also examples in
which the responses should be presented in a certain order. You can use categories
to avoid having too many response choices. For example, when asking your col-
leagues in a K–12 unit school to indicate the grade level they teach, the grades may
be grouped into categories such as primary, intermediate, middle, and high school.
Please put a check mark next to your highest level of education.
Elementary school
High school
High school+
BA
BA+
MA
MA+
Doctorate
FiGuRe 5.23. Example of ordered response choices.
FiGuRe 5.23.
12 0 action RESEaRcH in Education
Unordered Responses
This category is used when the responses cannot be presented in any particular,
predetermined order. An example of unordered responses may be the item in a
survey given to school staff shown in Figure 5.24.
Checklists
Checklists are used to record or assess items, behaviors, skills, or other occur-
rences. Checklists are used in surveys in which respondents are asked to consider
a list of choices and place a check mark next to the items they choose. The list of
choices is dichotomous as opposed to the list of choices on rating scales that are
on a continuum. The respondents typically are asked to choose one of more items
on the checklist. An example may be the list of activities shown in Figure 5.25.
Please indicate your position/role:
Classroom teacher
Aide
Support staff/specialist
Administrator
Other (please list)
FiGuRe 5.24. Example of unordered response choices.
FiGuRe 5.24.
Check all the activities planned for your reading class today:
Group work
Worksheets
Silent reading
Teacher reading to the class
Students reading aloud to the class
Other (please specify)
FiGuRe 5.25. Example of items on a checklist.
FiGuRe 5.25.
5. data collection tools 121
A variation of the checklist may be a list from which respondents are asked to
choose only three items. For example, you can offer a list of adjectives and ask
teachers to mark the three that best describe their school principal.
Rank Order
In items using the rank-order format, a list of choices is provided and the respon-
dents are asked to rank order the items on the list. If you plan to use this format,
do not offer too many choices, because ranking becomes a difficult task when
too many choices are provided. Make sure you tell the survey takers how to rank
order. Figure 5.26 shows an example in which there are seven options and the
respondents are asked to assign 1 to their favorite choice and 7 to their least favor-
ite choice.
Unstructured (Open-Ended) Responses
There are two major types of responses in this category: those that require a lim-
ited range of responses and those that require one or more sentences. Open-ended
responses, especially those that are one or more sentences, can also be used to help
explain why people have responded in a certain way, or to clarify answers to other
questions.
Rank order your favorite school subject, writing 1 next to your most favorite subject
and 7 next to your least favorite subject.
Reading /language arts
Math
Social studies
Science
Physical education/gym
Music
Art
FiGuRe 5.26.
FiGuRe 5.26. Example of a rank-order format item in a survey of sixth-grade stu-
dents.
12 2 action RESEaRcH in Education
Short Write-In Responses
Figure 5.27 shows an example of an item with a short write-in response in which
the survey takers are asked to respond to a question with limited response options,
usually one or a few words, or a number.
Responses with One or More Sentences
In this type of item, respondents are asked to write longer responses, usually in
complete sentences. The amount and quality of the responses may depend to a
large extent on the writing skills of the respondents. The response rate may also
suffer because most people tend to be more willing to circle or mark responses that
are provided, as opposed to constructing their own narrative. These items usually
ask the respondents for additional information, comments, or feedback and it is
better to place these longer open-ended responses at the end of the survey (see
Figure 5.28)
In a typical school week, how many minutes per day do you spend
on the following activities?
Activity
number of minutes per Day
Homework
Watching TV/videos on my computer
Playing with friends or family members
Playing electronic games
Doing chores
FiGuRe 5.27.
FiGuRe 5.27. Example of an item with a short write-in response.
What did you like best about this professional development day and why?
FiGuRe 5.28.
FiGuRe 5.28. Example of a question requiring a response with one or more sentences.
5. data collection tools 123
Figure 5.29 presents suggestions and guidelines for you to consider as you plan
and carry out surveys.
ARtiFActs And documents
official and Personal Artifacts and documents
Artifacts are physical documents and records that allow teacher researchers to
construct a layered and contextual understanding of their topics. These may
include students’ work, meeting minutes, school reports, and public records. These
formal and informal documents provide historical, personal, and demographic
information that can provide additional knowledge about individuals (e.g., stu-
dents, parents, teachers, and administrators), the social and cultural life of the
school, and the general characteristics of the educational process. Data sources
assessments, essays, portfolios, and parents
or students’ e-mail messages are often easily available. These are naturally occur-
ring data in the practice of your teaching that do not require extra time or special
arrangements to collect. Like many other teachers and teacher candidates, you
may find that these methods of data collection are the most practical and doable
for action research. This information can corroborate, expand, or challenge what
you have gathered through other data collection tools (Cohen et al., 2011; Prior,
2012). For example, Joan, a fifth-grade teacher, is investigating the success of a
generated artifacts such as
homework assignments, students’ written reflections on the curriculum, and her
own artifacts, such as lesson plans, communication with parents, and bulletin
Some researchers (e.g., McMillan & Schumacher, 2010) distinguish between
records that have an official purpose and documents that are prepared for per-
on persons (students, teachers, and administrators), issues, and processes. These
may include school handbooks, free-lunch lists, policy statements, and standard-
ized test scores. Personal or episodic artifacts and documents comprise personal
or episodic records, such as diaries, class projects, and student artwork. (Table 5.1
shows examples of official, personal, and episodic artifacts and documents.) Other
researchers differentiate between quantitative numerical data, such as graduation
and diaries, notes, letters, and student projects.
suggestions
1. Be cognizant of the amount
of time that you can devote to
your survey and the access
you have to the responden
ts and plan accordingly.
2. Plan carefully the logistics
of distributing and collecting th
e surveys.
3. Consider the length of your
survey and ask only what you r
eally need to know; longer
surveys usually result in lo
wer response rates.
4. Contemplate the possibility
of surveying your students as p
art of your ongoing instruction.
5. Choose the appropriate for
mats for the questions and res
ponse choices in order to obtai
n
the information you need.
6. Write the items for your sur
vey following the guidelines pr
ovided in this chapter.
7. Share the survey with colle
agues or classmates and ask f
or their feedback.
8. Pilot test your survey with a
few selected respondents who
are similar to those you intend
to survey.
9. Make sure your questions
are clear and flow well and are
appropriate for the level of your
respondents.
10. Be sensitive in the way you
phrase your questions so they
are not perceived as too
FiGuRe 5.29.
personal or invasive of the
respondents’ privacy.
11. Color code the surveys for
easy identification if you are di
stributing hard copies to
different classrooms or sch
ools.
12. Include open-ended (unstr
uctured) questions or follow th
e survey with in-depth
interviews if you want to o
btain responses that reflect par
ticipants’ views or feelings.
13. Plan how you will analyze t
he open-ended responses and
how you will tally and analyze
the numerical data you coll
ect. (Several online survey serv
ices, such as SurveyMonkey,
provide a data summary a
nd charts.)
14. Tabulate and analyze the r
esponses to enable you to sum
marize the data and find
answers to your research q
uestions.
15. Consider using electronic s
urveys, when possible, becaus
e they are often the easiest and
most effective way for adm
inistering surveys.
16. Look for emerging trends,
patterns, similarities, or differe
nces in the responses.
17. Remember when interpretin
g the survey data that most sur
veys measure respondents’
perceptions or attitudes, n
ot what they actually do or how
they behave.
18. Remember that surveys do
not have to be long; they can b
e short and quick and be a
natural part of your instruc
tion.
FiGuRe 5.29. A checklis
t of suggestions for planni
ng and collecting data usin
g sur-
veys.
124
5. data collection tools 125
tABle 5.1. examples of official and Personal or episodic Artifacts
and documents
official artifacts and documents
Personal or episodic artifacts and documents
• •
• Policy statements
• Journals and diaries
• School handbook
• •
• •
•
• •
• •
• •
• •
• •
• •
• •
• •
• •
•
cards
• •
•
•
teacher journals
Many teacher researchers find journals to be an especially useful research
method.
The journal may include critical incidents, anecdotes, situations, events, i
nsights,
questions, and uncertainties that you consider relevant to your study. You
will find
iors of others in the setting that you investigate and in increasing your
insight
into daily classroom interactions. This documentation will reveal patterns i
n class-
room interactions, illuminate constraints and possibilities unnoticed in your
hectic
classroom life, and allow you to monitor your subjectivity and be mindfu
l of the
different roles you take in the study (Guillemin & Gillam, 2004). Raisi
ng the
awareness of the different roles you take in class as a practitioner and res
earcher
will contribute to the study’s ethical considerations (Rallis & Rossman, 201
2). The
journal entries may range from unstructured to structured formats. Unstr
uctured
journal entries record, from your perspective, whatever happens in class tha
t seems
drawn from your research topic. For example, Ed, a reading specialist, rec
ords in
his journal during lunchtime and reflects on what took place during the
morning
12 6 action RESEaRcH in Education
session when he met his students. Structured journal entries may include lists of
events, particular daily activities, and specific students’ behavior dated and timed.
For example, Anne, a high school science teacher, wonders about ways to improve
the effectiveness of group work in her class. She depicts in her journal anecdotes of
students’ interactions as they work in groups on a project; records the instructions
she provided; describes the seating arrangements of the different groups and the
You may want to consider the timing and frequency of your entries. On the
basis of our experience of working with educators conducting action research, we
suggest recording the unstructured journal entries as soon as practically possible
after the critical incident, situation, or behavior has occurred. By comparison, the
structured entries should be logged daily or weekly at designated times (A. Camp-
bell, McNamara & Gilroy, 2004).
and using official and personal artifacts and documents.
suggestions
1. Be purposeful in selecting the kind of information that will be useful and relevant to your
own research question.
2. Obtain permission, as necessary, to collect and use the documents form. (Follow the
ethical guidelines outlined in Chapter 4.)
3. Look for documents and records that can be easily obtained in school offices or found
on school or district websites. Other documents are not available or are not accessible
to teachers.
4. Keep a journal in which you record and reflect on critical incidents, situations, and
anecdotes that occurred in your class, as well as list specific events, activities, and
behaviors, dated and timed.
5. Record the unstructured entries as soon as practically possible after they occur;
designate times—daily or weekly—to record the structured entries.
6. Make copies of the original documents and be sure to label them. Include the date and
context and, in the case of students’ work, identify the author by name, age, and grade.
7. Organize the artifacts in hard copy or electronic files to help you access and document
the data later.
FiGuRe 5.30. A checklist of suggestions for gathering artifacts and documents.
FiGuRe 5.30.
5. data collection tools 127
FinAl comments ABout dAtA collection tools
This chapter presents a variety of qualitative and quantitative data
collection tools
which are summarized in Table 5.2. As you develop your own stra
tegies for data
collection, we suggest that you keep in mind the following points re
gardless of the
specific tools you choose for your data collection:
1. Set specific times for data collection. Be deliberate and practi
cal in planning
the process of gathering and storing the data. Be cognizant of ho
w the research
conflicts least with your role as a teacher, and, preferably, can be g
athered as part
of your everyday practice.
2. Do not rely on any single source of data. Triangulate, corro
borate, extend,
or challenge your information by collecting data through multiple an
d complemen-
3. Don’t feel overwhelmed by the long list of data collection
methods pre-
sented in this chapter. You do not have to use all of these strategies!
Depending on
selecte
gies will provide you with the information needed for your investiga
tion. The qual-
ity of the data you gather is more important than the number of ways
you collect it.
4. Feel free to modify your research design plans as you go.
For example, if
while conducting the study in your classroom you realize that obse
rving in a dif-
make the changes that reflect this modification.
128 action RESEaRcH in Education
tABle 5.2. A summary of qualitative and quantitative data collection tools
Tools
Qualitative Quantitative
• •
Observation
• Observation protocol • Tally sheet
Descriptive • • Checklist
•
• Behavior logs
•
•
Interview • Unstructured
•
• •
• •
Survey • Unstructured (open-ended) responses • Structured responses
•
• Short (write-in) responses • • Rating responses
•
• •
• •
Artifacts • Official documents • Assessment data
• •
documents records
•
Chapter Summary
1. The selection of data collection tools and strategies derives from the nature of the
research questions, rather than from theoretical orientations.
2. Because of the inherent complexity of classroom life, it is hard to divide the research
tools and methods into qualitative and quantitative when carrying out teacher action
research. The same tool may generate qualitative or quantitative data depending on the
strategy developed.
3. When developing strategies for data collection, researchers should set specific times for
data collection, attempt to gather multiple sources of data, and modify their research
5. data collection tools 129
4. Observation refers to looking at a setting purposely; it allows practitioners to systemati-
cally observe the activities, people, and physical aspects of their educational settings.
5. The observation strategies available to teacher researchers lie on a continuum: from
ended, from unstructured to
structured, and from holistic to focused.
6. Action researchers should determine what their role will be during their observation;
when observing their own classrooms, they should consciously look from the perspective
of an outsider.
7. An observation protocol contains descriptive and reflective field notes that are detailed
descriptions of what the researchers see, hear, and sense during the observation, and
the thoughts, feelings, and understandings these observations provoked.
8. Descriptive field notes aim to record what is happening during the observation by
describing the physical setting, the participants, activities, and events that take place,
and by documenting conversations verbatim.
9. Reflective field notes are used to record reflections and insights about what is happening
in the setting.
10. A behavior log is a useful observational tool for a more focused observation to help keep
track of the behaviors exhibited by an individual student or a small group of students
during a given situation; an interval behavior log is used to record what is happening at
11. Observational tools (like photographs, audiotapes, and videotapes) can enhance the
researcher’s capacity to capture student behaviors, attitudes, and social interactions
through images and sounds.
ended observations are focused on predetermined categories and
12. Structured closed-
13. Quantitative observations allow a comparison among settings, individuals, and situa-
tions, and frequencies, patterns, and trends.
14. Tally sheets are used to track the frequency of a target behavior or event at a specific
point in time.
15. A checklist is made up of a predetermined list of behaviors or activities that are the focus
of the observer’s attention.
16. A rating scale is used to record the extent to which a specific behavior or situation exists.
17. An interview provides an understanding of the participants’ experiences from their own
13 0 action RESEaRcH in Education
perspectives as it allows them to voice their ideas, opinions, values, and knowledge on
issues related to the investigation.
18. The unstructured interview is an informal, though purposeful, conversation; the inter-
view questions are broad and are presented in a casual style, and the interviewer lets
the conversation proceed naturally on its own course.
19. The semistructured interview is based on open-ended questions that are prepared prior
construct the narrative and raise and
pursue additional issues that are related to the study.
20. The structured interview is based on prepared questions in which the interviewers frame
the questions using an exact wording, replicating the order of the questions and provid-
21. An interview guide contains two sections: (a) Section I is completed before the interview
and contains the research question and concrete information about the interview and the
interviewee; notes taken during the interview may also be recorded in this section; and
(b) Section II is completed after the interview and provides a narrative description of the
interviewee and the interviewer’s reflections and insight gained through the interview.
22. A focus group is an interview technique in which several individuals come together and
share among themselves their ideas, thoughts, and experiences about the topic of the
study.
23. The use of the Internet to interview participants can be a time- saving technique; it can
online at the same time (synchronous interview) or it can be via e-mail (asynchronous
interview).
24. Surveys are one of the most common and efficient ways to gather information about
people’s opinions and attitudes, as well as factual information. Surveys can be utilized
provide large-scale responses very quickly. While some make a distinction between sur-
veys and questionnaires, in this book we used these terms interchangeably.
25. One of the main problems with using surveys in action research is that often the response
rate may not be high enough and those who respond do not necessarily represent the
whole group of potential respondents. Another major problem is that the respondents
may or may not be honest in their responses and may choose those response choices
that they believe are expected, rather than record their true opinions, attitudes, or beliefs.
5. data collection tools 131
26. Survey questions and response choices can elicit various types of responses, and the
data collected can be both numerical and narrative. Questionnaires can be administered
directly (face-to-face) or indirectly by distributing them to people and collecting them
later on or by sending surveys to respondents via regular or electronic mail.
27. Survey items may be divided into two general categories: structured (also called forced
choice or fixed choice) and unstructured (open-ended). In structured items, the respon-
or rank ordering their response choices. In unstructured items, a statement (or question)
is followed by a blank space where the respondents are asked to record their responses.
28. Artifacts are formal and informal documents and records that provide historical, per-
sonal, and demographic information that can provide additional perspectives on indi-
viduals, the social and cultural life of the school, and the general characteristics of the
educational process.
Chapter exerCiSeS and aCtivitieS
The following activities present several data collection tools. You may choose those most
appropriate for your study. These activities can be done individually, with a peer, or with
your research group.
1. List the types of data collection tools (observation, interview, survey, or artifacts
and documents) that you plan to use in your research project and the reasons for
different perspectives.
2. Using Figure 5.2, develop an observation protocol. Decide on the foci of the
observation and what behaviors, interactions, activities, or conversations interest
observation process:
a. Find a public setting where multiple interactions take place (e.g., library, cafeteria,
playground, or swimming pool).
b. Write down detailed descriptive notes on what you see, hear, and sense
during the observation and reflective notes on the thoughts, feelings, and
132 action RESEaRcH in Education
c. End the observation by noting your interpretation of and insight into what you
have learned from the process.
d. Assess the observation process and evaluate your descriptive and reflective field
notes. You may address the following points:
•• Do the field notes represent accurately the context of the observation?
•• How rich and detailed is the description of the participants’ actions?
•• Are the tentative interpretations supported by the data?
If you conduct the observation with a colleague, compare each other’s account
and discuss any differences between your subjective observations.
3. Using Figure 5.9, develop a 15-minute interview guide on a topic related to your
research project or another issue of interest.
a. Assess your interview guide and evaluate your questions by addressing the
following points:
•• How are the interview questions relevant to your research topic or issue of
interest?
•• Are the questions formulated clearly?
•• Are the questions organized logically?
b. Pilot test the interview questions with one or more persons. (You may use a
recording device.)
c. Reflect on the interviewing experience using the following points:
•• How did the interviewee(s) respond to your questions? Explain.
•• How comfortable were you during the interview? Explain.
•• What questions would you revise, rephrase, add, or omit for the next time you
conduct a similar interview?
4. Using the guidelines in the chapter and the examples in Figures 5.11–5.28, develop
a 5- to 10-item survey that can be used to collect data related to your research
a. Review the complete survey to ensure that it includes easy-to- understand items,
appropriate response choices, and clear instructions.
5. data collection tools 133
b. Administer the survey to a small group of respondents (four to eight people) and
gather the following information:
•• How long did it take the respondents to complete the survey?
•• Were there any questions that were not clear?
c. Reflect on the data you collected and draft your summary of the responses.
d. Revise the survey items as needed.
5. Make a list of documents, records, or artifacts that you plan to use for your study.
(Table 5.1 may be helpful in making your choices.)
a. How will you obtain these documents?
b. Explain how these documents will contribute to your investigation.
c. What additional information is provided by the documents that cannot be
obtained in other data collection tools?
AdditionAl ReAdinGs
Brown, J. D. (2001). Using surveys in language programs. Cambridge, UK: Cambridge
University Press.
based early care and edu-
Bryant, D. (2010). Observational measures of quality in center-
to-Policy, Research-to-Practice Brief OPRE 2011-
for Children and Families, U.S. Department of Health and Human Services.
Eisner, E. W. (1998). The enlightened eye: Qualitative inquiry and the enhancement of
educational practice. Upper Saddle River, NJ: Prentice Hall.
Geertz, C. (1973). Thick description: Towards an interpretive theory of culture. In C.
Geertz (Ed.), The interpretation of cultures (pp. 3-32). New York: Basic Books.
Kawulich, B. (2005). Participant observation as a data collection method [81 paragraphs].
Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 6(2), Art.
43. Retrieved from http://nbnresolving.de/urn:nbn:de:0114-fqs0502430.
Olstein, J., & Gubrium, J. (Eds.). (2003). Inside interviewing: New lenses, new concerns.
Thousand Oaks, CA: Sage.
Opdenakker, R. (2006). Advantages and disadvantages of four interview techniques in
qualitative research. Forum Qualitative Sozialforschung/Forum: Qualitative Social
research.net/index.php/fqs/
article/view 175/ 392.
13 4 action RESEaRcH in Education
Rea, L. M., & Parker, R. A. (2005). Designing and conducting survey research: A compre-
hensive guide (3rd ed.). San Francisco: Jossey-Bass.
Spradley, J. P. (1979). The ethnographic interview. New York: Holt, Rinehart & Winston.
Spradley, J. P. (1980). Participant observation. New York: Holt, Rinehart & Winston.
weBsites FoR suRveY desiGn
http://www.howto.gov/customer-service/collecting-feedback/basics-of-survey-and-
question-design
www.surveysystem.com/sdesign.htm
http://changingminds.org/explanations/research/measurement/likert_scale.htm
www.john- uebersax.com/stat/likert.htm
http://dataguru.org/ref/survey/responseoptions.asp
chAPteR 6
using assessm
ent data
in action
Research
A from standardized tests, you are surrounded by test data. Although most of
ssessment data are an integral part
of life in schools. With the heavy
educator (e.g., state testing data, district-
empha-
based decision making, and stude
nts’ scores
these data are designed to monito
r students’ progress and performa
nce, they are
also used to evaluate teachers and
schools.
designed tests, unit tests, and you
r own
designed assessment tools). Being
a reflective practitioner, you routi
nely
135
and effectively using assessment to
ols is an essential part of your roles
as an educa-
tor and action researcher.
through action research. Assessme
nt information can be a valuable d
ata source as
you explore the effectiveness of y
our practice, including examining
your teaching
strategies, exploring a new curric
ulum unit, or evaluating a school
wide program.
Therefore, in this chapter, we de
scribe the various methods of ass
essment most
commonly used by educational pr
actitioners.
multiple assessment data, both qua
litative and quantitative. These dat
a can include
made or sta
ndardized tests, students’ portfoli
os, attendance
and discipline records, referrals,
communication with parents, and
information
about your students’ behaviors, at
titudes, and motivation.
13 6 action RESEaRcH in Education
While you, as a practitioner, have no control over the standardized, high- stakes
mative (during instruction) and summative (at the end of instruction) assessment
of your students. No single assessment is sufficient in providing information to
educators to guide their instructional practices; therefore, you need to know how
to design and evaluate multiple assessment tools.
nal and internal expectations. Formal assessments are usually dictated by local,
state, or federal mandates and policies. For example, standardized student testing
and data- driven decisions have moved to the forefront of education with the enact-
dents, teachers, and administrators are assessed and are held accountable for their
performance using a mandatory testing program that is designed and administered
by the state. Similarly, the Race to the Top enacted by the Obama administration
and the Common Core State Standards Initiative include standardized testing as
an important component of accountability. In addition to these tests, many dis-
tricts administer other standardized tests (such as Terra Nova or Iowa Test of Basic
developed tests. Thus, formal test data have an immedi-
ate and important impact on educators’ practice and professional life.
each teacher has many opportunities to conduct informal assessment of students
throughout the day. For example, as a classroom teacher and an action researcher
you may observe your students’ levels of engagement and cooperation, their enthu-
siasm and participation, their interaction with one another, or how they play with
each other during recess. You, as an observant teacher, know that there are many
picture of the students, their dispositions, progress, challenges, and areas where
they need help and where they excel.
instruction starts; during instruction (formative and diagnostic assessment); and
at the end of instruction (summative assessment; Gareis & Grant, 2008; Green &
Johnson, 2010; Miller, Linn, & Gronlund, 2009). Classroom testing and assess-
ment are also used to (1) determine the best placement for students to maximize
their potential; (2) plan differentiated instruction to meet the needs of all students
in the class; (3) assign grades; (4) comply with local, state, and federal laws; and (5)
students allow them to participate in setting their own educational goals.
6. using assessment data in action Research 137
In this chapter we focus on several issues: (1) understanding standardized com-
mercial achievement tests, (2) writing instructional objectives, (3) using teacher-
made authentic assessment
tools, (5) using rubrics to assess students’ performance, (6) using portfolios to
assess students, and (7) comparing the major advantages and disadvantages of
these assessment tools.
undeRstAndinG stAndARdized commeRciAl Achievement tests
As a classroom teacher, your students are likely to be tested annually by standard-
ized tests mandated by your district or your state. These tests are constructed by
professional item writers and undergo extensive pretesting prior to administering
them to students across the district, state, or nation. The majority of these tests can
referenced and criterion referenced. In the section
that follows, we briefly describe these types of commercial tests.
norm-Referenced commercial tests
referenced tests are used by educators to interpret scores and compare the
Norm-
took the same test (McMillan & Schumacher, 2010; Popham, 2013). These stu-
dents comprised the norming sample that was used to derive the test norms and
they represent the demographic characteristics of the future test takers, such as age
stakes tests are usually norm referenced and scores
obtained by K–12 students on such tests can have important consequences for
students, teachers, schools, staff, and the whole community. The consequences
may include failing to be admitted to a program, failing to graduate from a pro-
gram or pass a course, or failing to earn certification (Shermis & Di Vesta, 2011).
stakes tests used in education are likely to be those developed by commercial
stakes tests include (1) tests whose scores are used
by school systems to determine merit pay for teachers; (2) tests that are adminis-
tered by the state as part of NCLB or other state or federal mandates in which low
performance may result in judging schools as “failing” if the whole school or sub-
groups within the school do not make enough annual yearly progress (AYP); and
medical and law schools.
13 8 action RESEaRcH in Education
referenced tests are designed to maximize differ-
Test items written for norm-
shaped distribution of
answered correctly by 40 to 70% of the examinees. Some very difficult items are
designed to differentiate between the good and excellent students, and some easy
performance students. Easy items
can also be placed at the beginning of the test or section to encourage all students.
referenced tests are reported in terms of percentiles, stanines,
and grade equivalents.
referenced tests, items
on these tests may be tied to specific instructional objectives. For example, on the
report of a student’s test results, there may be a list of objectives and how well the
student or the whole class achieved these objectives.
criterion-Referenced commercial tests
Criterion- referenced tests are used to compare the performance of the student to a
certain predetermined criterion or standard (Boyle & Fisher, 2007; Shermis & Di
Vesta, 2011). Students are not compared to one another, nor do they have to com-
pete with other students taking the test (Popham, 2013). Instead, they have to meet
certain curricular criteria that are clearly articulated and meet preset benchmark
criteria. For example, they have to answer correctly at least 80% of the questions
in order to demonstrate mastery of the materials and pass the test, regardless of
how well their classmates performed.
referenced tests tend to be easier than items in norm-
items written for criterion-
referenced tests can better inform teach-
to assess (Ravid, 2011). Often, criterion-
reteaching.
referenced tests. The standardized tests
great deal to the popularity of criterion-
NCLB are based on standards. Usually, in order to pass the test, students have to
meet or exceed state standards as measured by test items. Many districts also use
priate for each grade level. Chapter or unit tests that are prepared by textbook
referenced tests.
6. using assessment data in action Research 139
tABle 6.1. main Advantages and disadvantages of norm-Referenced
and criterion-Referenced standardized commercial Achievement tests
main advantages
main disadvantages
• •
• Developed by professional test writers
• Cannot provide ongoing monitoring of
• Pilot tested and carefully constructed
• students’ progress
•
• Tests usually have high reliability
match the curriculum being taught
• •
test formats or ability differences
• •
with learning difficulties • test anxiety and stress
•
to other similar students across the district, time away from classroom instruction
•
state, country, or internationally • Norm-referenced tests may not have
• •
comparison to preset criteria or benchmarks • Criterion-referenced tests may not easily
rather than to other students allow for a comparison across different
Table 6.1 summarizes the main advantages and disadvantages of nor
m-
referenced and criterion- referenced standardized, commercially developed achie
ve-
teAcheR-mAde tests
As a classroom teacher, you are responsible for continuously assessing your st
u-
dents by using a variety of formal and informal means. These multiple approac
hes
include quizzes, essays, homework assignments, projects, portfolios, oral present
a-
pencil tests, and performance tasks. Some of these assessm
ents
are referred to as traditional and others are considered alternative or authentic. T
ra-
essays. The focus of alternative (or authentic) assessments is on directly meanin
g-
ful and real-life tasks.
made tests focuses on the following: (1) plann
ing
and writing instructional objectives, (2) writing and evaluating traditional t
est
Make sure that you clearly communicate with your students and explain
to
them why you test, how the test is formatted, how you will score the test, and h
ow
14 0 action RESEaRcH in Education
they will be graded on the basis of the test. Because teacher- made written tests are
tion guides you through the steps of writing and assessing your own classroom tests.
wRitinG instRuctionAl oBjectives
Start your instructions by articulating your instructional objectives to yourself and
to your students. When you are ready to assess your students, write tests that will
allow you to assess the level at which these objectives have been met by the indi-
vidual students in your class and the class as a whole. In writing your instructional
objectives, you may want to consider the taxonomy of the cognitive domain. The
taxonomy, which was developed by Benjamin Bloom in 1956 (Bloom, Engelhart,
intellectual skills into six
levels, going from the lowest to the most complex (see Table 6.2). When planning
a test, you need to consider what levels of the taxonomy to assess and how many
items to use for each level. Table 6.2 contains a list of the levels of the taxonomy.
Definitions and typical verbs that can be used in writing objectives for each level
are also included.
intended objectives of your instructional unit and will allow you to assess how well
tABle 6.2. An explanation of Bloom’s taxonomy
level of taxonomy
Description includes Typical verbs used
Knowledge
Knowing and memorizing facts List, state, label
Comprehension Understanding Describe, restate, explain
Application Applying new knowledge to a new, but Construct, illustrate, use
similar situation
Analysis Logically breaking down into components Contrast, differentiate, deduce
Synthesis Integrating and organizing information to Compose, design, organize
create something new
Evaluation Judging and appraising new and existing Conclude, judge, assess
knowledge
6. using assessment data in action Research 141
your students have accomplished these objectives. Creating a well- crafted table of
cussion of content validity later in this chapter.)
Preparing a table of test specifications
After writing the instructional objectives for the unit you are going to teac
h (e.g.,
chapter, story, or semester), you can now plan the test by preparing a table
of test
specifications, or a test blueprint. The goals of creating a test blueprint is t
o help
as well as communicate your expectations to your students (Stiggins & Cha
ppuis,
2011). In this table, you list the contents of the items as the rows, while the c
olumns
show the outcomes you choose to highlight from some of the six levels in B
loom’s
taxonomy. The number of points assigned to each outcome is also listed. I
n each
cell, the number of items to be included in that category is indicated. Figure 6.
1 is an
example of a table of test specifications used by a teacher to plan student asses
sment.
of specifications, in all likelihood you will find that you do not have the ti
me to
create such a table every time you design a test. Still, you should ensure tha
t your
tests reflect the content and skills that you covered in class and write appro
priate
items that will allow you to assess your students. Other, less formal appro
aches,
which include a systematic review of the materials to be tested and the co
nstruc-
tion of corresponding items, also can contribute greatly to the high content v
alidity
FiGuRe 6.1.
of your test.
outcomes
content
Knowledge
15 point s comprehension Application ToTAl
20 points 15 point s 50 points
Topic A
5 items 3 items 2 items 10 items
Topic B 5 items 3 items 2 items 10 items
Topic c 5 items 4 items 1 item 10 items
ToTAl 15 items 10 items 5 items 30 items
FiGuRe 6.1. Example of a table of test specifications for planning an assessment.
142 action RESEaRcH in Education
constRuctinG teAcheR-mAde tRAditionAl Assessment tools
Teacher- made assessment tools can be used in all stages of instruction. They may
mative (at the end of instruction). In creating these tests, teachers can choose from
a variety of item formats depending on the curriculum and their instructional
goals. The following suggestions focus on the most common test formats used by
classroom teachers. We start by discussing two types of assessment: selection type
type items, you ask your students to select the cor-
rect or best response from a predetermined number of options that are presented
type items include multiple
choice, matching, and true/false (Stiggins & Chappuis, 2011). Supply-type items
require your students to recall, compose, or analyze information and construct
type items
include short answers, completion (fill in the blank), and essay.
writing test items
Following are explanations, examples, and guidelines for writing selection- and
supply- type items. Regardless of the type of test you develop for your class, you
suggestions
Avoid using ambiguous, confusing, or vague wording.
Keep the language level of your test items appropriate for your students.
Write items that match the content of the materials that you have taught.
Write questions that are short and to the point.
Review the order of the items in your test to ensure that it is logical; when possible, place
easier items at the beginning of the test to encourage students and reduce their anxiety.
When possible, write items that have one correct answer (with the exception of essay
questions or multiple-choice questions that have more than one correct answer).
Ensure that your questions do not provide clues to the correct answer.
Emphasize (e.g., underline, use boldface, or type in upper case) important words, such as
all, none, and don’t.
FiGuRe 6.2. A checklist of suggestions for writing selection- and supply-type items.
FiGuRe 6.2.
6. using assessment data in action Research 143
will find these guidelines helpful. Additional guidelines and suggestions for writ-
ing good items can be found in many books on classroom assessment (e.g., Fisher
& Frey, 2007; Gareis & Grant, 2008; Nitko & Brookhart, 2010; Russell & Aira-
sian, 2012; Salend, 2011; Shermis & Di Vesta, 2011; Stiggins & Chappuis, 2011;
Suskie, 2009; Van Blerkom, 2009). We start with a checklist of general suggestions
type items (see Figure 6.2).
Selection-Type Items
type items, the student is asked to choose the correct or best answers
In selection-
type items share
guess the correct answer. You may want to set the task for the students by requir-
ing them to “select the best answer” rather than “select the correct answer,” espe-
cially in cases where there is a slight possibility that more than one answer is cor-
rect, but one is clearly better than the other one. The following are guidelines for
type items.
Multiple-Choice Items
choice items consist of two parts: the stem, which represents the problem
Multiple-
select an answer (Green & Johnson, 2010). The stem can be written as a question
or an incomplete statement (Shermis & Di Vesta, 2011). In most cases, there is
only one correct answer and the rest of the alternative responses, called distrac-
logically and should sound plausible. To avoid a predictable response pattern, the
location of the correct answer should vary (Nitko & Brookhart, 2011; Popham,
choice items are used extensively in achievement tests, mostly
to test knowledge and comprehension. However, with practice you may be able
choice items to measure higher levels of the cognitive pro-
cesses, such as interpretation, application, analysis, and synthesis. Recently, due
choice tests, a number of multiple-
choice tests include items with more than one correct answer. Figure 6.3 shows
choice items; the first shows an example in which the
stem is written as a question, and the second shows an example in which the stem
is written as an incomplete statement. In both examples, there are four response
choices.
14 4 action RESEaRcH in Education
example 1:
Which state in the following list of states did not participate in the American Civil War?
a. Alabama
b. California
c. Hawaii
d. Virginia
example 2:
The rhine river is in the continent of .
a. Africa
b. Australia
c. Europe
d. South America
FiGuRe 6.3. FiGuRe 6.3. Examples of multiple-choice items.
Interpretive Exercise
choice items are often criticized for their frequent use in education to
Multiple-
type items can also be used to mea-
sure higher-
Airasian, 2012). The materials to be interpreted can be graphs, tables, pictures,
choice items, the exercise includes a
question and several responses (i.e., the correct answer and several distractors).
Interpretive exercises take longer to construct and respond to and usually their
number is more limited (Green & Johnson, 2010). Their greatest advantage is that
they can be a more authentic representation of the materials and skills taught in
class. Figure 6.4 shows an example of an interpretive item.
Matching-Format Items
This format is used to determine whether students can distinguish and match simi-
lar ideas or facts. The exercise consists of two columns; the left column is called the
stems or premises, and the right one is called the responses. The stems are usually
6. using assessment data in action Research 145
Study the train fare chart below which shows the costs of train tickets for one-way, 10-rides,
and monthly rides.
Zone Ticket class Zone A Zone B Zone c Zone D
A
One-way $2.25
10 -ride $18.20
Monthly $60.50
B
One-way $2.60 $2.25
10 -ride $22.00 $18.20
Monthly $65.25 $60.50
c
One-way $3.50 $2.60 $2.25
10 -ride $29.35 $22.00 $18.20
Monthly $88.60 $65.25 $60.50
D
One-way $4.10 $3.50 $2.60 $2.25
10 -ride $35.40 $29.35 $22.00 $18.20
Monthly $90.20 $88.60 $65.25 $60.50
1. Jacob has to ride the train round-trip from Zone B to Zone C every Monday for a month
(a total of 4 days). Which ticket class would be the cheapest for him to buy?
a. One-way
b. 10-ride
c. Monthly
FiGuRe 6.4.
FiGuRe 6.4. Example of an interpretive question.
and responses should be homogeneous, dealing with only one topic or concept
(Popham, 2013; Suskie, 2009; Taylor & Nolen, 2008), and each word or phrase in
the left column should have only one correct answer in the right-side column. Ide-
ally, you should have no more than 10 to 12 responses for older children to match,
and about 4 to 5 responses for younger children to match (Gareis & Grant, 2008;
Popham, 2013; Taylor & Nolen, 2008). The reason for this is that the student is
required to deal with two sets of items (two columns of words, phrases, pictures, or
graphics) at the same time, and this task can be challenging if there are too many
items to match. To reduce the effect of guessing, it is recommended that the number
of response choices be higher than the number of the premise items in the left-side
shows an example of a matching exercise in which the number of response choices
(right column) is higher than the number of premises in the left-side column.
14 6 action RESEaRcH in Education
Match the books with their authors.
Books
Authors
1. Alice in Wonderland
a. Jane Austen
2. The Last of the Mohicans
b. James Fenimore Cooper
3. Gulliver’s Travels
c. Charles Dickens
4. Pride and Prejudice
d. Sir Walter Scott
5. Ivanhoe
e. Louisa May Alcott
6. White Fang
f. Jonathan Swift
7. A Tale of Two Cities
g. Jack London
8. Little Women
h. Daniel Defoe
9. The Great Gatsby
i. Ernest Hemingway
10. Robinson Crusoe FiGuRe 6.5.
j. Lewis Carroll
k. F. Scott Fitzgerald
l.
Leo Tolstoy
FiGuRe 6.5. Example of a matching exercise.
Another type of matching exercises is called category matching. In this exer-
cise, one column has a list of items, and the other column includes a limited num-
should include at least one item (see Figure 6.6).
True/False Items
True/false items provide two response choices for each item: it is either true or false
(Russell & Airasian, 2012; Stiggins & Chappuis, 2011). True/false items are rela-
tively easy to construct and score and can be answered quickly by students. The
main disadvantage of the true/false format is that students can more easily guess
the answer (Popham, 2013). The true/false format is appropriate for measuring a
factual statement (Taylor & Nolen, 2008) only for items that are clearly true (cor-
Another option that would make true/false items more challenging is to ask
students to correct false items in order to make them true and thereby earn extra
6. using assessment data in action Research 147
Match the words in the list on the left side with their category
on the right side.
Animal
category
1. Fly
a. Reptile
2. Turtle
b. Insect
3. Bear
c. Fish
4. Dog
d. Mammal
5. Iguana
6. Bee
7. S a l m o n
8. Monkey
9. Tuna
10. Cro co dile
FiGuRe 6.6. Example of a category matching exercise.
FiGuRe 6.6.
1. Tr ue / Fals e: The book Tom Sawyer was written by Mark Twain.
2. Tr ue / Fals e: The United States president during the Civil War was Ge
FiGuRe 6.7. Examples of true/false items.
orge Washington.
FiGuRe 6.7.
credit. For example, in item 2 in Figure 6.7, students who
circle false can get extra
In supply- credit for listing Lincoln instead of Washington.
Supply-Type Items
type items, the student has to provide the answer (Gareis
& Grant, 2008).
type
answers. Completion items that require writing longer res
ponses can also measure
order skills by asking the students to write in com
plete sentences, explain-
ing and developing ideas and positions. The following is a
brief description of each
type items.
14 8 action RESEaRcH in Education
Completion Items
Completion items (also called fill in the blank) require students to construct their
own answers by filling in or completing a sentence from which a word or a phrase
has been omitted (Russell & Airasian, 2012). Completion items are easy to score
because there is usually only one correct answer. The wording of these items should
provide sufficient clues to help lead students to the correct answer, yet be chal-
two examples of completion items: The first example is too vague and can have a
number of correct answers. The second example specifies that the correct answer
should be the year when the war started.
Short-Answer Items
answer format requires the student to supply a word, phrase, name, or
The short-
answer items
are not effective at measuring higher-
in which students are asked to compute or solve a problem. These items are fairly
easy to construct and decrease the likelihood of guessing. Though in most cases
scoring them is fairly easy, in some cases scoring may require some subjective judg-
ment, such as when words are not spelled correctly or the answer is not complete.
answer items.
1. A poor item (there could be many answers such as “in the fall” or “in Germany” or “in Europe”):
World War II started in
.
2. A better item (it is clear that the answer should be a year):
World War II started in the year
.
FiGuRe 6.8. Examples of completion items.
FiGuRe 6.8.
Example 1: What was the main reason the United States joined the Allies in WWII?
Example 2: What does the expression “It’s raining cats and dogs” mean?
FiGuRe 6.9. Examples of short-answer items.
FiGuRe 6.9.
6. using assessment data in action Research 149
Essay Items
An essay item re
quires students to
respond to a ques
tion or a prompt
by compos-
ing a response th
at is more than
one sentence, usu
ally one or more
paragraphs.
Essay items provi
de a more authent
ic way for student
s to respond to the
se items, as
well as the freed
om to decide ho
w to approach th
e task and how to
made traditional assessment tools with selection- type items.
structure and
organize their res
ponses. The bigge
st disadvantage w
ith essay items is t
hat they are
ably score student
s’ responses (Pop
ham, 2013). None
theless, essay ite
•
ms provide
•
you with a good
way to assess you
r students’ ability
to organize, analy
ze, express,
and defend their i FiGuRe 6.10.
deas (Russell &
Airasian, 2012), r
ather than just rep
eat or recall
facts. Be sensitive
to the fact that e
ssay items place
a premium on wr
iting skills,
and therefore ma
y penalize studen
ts whose writing
skills or languag
e ability is
limited. To help
your students use
their time effectiv
ely, you should i
nform them
about the approxi
mate time they sh
ould spend on eac
h essay item and t
he number
of points assigned
to each item. To a
ssist you in scorin
g, you may want t
o develop
a scoring guide in
the form of a che
cklist or a rubric (
Stiggins & Chapp
uis, 2011).
(See the discussio
n of rubrics in thi
s chapter.) Figure
6.10 shows an ex
ample of an
essay item.
type and supply-
evaluating traditi
onal teacher-mad
e Assessment to
ols
According to the
results of the te
st, you assign gr
ades to students,
plan your
instruction, or ma
ke decisions abou
t students’ place
ment. Therefore,
you need to
Explain the main adva
ntages of recycling an
d its effects on the env
ironment.
• Describe and comp
are at least three differ
ent types of recycling
programs.
• Explain at least thr
ee advantages and po
sitive impacts on the e
nvironment.
Your responses will be
assessed in terms of o
rganization of ideas, c
ompleteness, accurate
information, clarity, an
d language mechanics
(grammar, spelling, an
d punctuation).
FiGuRe 6.10. Exa
mple of an essay ite
m.
15 0 action RESEaRcH in Education
tABle 6.3. main Advantages and disadvantages of teacher-made traditional
Assessments with selection-type and supply-type items
main advantages
main disadvantages
•
• Usually have high content validity and reflect •
• Writing good test items requires time and
the knowledge and skills taught in class
• • expertise to construct, score, and evaluate
and format commercial tests
• •
of students and modifying instruction across settings
accordingly
• •
level skills such as recalling facts
• •
other contexts correct answer, unlike real life
• •
unique needs of individual students selection-type items
• •
and quickly scored grade objectively
• •
the content being tested or the curriculum
amount of content objectives
•
higher-order skills, writing skills, and • supply-type items, such as open-
creativity ended questions and essays, may be
• subjective and time consuming
for nuanced and original answers
understanding of the material you have taught. After you administer a test to your
students, you need to analyze and interpret the results of the test and their mean-
This is especially important if you are planning to use the test with other groups of
students. In this section, we suggest several steps that you may take, including the
assessment of the test validity and reliability. Several approaches to item analysis
are also discussed.
Content Validity and Reliability of Tests
Every achievement test that you use, whether it is one you have created or one pre-
pared by others, should have content validity. Content validity refers to the degree
of match between a classroom test and the instruction, content, knowledge, and
skills the test is designed to assess (Lamprianou & Athanasou, 2009).
6. using assessment data in action Research 151
As you write the test, be sure that the test items are a representative sample of
the content and skills that were taught. Using a table of test specifications that we
discussed earlier can enhance the match between the content that you taught and
your test and increase the content validity of your test (Green & Johnson, 2010).
grade science teacher, is unable to fully complete
the first-quarter curriculum unit about plants and animal cells. To ensure the con-
to exclude a few items relating to material she did not cover in class.
degree to which the same results will be obtained when the test is used repeatedly
with the same individuals or group (Green & Johnson, 2010). Most approaches
to assessing test reliability involve using statistical programs or lengthy computa-
tions. Therefore, they are of concern mostly to commercial test makers.
Another factor is the length of the test; shorter tests tend to have lower reliability
than longer tests (Green & Johnson, 2010). The reason is that longer tests provide
a more consistent sample of students’ abilities and performances, whereas shorter
tests allow more room for chance and guessing. Additionally, it is recommended
that you write several items to measure each objective or specific area of content to
reduce the chance of guessing.
the experts in terms of reliability. On the other hand, teacher- made tests are likely
who know best what was taught in class and who recognize their students’ culture,
language, and level of understanding.
Looking at Students’ Response Choices
Inherently, all tests have a certain level of error. As you develop your tests, your
goal is to minimize this problem so that students’ test scores will represent as
closely as possible their knowledge and skills. Errors can result from several
sources, including the way test items are phrased, the choice of response options,
and guessing, fatigue, and conditions during testing. Therefore, you should review
each individual test item and analyze student responses.
type item, such as
multiple choice and true/false items, and tabulate the number of students who
choice
item with four response choices, tabulate the number of students who chose each
152 action RESEaRcH in Education
response. You will note that good items can better differentiate between those
students who know the materials and those who are guessing the correct answers
(Shermis & Di Vesta, 2011; Suskie, 2009).
choice item written multiple-
and a poorly written multiple- choice item, respectively.
usinG teAcheR-mAde Authentic Assessment tools
Authentic assessment tools were created as an alternative to standardized com-
choice or
other similar items in teacher- made tests. Authentic assessments, also referred to
response choices
A * B
C D
Percent of students choosing
each response option 12 65 11 12
*
Note that the majority of students selected B (the correct answer). The rest of the
students, who probably did not know the answer, were equally divided among the
other three choices (A, C, and D); this is evidence that all three distracters were
equally attractive to students who did not know the correct answer.
FiGuRe 6.11. Example of distribution of responses for a well-written multiple-choice
FiGuRe 6.11.
item.
response choices
* A
B C D
Percent of students choosing
each response option 45 7 40 8
*
Note that the number of those choosing the correct response (A) was only
slightly higher than the number of those who chose C, one of the distractors.
Very few students chose the other two distractors (B and D). Option C was too
attractive for those who did not know the correct answer.
FiGuRe 6.12. Example of a distribution of responses to a weak multiple-choice item.
FiGuRe 6.12.
6. Using Assessment Data in Action Research 153
These assessments have several characteristics. They (1) emphasize the practical
application of the knowledge, (2) encourage open-ended thinking rather than
finding one correct answer, and (3) present realistic problems drawn from every-
day life.
based measurement (CBM). We end this sec-
mance assessment, and curriculum-
formance on authentic assessment tools.
Performance Assessment
At times, you may feel that the traditional means of assessing your students
do not fully reflect their knowledge and ability. In such cases, you may choose
to use performance assessment as a formative or summative evaluation of your
students. Performance tasks provide students with opportunities to demonstrate
their mastery of different concepts in nontraditional ways (Fisher & Frey, 2007).
In doing so, you can observe your students and directly assess their performance
on a relevant task. Using performance assessment allows teachers to combine
assessment with students’ learning (Suskie, 2009). For example, you may ask
your students to perform an experiment in the lab and assess how well they com-
plete this task, as opposed to asking them to simply write the steps of the experi-
ment without actually doing it. Or students may demonstrate their knowledge
and skills through performance such as dance, drama, artwork, and electronic
media.
learning tasks, you may also wish to assess students’ performance on behavior
tasks, such as cooperating with other students during team sports in physical edu-
cation classes or assisting students with special needs.
closely related to real life in comparison with traditional types of tests, such as
multiple choice or fill in the blank. The assessment task usually involves more
order thinking and can provide opportunities to students to be
actively involved in their own assessment.
daily life (such as their attitudes toward peers in the lunch room or during study
hall) or a specially designed situation where they know that their performance
is being assessed (such as producing a play or a digital story on a specific topic).
Assessing students’ performance is usually done with rubrics that are shared with
15 4 action RESEaRcH in Education
the students prior to their performance. (An explanation of rubrics is provided
later in this chapter.)
clearly articulated and explained to students in advance (Taylor & Nolan, 2008).
It is common to assess the product being created by the students as well as the
process used to create the product. For example, Latisha, a sixth-grade language
the vocabulary words from the last unit. The game is considered the product and
it is assessed based on the vocabulary used, as well as the students’ creativity and
imagination in designing and constructing it. Students are told that they will also
be assessed on the basis of their behavior and attitudes in the process of creating
the game. Together, Latisha and her students develop a rubric that includes criteria
such as how they relate to each other, their cooperation skills, and how well they
follow classroom rules. Additionally, the quality of the game they develop is evalu-
ated on criteria such as its structure, the instructions provided, and the vocabulary
words used.
made performance assessment.
tABle 6.4. main Advantages and disadvantages of teacher-made Performance
Assessment
main advantages
main disadvantages
•
• Provide opportunities for students to •
• Articulating clear assessment criteria may be
demonstrate their unique strengths and
• challenging
•
• Encourage open-ended thinking and students
creativity
• •
difficult and demands teacher expertise
application of knowledge •
• settings
range of student abilities •
• consuming and may take time away from
and real-life knowledge instruction
• •
assessment process who are used to traditional assessment
• procedures
•
implement in an environment of high-stakes
testing
6. Using Assessment Data in Action Research 155
Curriculum-Based Measurement
CBM is another alternative approach use
d to assess student performance. In CBM
,
students’ academic performance is evalu
ated in relation to the curriculum (Boyl
e
& Fisher, 2007), rather than in relation t
o external standards or norming groups.
What distinguishes CBM from other appr
oaches is that (1) it is done often, (2) it is
usually very short (1 to 5 minutes), (3) it i
s directly related to the materials and con
-
CBM accessible for classroom teachers a
nd easy to implement. CBM measures ar
e
useful in (1) diagnosing students’ areas
of difficulty early on, (2) planning appro
-
priate interventions, and (3) closely foll
owing students’ response to the planne
d
intervention. Using CBM is especially h
elpful with students who are identified a
s • •
at risk or those who seem to have difficu
• •
lty mastering the course material. CBM i
s • •
often used to assess student progress in
basic subjects such as reading, math, an
•
d •
spelling (Green & Johnson, 2010).
•
grade teacher, focuses his action researc
h proj-
ect on the effectiveness of using supple
mentary intervention materials with three
of his students who have learning disabi
lities. He monitors the progress of these
struggling students by using short read
ing passages from their textbook. Thes
e
1-minute tests are administered once a
week. In his CBM, he records their ora
l
reading fluency including decoding, sig
ht vocabulary, number of words read co
r-
rectly, and comprehension.
TABLE 6.5. Main Advantages and Disadvant
ages of Curriculum-Based
Measurement
Main adva
Main disadv
ntages
antages
• Highly related to the
• Usually measure o
curriculum and
nly basic skills
classroom instructio
• Lack long-range go
n
als
gaps in k nuanced and s
nowledg pecific feedbac
e k
for students with specific
arning problems a large number of stu
• Provide continuous monitoridents
ng of students’
in their growth over ti
me tool
•
15 6 action RESEaRcH in Education
using Rubrics to Assess student Performance
A rubric is an authentic scoring system that is used to assess various processes and
products (Russell & Airasian, 2012), as well as students’ performance on various
tasks. These tasks include assignments such as artistic projects, essays, papers,
projects, and behaviors. For example, you can use rubrics to assess a video that is
science project that they develop as a group; and their level of cooperation during
group work.
that are often hard to evaluate objectively. This formative and ongoing assessment
provides you with information and feedback that you can use to improve your
teaching and enhance your students’ learning.
linked to your learning objectives and assign a range of numerical values to these
criteria. Engage your students in the task of defining and distinguishing a good-
quality product (Stiggins & Chappuis, 2011). Sharing
these criteria with your students has several advantages: (1) it allows you to com-
municate your objectives; (2) it helps your students understand what is expected of
them and how they will be graded, (3) it increases their understanding of how the
assignments relate to their learning, and (4) it enables your students to take control
of their learning and progress.
helpful to develop them collaboratively with your students. This approach gives
your students a sense of ownership (Russell & Airasian, 2012), creates a more
democratic classroom environment, and helps your students become more autono-
directed. Constructing the rubric with the students also allows the
students to gauge their level of progress on the project being assessed (Fisher &
Frey, 20 07 ).
simple rubric rating scale contains two elements: the performance criteria to be
assessed and a rating scale of the performance proficiency levels. The more com-
formance proficiency level. The rating scale can be represented by numbers (e.g.,
1–3) or words (e.g., beginning, competent, and exemplary).
middle school Spanish teacher. At the end of a unit on visiting a Spanish- speaking
6. using assessment data in action Research 157
country, Esther asks her students to write a composition using the new vocabulary
and grammatical structures introduced in the unit. The composition has to be at
least 130 words. To assess the compositions, Esther and her students develop a
scoring rubric. The criteria they develop focus on the following elements among
others: vocabulary, spelling, grammar, organization, and expression of ideas.
to her students: a rating scale and a descriptive rubric. Figure 6.13 shows excerpts
from a rating scale that contains the performance criteria and the proficiency lev-
els. Figure 6.14 shows excerpts from a descriptive rubric that provides a descrip-
tion of each proficiency level, in addition to the rating scale.
to assess students’ performance.
using Portfolios to Assess students’ Performance
In our discussion of assessment tools in this chapter we distinguished between
various types: commercial versus teacher made, and traditional versus authentic.
Portfolios can bring all these tools together to provide a more holistic way of evalu-
ating and documenting students’ learning. A portfolio is a systematic collection
exemplary Accomplished Developing Beginning
Performance criterion 4 3 2 1
Vocabulary:
vocabulary
Vocabulary:
learned in previous units
sentence structure:
sentence structure:
FiGuRe 6.13.
FiGuRe 6.13. Excerpts from a rating scale used to assess end-of-unit composition in
Spanish as a second language.
15 8 action RESEaRcH in Education
Performance criterion exemplary Accomplished Developing Beginning
4 3 2 1
Vocabulary:
Utilizes most Utilizes some Utilizes a small Utilizes very few
of the new of the new number of new new vocabulary
some of which are which are used
used incorrectly
and/or incorrectly
Vocabulary:
Utilizes a wide Utilizes a variety Utilizes a small Utilizes a
variety of existing of vocabulary variety of very limited
vocabulary including nouns, vocabulary, some
including nouns, verbs, and of which are used words are used
verbs, and adjectives to incorrectly inappropriately
adjectives to express ideas and/or incorrectly
express ideas
FiGuRe 6.14.
FiGuRe 6.14. Excerpts from a descriptive rubric used to assess end-of-unit composi-
tion in Spanish as a second language.
tABle 6.6. main Advantages and disadvantages of using Rubrics to Assess
students’ Performance
main advantages
• • main disadvantages
• Enable teachers to link instruction to
• • • Creating rubrics requires teacher expertise
assessment
performance expectations can be difficult
and is time consuming
•
• Articulating clear rubric criteria may be
•
levels of instructional objectives
• • May be used inconsistently across teachers
• May limit teachers’ ability to provide
their expectations to their students •
• • •
across students
• • • May not always serve as an effective
•
rubric and in evaluating their own work diagnostic tool
•
are used to traditional assessment methods
6. using assessment data in action Research 159
of samples of students’ work (Popham, 2013). These samples are carefully and
purposely chosen by a teacher, students, or both. Portfolios may contain paper or
electronic copies of materials such as assignments, formative and summative tests,
student writings, art projects, videos, and audio recordings. Electronic portfolios
that use digital storage processes are increasingly replacing the more traditional
paper type because they are more dynamic and present sound, motion, and color
ject to deterioration as paper portfolios are.
lios, you need to meet with your students and together choose artifacts that reflect
the curriculum unit and your students’ learning goals. These portfolio samples
may represent your students’ best work (Russell & Airasian, 2012), demonstrat-
ing mastery of materials taught in class. The samples can demonstrate students’
growth over time through samples of their work in progress and reflections on
their experience throughout the learning process. Additionally, you may ask your
students to provide an explanation of the value and significance of the various
artifacts that they chose to include in the portfolio.
These criteria are often presented in the form of a rubric and are shared with stu-
dents ahead of time. As part of the process, you and your students will probably
wish to hold formal and informal conferences to review their work, reflect on their
achievement, and set future learning goals.
promote students’ ownership of their portfolios (Russell & Airasian, 2012) and
encourage them to take a more active role in their own learning and in becom-
directed learners. Portfolios assist students in assessing their own work
(Van Blerkom, 2009). Using portfolios enables you to differentiate your instruc-
tion by developing goals, teaching materials, and assessment criteria to meet the
unique needs of each of your students. You may find also that the use of portfolios
strengthens your communication with parents by allowing you to authentically
show the quality of their children’s work as evidence of their growth over time.
developing ways to improve students’ involvement and ownership in setting goals
directing their learning. She decides to use portfolios as
one of the means to accomplish this goal. She starts by explaining the idea and
student and together they decide on the learning goals for the next week and
160 action RESEaRcH in Education
what should be included in the portfolios to demonstrate that these goals were
achieved. The items chosen by the learners are both paper and digital. Examples
of paper items are students’ drawings, samples of their writing of the alphabet
letters, and their home phone number. Some of the digital samples include an
audiotape of the student telling a story and a videotape of a play created and acted
by a group of students.
portfolio. They go over each new item that was added that week, and she asks
her students to evaluate their work and decide what they would like to improve,
change, or add in the coming week. They also create goals for the coming week
and plan the activities that will demonstrate these goals.
documents improvements in her students’ ability to set goals for themselves and to
choose appropriate activities to reflect those goals.
folios to assess students.
tABle 6.7. main Advantages and disadvantages of using Portfolios
to Assess students
main advantages
main disadvantages
•
• Allow teachers to differentiate their •
• Tend to be time consuming to plan and
instruction to meet students’ individual
• create
•
• Complement the curriculum rather than take regularly with each student is challenging
time away from instruction
• •
• and students to logically present the
portfolio artifacts
progress •
• evaluations
that enables planning for future instruction •
• analyze or summarize
of individuality •
• storage space are required to create and
directed learning maintain portfolios
• •
by sharing tangible evidence of students’ standardized achievement tests
progress
6. using assessment data in action Research 161
FinAl comments ABout clAssRoom Assessment
Classroom teachers have many methods available to them to evalu
ate their stu-
dents. Each of these methods provides opportunities for the teache
r to evaluate
aspects of their students’ development, growth, accomplishments,
and further
needs. Each of the methods has advantages and disadvantages. Tea
chers should
ment and use these assessments appropriately. As educators, we un
derstand that
a combination of different assessment tools will provide a richer,
more holistic
insight into each student’s work. When it comes to researching your o
wn practice,
you may benefit from the multiple forms of assessments that are
used in your
made assessm
ent tools, and
teacher-made traditional tests, as well as authentic assessments. Th
e richer the
data you collect, the better you will be able to analyze, synthesize,
and interpret
the issue at the center of your study.
Chapter Summary
1. Student assessment data are an integral part of school life and, although
most data are
designed to monitor students’ progress and performance, they are also us
ed to evaluate
teachers and schools.
2. Assessment information can be a valuable data source for school action r
esearchers as
they explore the effectiveness of their practice, by collecting and analyz
ing qualitative
and quantitative assessment data.
3. Because no single assessment is sufficient in providing information to edu
cators to guide
their instructional practices, educators need to know how to design and
evaluate mul-
tiple assessment tools.
4. Assessment, both formal and informal, is used by teachers to assess stude
nts’ readiness
and dispositions; diagnose and monitor students’ progress and performan
ce; determine
the best placement for students to maximize their potential; plan differen
tiated instruc-
tion to meet the needs of all students in the class; assign grades; com
ply with local,
state, and federal laws; and communicate with parents and other stakehol
ders.
5. Sharing assessment data with students allows them to participate in set
ting their own
learning goals and evaluating their own progress.
162 action RESEaRcH in Education
6. The majority of standardized commercial tests can be divided into two types: norm-
referenced tests that are used to compare the performance of a student to the perfor-
7. Writing instructional objectives helps teachers to articulate and clearly communicate the
intended objectives of their instructional unit and assess how well students have accom-
made assessment tools can be used in all stages of instruction: diagnostic (used
8. Teacher-
tion).
9. Selection-type items, in which students are asked to select the correct response from a
number of options that are presented to them, are easy to score and analyze, but allow
students to guess the correct answer.
10. Supply-type items, in which students are asked to recall, compose, or analyze informa-
tion and construct an answer to a question, are fairly easy to construct and minimize the
likelihood that students will guess the correct answers. However, longer response items
or essays may be harder to score.
11. Every achievement test should have content validity that refers to the degree of match
between a test and the content, knowledge, and skills it is designed to assess, and reli-
same results will be obtained when the test is used repeatedly with the same individuals
or group.
12. Authentic assessment tools emphasize the practical application of knowledge, encour-
age open-ended thinking rather than finding one correct answer, and present realistic
observe their students and assess their performance on a relevant task, should include
clearly articulated criteria to evaluate the product being created by the students as well
as the process used to create the product.
13. Curriculum-based measurement (CBM) is used to evaluate student performance in rela-
related to the materials and content taught in class, and is easy to score and grade.
14. A rubric is an authentic scoring system that is used to assess students’ performance
on various tasks; rubrics can range from a simple assessment tool to one that is more
6. using assessment data in action Research 163
15. A portfolio is a systematic collection of samples of students’ work that are carefully and
purposely chosen by the teacher, the students, or both. Portfolios allow students to take
a more active role in their own learning and can bring various assessment tools together
to provide a more holistic way of evaluating and documenting students’ learning.
16. Each assessment method has advantages and disadvantages; thus, a combination of
different assessment tools can provide for richer and more holistic insight into students’
17. Practitioners conducting action research can utilize data obtained through different
assessment tools to enrich and expand their investigations.
Chapter exerCiSeS and aCtivitieS
1. List at least three assessment tools used in schools and indicate whether they are
used locally, statewide, or nationally. Choose one of these three tools and examine
questions used, and how the results are reported.
2. List three examples in which assessment data can be used in action research
projects.
3. Reflect on your own experience as a student taking tests. What test format did you
like the best and why?
4. Choose and describe a topic for assessing students that you teach or plan to teach.
Using the information in Table 6.2, write five to eight items on the topics of your
Each item should include one of the action verbs listed in the right column of the
table.
5. Following are responses of 100 students to a multiple- choice test item. Would you
consider this to be a good item? Explain.
response choices
A
B C (correct D
response)
number of students choosing
each response 21 24 31 24
16 4 action RESEaRcH in Education
6. Choose a topic or an instructional unit, as well as a grade level, and design a
performance assessment task. Be sure to include instructions for the students about
7. Plan a curriculum- based measurement that may be used by a first-grade teacher or a
8. Create a rubric that you can use to evaluate your students’ learning on a unit of your
choice. (You may want to consult Figures 6.13 and 6.14 in creating the rubric.)
9. Choose a grade level and a subject and develop a list of five to ten items that may
be included in a portfolio. Indicate the purpose of the portfolio and the reasons for
AdditionAl ReAdinGs
Chappuis, J., Stiggins, R. S., Chappuis, S., & Arter, J. A. (2011). Classroom assessment
for student learning: Doing it right—using it well (2nd ed.). Upper Saddle River, NJ:
Pearson.
Gardner, J. R. (Ed.). (2012). Assessment and learning (2nd ed.). Thousand Oaks, CA:
Sage.
Hosp, M. K., Hosp, J. L., & Howell, K. W. (2006). The ABCs of CBM: A practical guide
to curriculum based measurement. New York: Guilford Press.
-
Johnson, J., Mims-Cox, S., & Doyle- Nichols, A. R. (2009). Developing portfolios in edu-
cation: A guide to reflection, inquiry, and assessment (2nd ed.). Thousand Oaks, CA:
Popham, W. J. (2008). Transformative assessment. Alexandria, VA: Association for Super-
vision and Curriculum Development.
Tovani, C. (2011). So what do they really know? Assessment that informs teaching. Port-
land, ME: Stenhouse.
chAPteR 7
data analysis a
nd interpretatio
n
B probably feel a bit overwhelmed. You may be asking yourself: How should
y now, using various strategies, you
have collected data from different s
ources.
Standing before the mass of raw
data, you, like many action resea
rchers,
I proceed from here in making sen
se of all the information I have gat
hered? What
steps will allow me to turn the d
ata into research findings? and W
hat strategies
will enable me to use my data to a
nswer my research questions?
practitioners engaged in research,
whether narrative, numerical, or mixed— you may find this phase to be the
most challeng-
ing, as well as the most rewarding.
At last you are about to discover, b
165
uried within
the raw data, the answers to your r
esearch questions, and satisfy the
curiosity that
launched your inquiry journey.
ing and interpreting information a
s they make spontaneous decision
s throughout
the daily routine of school life.
However, action researchers’ data
analysis is a
systematic and deliberate process t
hat results in trustworthy and relia
ble findings.
These findings are transformed i
nto dependable new understandin
gs, assertions,
explanations, and conclusions abo
ut the issues at the center of their i
nvestigations.
based k
nowledge can now lead to a plan
of action and
have direct implications for their p
ractice.
order to discover its essential feat
ures. Interpretation means provid
ing a descrip-
tion or explanation of the meanin
g of the study. The research ques
tions and the
dictate the strategies
166 action RESEaRcH in Education
In this chapter we describe common methods that we have found most use-
ful for analyzing and interpreting the data collected in action research. We review
the process of organizing, analyzing, interpreting, and presenting the data. These
steps are similar in both qualitative and quantitative research (Creswell & Plano
Clark, 2011). We describe the methods most often used for qualitative analysis
and interpretation followed by a discussion of several of the most commonly used
methods
research. We end this chapter with suggestions for writing the study’s conclusions
and implications.
a critical friend, colleague, or research group member as you plan, design, and
carry out your investigation is very helpful (Samaras, 2011). To facilitate the feed-
back process, this chapter includes checklists that will enable you and your group
to critically read and assess the section of your report that includes your data
analysis, interpretation, and conclusions. The questions listed serve as a guide for
writing specific comments, offer ideas for revisions, and provide suggestions for
improvement. You may, of course, adapt the questions to fit your own particular
study and your own specific needs.
quAlitAtive dAtA AnAlYsis
The goal of qualitative data analysis is to bring meaning and order to the mass of
collected data by looking for recurring themes, categories, and patterns (Hatch,
2002; Shank, 2006). This insight allows you to discover the significant connec-
tion and present logically structured findings. The new gained understanding will
enable you to answer your research questions and consider the implications of the
newly gained knowledge for your practice (Marshall & Rossman, 2011; Miles &
Huberman, 1994; Shank, 2006).
(Glesne, 2010; Merriam, 2009; Miles & Huberman, 1994). The researcher begins
analyzing data as they are collected, and the emerging preliminary understand-
ings help shape, revise, and refine the investigation throughout the data collec-
tion process. For example, Jonathan, a sixth-grade reading specialist, wants to
For this purpose, he plans to interview the school principal, teachers, and par-
ents to obtain their perspectives. Jonathan starts the inquiry by interviewing the
7. data analysis and interpretation 167
principal. After he analyzes the information from the interview, he gains a better
understanding of the school’s policy regarding homework. As a result, when he
develops the interview guide for the sixth-grade classroom teachers and parents,
he adds several questions based on the new knowledge gained from the interview
with the principal.
tion are mostly the same. Unlike in quantitative data analysis in which data analy-
sis and data interpretation are two separate phases, in qualitative data analysis the
procedures are often integrated and recursive (Gibson & Brown, 2009; Marshall
& Rossman, 2011). In the following sections, though, we focus on the final phase
of the study, after all data are collected and you are analyzing the data to answer
your research questions. For clarity purposes, we present the procedures linearly.
We first describe the steps in data analysis followed by a discussion of the process
of synthesizing and interpreting the data. We conclude by outlining ways to pres-
ent the findings of your data analysis and their meaning.
inductive process, which means that the analysis moves from analysis of parts to
a whole, or from analysis of specifics to a general understanding (Hatch, 2002;
Merriam, 2009). The analysis process begins by examining a myriad amount of
information and organizing it into codes, themes, and categories. This is followed
by an identification of the connections, relationships, and patterns in the data,
and pulling them together into a significant whole that describes and explains
the issue at the heart of the investigation. The data analysis process follows these
steps:
1. Preparation for analysis
2. Analysis of the data
3. Synthesis and interpretation of the data
4. Presentation of data analysis and interpretation
Qualitative analysis and interpretation are very dynamic and subjective pro-
cesses (Corbin & Strauss, 2007). Using the guideposts we outlined above may
assist you in gaining trustworthy and dependable insights. We hope it will also
allow you to assert the implications of your findings and achieve a coherent under-
these guidelines should not be perceived as a recipe but rather as a set of sugges-
tions to be adapted to your own individual project and inquiry (Patton, 2002).
168 action RESEaRcH in Education
Preparation for Analysis
Transforming Data into Readable Text
The first step in the data analysis process is to organize the data so they can be
easily retrieved for analysis. This means transcribing the audiotapes, videotapes,
observation field notes, and open-ended survey items into typed text, and using a
copies. We recommend housing the data electronically in a database, though you
also may want to keep a set of hard-copy files (Gibson & Brown, 2009; Richards,
2009).
Sorting the Data into Files
Next, sort and organize the data into specific files (Richards, 2009). For example,
you may create separate files by sorting the data according to participants or data
sources. Let’s say you explored through interviews and open-ended survey questions
the perspectives of reading specialists, parents, and students on the value of using
drama in a language arts class. You may arrange the data into three files according to
the participants: a file dedicated to the parents, a file dedicated to the students, and
a file dedicated to the reading specialist. Another option is to file the data according
to the method of data collection: all the interviews in one file, all the observations in
another file, and all the documentations in a third file. Breaking down the data into
smaller units will help later as you read through the text and code responses.
Creating a Data File Organizer
Another helpful step in preparing data for analysis is to create a table for the data
you collected and the files you created to organize it. Record helpful information
like the name, role, age, or grade of the participant, as well as the methods used to
collect the data, the date and place where the data were collected, and any other
information you deem appropriate. This will provide an organizing framework,
allow efficient retrieval of the data, and keep a paper trail of useful identifying
details (Richards, 2009). Figure 7.1 is an example of a data file organizer.
Immersing Yourself in the Data
Before you separate the data into particular elements, categories, and patterns,
immerse yourself in the transcribed data: read and reread the data in their entirety.
7. data analysis and interpretation 169
file I: Parents’ Perspectives on using Drama in language Arts
Student’s
Name of DemographicSource Name level of
parent Age information data Date Location student
FiGuRe 7.1. Data file organizer.
FiGuRe 7.1.
The purpose is to get an overall sense of the information and
become familiar with
the ideas and views being expressed. You may want to jot
down initial comments,
questions, or ideas. At the same time, avoid making judgme
nts or engaging in pre-
mature guessing of what the information means (Patton, 20
02).
Analysis of the data
The process of analyzing data is based on categorizing a
nd coding procedures
that identify units of meaning within the data. Then these
units of meaning can
Marshall & Rossman, 2011; Miles & Huberman, 1994; S
hank, 2006). As men-
tioned above, qualitative data analysis is an open-ended ind
uctive process of mov-
ing from particular categories to general patterns. These cat
egories may be prede-
termined or emerging from the text. Next, we outline the pr
ocedures for analyzing
data using both kinds of categories.
Using Predetermined Categories
Identifying the Predetermined Categories
Start this process by identifying the categories that will serv
e as a guide for group-
ing the data. These categories may be drawn from your rese
arch question(s) or they
170 action RESEaRcH in Education
may emerge from your literature review or another source (Boyatzis, 1998; Hatch,
2002).
you are concerned about and that they do not overlap. For example, Sharon, a
middle school social studies teacher, chairs a committee that is charged with the
responsibility of developing a new integrated literature and social studies unit that
to conduct a preliminary study to find out how values currently are being taught
formally and informally during social studies and literature classes. Sharon and
her committee decide to observe two social studies and two literature teachers
and interview them. Based on their reading of existing literature, Sharon and the
committee members identify the following eight categories and apply them in the
data analysis:
1. Values are integrated within the teaching (content).
2. Values are reflected in classroom interactions and relationships.
3. Connections are made between classroom discussion and student’s actions,
behaviors, and relationships in and outside of class.
4. Values are transmitted from one point of view or diverse perspectives are
encouraged.
5. Links are made between values discussed and current events that include
controversial issues.
6. The nature of classroom management style (e.g., democratic, acceptance of
differences, caring, autocratic) is explored.
7. Sharing of students’ family and community values is encouraged.
8. There is recognition of the influence of peers and social networks on stu-
dents’ points of view.
Dividing the Data According to Predetermined Categories
Once you create the list of categories, comb through the transcript closely and
look for segments in the data that belong to each category. As you find a segment
that fits a category, mark it to make it easy to retrieve later. Repeat this process
irrelevant to the chosen categories, whereas some segments are contained in several
categories.
7. data analysis and interpretation 171
There are several methods for dividing the segments and separating the data
by categories; choose the one you feel most comfortable with. If you prefer the
method of sorting the data manually, color code the segments or use symbols,
numbers, or abbreviations to identify these entries and aggregate them (Hatch,
2002). Word processing programs perform this function quickly and easily.
Another option is to use special computer software programs, such as NVivo, for
Lewins & Silver, 2007).
into categories, the segments are taken out of their original place and become
decontextualized. Be sure that you have one intact version of the complete dataset
that serves as a master copy, and that each entry is marked and identified to indi-
cate the source of data and page number. Reread the sections you have inserted in
each category. You may want to modify and refine the categories by merging or by
adding new categories to the list (Richards, 2009).
Looking for Themes within Each Category
Once you formulate the categories, they become units of analysis. Within each
individual unit, look for central themes that describe the theme and arrange them
in a logical order. Themes are ideas, points of view, or experiences that run through
the category (Boyatzis, 1998; Miles & Huberman, 1994; Shank, 2006).
process, it can be helpful to ask questions such as What is important here? What
are the critical incidents? and What are the key elements and issues? In the margin,
unit of analysis, compile the labeled elements that you discovered. You also may
add a succinct description of the content of each element.
For example, look for recurring concepts, incidents, and issues and the common
threads that connect them. The connected elements that are threaded throughout
the units of analysis are the category themes.
record the categories and choose the quotes that capture the essence of each cat-
egory. For example, Sharon and her committee identify several themes in their
events that include controversial issues. They first arrange these themes logically
and then insert the quotes that reflect them (see Figure 7.2).
172 action RESEaRcH in Education
category 4:
Links are made between values discussed and current events that include controversial issues.
Identified Theme
selected Quotes from the Data
a. making a link
• “It is important to raise the moral questions the text
presents because at some point in their lives, they will face
• “I want the students to make the connection between the
•
themselves.” (Ms. B., Lit., p. 29)
b. linking to current events
• Classroom
•
“At times, a tense situation in the story we read reminds
students of something similar that happened in our class.” (Ms.
B., Lit., p. 31)
• Schoolwide
“Last week we talked about the waves of immigration during
the turn of the 20th century and Joan cried out: ‘Do we treat
the immigrant students among us any better than they did
then?’ ” (Ms. A., SS, p. 39)
• Social and political events
“Often in our class conversations, students connect events
that.” (Mr. F., SS, p. 57)
c. linking to controversial Issues
• Open debate
“For me, when students discover that social and political
issues are morally complex I do not care if we do not cover all
that I have planned for this lesson. For me, this is education.”
(Mr. G., SS, p. 36)
• Limited debate
“As a teacher, I need to make a decision if the students want
to discuss the moral issue because it is meaningful to them or
FiGuRe 7.2.
Lit., p. 48)
• Debate discouraged
“Frankly, I do not think that many of the fuzzy issues that the
students want to discuss are relevant to the subject matter or
to a classroom. I am not a psychologist!” (Ms. B., Lit., p. 30)
FiGuRe 7.2. Example of Sharon’s theme organizer with selected quotes.
7. data analysis and interpretation 173
Using Emerging Categories
Unlike the process of using prede
termined categories, in which the
categories are
identified before the data analysis
process begins, identifying emerg
ing categories
developing codes from the data a
nd organizing them into categorie
s.
Coding the Data
To develop a set of codes, read
the data slowly and carefully an
X
d divide them
into topics. The topic may appe
ar in different segments within t
X
he data. These
segments can vary from a phrase,
a sentence, a paragraph, or even
X
several pages
(Gibson & Brown, 2009). Bogdan
and Biklen (2006) offer questions
to help action
X
researchers scrutinize the data to
discover meaningful topics. You
may want to
X
consider some of these:
X Events What is going on he
re?
How is the event perceived by th
e participants?
X Behavi What action(s) led to a
or particular behavior?
What is the response to this beha
vior?
X Perspect
ives
How donts perceive the investigat
e participa
ed issue?
Are there differences and similari
ties of opinions among the
participants?
X Relations
How do the participants f
hip eel about each other?
What are the relationships betwe
en the participants?
X StrategiWhat strategies are used
es by the participants?
How useful are these strategies fr
om the participants’
perspectives?
Once you identify a segment to be
coded, mark and assign a coding l
abel that prop-
erly depicts its meaning (Bogdan
& Biklen, 2006). You may choose
an abbreviation
terms as your coding labels. Rec
ord the coded label in the margin
of the segment
page. You may also want to note y
our insight in the other margin. Re
peat this coding
174 action RESEaRcH in Education
process, transcript by transcript, identifying codes that were already noted, while
at the same time looking for new ones. After all the transcripts have been reviewed
and coded, make a list of the codes. Review the codes to be sure that you understand
their meaning, and combine codes with duplicating or overlapping meaning.
your research (Marshall & Rossman, 2011). As a rule, try to reduce the codes to a
manageable number. As you explore the transcripts you will probably realize that
a considerable amount of data is irrelevant or peripheral to your study (Maxwell,
2013). Get rid of the excess! On the other hand, be careful not to overlook impor-
tant issues that contribute to your understanding of the data, although they may
appear infrequently in the transcript.
sixth-grade student teacher. Jesse is concerned about the challenges of classroom
management. For his action research project, Jesse decides to explore the issue of
classroom management styles. He conducts semistructured interviews with four
sixth-grade teachers and with the school principal. He also administers an open-
ended survey to one sixth-grade class. Figure 7.3 shows the codes assigned by Jesse
to teachers’ responses to one of his interview questions: “What is your opinion
about punishing students for their misbehavior in your class?” The figure also
contains Jesse’s insight.
Moving from Codes to Emerging Categories
You are ready now to proceed to the next step of data analysis: organizing the
codes into emerging categories. Review the list of codes that represent topics you
egories. Each category represents a theme around which similar topics are grouped
(Charmaz, 2006). For example, under the category of “The goals of classroom
management” (shown in Figure 7.3) Jesse lists the following topics:
X Enhancing learning
X
X Respecting others
X
X Scaffolding behavior
X
X Recognizing consequences for one’s behavior
X
X Developing personal responsibility
X
X Making good choices
X
7. data analysis and interpretation 175
Insight and reflections Quotes Abbreviated codes
*
Can be used as a
quote? Transcript A: Teacher I (29, F, 2 yrs’ experience)
P as failure
I punish a student I fail myself and my students.]
Reminds me of [My goal is to help my students learn to make
Glasser’s theory good choices that lead to good behavior.] [My job g: good choice
Potential theme: is to help my students examine their behavior,
goals of classroom Impl.
management and what can they do about it. Class meetings
are an essential element in addressing behavior
problems.] [Punishments emphasize teacher
Power s
control; I prefer to empower my students.]
Potential theme:
implementation of Transcript B: Teacher II (46, M, 11 yrs’
experience) positive rewards
chosen technique
over punishment. Rewarding good behavior Impl.
g: scaffolding
behavior. Immediate feedback, consistency, and
behavior
positive reinforcement of good behavior can
Seems like behavior punishment as a last resort to discourage
change troublesome behavior.] [However, I do Impl.
modification inappropriate actions. Students should know that
every act has consequences, good or bad.]
P as consequence
Possible theme:
extrinsic vs. intrinsic Transcript c: Teacher III (28, F, 2 yrs’ experience)
rewards [I do not think that classroom management should
g: personal
responsibility
my students’ personal responsibility.] [This can
be done by sharing responsibility in establishing
Impl.
together class rules.] [Punishments and rewards
Seems like a democratic assert teacher control, but I want to empower P as teacher control
classroom approach
am not consistent in my response and resort to Power s
punishments and rewards. But I am working on
consistent impl.
myself to be less dependent on external control
ext/Int
discipline from within.]
Reminds me of Lee
Canter’s assertive Transcript D: Teacher IV (53, F, 28 yrs’
learning approach experience)
P as consequence
consequences.] [I define what an unacceptable
behavior is and I firmly apply appropriate Impl.
consequences when a student exhibits
FiGuRe 7.3.
(continued)
FiGuRe 7.3. Coding of responses and insights by Jesse to one interview question.
176 action RESEaRcH in Education
objectionable behavior.] [Without proper control Power T
no teacher can have an effective classroom.]
[Classroom management that is based on consistent
firmness, kindness, and consistent reinforcing of
Possible quote? rules results in effective learning.] g: effective learning
Abbreviated codes: *
P = Punishment as . . .
consistent = Following one’s method
Impl. = Implementation of classroom management
g = Goal of punishment
Power T/s = Whose power is emphasized:
teacher or student ext/Int = Extrinsic/intrinsic
FiGuRe 7.3. (continued)
FiGuRe 7.3.
Similarity in a theme does not mean that it embodies a single point of view.
On the contrary, a category should comprise converging perspectives agreed on by
many educators, as well as divergent points of view held by few (Gibson & Brown,
2009). For example, in Jesse’s study about classroom management, the theme of
“management as power” presents the point of view of two of the teachers who
believe that the teacher needs to have the power to enforce the proper regulations
and rules. The remaining two teachers want to empower the students and believe
that the emphasis on control does little to teach students to make good choices.
software programs. Their capabilities for storing data, assigning codes, and locat-
ing and retrieving coded materials are particularly effective (Bazeley, 2007; Flick,
especially useful for managing a large database.
2006). First, examine the data represented by each category and ensure congru-
ency between the data and the category. Next, reflect on how the topics within
the category relate to each other and arrange them hierarchically according to a
logical order. Last, using a table, record the categories and add quotations that
demonstrate their content (see Figure 7.2).
emerging categories, is subjective and is done in a manner that makes sense to you,
the researcher (Charmaz, 2006). Nevertheless, you are expected to be consistent,
reliable, and systematic. You may want to go back to your research group or a
trusted friend and share with them your categorization system and the rationale
that underlies your analysis.
7. data analysis and interpretation 177
The process of using predetermined and emerging categories to analyze data
is summarized in Figure 7.4.
synthesis and interpretation of the data
You are ready now to move to the next phase of the analysis process: the synthesis
and interpretation of data. The strategies we discuss apply to both predetermined
and emerging categories, and from this point on we make no distinction between
the two. Regardless of whether you used predetermined or emerging categories
during the analysis process, you have taken the data apart, sorted the data into
themes and categories, and analyzed each category separately. Now, as the synthe-
sis and interpretation phase begins, you put the parts together, examine how they
relate to each other, and identify patterns (Miles & Huberman, 1994). The aim is
to build on these patterns to develop a holistic story and interpret the data’s mean-
ing (Patton, 2002). This requires an ability to see the “big picture” while carefully
attending to the particulars. Looking at the overall picture without getting lost
in the details allows you to discover what the data tell and the significance of the
story for your research question (Bogdan & Biklen, 2006; Charmaz, 2006).
tation of the data are not distinct or separate phases. The process of analyzing
data and interpreting findings is not linear and may take place simultaneously.
Nevertheless, for purposes of clarity, we present the process sequentially, and in
the following section we focus on the interpretation phase only. We outline four
steps in the interpretation process: (1) identifying patterns, (2) creating a concept
map, (3) supporting the findings with evidence from the data, and (4) validating a
Identifying Patterns
In your interpretation of the data, present your insights and understandings that
are based on the analyzed data and that relate to your research questions. Such a
holistic understanding can be gained by connecting the categories and identifying
patterns and relationships among them (Corbin & Strauss, 2007; Shank, 2006).
or emerging) that you have obtained in the analysis phase. Next, group similar or
duplicated categories together into larger, more general, and encompassing cat-
egories (Charmaz, 2006; Hatch, 2002). For example, in the study on how values
are taught in school during social studies and literature classes, Sharon and her
committee decided to cluster the eight categories they identified into the following
178 action RESEaRcH in Education
USING PREDETERMINED CATEGORIES USING EMERGING CATEGORIES
1. Identifying categories 1. Coding the data:
before the analysis begins: Breaking the data into
Drawing the predetermined categories segments according to topics
from the research questions, Assigning coding labels that depict the
meaning of the identified segments
Developing a list of codes
2. Dividing the data according to 2. Organizing the codes
the predetermined categories: into emerging categories:
Finding and identifying segments in Identifying themes around
the data that belong to each category which similar topics are grouped
Identifying emerging categories that
comprise the identified themes
3. Organizing the 3. Organizing the
predetermined categories: emerging categories:
Looking for themes that comprise Reflecting how the themes within each
each of the categories category relate to each other
Arranging the themes within Arranging the themes within
each category in a logical order each category in a logical order
Ordering the categories according Ordering the categories according
to how they relate to each other to how they relate to each other
4. Recording the categories 4. Recording the categories
and adding quotations that and adding quotations that
FiGuRe 7.4.
FiGuRe 7.4. The process of using predetermined and emerging categories to analyze
data.
7. data analysis and interpretation 179
four major categories: (1) teaching values through discipline content; (2) teaching
values through relationships; (3) teaching values through classroom management;
and (4) relating classroom discussion to familial, cultural, and political life outside
of school.
the data. To discover the patterns, we suggest that you examine how the categories
are related to each other in terms of the following domains: context, frequency,
sequence, cause and effect, and rationality. Throughout the process, be mindful of
your research questions. For example, Sharon and her committee, who examine
how values are taught through social studies and literature classes, realize that
there is a pattern that connects the four major categories that the group identified.
The pattern is the influence of the teachers’ personal beliefs and of the values of the
community on how moral values are taught in class. Another example is the study
by Jesse as he examines the categories that he formed around the question “How
should I manage my classroom environment?” Jesse realizes that there is a pat-
tern that appears among the different categories that emerged in the data analysis
phase: Good behavior is a result of discipline that is either enforced from outside
or is emerging from within.
seeking process and help highlight the relationships between two
tate the pattern-
tABle 7.1. An example of domains and questions for the Pattern-seeking Process
Domains
Questions
•
Context
• What are the contexts in which the categories are embedded?
• • What are the conditions that give rise to these categories?
•
Frequency • How often do particular things occur?
•
•
Sequence • In what order do things occur?
•
•
•
Cause and effect • What are the possible causes for what happened?
• • What are the possible consequences or outcomes?
•
Rationality • What are the reasons for the occurrence?
•
18 0 action RESEaRcH in Education
or more categories. Keep in mind that this is not an exhaustive or prescriptive list
of domains or questions; you should adapt the list to your own research.
Creating a Concept Map
You may find that making a visual representation of the categories will help you in
seeking process (Miles & Huberman, 1994; Stringer, 2007). Doing so
allows you to cluster them differently and to consider the interconnections among
them. It also helps you visualize how the categories and patterns are related to your
research question(s). Finally, like an outline, the visual device assists in writing up
your findings and interpretation and communicating these to others.
maps, diagrams, hierarchical trees, and flowcharts. To allow the patterns and links
to emerge, write your research question(s) and use lines, arrows, and shapes to
show how the categories and subcategories are related to each other. (See examples
of concept maps in Figures 7.5 and 7.6.) To facilitate this process, we suggest using
the statements and tables you drafted previously to describe the categories and
subcategories (see Figure 7.2). Record your hunches about the emerging patterns.
These notes can form the basis for generating your research findings, explanations,
and tentative conclusions.
PATTERN:
teachers’ personal values,
community’s values, and
CATEGORY:
CATEGORY: CATEGORY: CATEGORY: Relating classroom
Teaching values Teaching values Teaching values
familial, social,
content management cultural, and political
FiGuRe 7.5. An example of a concept map created by Sharon and her committee
FiGuRe 7.5.
while exploring how values are taught during literature and social studies classes.
7. data analysis and interpretation 181
QUESTION:
management style b
e?
FiGuRe 7.6.
Preve Trea
nting ting
bad b othe
ehavi rs
or
Discip
lining
CATEGORY:
teachers, and princi
pal
about the state of dis
cipline
FiGuRe 7.6. An
example of a conc
ept map created b
y Jesse in his inv
estigation of
classroom manage
ment styles.
182 action RESEaRcH in Education
Supporting the Findings with Evidence
Now, go back to and comb the data to test your hunches. Check your patterns
against the data and seek segments in the transcript that may serve as evidence to
support your insights and explanations. Evidence means that many segments in
found (Hatch, 2002). This process requires moving back and forth between the
categories, patterns, and data for confirmation or repudiation of your assertions.
Remember, your hunches become trustworthy research findings or meaningful
explanations only if the data support them.
ate answers to your research questions. The patterns may suggest plausible expla-
nations and conclusions about your research questions. They may also guide you
in considering future actions based on lessons learned from the study (Corbin &
Strauss, 2007).
that summarize what you have learned as a result of the analysis process (Hatch,
2002; H. F. Wolcott, 2008). These statements present your overall interpretation
and holistic understanding of your findings and their significance for your prac-
tice. They also serve as the basis for your overall story, impose order and structure
on your account of the meanings you have drawn from your study, and enable you
to communicate your insights and new knowledge to others.
Validating the Interpretation
Keep in mind that there is no one right or best way to arrive at the study’s con-
clusions. Moreover, your aim in the analysis process is not to produce definitive
rather it is a personal process that allows subjective and tentative interpretation.
However, being subjective does not mean being less rigorous or settling for find-
ings that are not trustworthy or valid (Marshall & Rossman, 2011). You should
critically examine your assertions and interpretation to ensure their credibility.
Here are some strategies that may allow you to do this.
Searching for Alternative Interpretations
You ensure the trustworthiness of your findings by searching the data for discrep-
ancies and counterevidence that may refute your assertions or provide alternative
7. data analysis and interpretation 183
interpretations (Gibson & Brown, 2009). For example, let’s look again at Jesse,
the student teacher, whose research focused on classroom management. As he
returned to his data looking for support for the patterns he identified, Jesse real-
ized that the teachers and students he interviewed overwhelmingly named disre-
spect among the students and toward their teachers as a major problem in the
school. To his surprise, the principal, on the other hand, did not mention this
considers several possible explanations: (1) although the students and teachers are
routinely disrespectful toward each other, they are respectful toward the prin-
cipal; (2) the principal has a different perception of what constitutes disrespect-
ful behavior; or (3) the principal is overwhelmed with other concerns, such as
declining test scores, inadequate school funding, or issues related to school safety.
Similarly, if your findings are supported by your data but there are still some
discrepancies, you should point to the inconsistencies and offer possible reasons
without providing a definitive explanation.
Triangulating the Findings
You may want to triangulate different data sources to validate the accuracy of your
patterns and findings. To corroborate your intuitive insights, cross-check different
sources, situations, or points of view to see if the same patterns keep occurring
(Hendricks, 2012; Lincoln & Guba, 1985). For example, after constructing his
concept map, Jesse has a hunch that teachers’ trust in their ability to influence
students’ behavior leads to a classroom management approach that is based on
his hunch he returns to the data to verify whether these ideas were expressed by
different participants.
Contextualizing the Findings within a Theoretical Framework
Another strategy is to link the findings to a theoretical framework. Interpret your
assertions and explanations in the context of theories and research discussed in
your literature review. This lends support and depth to your interpretation (Mar-
shall & Rossman, 2011; Richards, 2009). Thus, Jesse, for example, interprets his
own findings about different classroom management styles used by the teachers in
his school within the context of different theoretical approaches reported in the
literature.
18 4 action RESEaRcH in Education
Practicing Self-Reflexivity
Another way to lend trustworthiness to your interpretation is to practice reflexiv-
ity and openly discuss how your personal experience, biases, and subjective judg-
ment shape your interpretations. You need to ensure that your interpretations are
drawn from participants’ words, behaviors, and interactions, rather than from
your own personal beliefs and biases (Glesne, 2010; Rallis & Rossman, 2012). For
ever, when interpreting the different styles of the teachers in the school, he consis-
tently reminds himself to present and analyze the teachers’ perspectives without
judging them or projecting his own values.
Presentation of data Analysis and interpretation
Through the process of analysis and interpretation you have constructed mean-
ing and newly gained knowledge out of the raw data that you have collected. All
that remains now is to put into words your findings and their implications. For
provoking task. However, through the analysis and
interpretation processes you may have already created a visual presentation of the
categories and patterns that can easily be transformed into an outline for your
final report. Additionally, you have drafted general statements that represent what
you have learned as a result of the analysis. Together, the visual presentation and
the general statements serve as the basis for your written report. To complete the
process, from the excerpts you identified before, choose those that best represent
and support your assertions.
proceeding with the writing process. Our suggestions are focused on reporting
on the analysis process and the research findings and their meaning. As always,
we suggest that you adapt these suggestions to your own personal needs, research
focus, and writing style.
Reporting on the Analysis Process
You may begin writing your report on the analysis and interpretation section by
describing the methods of analysis you have used (Marshall & Rossman, 2011).
You want to demonstrate how these strategies involved multiple sources and multi-
ple perspectives and how you dealt with your own research biases. You also want to
show that these strategies lead to accurate and trustworthy findings. Additionally,
7. data analysis and interpretation 185
we recommend that you report whether you used a computer software program
and, if so, how it was used.
terns you have identified as a result of the analysis. This is also a place where you
can display the visual formats you have developed to illustrate how you analyzed
the data.
Reporting the Findings and Their Meanings
There are different formats for presenting your findings. The most common are the
thematic format and the chronological format (McMillan & Schumacher, 2010).
Using a Thematic Format
In this format, research findings are organized thematically around the categories,
themes, and patterns that were identified. The action researcher may start with
an advanced organizer that outlines the major themes that emerged from the data
and explain how each finding is supported by excerpts from the data. For each
finding, start by introducing the theme, followed by a presentation of the chosen
quotation(s) as evidence, and ending with an explanation of the meaning of the
quotations. The study of classroom management conducted by Jesse and the study
of teaching values in literature and social studies are both examples of the thematic
format.
Using a Chronological Format
In this format, the findings are organized around a chronological description of the
investigated topic. The action researcher starts with a description of the broader
context of the study and then narrows the focus to specific events or actions that
are at the heart of the investigation. For example, Nora, a third-grade teacher in an
inner-city school wants to strengthen her relationships with parents and encour-
age them to be more involved in their children’s learning. She institutes several
strategies of ongoing communication, home visits, and an open invitation for face-
to-face conversation. For 6 weeks Nora records the implementation of these strate-
gies and their impact on parents’ involvement. In reporting her findings, she first
strategies that she implemented to promote stronger relationships and the gradual
changes that occurred.
18 6 action RESEaRcH in Education
Choosing a Style of Writing
In writing your report, you may want to consider the style of writing you will
use (H. F. Wolcott, 2008). Typically, action researchers report their findings in
the third person. Some practitioners, though, prefer a narrative that is told from
their own personal perspective. These writers share their challenges, discoveries,
failures, and epiphanies during the process of analysis and interpretation. This
ested in illuminating significant insights about their experience in educational
settings and about themselves as educators. The danger is that with this format
indulgent and focus more on the self than on the
issue being investigated. If you are interested in this style of narrative, you need to
work hard to balance the personal and the professional. For example, Antonio, a
middle school counselor, conducts research on the phenomenon of bullying in his
school. In reporting his findings he reveals how saddened he was by the impact of
cyberbullying on several students. In his report he reveals, “I felt extremely angry
thinking about the shame and helplessness these students must feel. I visualized
Simona finding out, to her horror, the vicious rumors about her that were posted
for everyone to read. What can I do to remedy the situation?”
nature of your study and your own personal preference. Nonetheless, in qualita-
tive research, certain elements are essential. Dominant among them are providing
a “thick” description that is rich, detailed, and concrete. Quoting participants’
voices also contributes to the readers’ sense of being present in the setting.
Using a “Thick” Description
Qualitative research reporting of the analysis outcome depends on rich, detailed
description. Your vivid narrative should make the setting come alive, the partici-
pants seem familiar, and their emotions understood. The “thick”—textured and
detailed —descriptions should allow the reader to see, hear, and feel what you saw,
heard, and felt during the data collection, analysis, and interpretation (Patton,
2002; H. F. Wolcott, 2008). Therefore, you don’t state that “The students misbe-
haved in class,” rather, vividly illustrate how their destructive behavior manifested
itself. For example, “The students whispered to each other, clearly not paying
sent to her by a classmate. While the teacher was writing on the board with her
back to the students, the class was in chaos!”
7. data analysis and interpretation 187
Quoting the Participants’ Voices
It is important in qualitative action
research to allow participants’ voic
es to come
through clearly. Use participants’ w
ords and expressions, as well as di
alects and
slang. If there are diverse participa
nts in your study, make sure you re
present the
range of voices (Patton, 2002; H. F.
Wolcott, 2008). Quotes may be a fe
w signifi-
cant words, short sentences, paragr
aphs, or even a dialogue. For exam
ple, on the
in some cases external rewards for g . .
ood behavior can encourage student
s to follow
the teacher’s instruction for the wr
ong reasons. To provide support fo
r his claim,
grade male
students (with the initials of N and
T), who are working on worksheets
:
Student N: Why are you not payi
ng attention?
Student T: I hate this boring hand
out.
Student N: Because of you, we wi
ll not have the extra 10 minutes for
recess
that Ms. Marvell promised us.
Student T: Ms. Marvell is bribing
us, but she can’t buy me off .
Student N: Don’t be stupid. Just b
ehave as if you are working on the
hand-
out. In 8 minutes the bell will r
ing and it will be all over.
The participants’ voices constit
ute your study data. Nevertheless, d
ata do not
speak for themselves and quotes th
at are strung together without any e
xplanation
are meaningless. You need to mak
e the connection between the quote
s and your
At the end of your interpretat
ion and data analysis section you
present the
conclusions of your study. This sect
ion is similar in all three research a
pproaches:
methods. Therefore, we pres
ent suggestions
for writing this section at the end o
f this chapter.
the preparation for data analysis, S
tep 2 highlights the two alternative
s for data
using predetermined or e
merging categories, Step 3 is the sy
nthesis and
interpretation of the data, and Step
4 is the presentation of data analysi
s and inter-
pretation.
the analysis and interpretation of q
ualitative data.
18 8 action RESEaRcH in Education
STEP 1: PREPARATION FOR DATA ANALYSIS
Transcribing data
Organizing data into (computer) files
Creating a data file organizer
Immersing in the data to get a sense of the whole
STEP 2: ANALYSIS OF THE DATA: STEP 2: ANALYSIS OF THE DATA:
PREDETERMINED CATEGORIES EMERGING CATEGORIES
Identifying the predetermined categories Generating topics from the data and
Finding segments in the data that assigning them codes
fit each category Organizing quotes with similar content
Looking for themes within each category into categories
Arranging the categories and themes Ensuring congruency between data
in a logical order and category
Recording the categories and Arranging topics logically within each category
selecting quotes that illustrate their essence Recording the categories and selecting quotes
that illustrate their essence
STEP 3: SYNTHESIS AND
INTERPRETATION OF DATA
Identifying patterns in the data by finding
relationships among categories
Creating a visual display of the categories
and patterns
Formulating findings and supporting them
with evidence from the data
Validating the findings
STEP 4: PRESENTATION OF DATA ANALYSIS
AND INTERPRETATION
Reporting the analysis process
Reporting the findings and their meaning
Choosing the format and style of writing
FiGuRe 7.7.
FiGuRe 7.7.
The process of qualitative data analysis, synthesis, presentation, and
interpretation.
7. data analysis and interpretation 189
feedback checklist for reviewing the Analysis
and Interpretation of Qualitative Data comments
1. Are the procedures for data analysis clearly and
explicitly outlined?
2. Is the analysis logically and systematically
developed?
3. Are the analysis and interpretation processes linked
to the research question(s)?
4. Did the analysis and interpretation include
a description of the search for patterns and
relationships within and across categories?
5. Is it stated whether computer software was used to
assist with the data analysis?
6. Are there other visual displays that could enhance
understanding of the data analysis and interpretation?
7. Are issues of validity and trustworthiness directly
addressed?
8. Are the subjectivity, preconceptions, and biases of
the action researcher recognized?
9. Is there a rich description of the people, places, and
events involved in the study?
10. Can the reader get a holistic understanding of the
meaning of the data from the narrative description of
the findings?
11. Are multiple perspectives offered?
12. Are the participants’ words and statements quoted?
Are the contexts and meanings of the quotations
offered?
13. Are interpretations supported by appropriate excerpts
from the data?
14. Are the findings linked or compared to theory and
research discussed in the literature review?
15. Are the interpretations logically structured and the
findings systematically presented?
FiGuRe 7.8. A checklist for reviewing the analysis and interpretation of qualitative
FiGuRe 7.8.
data.
19 0 action RESEaRcH in Education
quAntitAtive dAtA AnAlYsis
The goal of quantitative data analysis is to answer research questions posed before
the start of the study. Many studies are also conducted to test hypotheses; statisti-
cal tests are applied to the data collected to determine whether the hypotheses can
be supported. Statistical procedures can help you further reflect on and study your
relationships between variables, and comparing groups on selected characteristics.
The decision as to which statistical test you will use in a given situation is deter-
mined by your research question and the type of data that you have collected.
researchers can agree on the types of statistical tests that should be used to analyze
numerical data. For example, if both you and your colleague want to study the
relationship between your students’ scores on two tests, you would probably agree
on a correlation procedure. If you analyze the same data, you also should come
up with the same results and interpret your findings in the same way. There is no
subjectivity or personal interpretation in this process. Quantitative data analysis is
also made easier by the availability and ease of use of computer software programs
(such as Excel). These computer software programs can help you organize, graph,
and analyze your data.
process. This means that you start with a general principle or premise and proceed
to a specific conclusion (McMillan & Schumacher, 2010). Stated in another way,
we can state that “If X (a more general rule or theory) is true, then we can expect
Y (a more specific case or phenomenon) to be true as well.” Let’s say, for example,
dents will have a positive effect on their behavior. You may put this into practice
in your classroom management. For instance, you can try to reduce the disruptive
off-task behavior of Mark, one of your students, by promising him some sort of
reward (such as points for a pizza party or extra time for recess) for his on-task
behavior.
not ordered or summarized. To let patterns emerge, start by exploring your data.
Your first step is to examine each of the variables, then proceed to studying the rela-
tionships among the variables (Moore, 2009). To do this you will need to prepare
sorting the data, and using a computer program or another aid to organize the data.
7. data analysis and interpretation 191
The discussion that follows begins with suggestions for entering, organizing,
graphing, and tabulating data, followed by procedures for describing distributions
between variables and conclude with approaches to studying differences between
groups or means. In discussing these approaches to quantitative data analysis, we
define each concept, explain its use, and give an example to illustrate how it can be
1. Entering, organizing, graphing, and tabulating data
2. Computing measures of distribution centers
3. Computing measures of distribution variability
4. Analyzing the data
5. Evaluating the statistical findings
6. Presenting the findings
In the discussion that follows, we start by offering suggestions for prepar-
ing your data for analysis, focusing on some of the most popular and practical
techniques and statistical tests for analyzing quantitative data. Clearly, though,
presenting all the statistical tests and approaches that can be used by researchers
as an action researcher is to choose and apply the right methods to analyze your
numerical data and to interpret your findings appropriately.
entering, organizing, Graphing, and tabulating data
Coding and Entering Data in Preparation for Data Analysis
After collecting your data, you need to prepare for data analysis. In most cases, you
start this process by inspecting the data you collected to determine whether you
need to code any variables, assign them a numerical value, or compute new vari-
ables. For example, let’s say that you want to analyze results from a survey measur-
ing students’ attitudes toward school. The survey includes eight items with response
choices ranging from strongly disagree (1 point) to strongly agree (4 points). After
entering your data into a spreadsheet, check and verify that you entered the data
compare the data in your spreadsheet to the raw data you collected, noting any
192 action RESEaRcH in Education
numbers that are out of range (e.g., a score of 7 on a Likert scale question with four
response choices), missing data, or any other irregularities.
Creating Frequency Distributions
When you order and tally the scores, you create a frequency distribution (Ravid,
2011). For example, Larry, a seventh-grade math teacher, investigates a new teach-
ing strategy and as part of his investigation, he wants to examine his students’ test
scores. After finishing the new math unit, Larry’s 36 students take a test. Larry
then creates a frequency distribution (see Table 7.2).
Graphing Data
Following are some ways you can graph your data. Keep in mind that, although
there are many graphs readily available to you that are easy to create, you still need
to choose the most appropriate graph to present your particular data.
ine their performance in relation to each other and assign grades. The frequency
distribution will also allow him to focus on specific students who are of concern
to him. Displaying the test scores graphically would also be helpful for Larry. Two
graphs may be used to depict frequency distributions: histogram and frequency
polygon. A histogram is a series of bars, each representing a score or group of
scores. A frequency polygon is used to display similar data using a line that con-
nects the different data points. When there are many scores in the distribution, the
polygon usually gets smoother and resembles a bell shape.
tABle 7.2. A Frequency distribution of larry’s students’ math
test scores
Test scores
frequency Test scores frequency
12
1 25 2
17 1 26 1
20 1 27 4
21 1 28 6
22 2 29 9
23 3 30 2
24 3
7. data analysis and interpretation 193
Larry chooses a histogram to display the scores of his students on the math
test. Inspecting the graph (Figure 7.9), Larry can see that there are slightly more
students at the upper end of the distribution, which is to be expected, because the
test was given right after finishing the unit, when most students knew the material.
The graph also shows that there are two students with low scores.
scoring students, Mike and
Shannon. Mike, who obtained a score of 12, is an ELL student, who joined the
class at the beginning of the year. Shannon, whose score was 17, is a B student
who usually gets average scores on math tests. However, she missed several classes
prior to taking the test due to illness. To better understand the reasons for some of
average scores, Larry can examine which questions were
missed by Mike and Shannon and plan his instruction accordingly. Additionally,
Larry may want to examine the test questions to determine why more students did
not obtain high scores on the test, because usually the number of students who get
all or almost all the items correct is higher.
15
10
FREQUENCY
5
0
10 15 20 25 30 35
MATH TEST SCORE
FiGuRe 7.9. A histogram showing Larry’s students’ math scores.
FiGuRe 7.9.
19 4 action RESEaRcH in Education
Another graph you may use to display your data is the pie graph. The pie
graph is a circle divided into wedges in which each wedge represents a certain
defined category or subgroup (Ravid, 2011), and the size of the wedges indicates
which one represents the largest group or set of data. The pie graph is an effective
tool to display segments of data that add up to 100%. For example, Dr. Mayer,
the principal of Jefferson High School, wants to examine how well her high school
of the students regarding their postsecondary plans. She found that 41% of the stu-
dents plan to go to public universities, 23% plan to go to private universities, 18%
plan to go to community colleges, 9% of the students indicated that they do not
plan to go to college, and 9% were unsure of their plans. Dr. Mayer constructed a
pie graph to depict her findings (see Figure 7.10). Using the findings depicted in the
pie chart, she decides to focus on the students who do not plan to go to college or
those who are unsure of their plans so that the school can provide them guidance
in making informed choices about their future plans.
prises a series of bars that do not touch (unlike the histogram that is used for data
on a continuum, where the bars do touch). The bars represent discrete data and are
organized by height (from the lowest to the highest or the highest to the lowest).
Go to public unversity
9% Go to private university
Do not plan to go to college
9% Not sure about my plans
41%
18%
23%
FiGuRe 7.10. A pie graph showing students’ postsecondary plans.
FiGuRe 7.10.
7. data analysis and interpretation 195
For example, Ron, the librarian of a middle school, and the school library com-
mittee, which includes other teachers and parents, decide to investigate the types
of books read by the students. They also want to examine the choice of books by
gender. Ron and the committee plan to use this information to decide which books
to purchase in the future. They also plan to use this information to find ways
to encourage students to expand their choices. Using the library book checkout
information by gender allows the committee to further understand students’ read-
ing choices.
its and preferences and decide whether they need to plan activities to encourage
students to expand their reading choices. They can also determine whether the
library’s current holdings match the students’ reading preferences.
visually. It consists of one or more horizontal lines that can be used to show trends
or progression over time. The graph has two axes: the vertical axis is used to show
axis is used for data that are on a continuum, such as age and calendar years. For
example, Lorna, a science coordinator in the district, wants to evaluate the new
curriculum that her district implemented last year. As part of her action research,
she compares science test scores of fifth-grade students in the three schools in the
district over the last 4 years. After tabulating the numerical results, Lorna graphs
the data to get a better picture of the trends in students’ performance over time
(see Figure 7.12).
Girls
Boys
80
70
60
50
40
30
20
10
Romance
Adventure/ Biographies/ Nonfiction/ Fantasy/
Mystery Autobiographies Sports Science Fiction
FiGuRe 7.11.
FiGuRe 7.11. A joint bar graph showing the comparison of book genres read by mid-
dle school girls and boys during the academic year.
19 6 action RESEaRcH in Education
Glenwood
Green Wood
Tall Oak
MEAN SCIENCE TEST SCORE
85
80
75
70
65
55
50
2009 2010 2011 2012
YEAR
FiGuRe 7.12. Line graph showing science test scores of three schools, 2009–2012.
FiGuRe 7.12.
Inspecting the graph, Lorna is gratified to see a clear gain in students’ science
scores between 2011 and 2012 in the three schools. This may indicate that the new
curriculum, implemented in 2011, is effective. Of course, other factors may have
contributed to the increase in students’ science test scores. These include changes
in instructional practices, a growing emphasis on science education, and imple-
mentation of enrichment programs in the district.
graphs rarely speak for themselves (Pearson, 2010). Additional information, such
as narrative explanation and interpretation of the graphs, as well as other statisti-
cal information, present a more complete story.
Tabulating Data
Another way to organize and display data is to tally and summarize them into
tabulation tables (also called crosstab tables). Individual responses are
recorded, added up, and presented as raw numbers or percentages. For example,
if you administer a survey with four response choices (strongly agree, agree, dis-
responses as your columns. To illustrate, let’s look at a study conducted by Jea-
nette, a high school geometry teacher. Jeanette is trying to implement more group
work in her teaching and decides to have her students spend half of each class
ability groups. After a month, Jeanette uses a 15-item survey
to assess her students’ attitudes toward working in groups. Table 7.3 shows the
responses of her 37 students on the first four questions of the survey. This table
7. data analysis and interpretation 197
tABle 7.3. Partial Results from the survey Administered by jeanette to measure her
students’ Attitudes toward working in Groups
strongly
strongly agree Agree Disagree disagree
Question n % n % n % n %
1. I like working in groups.
21 57 5 14 6 16 5 14
3. I learn better when I work 4 11 23 6 62 9 24 5
with my group. 22 59
learn while working in groups. 24 65 8 22 4 11 1 3
Note. n = 3 7.
summarizes the individual responses of Jeanette’s students in raw numbers and in
percentages, so she can more easily determine her students’ attitudes toward this
instructional approach.
support working in groups. She also can see that there are a few students who do
not like working in groups, preferring to work by themselves. She may want to find
out why those students do not like working in groups and modify her teaching to
accommodate these students.
computing measures of distribution centers
Besides depicting your data visually using graphs, you can also study your data by
computing measures of central tendency. These measures can be viewed as typical
scores that are used to represent and summarize a set of scores. There are three
such measures that are most frequently used in education: mode, median, and
mean (Coladarci, Cobb, Minium, & Clarke, 2010).
Mode
The mode is the score that occurs with the greatest frequency in a set of scores.
You can use it with any type of data. To find the mode, you first have to tally the
mode is used for descriptive purposes only and is much less useful than the median
and the mean.
19 8 action RESEaRcH in Education
Median
The median is the score or point that divides the set of scores into the top 50% and
the bottom 50%. To be able to compute the median, you need to first rank order
all the scores and then find their midpoint.
Mean
The mean, also known as the arithmetic mean, is calculated by adding up the
scores and dividing the sum by the number of scores. The mean is by far the most
commonly used measure of central tendency and the one that you are probably
most familiar with. You can use means to describe sets of scores and to compare
two or more distributions of scores, such as the performance of two classes on the
same test, or pretest and posttest scores of students on some test or survey.
scores obtained by seven students in Blake’s special education class: 9, 13, 5, 14,
10, 6, and 14 (see Figure 7.13). Although Blake does not need to order the scores
in order to find the mode and the mean, it is necessary to do so in order to find the
median. Therefore, Blake’s first step is to order the scores.
value of 14; no other score repeats more than one time. The median is 10; there are
three scores above it and three below it. To calculate the mean, Blake needs to add
up all the scores and divide the sum by 7, the number of scores. Blake finds that the
sum of the scores is 71; dividing it by 7 gives him a mean of 10.14.
SCORES
}
5
6
3 SCORES
9
10
MEDIAN
13
14 }
3 SCORES
14
FiGuRe 7.13.
FiGuRe 7.13. Distribution of seven test scores.
7. data analysis and interpretation 199
Outliers
Even though t
he mean is the
most common
ly used measu
re of a central
tendency,
it may provide
misleading inf
ormation whe
n it is calculat
ed for a set of
scores that
either v
ery high or ver
y low—that
are outside the
distribution of
the rest of the
scores and thu
s they are view
ed as spe-
the same set of
scores as that i
n Figure 7.13 f
rom Blake’s cl
ass, but chang
grade classes— took
e the last
score from 14
to 50. The sum
of the scores w
ill be 109 and t
he mean will b
e 15.57.
This new mea
n is higher tha
n six of the se
ven scores an
d clearly cann
ot serve as
their represent
ative score. T
he effect of ou
tliers can also
be seen in an i
ndex that
we are all fa
miliar with in
everyday life.
As we all kno
w, the “averag
e” housing
prices and sala
ries are report
ed as medians,
not means (M
ertler & Charl
es, 2011).
This is done f
or the same re
ason as discus
sed above, na
mely, there ar
e outliers in
salaries and h
ousing prices
and if the me
an is used, it
would provide
inaccurate
information.
advantages (Tr
iola, 2006). Re
member that w
hile the mode,
median, and m
ean pro-
vide summary
information a
bout a group o
f scores, these
measures do n
ot reveal
information a
bout the perfo
rmance of indi
vidual student
s within that g
roup. For
example, altho
ugh Blake kn
ows the mean
of his students
on the test, t
his mean
does not prov
ide him speci
fic informatio
n about the p
erformance of
particular
students in the
class.
computing me
asures of dist
ribution varia
bility
In addition to
describing the
center of a di
stribution of s
cores, it is als
o helpful
to be able to d
escribe the spr
ead (i.e., varia
bility or dispe
rsion) of the s
cores. For
Joey’s and Ele
na’s classes—
can see in Fig
ure 7.14, Joey’
s class has a
wider range of
scores. When
combined
with the mean,
a measure of s
pread would a
llow us to bett
er describe the
scores.
Range
The range is t
he distance bet
ween the high
est and lowest
score; it is the
simplest
measure of spr
ead, and the e
asiest to calcul
ate and unders
tand. In the set
of scores
of Blake’s stud
ents (in Figure
7.13), the rang
e is 9 (14 – 5 =
9). You must r
emember,
200 action RESEaRcH in Education
JOEY’S CLASS ELENA’S CLASS
FiGuRe 7.14. A graph showing scores from the classes taught by Joey and Elena.
FiGuRe 7.14.
though, that the range can be misleading because it does not provide information
about the scores within the distribution. If the students in Blake’s class had the
scores of 5, 12, 13, 13, 13, 14, and 14, the range would have been the same as the
range of scores in Figure 7.13. As was the case with the mean, extreme high or low
scores can also inflate and skew the range.
Standard Deviation
The standard deviation indicates the average (i.e., the mean) distance of scores
around their mean. Some scores are above the mean and some are below the mean;
some are close to the mean and some are farther away from the mean. The stan-
dard deviation can be conceptualized as the average of all these distances. Because
the standard deviation is an average (i.e., mean) of all the distances, extreme scores
test is taken by two classes with a similar number of students, and one class has
a higher standard deviation on the test, it shows that there is a greater spread of
scores in the class with the higher standard deviation compared with the other
class with the smaller standard deviation.
has a greater diversity of learning styles, ability levels, and needs compared with
her afternoon class. Before starting a new unit, Alice administers the unit’s pretest
to her two classes and computes the means and standard deviations of both classes
than that of her afternoon class although the means of both classes are very simi-
lar. This confirms that indeed there is greater variability in the scores between her
7. data analysis and interpretation 201
classes. (Alice may also want to create a histogram to help her get a better visual
picture of her students’ test scores.) Alice decides to incorporate into her teaching
additional strategies that will accommodate different learning styles and needs
scoring students. At the end of the unit, Alice administers
the posttest to both classes and examines the scores to determine the effect of her
new teaching strategies. A smaller standard deviation in the scores of her morning
ability students would indicate that
her new teaching strategies are effective. Of course, Alice expects both classes to
have a higher mean on the posttest compared with the pretest to indicate growth
and increased knowledge by all students.
Analyzing the data
In this section we introduce you to two main approaches to analyzing numerical
data. The first focuses on measuring association and relationship between vari-
ables; the second explains how to analyze differences between means or groups.
Measures of Association
Correlation
To measure the relationship or association between two or more pairs of quantita-
tive variables we use a statistical test called correlation. An example would be a
made test
and a standardized test or between students’ achievement and motivation. Remem-
ber that correlation does not imply causation; the fact that two variables correlate
need to have two scores for each student.
Correlation Coefficient
The extent of the correlation and its direction (positive or negative) are expressed
by a correlation coefficient, which can range from –1.00 (perfect negative) to 0.00
was developed by Pearson and the symbol used for the coefficient is r. A positive
correlation means that high values in one variable are associated with high values
high values in one variable are associated with low values in the other variable
202 action RESEaRcH in Education
(Moore, McCabe, & Craig, 2010). Correlations closer to 0.00 are defined as very
low or negligible.
between the variables compared with a lower positive correlation. Figure 7.15
shows how to assess the correlation coefficient.
high positive, whereas a correlation of r = –.20 would be defined as low negative.
To illustrate the use of correlation, let’s examine a study conducted by Sim-
students’ homework completion rate and their scores on a math test administered
by the district to all third-grade students at the end of the first semester. She cor-
relates students’ homework completion rate and their math scores on the district
test using Pearson correlation and obtains a correlation coefficient of r = .65. This
to-high correlation. What can Simone conclude about
the relationship between her students’ homework completion rate and their perfor-
mance on the district math test? Although there is a positive relationship between
the two measures, it is not necessarily a causal relationship. In other words, Sim-
one cannot be sure that students who complete their homework regularly would
score higher on the district test, or, alternatively, that increasing students’ math
test scores will increase their homework completion rate. Only an experimental
study can document causal relationship between these two variables.
Scattergram
Correlation can be depicted visually with the use of a scattergram (also called a
scatterplot). Each dot on the scattergram represents the intersection of the two
the strength of the correlation (high, moderate, low, or negligible) and whether it
Perfect Negative No Correlation Perfect Positive
–1.00
–.66 –.33 .00 +. 3 3 +.6 6 +1 . 0 0
High Moderate Low Low Moderate High
Negative Negative Negative Positive Positive Positive
FiGuRe 7.15.
FiGuRe 7.15. Guidelines for interpreting correlation coefficients.
7. data analysis and interpretation 203
65
60
DISTRICT MATH TEST
55
50
45
40
50
100
FiGuRe 7.16.
FiGuRe
7.16. A s
cattergra
m depicti
ng the rel
ationship
between s
tudents’ h
omework
completio
n rate and
their scor
es on a di
strict mat
h test.
is positiv
e or nega
tive. Fig
ure 7.16
shows a
scattergr
am depic
ting the r
elationsh
ip
between
Simone’s
students
’ homew
ork com
pletion r
ate and
their sco
res on t
he
district
math tes
t.
Measure
s of Diffe
rences
Many re
search st
udies are
conducte
d to com
pare two
or more
means to
see if the
y
are differ
ent. Here
we discu
ss two su
ch comm
only use
d tests: (
1) t-test t
hat is us
ed
to analyz
e two m
eans, an
d (2) ana
lysis of
variance
(ANOV
A) that i
s used to
ana-
lyze two
or more
means.
t-Test
The t-test
is used
to compa
re two
mean val
ues to d
etermine
if they a
re differe
nt
(McMill
an & Sc
humache
r, 2010).
The test
statistic t
hat is co
mputed i
s called t
he
t value.
Followin
g is a bri
ef discus
sion of t
he two o
ften-
used typ
es of t-tes
t: inde-
204 action RESEaRcH in Education
The t-test for independent samples is used when the two means being com-
pared come from two separate groups, such as boys and girls, or experimental
and control group. The difference between the two means, as well as the groups’
standard deviations and size (number of people), all play a role in the computation
grade teacher of ELLs wants to test
the efficacy of a new and creative way to teach vocabulary to his students. This
new approach uses educational software that demonstrates the vocabulary words
with the help of visuals (e.g., pictures, cartoons, and videos). Nelson is testing this
new approach by teaching the traditional district curriculum for one of his classes
grade class. Nel-
son tests the two groups of students prior to the start of the study to ensure that
the two groups are comparable in terms of their vocabulary knowledge. Students
in both classes are tested at the end of the 4-week study. Nelson uses a t-test for
independent samples to compare the vocabulary test scores from the two groups.
If the mean score of students in the first group using the new teaching approach is
higher, this higher score would provide evidence for the advantage of using visuals
for teaching English vocabulary to ELL students.
group. An example would be pretest and posttest scores on the same or similar
test obtained for the same students. For example, Halina, a middle school student
teacher, wants to increase students’ awareness of environment protection. As part
of this effort, Halina shows students a video about the benefits of composting.
Before and after viewing the video, Halina administers a questionnaire to students
to assess their knowledge and willingness to participate in a composting program
in school and at home. She uses a t-test for paired samples to compare students’
cate the effectiveness of the video presentation.
Analysis of Variance
When researchers compare two or more means, a statistical test called analysis
of variance (ANOVA) is used (McMillan, 2011). The test statistic computed in
the means, standard deviations, and sample sizes. Computer programs can easily
do the computations and provide the results for you. For example, let’s say that
approaches to teach vocabulary: a traditional approach, an approach using visuals,
grade
classes and can use a different method in each class. The three classrooms are
7. data analysis and interpretation 205
similar to each other in the level of student ability. After 4 weeks of using the three
instructional methods, Nelson compares the vocabulary scores of the students in
the three classes using ANOVA to ascertain which teaching approach resulted in
higher student performance.
evaluating the statistical Findings
As an action researcher, you will analyze your data often for the purpose of describ-
ing existing conditions in the educational setting that you are studying. For exam-
compute the means and standard deviations on the pretest and posttest or compare
scores from a test, after using the new method, to typical test scores using the
existing method. The difference between the two means will reveal whether your
students performed better using the new approach. The standard deviation will
provide a measure of dispersion; besides your desire to raise the scores of the whole
group, you may want to decrease the standard deviation by raising the scores of
ability students in your class. You can compare the two means— pretest
want to know whether students’ attendance is related to their reading test scores.
You can use Pearson correlational analysis to study the relationship between these
two variables (attendance and reading test scores). Examining the correlation coef-
ficient can determine whether these two measures are related and the direction of
the correlation (positive or negative).
statistic is evaluated to determine if it is statistically significant or could have hap-
pened by chance. Using the p value in such cases helps us determine the statistical
significance of our results (Mertler, 2012). In most educational studies, researchers
use a p value of .05 as a cutoff point in determining whether the results are statisti-
cally significant. If our p value is equal to or less than .05 (p < .05), the results are
reported as statistically significant, which means that there is a 5% or less prob-
ability that the results were obtained purely by chance (Lauer, 2006).
Statistical Significance
In reading published research studies in which quantitative data were collected,
you will often come across the concept of statistical significance, expressed as
inferences about a population from which they were selected (Mertler & Charles,
2011). For example, Samira, the Assistant Superintendent, wants to survey parents
206 ACTION RESEARCH IN EDUCATION
about their attitudes toward extracurricular activities in the district, using a
5-point Likert scale. The district has a high number of parents, so she chooses
a sample of 200 parents who represent all grade levels in the school and surveys
them by phone. Next, she analyzes the results to determine parents’ attitudes. In
this example, the responses of the 200 parents she surveys are thought to represent
the attitudes of all parents in the district, because her sample was carefully chosen
Hypothesis Testing
As was discussed in Chapter 2, quantitative studies are often conducted to test
hypotheses. Hypotheses are formalized predictions about the relationship between
two or more variables (Slavin, 2007). There are two main types of hypotheses: null
hypothesis and alternative (research) hypothesis (Schreiber & Anser-Self, 2011).
(when running a correlation analysis) or no difference between means (when con-
ducting a t-test or ANOVA). For example, we can predict that there will be no
statistically significant difference between the mean scores of girls and boys on
our math test. The alternative hypothesis reflects the prediction of the researcher
and states that there will be a significant correlation between variables (for correla-
tional analysis) or that there will be a significant difference between the means (for
t-test and ANOVA). For example, Antonio, the middle chool counselor, predicts
that students will report fewer incidents of bullying after the implementation of
bullying program in his school, compared with the number of incidences
reported prior to program implementation. In other words, Antonio’s research
hypothesis is that there will be no significant difference between the pretest and
posttest means, or between the number of bullying incidents before and after the
When p < .05, the null hypothesis is rejected, and we conclude that there is
a statistically significant relationship, beyond what might be expected by chance
alone, between the variables (in correlation) or a significant difference between the
means (for a t-test or ANOVA).
ered pretest and posttest data before and after implementing the curriculum. We
use a t-test for paired samples to compare the two means and use a computer pro-
gram, such as Excel or SPSS, to calculate the p value (Abbott, 2011). Suppose we
find that the p value is .009 (p < .01), which means that the differences between
7. data analysis and interpretation 207
the pretest and posttest means could have happened by chance alone less than 1%
of the time. We are fairly sure that the two means are indeed different from each
other beyond what might be expected by chance alone.
hypothesis and conclude that the difference could have happened by chance more
than 5% of the time. In such cases, the alternative hypothesis is not supported. For
in our class. Using a computer program, we find that the correlation is low and the
p value is higher than .05 (p > .05). Therefore, we have to retain the null hypothesis
science scores of our students beyond what might be observed purely by chance.
Practical Significance
Statistical significance should not be confused with practical significance. Just
because the results are statistically significant, does not mean that they are impor-
cients, t-values, or other statistical indexes are likely to be statistically significant.
Conversely, with experimental studies using very small samples, the effect of the
treatment may not be detected (Lauer, 2006). For example, a correlation of r = .20
but it is still a low correlation that does not show a strong relationship between the
two variables being correlated. Similarly, a gain of 2 points from pretest to posttest
on a 50-item test might yield a statistically significant t-value (p < .05), but you will
as the practitioner, will have to make this determination. Deciding about the sta-
tistical significance is simple and is usually done by computer programs, whereas
the decision about the practical significance is more subjective (Mertler, 2012).
Effect Size
In experimental studies, in addition to reporting the statistical significance,
researchers can also evaluate the practical significance of the intervention using an
means of the experimental and control groups; higher effect sizes indicate larger
effects of the treatment (Lauer, 2006). To compute the effect size in experimental
studies, the difference in the means of the two groups is divided by the standard
deviation of the control group (Slavin, 2007). Effect size is not affected by the
208 action RESEaRcH in Education
sample size or the measures used to obtain the data and can be computed even if
the results are not statistically significant (Ravid, 2011).
in terms of probability, not certainty. As statisticians like to say, “In statistics, you
never have to say you are certain. . . . ”
Presenting the Findings
When you carry out quantitative studies, your findings are presented objectively
and systematically in the results section. Some of your results are likely to be
teacher confer-
ence, or the number of students who agreed or strongly agreed with a certain state-
ment on a survey. Your results may also be depicted visually. Therefore, tables and
graphs are often found in this section.
questions or to test your hypotheses. For example, you may state that, as pre-
dicted, more parents came to parent– teacher conferences held in the evening com-
pared with the number of parents who came to conferences held during the day. In
another example, you may state that the hypothesis that predicted that the major-
ity of students would disagree or strongly disagree with a particular statement
was not confirmed. In writing this section, do not include any value judgments.
For example, do not use words such as “I was disappointed to find out that. . . . ”;
or “We were pleased to see that the findings supported all our hypotheses.” Such
statements may be included in the discussion section, but not in the results section.
rative, make sure your writing is clear and easy to follow. It is always a good idea
to “walk” the reader through your results and explain what they are and what they
mean (Ravid, 2011). Make sure you refer in your writing to every table and graph,
and that they are clearly identified and labeled. You are also expected to highlight
patterns, trends, or other results that relate to your research questions and hypoth-
eses. For example, Carina, a school board member, administers a 10-item survey
to students in her school to measure their attitudes toward school uniforms. After
collecting the data, she tabulates the results, broken down by gender and grade
level. In her presentation of the data, she explains the structure of the tables that
contain the results and points to differences or similarities between boys and girls
Figure 7.17 provides a checklist with suggested questions that you can use for
the analysis and interpretation of quantitative data.
7. data analysis and interpretation 209
A feedback checklist for reviewing the Analysis
and Interpretation of Quantitative Data comments
1. Are the procedures for data analysis clearly explained?
2. Is it stated whether and which computer software
package was used to enter and analyze the data?
3. Are there codes or other means that were used to
represent the numerical information when entering the
data for analysis?
4. Were the data used for analysis proofed and checked to
ensure their accuracy?
5. Were the data analysis procedures appropriately chosen
to provide answers to the study’s research questions?
6. Were the data analysis procedures appropriately chosen
to provide information to test the study’s research
hypotheses?
7. Are the study’s findings clearly presented in a way that
is easy for others to understand?
8. Are the findings summarized and presented in tables or
graphs? Are the tables and graphs clearly labeled?
9. Are references made to the tables and graphs in the
narrative description of the results?
10. Does the narrative in the results section “walk” the
reader through the findings, explaining the meaning and
significance of each finding?
11. Is the interpretation of the findings justified based on
the data that were collected?
12. Are the explanations of the results presented objectively
and factually?
F i G u R e 7.17. A checklist for reviewing the analysis and interpretation of quantitative
F i G u R e 7.17.
data.
210 action RESEaRcH in Education
mixed-methods dAtA AnAlYsis
Three of the most commonly used types of mixed- methods designs that combine
two-phase design, and (3) the triangulation design. The procedures of data analysis
vary among the three and the differences are based on three elements: (1) whether
the data are analyzed concurrently or sequentially, (2) when and how the integra-
tion of the qualitative and quantitative data occurs, and (3) whether the qualita-
tive or quantitative approach is given priority in the study or the two approaches
are equal (Creswell, 2009). Because the procedures for analyzing qualitative and
quantitative data were already discussed in this chapter, in this section we provide
methods design, an example of how each design is used
by the practitioner, and suggestions for how to present the analysis and interpreta-
tion of each design in the research report.
embedded design
In this design, one type of data (qualitative or quantitative) is embedded within
a study that is dominated by the other (quantitative or qualitative) types of data
(see Figure 7.18). The analysis of the two research methods is done separately. The
priority throughout the analysis process is given to the primary form of data, while
QUALITATIVE QUANTITATIVE
OR
QUANTITATIVE
QUALITATIVE
INTERPRETATION INTERPRETATION
FiGuRe 7.18.
FiGuRe 7.18. A diagram of embedded mixed-methods design.
7. data analysis and interpretation 211
the second source of data serves in a supportive role (Creswell & Plano Clark,
2011; Teddlie & Tashakkori, 2009).
grade students in a nearby school. Two
eighth- grade students mentor the fourth-
methods design to
In the parents’ study, the majority of the data obtained comprises two qualitative
sources: field observations and semistructured interviews. A limited amount of
quantitative data is gathered using an observation checklist. As the parents analyze
the data their primary focus is on the qualitative data, whereas the information
gained from the quantitative data serves as a support to augment the findings from
the primary qualitative data analysis. As the parent researchers report the results
of the study, the quantitative and the qualitative data analyses are discussed sepa-
rat ely.
two-Phase design
In this design, the data analysis of one research method (qualitative or quantita-
tive) is used to build the second phase (quantitative or qualitative) of data col-
lection and analysis. The purpose of the second phase is to expand, extend, or
refine the results from the previous one (Creswell & Plano Clark, 2011; Teddlie &
Tashakkori, 2009). Figure 7.19 is a diagram of the two options in the two-phase
grade math teacher, that we discussed
a study conducted by Larry, the seventh-
to evaluate a new teaching strategy. As he was examining his students’ numerical
test scores, he realized that two of his students scored far below their classmates.
up interview with the two students and their
parents to gain insights into why they fell so far behind their peers and what, from
their perspectives, can be done to help them.
phase quantitative study is an investigation conducted by Pam, the assistant prin-
cipal of a small rural high school. Pam wants to understand the reasons for a drop
school programs offered by
the school. The qualitative data that she obtains from interviewing several students
in the first phase of the study are analyzed by coding and categorizing the factors
school
212 action RESEaRcH in Education
QUALITATIVE QUANTITATIVE INTERPRETATION
OR
QUANTITATIVE QUALITATIVE INTERPRETATION
FiGuRe 7.19. A diagram of two-phased mixed-methods design.
FiGuRe 7.19.
programs. The categories that emerge from the first phase of the study are used by
Pam to develop a Likert-scale survey to be used in the second phase of the study. In
this second phase, this schoolwide survey yields numerical data that she analyzes
using graphs and descriptive statistics.
qualitative (or quantitative) analysis followed by quantitative (or qualitative) anal-
ysis. As the action researchers interpret the study’s findings, they contemplate how
the findings from the second phase of the study helped them to explain or extend
their understanding of the results from the first phase of the study.
triangulation design
In this approach, the qualitative and quantitative databases are given equal prior-
ity. Qualitative and quantitative data are collected and analyzed at the same time,
to determine whether they yield similar results (Creswell & Plano Clark, 2011;
7. data analysis and interpretation 213
Teddlie & Tashakkori, 2009). The triangulation mixed- methods design is illus-
trated in Figure 7.20.
grade teacher, conducts ac
tion research to
assess the impact of a new computer software program on her stu
dents’ level of
acquisition of new vocabulary and their opinions of the new pr
ogram. For her
study, Audrey collects both qualitative and quantitative data. For
her qualitative
ent achievement levels to gain insight into their perceptions of th
e program. She
also collects quantitative data from a questionnaire given to the w
hole class and
from the students’ scores on several weekly vocabulary tests. Audre
y compares the
qualitative themes, categories, and patterns that emerge from her
qualitative data
analysis with the quantitative results. In her interpretation of her fi
ndings, Audrey
discusses the value of combining the two methods of research for
a deeper under-
standing of the impact of the program. She also highlights how the
qualitative and
quantitative findings complement each other.
methods triangulation design, the analyses of the
qualitative and
quantitative data are presented separately. However, in the int
erpretation and
QUALITATIVE
FiGuRe 7.20.
INTERPRETATION
QUANTITATIVE
FiGuRe 7.20. A diagram of triangulation mixed-methods design.
214 action RESEaRcH in Education
conclusions phases—when Audrey discusses the meaning of the findings in rela-
tion to each research question—the approaches are integrated (Hesse-Biber, 2010).
enhance the comparison between quantitative and qualitative data (Krippendorff
& Bock, 2009). The comparison is achieved by transforming the qualitative data
into numerical form. This conversion starts by analyzing the data inductively by
calculating the number of times these categories appear in the transcript, they are
counted and tabulated. The numerical results are then compared to those obtained
through the quantitative method. For example, Rhoda, a high school AP history
teacher, wants to assess the efficacy of using group work in her teaching. She
divides the students into groups of four for the first month of the school year to
get them used to working in groups. During the first week in October, she asks the
students to fill in an exit slip at the end of each class reflecting on and assessing
their experience working in groups. Each slip starts with the prompt “Working
in groups . . . ” Rhoda then reads all the slips and marks each comment as either
positive (+) or negative (–), and as pertaining to several categories that emerge from
her data: social aspect of working as a group (social), learning and understand-
ing the material taught in class (learning), comparing working in groups to other
traditional classroom structure (comparison to traditional), and general comments
(general). Next, Rhoda can tabulate the comments in terms of the number of posi-
tive and negative comments in each category using Figure 7.21.
category + – Total
Social
Academic
Comparison to Traditional
General
FiGuRe 7.21. An example of a content analysis table used by Rhoda to tabulate her
FiGuRe 7.21.
findings.
7. data analysis and interpretation 215
A feedback checklist for reviewing the Analysis
and Interpretation of mixed-methods Data comments
1. Is there a clear explanation of the rationale for using
a mixed-methods analysis to answer the research
questions?
2. Are the procedures for combining qualitative and
quantitative approaches that were used in the analysis
and interpretation clearly outlined?
3. Is it indicated whether the analysis occurred concurrently
or sequentially?
4. Is there a description of when and how the integration of
the two approaches occurred and which approach was
given priority?
5. Is there a discussion of the value of combining the two
approaches?
FiGuRe 7.22. A checklist for reviewing the analysis and interpretation of mixed-
FiGuRe 7.22.
methods data.
Figure 7.22 provides a checklist with suggested questions that you can use for
methods data.
RePoRtinG the studY’s Results, conclusions, And imPlicAtions
You are now ready to complete your study by reporting its conclusion or implica-
tions based on the analysis and interpretation of your data. Writing your conclu-
sion allows you to present what you have learned through the long and challenging
process of analyzing your data and interpreting the meaning of your findings. In
this section we offer suggestions for reporting the results, drawing conclusions,
and assessing the implications of your study. In many ways, in action research,
reporting the study’s conclusions does not differ a great deal for qualitative, quan-
methods studies. All action research studies emphasize the use-
fulness of the inquiry results to one’s own practice rather than seeking to generalize
2012; A. P. Johnson, 2011).
216 action RESEaRcH in Education
In writing your conclusion, you provide a short reiteration of the major find-
ings and insights from your data. Additionally, you present your interpretation and
explain your findings. In writing this section, don’t overstate or understate your
assertions, and any conclusion you put forward should be grounded in the data.
Following the action research tradition that does not aim to generalize or find
conclusive answers, be tentative in pronouncing the study’s outcomes. Use phrases
reasonable to assume that. . . . ”
cussion. If you feel that your questions were not properly answered, reflect on the
reasons for this and offer possible explanations (Mills, 2011). For example, were
there difficulties in implementing the data collection methods that you planned
for the study when designing it? Did you change the focus of your research ques-
tions as the study evolved? Have your professional responsibilities limited your
ability to conduct the study as you originally planned? Similarly, if your study’s
hypotheses were not confirmed, there can be several possible explanations, such
as Was the duration of your study too short? Were the participants in your study
dishonest in their responses to your survey questions? Or, alternatively, Was your
hypothesis simply incorrect? Limitations of your study should be acknowledged
and discussed.
ings with other theories and studies that were reported in your literature review.
Comparing and contrasting the results of your study with the knowledge gained
from previous research on your topic adds trustworthiness and validity to your
findings (Ravid, 2011).
ask yourself questions such as How might my action research contribute to my
practice? What changes will I make as a result of my newly gained knowledge?
How can the new information be helpful to others? and Are there additional ques-
tions that were brought up in my study that I might pursue in the future? Addition-
ally, you may want to reflect on your journey as an action researcher. Questions
that you may ask yourself include What might I change or do differently next time
I launch an action research project? How did the experience of action research
affect my perception of my work? and How did it affect my professional develop-
ment?
evaluate your study’s conclusion.
7. data analysis and interpretation 217
A feedback checklist for reviewing
Quantitative, and mixed-
comments
methods studies
1. Is a summary of the major results of the study
offered?
2. Are the interpretations and conclusions consistent
with the findings?
3. Are all the assertions, explanations, and claims
supported by evidence?
4. Do the conclusions and interpretation relate to the
research questions and hypotheses?
5. Are the limitations of the study acknowledged?
6. Are the findings linked to or compared with theory
and research discussed in the literature review?
7. Are the implications of the study discussed and
explicated?
8. Are there personal reflections on the study’s results
and its effects on you as a practitioner?
9. Are there suggestions for directions for future
research?
FiGuRe 7.23. A checklist for reviewing the study’s conclusions.
FiGuRe 7.23.
Chapter Summary
1. Although teachers and other school practitio
ners are constantly and intuitively analyz-
ing and interpreting information, action rese
archer’s data analysis is a systematic and
deliberate process that results in trustworthy
and reliable findings.
3. The research questions and the nature of the data—
2. The process of analysis is defined as breakin
g down the whole into elements in order to
discover its essential features. Interpretation
is referred to as providing a description or
explanation of the meaning of the study.
whether narrative, numerical, or
dictate the strategies that might be appropriate fo
r data analysis and interpreta-
tion.
218 action RESEaRcH in Education
4. There are many qualitative analysis approaches, and they all share an inductive process
in which the analysis moves from individual parts to a whole and from specifics to a
general understanding.
5. Preparing for data analysis involves several steps: transforming the data into readable
text, sorting the data into files, creating a data file organizer, and immersing yourself in
the data.
6. Predetermined or emerging categories can be used to analyze the data.
7. The predetermined categories serve as a guide for grouping the data into units of analy-
sis and may be drawn from the research questions or the literature review.
8. The emerging categories are created from the ground up. This process involves develop-
ing a set of codes that are grouped together and organized into categories.
9. In the phase of synthesis and interpretation of data, researchers put the parts together,
examine how they relate to each other, and identify patterns.
10. Four steps of data interpretation are described: identifying patterns, creating a concept
map, supporting findings with evidence from the data, and validating a trustworthy inter-
pretation.
11. The report on the analysis and interpretation section may start by describing the meth-
ods of analysis that were used, how these strategies involved multiple sources and per-
spectives, and how the researchers dealt with their own research biases.
12. The written report on the analysis and interpretation section can start by describing the
methods of analysis used in the study, the study’s multiple sources and perspectives,
how the researcher’s biases were addressed, and how accurate and trustworthy were
the findings obtained.
13. In qualitative studies, a thematic or a chronological format may be used to present the
findings; “thick” description and quoting the participants’ voices are common writing
styles.
14. The goal of quantitative data analysis is to answer research questions posed before
the start of the study. Studies may also be conducted to test hypotheses; statistical
tests are applied to the data collected to determine whether the hypotheses can be sup-
ported.
15. Quantitative data analysis, in contrast to qualitative data analysis, is a deductive pro-
cess, starting with a general principle or premise, and hypothesizing that certain predict-
16. The process of analyzing numerical data may involve coding data, labeling variables,
sorting the data, and using a computer program or another aid to organize the data.
7. data analysis and interpretation 219
17. Data can be depicted visually using graphs; measures of central tendency (e.g., mean)
and dispersion (e.g., standard deviation) are often used to describe distributions of
scores.
18. Correlation is a statistical test used to measure the relationship or association between
two or more pairs of variables; t-test and analysis of variance (ANOVA) are statistical
tests that are used to compare different means.
19. When analyzing results, researchers want to know whether they are statistically signifi-
cant or could have happened by chance. Using the p value in such cases helps deter-
20. When carrying out quantitative studies, findings are presented objectively and system-
atically in the results section.
21. The numerical results that you obtain may be used to answer your research questions or
to test your hypotheses.
22. When presenting tables and graphs, or embedding statistical results in the narrative,
the results should be presented and explained by highlighting patterns, trends, or other
results that relate to the research questions.
23. The three most common types of mixed- methods designs that combine both qualitative
triangulation design.
24. The procedures of data analysis vary among the three mixed- methods designs based on
and how the integration of the qualitative and quantitative data occurs, and (c) if the
qualitative or quantitative approach is given priority in the study or the two approaches
25. In the embedded design, one type of data (qualitative or quantitative) is embedded
within the larger action research that is dominated by the other (quantitative or qualita-
tive) type of data and the analysis of the two research methods is done separately.
26. In the two-phase design, the data analysis of one research method (qualitative or quan-
titative) is used to build the second phase (quantitative or qualitative) of data collection
and analysis and the purpose of the second phase is to expand, extend, or refine the
results from the previous one.
27. In the triangulation design, the qualitative and quantitative databases are given equal
priority and both types of data are collected and analyzed at the same time, but sepa-
whether they yield similar results.
220 action RESEaRcH in Education
28. The conclusion section should provide a short reiteration of major findings and insights
from the data and present an interpretation and explanation of the findings. Assertions
and conclusions should not be overstated but rather grounded in the data.
29. The study’s research questions and hypotheses should be addressed in the discussion
section, and possible explanations should be provided in cases where the outcomes are
different from those expected.
30. Connecting and comparing the study’s findings with other theories and studies that were
reported in the literature review strengthen the study’s interpretations and conclusions
and adds trustworthiness and validity to the findings. Implications and limitations of the
study should also be noted.
Chapter exerCiSeS and aCtivitieS
1. On the basis of the literature that you have read, list two to five possible themes
that you expect to emerge from the data you have collected.
2. At the end of an action research class, students were asked to reflect on the
contribution of action research to their current or future practice by responding to a
14 of these students to one of the questions. Read carefully the students’ responses
and look for themes and subthemes. Note that there are negative and positive
responses and different reasons are given for each one. If you are working with a
peer, colleague, or a group, compare and contrast the themes that were generated.
students’ responses to the question
#1 I think that teachers constantly do research in their classrooms and it is important to
understand what they are looking at. Additionally, learning about action research helps teachers
understand and evaluate published research.
#2 Action research helps me evaluate whether or not I am effective as a teacher.
#3 I feel confident in my ability to conduct research, and it does make for more informed decisions
in the classroom. However, it is difficult to conduct the research correctly when in the middle of
teaching . . . it is a bit like changing a tire while the bus is still in motion.
#4 Conducting research helps me to effectively gauge published research and criticize more
objectively any conclusions that the research is telling me.
7. data analysis and interpretation 221
#5 It helps you learn from your students and reflect on your actions in the classroom.
#6 I believe that one can be a very effective teacher by reading current educational research and
not actually conducting action research. However, if an educator wants to grow in his or her
practice and evolve to the next level, conducting action research is a logical step.
#7 Conducting research is a lot of work. I would like to be engaged in research but I am not sure
I
can actually do it in my practice.
#8 Research does a few things for teachers. First, it affirms what you are doing in the classroom.
Second, it might change what you do in the classroom. Third, it allows you to explore concept
s
you might find an interest in.
#9 I believe that action research allows me to better understand what is going on in my class. It
forces me to look at my students and what I do in a systematic way. It is a lot of work but it i
s
worth it.
#10 Because I conduct action research I can present before the parents and school administration
evidence of what is done in my class. I feel more appreciated as a professional.
#11
I think that action research helps you to become aware of how you teach and helps you to
continue to improve and become a better teacher.
#12 There are more important aspects in being an effective teacher than conducting research.
#13 The human brain is constantly doing research whether we’re aware of it or not. It is human
nature. Why not channel it into something beneficial to others?
#14 After conducting action research in my class, I view education completely differently. I am
not ready just to follow instruction given from above but rather I examine what works for my
more.
3. Select the data obtained for your research project from one or two sources that you
collected.
a. With the help of analysis guidelines presented in the chapter indicate three to
four emerging categories.
b. Summarize the categories indicating the central aspects of each one.
c. Exchange your narrative with a researcher colleague and reflect in writing what
you have noticed in each other’s categories. Discuss your insights.
4. Examine the emerging or predetermined categories that you obtained from your
analysis and write a preliminary interpretation. The following steps may help you in
a. Create a visual display of the patterns and categories identified in your data
using a concept map (see examples in Figures 7.5 and 7.6).
b. Consider the logical order of the themes and the patterns.
222 action RESEaRcH in Education
c. Triangulate your findings with evidence from at least two sources. Show how
you presented the different opinions and attitudes expressed by the research
d. Create an outline of your analysis report and note what quotations and
supportive evidence you will use.
5. The correlation of a teacher- made math assessment test with the standardized
math test administered by the state in the spring is r = .82. What are your
test?
6. Compare two bar graphs in Figures 1 and 2 that show responses to two survey
questions. How are the responses different or similar?
figure 1. responses to Question 1
40
35
30
25
20
15
10
5
0
Strongly Agree Neutral Disagree Strongly
Agree Disagree
figure 2. responses to Question 2
35
30
25
20
15
10
5
0
Strongly Agree Neutral Disagree Strongly
Agree Disagree
7. Results of a study to assess attitudes toward reading of 35 second- grade students
7. data analysis and interpretation 223
a survey measuring attitudes toward reading at the beginning of the year (pretest)
and again at the end of the year (posttest). During the year, the teachers of both
classes designed a series of weekly activities designed to enhance students’
attitudes toward reading. The scores of the students from the beginning and end of
samples t-test. The mean on the pretest was
34.31; the mean on the posttest was 36.77. There was an increase of 2.457 points
from pretest to posttest. The statistical significance was p < .01 level. Was the
Explain your answers.
8. Organize and tabulate the numerical data that you collected, using graphs and
tables (see examples of tables and figures in the chapter.) Write your preliminary
in Figure 7.17 to help you reflect on your report.
9. Read your analysis and interpretation using the checklists for qualitative data
(Figure 7.8), quantitative data (Figure 7.17), or mixed- methods data (Figure 7.22).
constructive feedback.
10. List the main findings or conclusions of your study. How are your findings related to
theories or studies you reported in the literature review? Do your findings confirm
reaffirm or differ from your educational experience (as a student, student teacher,
parent, teacher, or other roles as a school practitioner)?
AdditionAl ReAdinGs
Ary, D., Jacobs, L. C., Razavieh, A., & Sorensen, C. K. (2009). Introduction to research
in education (8th ed.). Belmont, CA: Wadsworth.
Creswell, J. W. (2011). Educational research: Planning, conducting, and evaluating quan-
titative and qualitative research (4th ed.). Boston: Addison Wesley.
Dane, F. C. (2011). Evaluating research: Methodology for people who need to read
research. Thousand Oaks, CA: Sage.
Dicks, B., Mason, B., & Coffey, A. J. (2005). Qualitative research and hypermedia: Eth-
nography for the digital age. London: Sage.
Gay, L. R., Mills, G. E., & Airasian, P. W. (2011). Educational research: Competencies for
analysis and applications (10th ed.). Boston: Addison Wesley.
224 action RESEaRcH in Education
Gibbs, G. R. (2002). Qualitative data analysis: Explorations with NVivo. Buckingham,
UK: Open University Press.
Glass, G. V., & Hopkins, K. D. (2008). Statistical methods in education and psychology
(3rd ed.). Boston: Allyn & Bacon.
Grbich, C. (2007). Qualitative data analysis: An introduction. London: Sage.
Greene, J. C. (2007). Mixed methods in social inquiry. San Francisco: Jossey-Bass.
Holstein, J. A., & Gubrium, J. G. (2011). Varieties of narrative analysis. Thousand Oaks,
CA: Sage.
Hoy, W. K. (2010). Quantitative research in education: A primer. Thousand Oaks, CA:
Sage.
Huck, S. W. (2012). Reading statistics and research (6th ed.). Boston: Pearson.
Kering, P. K., & Baucom, D. H. (Eds.). (2004). Couple observational coding systems.
Mahwah, NJ: Erlbaum.
Krippendorff, K. (2012). Content analysis: An introduction to its methodology (3rd ed.).
Thousand Oaks, CA: Sage.
Muijs, D. (2010). Doing quantitative research in education with SPSS. Thousand Oaks,
CA: Sage.
Neundorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage.
Ryan, G. W., & Bernard, H. R. (2000). Data management and analysis methods. In N.
K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (2nd ed., pp.
769–802). Thousand Oaks, CA: Sage.
Stake, R. E. (2005). Multiple case study analysis. New York: Guilford Press.
Tanner, D. E. (2011). Using statistics to make educational decisions. Thousand Oaks, CA:
Sage.
Tashakkori, A., & Teddlie, C. (Eds.). (2003). Handbook of mixed methods in social and
behavior research. Thousand Oaks, CA: Sage.
Wolcott, H. (1994). Transforming qualitative data: Descriptions, analysis and interpreta-
tion. London: Sage.
chAPteR 8
Writing, Sharin
g, and impleme
nting
the Research F
indings
ou have reached the final phase of your investigation and are probably excited
to put into action what you have learned about your research topic. Neverthe-
that tells the story of your research journey and its implications for your practice
and make public your newly gained knowledge (Altrichter et al., 2008).
Y less, there is one more impor
tant thing left to be done: to prod
uce a report
225
because you are the only one to act
on your findings. Still, we believe t
hat all prac-
titioners involved in action researc
h need to document their study.
question to reaching the study’s c
onclusions, has several benefits. Fi
rst, the very
act of writing the report allows
you to stand back and think holi
stically about
what you have seen, heard, experi
enced, and learned from the proce
ss. This self-
reflection enhances your ability to
organize your thoughts, crystallize
s your under-
standing of the study’s results, an
d presents clearly and convincingl
y your newly
gained knowledge (Hinchey, 200
8; H. F. Wolcott, 2008). Second
, the written
account serves as tangible evidenc
e of your personal achievement, do
cuments your
professional accomplishments, an
d contributes to your career port
folio (Mills,
to expand your circle of influence
by sharing your findings with yo
ur colleagues
and a wider audience (Mertler, 20
12). Finally, making your research
accessible to
226 action RESEaRcH in Education
others helps you connect with a community of learners who share your desire for
school improvement and personal growth through action research (Holly et al.,
2009).
research project. We also reflect on how doing research can become an integral
part of your professional growth as an individual and as a member of a community
dedicated to improving practice through action research.
report, (2) developing alternative formats for reporting on action research, (3)
sharing the research findings, and (4) implementing the research findings.
wRitinG A FoRmAl Action ReseARch RePoRt
There are different ways to report action research studies, although most of them
follow a similar structure. In this section, we highlight the different parts of a
formal research report. While different publication writing styles can be used for
describing your research, we focus here on APA (2010) style because it is the pre-
ferred format in education.
ture review, methodology, findings and results, discussion and implications, and
references (McMillan & Schumacher, 2010). As you recall, we have elaborated on
each of these sections in the previous chapters. Therefore, in the discussion that
follows, we review only various report sections. Some reports also have an appen-
dix. Published reports may also include an abstract that summarizes the study and
introduction
In the introduction, you describe the study’s background and state the purpose of
the study (Huck, 2012). Here you present the topic of the study and the questions
you explored, including your hypotheses, if any. The statement of the problem that
you investigated can be phrased as a question or in a declarative form. You also
articulate the rationale for the inquiry and its significance and how it will contrib-
ute to your educational practice. In this section, define terms that are at the heart
For example, you may choose to define terms such as gifted, RTI, or cyberbullying.
8. Writing, Sharing, and implementing the Research Findings 227
literature Review
The literature review se
ction provides a summar
y of existing research o
n your
topic (Slavin, 2007). Re
member to analyze and
synthesize the studies th
at you
reviewed and highlight c
ontroversies or points of
agreement between resea
rchers,
as well as conflicting fin
dings or any gaps in kno
wledge. To avoid plagiar
ism and
to maintain the integrity
of your report, cite caref
ully the information you
gleaned
methodology
In the methodology secti
on, describe the procedur
es you used in conductin
g your
study. There are usually
several subsections in th
e methodology: site and
partici-
pants, data collection pr
ocedures, researcher rol
e, and data analysis. Th
e order
section is designed to pro
vide clear, detailed infor
mation about how you co
nducted
t he s t udy.
Researcher Role
Here you explain your r
ole as the researcher. Fo
r example, describe your
biases
and subjectivity, or how
the subject of your resear
ch related to you persona
lly.
SIte and Participants
In this subsection, descri
be those who participate
d in your study. Include r
elevant
demographic information
about the participants (A
PA, 2010) such as the stu
dents’
price
lunch. Also include a d
escription of how the p
articipants were selected
(Dane,
2011). At the same tim
e, be sensitive to issues
of confidentiality. Consu
lt with
your supervisor (e.g., de
partment chair or princip
al) about these issues. W
hen in
doubt, use general demo
graphic information abo
ut the school that is avail
able to
the public. You may hav
e included several sampl
es in your study, such as
parents,
other teachers in the scho
ol, or students. Make sur
e you describe each one
of these
groups of participants.
228 action RESEaRcH in Education
Data Collection Procedures
In this subsection, describe how you collected your data and the tools (qualita-
tive, quantitative, or mixed methods) that you used. For example, if you collected
observation data, explain what you observed and how you recorded your observa-
tions. Or, if you gathered interview data, report information such as the interview
protocol and the questions you asked. Similarly, describe how you collected your
tion about it including the number of questions, sample questions, and other demo-
graphic questions that you may have included. Also, convey how you distributed
and collected the surveys. You can place samples of the qualitative and quantita-
tive data in the report’s appendix.
It should be detailed enough for a reader to understand how you conducted the
study and collected your data. Include information such as the process for obtain-
ing permission for your study, enlisting participants’ cooperation, and length of
t he st udy.
Data Analysis
This subsection is designed to explain how you analyzed the data you collected.
For qualitative studies, describe how you transcribed the data and developed the
codes, categories, and patterns. For quantitative studies, describe how the numeri-
statistical tests were calculated.
You may want to mention your research questions and explain how you analyzed
packages to analyze your data, report this information in this subsection.
Findings and Results
The results of your study are reported in this section. For qualitative data, describe
how you discovered the themes and organized them around categories and pat-
terns. On the basis of your evidence, provide a plausible explanation for your find-
ings, draw conclusions, and answer your research questions. You may find that
tables and graphs would enhance the presentation of your findings (Huck, 2012).
If your data are quantitative, report your findings as they relate to your research
questions and hypotheses. Present your results objectively without interpreting
8. Writing, Sharing, and implementing the Research Findings 229
them or expressing any value judgments. If you identify the real names of the par-
ticipants or educational setting, or if you use pictures or other artifacts, you need
to obtain permission to do so.
discussion and implications
In this section you revisit your own study by looking at the research questions (and
hypotheses, if you had any) and examining the data you collected and analyzed.
You should explain the implications of your findings for your practice and suggest
changes and modifications that may take place as a result of your study. Also,
explain your findings in a broader context (Fraenkel et al., 2011), describe where
your findings confirm or contradict those reported by others, and give possible
explanations for these discrepancies. You should acknowledge your study’s limita-
tions and offer suggestions for future research.
References
In this section, you list all the references you cited or quoted in your study (Dane,
2011). The exact order of the list may depend on the publication style that you
use. For example, in APA style, which is commonly used in educational research,
the references are listed in alphabetical order according to the author’s last name.
There should be a complete match between the text citations and the reference list.
This means that all the studies that you cited in the text should be listed in your
reference list, and that all the sources listed in the reference list should have been
cited in your text.
Appendix
The appendix often contains information that is distracting or inappropriate to
include in the body of the report (APA, 2010), or information that is too detailed
or too long to be included in the report itself. For example, samples of interview
transcripts, observation field notes, artifacts, permission letters, classroom seating
charts, student work, and copies of tests—all of this material can be included in
the appendix. All the items in the appendix should be ordered and labeled clearly
and referred to in your report.
Table 8.1 offers a summary of the structure of a formal action research report.
230 action RESEaRcH in Education
tABle 8.1. structure of a Formal Action Research Report
section
content
Abstract (a summary of the study,
optional) Overview of the study
Introduction Presentation of the topic of the study and the questions you
explored
Literature review Summary of existing research on your topic
Methodology Explanation of how the study was conducted and the data
collection methods
Findings and results Presentation of the study’s findings with relevant evidence
Discussion Explanation of the results in relation to the study’s questions
and to other research on your topic, implications for
practitioners, suggestions for future studies
References A list of the references cited or quoted in the report
Appendix Additional documentation (that is too detailed to include in
the report itself)
develoPinG AlteRnAtive FoRmAts FoR RePoRtinG on Action ReseARch
While the traditional account of communicating your findings is the most common
format for presenting action research, there are other options available. As long as
the procedures of collecting, analyzing, and interpreting the data are valid, trust-
worthy, and transparent, you may choose other ways of reporting your findings.
Some of these include poster presentations, portfolios, electronic media, and artis-
tic or dramatic performances. You may find that using one of these presentation
formats can communicate your study more effectively and be more engaging and
accessible to your audience than other methods. Additionally, these presentation
options are more visually appealing and allow for the integration of sight, sound,
and technology to complement or substitute for the narrative report. Several books
Phillips & Carr, 2010; Stringer, 2008). There are also a number of online resources
8. Writing, Sharing, and implementing the Research Findings 231
for creating posters, research portfolios, and multimedia presentations. We include
links to several of these websites at the end of the chapter.
Poster Presentation
In a poster presentation, the essential elements of the study are summarized and
written text is kept to a minimum. The action researcher stands next to the poster
format usually contains the following components:
X Title of the research project
X
X The research question(s) you address
X
X Major findings from the literature review
X
X The context of the study: participants, setting, and research methodology
X
X Carefully selected data representations, such as quotations and pictures
X
X The study’s findings and recommendations
X
If you choose this mode of presentation, be sure that your report is focused,
succinct, and contains only the essentials. Key findings should be clearly displayed
and the most representative and provocative quotes should be conveyed. It is a
good idea to make the poster aesthetically appealing by using pictures, charts, and
other visual displays that effectively tell your study’s story (T. G. Wolcott, 1997).
Research Portfolio
Portfolios can be constructed by organizing materials in a binder or in digital
formats. They are distinguished by a display of rich and varied data that include
students’ work, lesson plans, selected excerpts of interviews, and field notes. Port-
folios often contain visual displays, such as pictures, charts, and other illustrations
that capture the participants’ world and the complex environment of the educa-
tional setting. The variety of authentic documents allows the reader to interact
with the data and to engage in the interpretation of its meanings. The data are
accompanied by the action researcher’s reflections, explanations, and insights.
nize its many elements clearly and skillfully. A table of contents and a list of the
232 action RESEaRcH in Education
documents, figures, and artifacts will also be helpful (R. S. Johnson, 2009; Schär,
2002). Portfolios usually include:
X An overview of the research project, including the research question and its
X
significance
X The procedures for collecting and analyzing the data
X
X A display of a variety of data, such as artifacts, excerpts, pictures, and charts
X
X Commentaries on the findings and conclusions
X
X Reflections on the potential impact of your study on your practice
X
Digital portfolios are becoming more prevalent with the advance and versa-
tility of technology. A variety of electronic formats like DVD, CD, video, digital
photography, and hypertext navigation make this format a very suitable and stim-
ulating way to present your research. Make sure that this exciting format does not
detract from the substance of your study (Abrami & Barrett, 2005).
electronic media
moving advancement in technology makes it possible to tell
The amazing and fast-
tations. The new video and electronic media production that includes a variety
of tools such as video, YouTube, streaming video, and DVD allows the action
researcher to create an exciting presentation of his or her findings. Through the
sound and images you present, the experiences of your study’s participants are
for reporting your findings, it is time consuming and requires expertise in match-
ing the research with the technology in a meaningful way. Some researchers also
prepare a written summary of the key points of the study to accompany their pre-
sentation (Mayer & Moreno, 2002).
Performance Presentation
Another creative format for presenting your findings is through art or dramatic
performance. Through drawing, dance, song, drama, or other artistic means you
the actual events revealed in the study and participants’ own words, you illustrate
8. Writing, Sharing, and implementing the Research Findings 233
your insights and understanding. This format invites the audience members into
the participants’ world and allows them to see through participants’ eyes. If you
consider using this format, be aware that it requires a great deal of imagination,
creativity, and hard work (Delamont, 2012; Denzin, 2003; Glesne, 2010; Holmes,
2012; Sikes, 2012).
action research study. Your choice depends on the purpose of your presentation,
your audience, your own inclination and level of comfort, and time constraints. If
you conducted your research project as part of course or workshop requirements,
consult the guidelines given to you by your instructor.
several action researchers who were introduced to you earlier: Simone, Sharon,
Jeanette, Jesse, Audrey, and Antonio.
During the year-end review, Simone, the third-grade teacher who explored
the relationship between her students’ homework completion rate and their
scores on a math test, presented a formal research report as evidence of her
A poster presentation was the choice of Sharon, a middle school teacher, and
her committee, for their presentation to the school board on how moral
values were taught in school. Since there was a short amount of time given
for their presentation, they felt that a poster would be the most appropriate
means to present their findings clearly and succinctly.
Jeanette, a kindergarten teacher, focused her research on developing ways
to improve students’ ability to set goals for themselves and become self-
the spring, she presented the results of her research that focused on docu-
menting her students’ growth. Her evidence included a portfolio binder
that contained items from the students’ own portfolios.
While interviewing for a new teaching position, Jesse, the student teacher who
studied different styles of classroom management, used a digital portfolio
to present his findings in order to highlight his qualifications for the job.
grade teacher, studied the efficacy of a new computer soft-
Audrey, a second-
the effectiveness of the new software, Audrey used electronic media. She
maintained a wiki during the year where she embedded videos of students
234 action RESEaRcH in Education
using the new software, interviews with students, and students’ weekly
vocabulary test scores. Audrey presented this ongoing research project on
the school website and invited feedback and comments from colleagues,
students, and parents.
Antonio is the middle school counselor who conducted a study on the phe-
nomenon of bullying in his school. He chose performance presentation to
maximize the impact of his findings. He wrote a student play based on his
data that was presented to the school community.
Clearly, there are multiple options for you to present your research. In this
chapter, we introduced you to some of the most popular ways. These are summa-
shARinG the ReseARch FindinGs
One of the greatest contributions of action research is that it encourages educators
based knowl-
edge. Sharing practice-oriented research allows educators to speak in their own
tABle 8.2. Research Presentation options
Presentation format
Brief description
Formal research report
A written report following a traditional structure and order of
sections and content, similar to that found in published articles and
reports
Poster A visual display of the study that allows the action researcher to
stand beside it and verbally explain the study to the audience
Research portfolio A collection of rich data (such as students’ work, lesson plans,
and field notes), accompanied by the researcher’s reflections,
explanations, and insights
Electronic media A means to tell the story of the study using a dynamic integration of
audio and visual presentations
Performance presentation A means of presenting the study through art or other dynamic
performance (such as dance, song, or drama)
8. Writing, Sharing, and implementing the Research Findings 235
voice, take control of their work, and contribute to the creation of a vital body of
knowledge (Altrichter et al., 2008).
outside authoritative experts for the purpose of generalizing knowledge that can
be transmitted top-down to multiple settings. By comparison, action research is
conducted by educators in their own settings. Acknowledging the complexity and
solutions nor offer prescriptions for others to follow.
be “real research” and feel reluctant to expose your investigation to a peer review.
Nevertheless, action researchers like you have recognized the benefits of sharing
their research and learning from one another. It is important to note that action
research conducted by school practitioners has resulted in a shift in how educa-
tional research is viewed.
that other practitioners face. Making your study available to others can help your
colleagues gain new insights into their own practice. Your study may allow them
to think about their work taking a multifaceted perspective and present new direc-
tions for future action (Hopkins, 2008).
many different audiences so that colleagues in your local educational setting and
beyond can learn from your work. As a first step to disseminating your study,
you can build your confidence by talking to your close colleagues, students, and
parents about your research project and what you have learned. You may also
want to share the results of your investigation with those who participated in your
more formal mode. Professional development days organized by your school or
district may be good venues for sharing your findings within the local community.
Another option is to offer a workshop or to exhibit your study in a local teacher
center. Local events and presentations such as these allow you to advance the issue
you investigate and perhaps encourage some of your colleagues in collaboratively
expanding and exploring the issue in the future (Holly et al., 2009).
community and present your research project to a larger educational audience of
professional colleagues in state, regional, or even national conferences. Present-
a specific subject that is related to your study topic) would be a good next step.
You will probably feel more comfortable sharing your inquiry with colleagues,
236 action RESEaRcH in Education
who, like you, are interested in finding ways to improve their practice through
action research. Many national professional associations also sponsor regional
and state conferences. You may find it less stressful to present in these familiar
venues, and you will probably have a better chance of getting your proposal
accepted. In most cases you will be required to submit a proposal in which you
highlight the purpose of your study, its significance, and its contributions to your
If you want to enhance the impact of your research agenda and increase your
reach to wider audiences, consider publishing your study. The options for dissemi-
nating your written report electronically include publishing in a newsletter, news-
paper, or journal. As you prepare your study for publication, bear in mind that
these outlets expose your writing to different audiences; you will want to choose
the appropriate style, length, and depth for your writing (Mills, 2011; Stringer,
2008).
paper published, we suggest that you submit your writing first to a small local pub-
lication. Excellent places to start are parent newsletters, local papers, or district or
school websites. Another option is newsletters published by professional associa-
tions at a local or regional level.
reviewed jour-
nal. You need to target a journal that is suited for your topic. Check the websites
of national professional organizations, as well as their regional affiliates, to find
journals that specialize in the topic of your study. Once you have identified several
potential publications find out as much as possible about each. Familiarize your-
self with the content and style of previous articles published in that publication
print and online that are devoted to publishing action research that may be good
outlets for your study. Furthermore, if you are interested in publishing in the jour-
nal of a professional organization, be aware that their rate of acceptance is usually
lower than for those journals published at the state or regional level. Table 8.3
contains a list of journals, with a brief description of each journal as well as the
journals’ website information.
scrutinize its manuscript submission guidelines. These guidelines can often be
found on the journal’s website. We advise you to follow these closely.
research are summarized in Table 8.4.
8. Writing, Sharing, and implementing the Research Findings 237
tABle 8.3. journals with a Focus on Action Research in education
name
Description Website url
Print journals
Action Research An international, interdisciplinary, http://arj.sagepub.com
peer-reviewed quarterly that provides
a forum for the development of
research
ALARA Journal Contains project reports, reflectionswww.alara.net.au/publications/
on seminars and conferences, journal
articles related to the theory and
practice of action learning, action
research, and related approaches
International JournalA forum for discussions about actionwww.ctu.edu.vn/institutes/mdi/
of Action Research research, from both its present ntth/VN/PRA/PRA-013.pdf
journal, appearing three times a year.
Electronic (online) journals
Networks: An OnlineAn online journal for sharing http://journals.library.wisc.edu/
Journal for Teacher reports of action research in which index.php/networks
Research
postgraduate, reflect on classroom
practice
Wisdom of Practice:Online journal dedicated to sharinghttp://research.vancouver.wsu.edu/
An Online Journal action research conducted in K–12journal-of-action-research
educational settings
Educational Action A free, peer-reviewed journal for www.tandf.co.uk/journals/
Research
teachers exploring the unity between
educational research and practice
238 action RESEaRcH in Education
tABle 8.4. ideas for sharing Your Action Research
means
Advantage
Share within your local community
Informal; allows you to build your confidence
Present at professional development Semiformal; allows you to advance your topic and
days or workshops encourage others to pursue this or similar topics
Present at local, state, or national Formal; allows you to share your research with
conferences interested colleagues outside your school setting
Publish your research in a local Formal; contributes to your career and allows you to
newsletter or publication be active in your professional community
Publish your research in peer-reviewed Very formal; helps you gain recognition for being
professional literature, following the published and earn a highly prestigious and rewarding
guidelines of the publication professional status
imPlementinG the ReseARch FindinGs
While it is of great importance to disseminate your study to other professionals,
ultimately the purpose of action research is to take action in your own classroom
or school. For action researchers the linkage between one’s research and practice is
vital. The knowledge and information generated through your investigation should
not be confined to reflections and communications. Findings from your study that
recommendations generated by your inquiry that propose ways to improve your
work, should inform the decisions you make about your practice (Altrichter et al.,
2008).
findings—
a new cycle of inquiry begins, with more questions to pursue and addi-
action you need to monitor the impact of these actions. It is possible that your
intended objectives will not be fully achieved or that new, unforeseen problems
will present themselves. In these cases, some modifications will be required.
dent teacher, was excited to implement his action research findings in his new
grade teacher. Because his study led him to the conclusion that a
8. Writing, Sharing, and implementing the Research Findings 239
democratic classroom reflects his educational values and objectives, he enthusiasti-
cally implemented the classroom management methods and procedures advocated
by this approach. However, in reality, things turned out to be more complicated
than Jesse expected. Several of his students mistook the democratic sharing of
responsibilities as a sign of his weakness and inexperience and interrupted the
class. Worried about his declining effectiveness, yet not willing to compromise his
project. The focus of the new cycle of inquiry is on finding additional methods of
classroom management to enforce students’ discipline and respect for classroom
rules within a democratic and civil environment.
was satisfactorily answered, the action researcher may embark on a new study that
builds on the information and understanding generated by the previous investiga-
tion. For example, Sharon and her committee completed their inquiry into the
values that are taught in their school through language arts and social studies
classes. On the basis of their findings and conclusions, the team launched a follow-
up study that focused on developing a revised curriculum to improve how values
are taught. This curriculum also includes methods and benchmarks to assess and
monitor its effectiveness. Similarly, a new study may be initiated as the original
action research is completed, and as a consequence of what you have learned while
conducting the study, new, unexpected questions have risen that lead to a different
focus.
you realize that the journey is not complete; in fact, it is just beginning. You may,
for example, finish a research project as part of your course requirements and
research questions were not fully answered. However, you are so intrigued about
the topic that you decide to continue to pursue it on your own.
study to the next, as the answer to one research question leads to new questions.
This cyclical process is, in fact, an ongoing looping of learning. By taking owner-
ship of the improvement of your practice, you construct and reconstruct the ques-
tions you want to explore and the inquiries you intend to pursue. These questions
guide your personal and professional growth as you incrementally extend your
skills, experiment with new ideas, and critically reflect on and learn from your
growing knowledge, action research
provides you with a framework for authentic change that is tailored to your stu-
240 action RESEaRcH in Education
directed professional development (Hopkins, 2008; Stringer,
of autonomous, self-
2008)
comPletinG the Action ReseARch PRoject
You may want to celebrate the end of this research journey by reflecting with a
friend or a research colleague on the following questions:
1. What were the most important insights and knowledge you gained in your
investigation?
2. What questions were not answered or were answered only partially in your
study? What new questions emerged?
3. How will the research project impact your practice?
4. What have you learned about yourself, your students, your colleagues, and
your school as a result of the research experience?
5. What lessons have you learned that will enable you to plan more effective
action research in the future?
6. What are some of the ways you can share your study with others?
7. Will you continue conducting action research? Why? Why not?
BecominG A PARt oF the ReseARch communitY
Throughout the book, as we discussed each stage of the action research process,
we highlighted the value of working in research groups and sharing your research
with colleagues. Being part of an action research community will provide you with
opportunities to talk about your experiences openly and candidly, share your suc-
cesses as well as disappointments and doubts, raise questions, discuss possibilities,
minded
action researchers can reenergize you when you’re in doubt, support and encour-
age you when you need it, and challenge you to extend yourself and to continue
developing as an action researcher!
pose. You may form or join a research group within your school and together
develop a common research focus that will serve as an engine for moving forward
8. Writing, Sharing, and implementing the Research Findings 241
in bringing about a change and improvement within your school setting. Another
option is to become part of a research group comprising colleagues in your school,
district, or university. While each member may have a different research agenda,
all share your commitment and interest in research (Holly et al., 2009). A third
possibility is to create dialogues with action researchers outside of your immediate
circle. This can be accomplished through the use of technology to converse about
& Gregory, 2008).
the skills you have acquired, you will be able to navigate the action research cycle
on your own. You must be proud of your accomplishments: mastering the skills
of planning a study, collecting and interpreting data, and putting into action the
knowledge you have gained. We hope that action research becomes an integral
part of your professional life as a school practitioner. We trust that it will lead you
to become a change agent and a leader within your school community.
Chapter Summary
1. Practitioners involved in action research need to document their study and produce a
reflection enhances their ability to organize their thoughts,
crystallizes their understanding of the study’s results, and presents clearly and convinc-
2. The introduction to a formal written report presents the topic of the study, the questions
explored in the study, and the rationale for the inquiry and its significance.
3. The literature review section provides a summary of existing research on the study’s
topic; it includes an analysis and synthesis of the studies that were reviewed, highlight-
ing controversies or points of agreement between researchers, as well as gaps in knowl-
edge.
4. The methodology section describes the procedures for conducting the study and usu-
ally includes several subsections: site and participants, data collection procedures,
researcher role, and data analysis.
5. The findings and results section reports the study’s qualitative and quantitative results,
as they relate to the study’s questions (and hypotheses, if any).
6. In the discussion and implications section, researchers revisit their research questions
and hypotheses, examine the data they collected and analyzed, explain the implications
of their findings for their practice, explain where their findings confirm or contradict
242 action RESEaRcH in Education
those reported by others, acknowledge the study’s limitations, and offer suggestions for
future research.
7. In the references, list all the sources that were cited or quoted in the study; that is, all
the studies that were cited in the text should be listed in the reference list, and all the
sources listed in the reference list should have been cited in the text.
8. The appendix often includes parts of the report that are too detailed or too long to be
included in the report itself, clearly ordered and labeled.
9. Besides using the common traditional written report of the findings, action researchers
can use other means to communicate their findings, such as poster presentations, port-
10. One of the greatest contributions of action research is that it encourages educators to
learn from one another by sharing and advancing their experience- based knowledge.
11. Practitioners who conduct action research may want to publish their complete study in
reviewed journal; there are several print and online journals that are devoted to
publishing action research that may be good outlets for their studies.
12. For action researchers the linkage between one’s research and one’s practice is vital,
and the ultimate purpose of this research is to enable practitioners to take action in their
own classrooms or schools.
13. As the cycle of action research ends with the implementation of the study’s findings, a
new cycle of inquiry may begin, with more questions to pursue.
14. Being part of an action research community provides educators with opportunities to
talk about their experiences openly and candidly, share their successes as well as disap-
pointments and doubts, raise questions, discuss possibilities, refine ideas, and exchange
Chapter exerCiSeS and aCtivitieS
1. Develop an outline for your action research report. Write a few sentences to describe
what you will include in each section.
2. Deliberate on the possible significance of your research study. How does it contribute
to your own practice and professional growth? What are some ways that you think
8. Writing, Sharing, and implementing the Research Findings 243
3. As you conclude the research journey, reflect on how you can implement the findings
in your practice. Consider some of the steps required to put your findings into action.
4. If you had a chance to continue studying the same topic or designing a new research
project, what changes might you make that will enable you to conduct more effective
5. Using the ideas for sharing your research project with other practitioners (see Table
8.4), choose one or two possible ideas and explain the reasons for your choice. In
reflect the nature of the study and your target audience.
AdditionAl ReAdinGs
McNiff, S. (1998). Art-based research. London: Kingsley.
Norris, J. (2009). Playbuilding as qualitative research: A participatory art-based perfor-
mance. Walnut Creek, CA: Left Coast Press.
Theron, L., Mitchell, C., & Smith, A. (Eds.). (2011). Picturing research: Drawing on visual
methodology. Rotterdam, The Netherlands: Sense.
weBsites FoR PResentinG Action ReseARch
Poster Presentation
Adventures in poster making:
Poster presentations (University of Buffalo Libraries):
http://library.buffalo.edu/asl/guides/bio/posters.html
Creating effective poster presentation (North Carolina State University):
www.ncsu.edu/project/posters/NewSite
Poster session tips (Pennsylvania State University):
www.personal.psu.edu/drs18/postershow
Providing poster session (UMDNJ Center for Teaching Excellence):
http://cte.umdnj.edu/career_development/career_posters.cfm
Portfolio Research Presentation
Directions for research and development on electronic portfolio:
www.cjlt.ca/index.php/cjlt/article/view/92/86
244 action RESEaRcH in Education
Research Portfolio— Faculty Web Pages
http://faculty.tamu-
commerce.edu/scarter/research_portfolio.htm
Multimedia Presentation
Multimedia presentation (EduTech Wiki)
Designer eLearning:
for-
http://designerelearning.blogspot.co.il/2005/09/mayers- principles- design- of-html
References
Abbott, M. L. (2011). Understandi
ng educational statistics using Mic
rosoft Excel and
SPSS. San Francisco: Wiley.
tronic portfolios. Canadian Journal
of Learning and Technology, 31(3),
1–15.
(Ed.), Handbook of qualitative rese
arch in education (pp. 241–251).
Cheltenham,
UK: Elgar.
spaces. Mahwah, NJ: Erlbaum.
work: An introduction to action res
earch across the professions. New
York: Rout-
ledge.
logical Association (6th ed.). Washin
gton, DC: Author.
Andrew, M., Squire, C., & Tambou
245
kou, M. (2008). Doing narrative re
search. London:
Sage.
IL: Waveland Press.
and educational research: Towa
rd critical social explanation. New Y
ork: Routledge.
Apple, M., & Beane, J. A. (2007).
Democratic schools: Lessons in po
werful education.
246 References
Atweh, B., Kemmis, S., & Weeks, P. (1998). Action research in practice: Partnership for
social justice in education. New York: Routledge.
New York: Teachers College Press.
K. A., et al. (2005). Democracy and diversity: Principles and concepts for educating
citizens in a global age. Seattle: Center for Multicultural Education, University of
Bauer, S. C., & Brazer, D. (2012). Using research to lead school improvement: Turning
evidence into action. Thousand Oaks, CA: Sage.
Bazeley, P. (2007). Qualitative data analysis with NVivo. Thousand Oaks, CA: Sage.
Bloom, B., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Tax-
I: Cognitive domain. White Plains, NY: Longman.
to theory and methods (5th ed.). Needham Heights, MA: Allyn & Bacon.
Chicago: University of Chicago Press.
versity Press.
development. Thousand Oaks, CA: Sage.
based approach. Mal-
den, MA: Blackwell.
Handbook of research in second language teaching and learning (pp. 40–56). New
York: Routledge.
Berkshire, UK: Open University Press.
multicultural course: The message or the method? Journal of Teacher Education,
55(4), 325 –340.
UK: Policy Press.
man.
London: Sage.
development in education. London: Chapman.
References 247
Campbell, E. (2003). Moral lessons: The ethical role of teachers. Educational Research
and Evaluation: An International Journal on Theory and Practice, 9(1), 25–50.
38(4), 357–383.
Noffke & B. Somekh (Eds.), Handbook of educational action research (pp. 74–84).
London: Sage.
for student learning: Doing it right—using it well (2nd ed.). Upper Saddle River, NJ:
Pearson.
tative analysis: Methods for the 21st century. London: Sage.
Sage.
sand Oaks, CA: Sage.
tative research. San Francisco: Jossey-Bass.
Smith, M., & Lytle, S. L. (1993). Inside/outside: Teacher research and knowl-
edge. New York: Teachers College Press.
Smith, M., & Lytle, S. L. (1999). The teacher research movement: A decade later.
Educational Researcher, 28, 15–25.
Smith, M., & Lytle, S. L. (2009). Inquiry as stance: Practitioner research for the
next generation. New York: Teachers College Press.
New York: Routledge.
statistical reasoning in education (3rd ed.). Hoboken, NJ: Wiley.
dures for developing grounded theory (3rd ed.). Thousand Oaks, CA: Sage.
Press.
approaches (3rd ed.). Thousand Oaks, CA: Sage.
tative and qualitative research (4th ed.). Upper Saddle River, NJ: Prentice Hall.
Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods
Currie, D., & Kelly, D. M. (2012). Group interviews: Understanding shared meaning and
meaning making. In S. Delamont (Ed.), Handbook of qualitative research in educa-
248 References
Dana, N. F., & Yendol- Hoppey, D. (2009). The reflective educator’s guide to classroom
ed.). Thousand Oaks, CA: Corwin Press.
research. Thousand Oaks, CA: Sage.
(Ed.), Handbook of qualitative research in education (pp. 550–561). Che
ltenham,
UK: Elgar.
tury. Thousand Oaks: Sage.
Denzin, N. K. (2009). Qualitative research under fire: Toward a new para
digm dialogue.
Walnut Creek, CA: Left Coast Press.
methodologies. Thousand Oaks, CA: Sage.
(2nd ed.). Walnut Creek, CA: AltaMira Press.
tion. New York: Macmillan.
later works: Vol. 5. 1929–1930 (pp. 3– 40). Carbondale: Southern Illinois
University
Press.
of Education, 46(1) , 1 27 – 1 37.
teaching. In P. B. Joseph & G. Farrell (Eds.), Images of school teachers
(2nd ed.,
pp. 75–92). New York: St. Martin’s Press.
Recent thematic shifts and their implications for research on teaching. In V.
Richard-
son (Ed.). Handbook of research on teaching (4th ed., pp. 209–225). Wa
shington,
DC: American Educational Research Association.
Press.
York: Routledge.
CA: Sage.
tion (Vol. II). London: Cambridge Scholars.
References 249
techniques for your classroom. Alexandria, VA: Association for Supervision and Cur-
riculum Development.
Foddy, W. (1993). Constructing questions for interviews. Cambridge, UK: Cambridge
University Press.
Fox, M., Martin, P., & Green, G. (2007). Doing practitioner research. London: Sage.
Fraenkel, J., Wallen, N., & Hyun, H. (2011). How to design and evaluate research in edu-
Frank, C. (1999). Ethnographic eyes: A teacher’s guide to classroom observation. Ports-
mouth, NH: Heinemann.
ment: A field guide. New York: Teachers College Press.
A handbook of ideas for action. London: Alliance Publishing Trust.
Gall, M. D., Gall, J. P., & Borg, W. R. (2006). Educational research: An introduction (8th
ed.). White Plains, NY: Longman.
made assessments: How to connect cur-
riculum, instruction, and student learning. Larchmont, NY: Eye on Education.
analysis and applications (10th ed.). Boston: Addison- Wesley.
sciences. Cambridge, MA: MIT Press.
Gillies, R. M., & Ashman, A. F. (2010). The teacher’s role in implementing cooperative
learning in the classroom. New York: Springer.
Sociology Press.
Longman.
man.
cratic people. Boulder, CO: Paradigm.
gent bilingual writing: Lessons from first-grade dual language classrooms. Journal of
Early Childhood Literacy, 6(3), 323–354.
Hill.
250 References
Greene, M. (1978). Landscapes of learning. New York: Teachers College Press.
change. San Francisco: Jossey-Bass.
method. Thousand Oaks, CA: Sage.
in research. Qualitative Inquiry, 10(2), 261–280.
researchers (2nd ed.). New York: Teachers College Press.
New York: Teachers College Press.
versity of New York.
approach (3rd ed.). Upper Saddle River, NJ: Pearson.
practitioner research (2nd ed.). Thousand Oaks, CA: Corwin Press.
York: Guilford Press.
Holley, K. A., & Colyar, J. (2009). Rethinking texts: Narratives and the construction of
qualitative research. Educational Researcher, 38(9), 680 – 686.
ling the yellow brick road (3rd ed.). Upper Saddle River, NJ: Pearson.
of qualitative research in education (pp. 562–576). Cheltenham, UK: Elgar.
Open University Press.
Jarvis, P. (1999). The practitioner- researcher: Developing theory from practice. San Fran-
cisco: Jossey-Bass.
special education and remedial students. Exceptional Children, 69(3), 279 –292 .
Johnson, A. P. (2011). A short guide to action research (4th ed.). Upper Saddle River, NJ
:
Johnson, R. S. (2009). Developing portfolios in education: A guide to reflection, inquiry
and assessment. Thousand Oaks, CA: Sage.
Delta Kappan, 85, 34– 66.
gies in social science research. In A. Tashakkori & C. Teddlie (Eds.), Handbook of
References 251
mixed methods in social and behavioral research (pp. 351–384). Thousand Oaks,
CA: Sage.
Educational Researcher, 34(8), 14 –20.
CA: Sage.
Press.
learning and small group individualized instruction for math in a self contained class-
room for elementary students with disabilities. Educational Research Quarterly,
24(3), 41–56.
interviewing (2nd ed.). Thousand Oaks, CA: Sage.
Boston: Sense.
it. San Francisco: Jossey-Bass.
research: An introduction (2nd ed.). Lanham, MD: AltaMira Press.
Internet in a focused ethnography. International Journal of Qualitative Methods,
7(3) 31– 46.
34–46.
step guide. London: Sage.
Lofland, J. Snow, D. A., Anderson, L., & Lofland, L. H. (2005). Analyzing social settings:
A guide for qualitative observation and analysis (4th ed.). Belmont, CA: Wadsworth.
win Press.
Marshall, C., & Rossman, G. B. (2011). Designing qualitative research (5th ed.). Thou-
sand Oaks, CA: Sage.
dria, VA: Association for Supervision and Curriculum Development.
Thousand Oaks, CA: Sage.
ing and Instruction, 12, 107–119.
252 References
McMaster, K. N., & Fuchs, D. (2002). Effects of cooperative learning on the academic
Sniezek’s
review. Learning Disabilities Research and Practice, 17(2), 107–117.
B o t s n d o o - : e s y A d i s n W le .
(7th ed.). Boston: Pearson.
UK: Routledge.
ed.). London: Sage.
empowerment. American Educational Research Journal, 42, 639– 670.
education. London: Sage.
Francisco: Wiley.
San Francisco: Jossey-Bass.
ed.). Thousand Oaks, CA: Sage.
Boston: Sage.
& D. Keiser (Eds.), Teacher education for democracy and social justice. New York:
Routledge.
(2nd ed., pp. 196–218). New York: Routledge.
Thousand Oaks, CA: Sage.
teaching (10th ed.). Upper Saddle River, NJ: Prentice Hall.
Saddle River, NJ: Pearson.
Moore, D. S., McCabe, G. P., & Craig, B. A. (2010). Introduction to the practice of statis-
tics (7th ed.). New York: Freeman.
CA: Sage.
(3rd ed.). New York: Routledge.
References 253
Nitko, A., & Brookhart, S. M. (2010). Educational assessment of students (6th ed.). Upper
Saddle River, NJ: Prentice Hall.
tion. New York: Teachers College Press.
Noddings, N. (2003). Happiness and education. Cambridge: Cambridge University
Press.
sis. In S. Hollingsworth (Ed.), International action research: A casebook for educa-
tional reform. London: Falmer Press.
ing the sampling process more public. Qualitative Report, 12(2), 238–254.
Opdenakker, R. (2006). Advantages and disadvantages of four interview techniques in
Research, 6(2), Art 11. Retrieved from www.qualitative-
article/view 175/ 392.
Osterman, K. F., & Kottkamp, R. B. (2004). Reflective practice for educators: Profes-
sional development to improve student learning (2nd ed.). Thousand Oaks, CA: Cor-
win Press.
San Francisco: Jossey-Bass.
Teachers College Press.
Oaks, CA: Sage.
Peshkin, A. (2001). Angles of vision: Enhancing perception in qualitative research. Quali-
tative Inquiry, 7, 238–253.
context, and self-study (2nd ed.). New York: Routledge.
CA: Sage.
Upper Saddle River, NJ: Pearson.
of qualitative research in education (pp. 426– 443). Cheltenham, UK: Elgar.
Pritchard, I. A. (2002). Travelers and trolls: Practitioner research and institutional review
Rallis, S. F., & Rossman, G. B. (2012). The research journey: Introduction to inquiry.
New York: Guilford Press.
254 References
Ravid, R. (2011). Practical statistics for educators (4th ed.). Lanham, MD: Rowman &
Littlefield.
Oaks, CA: Sage.
parts. Journal of Curriculum Studies, 33(6), 631– 637.
in education (pp. 391– 404). Cheltenham, UK: Elgar.
-observation. Thousand Oaks, sel
CA: Sage. f
CA: Sage.
Thousand Oaks, CA: Sage.
tions (7th ed.). Columbus, OH: McGraw-Hill.
demic achievement for students with EBD. Remedial and Special Education, 25(6),
330 –341.
school teams. Thousand Oaks, CA: Corwin Press.
friendly tests. Educational Leadership, 69(3), 52 –58.
Salend, S. J. (2011). Creating student-
Samaras, A. P. (2011). Self-study teacher research: Improving your practice through col-
laborative inquiry. Thousand Oaks, CA: Sage.
Barker & S. Rebelsky (Eds.), Proceedings of World Conference on Educational Mul-
timedia, Hypermedia and Telecommunications 2002 (pp. 673–674). Chesapeake,
www.editlib.org/p/10095.
tions, sampling, design, and analysis. Hoboken, NJ: Wiley.
class bias of democratic the-
ory in education. Teachers College Records, 110(2), 405– 442.
tion and the social sciences (4th ed.). New York: Teachers College Press.
Saddle, NJ: Pearson.
Rowman & Littlefield.
References 255
Sikes, P. (2012). Dance: Making movement meaningfully. In S. Delamont (Ed.), Handbook
of qualitative research in education (pp. 577–590). Cheltenham, UK: Elgar.
Somekh, B., & Zeichner, K. (2009). Action research for educational reform: Remodeling
action research theories and practices in local contexts. Educational Action Research,
17(1), 5 –21.
Spring, J. (2010). American education. New York: McGraw-Hill.
Steinberg, S. R., & Cannella, G. S. (2012). Critical qualitative research reader. New York:
Lang.
Heinemann.
involved assessment FOR
learning (6th ed.). Boston: Addison- Wesley.
Stringer, E. T. (2008). Action research in education (2nd ed.). Upper Saddle River, NJ:
Pearson.
cisco: Jossey-Bass.
and behavioral sciences. Thousand Oaks, CA: Sage.
learning in real classrooms (2nd ed.). Upper Saddle River, NJ: Pearson.
grating quantitative and qualitative approaches in social and behavioral sciences.
Thousand Oaks, CA: Sage.
(2nd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.
Tomlinson, C. A., & Eidson, C. C. (2003). Differentiation in practice: A resource guide
sion and Curriculum Development.
standing by design: Connecting content and kids. Alexandria, VA: Association for
Supervision and Curriculum Development.
porary perspectives (6th ed.). New York: McGraw-Hill.
Tyack, D. B. (1974). The one best system: A history of American urban education. Cam-
bridge, MA: Harvard University Press.
256 References
Van Manen, M. (1994). Pedagogy, virtues, and narrative identity in teaching. Curriculum
Inquiry, 24(2), 135–170.
introduction to using critical event narrative analysis in research on learning and
teaching. New York: Routledge.
tional research. In S. Delamont (Ed.), Handbook of qualitative research in education
(pp. 325–341). Cheltenham, UK: Elgar.
Wolcott, H. F. (2008). Writing up qualitative research (3rd ed.). Thousand Oaks, CA:
Sage.
remembers. Newsletter of the Society for Integrative and Comparative Biology, Fall,
10 –11.
school students
with learning disabilities to recruit peer assistance during cooperative learning group
activities. Learning Disabilities Research and Practice, 16(3), 161–173.
ledge.
Sage.
author index
Abbott, Bogdan, Clarke, R. C.
M. L., 2 C., 40, 88, , 197
06 173, 176, Cobb, C. D.,
Abrami, 17 7 197
P. C., 23
2
149, B Cohen, L.,
156, B 62, 92, 12
159 3
Bri Coladarci,
Albe sk,
r, S. T., 197
M. Collier, J.,
R., 2 E.,
6 5
19
Alle Bro
n, L., Col
okfi yar,
94 eld,
Alsu J.,
S. 42
p, J., D.,
28 Co
28 nne
Bro lly,
Anderson, okh
L., 88 F.,
art, 42
Andres, L S.
., 109 M.,
Andrew, Core
143 y, S.,
M., 42
Angrosin 6
Bro Crai
o, M. V., phy
88 g, B.
, J. A., 2
Anser- E.,
Self, K., 2 02
86,
06 87
Antil, L.
257
R., 26 21
1,
21
2
Cu
rri
e, ,
D.
Apple, B , K., 225,
M., 25 r 230
Arhar, J C Carr, W.,
. M., 5 a 43
Ashman m
, A. F., p 14
26 b 9,
e 15
At l 6
we l
h, ,
B., A
7 .
Ay ,
ers 1
, 2
W. 5
, 2
8 C
a
Banks m
, J. A. p
, 25 b
Barre e
tt, H., l
232 l
Bartle ,
tt, S., E
2 .
Bauer ,
, S. C. 2
, 7 8
Baum
field, C
V., 7 a
n
n
e
l
l
a
,
G
.
S
.
,
4
3
C
a
r
r
D 7 y, J., 4, 2
a , 5
Del 8
am 8 Dillma
ont, n, D. A
S., D ., 115
233 e
w Edel
DeWalt, e stein
B. R., 8 , W.,
7, 88 25
DeWalt, Efro
K. M., 8 n, S.
, 28
Beane
, J. A. 1 Eisen
, 25 hart,
Benn M., 4
ett, A 2
., 42 Eliot,
D., 2
Bloom, B., Ch
140, 141 eck Elliott,
Bock, M. , R. J., 4
A., 214 , 8
5
Cla
ndi
nin
, D
. J.,
42
258 author index
Engelhart, M. D., 140 Holley, K. A., 42 Martin, P., 2
Epstein, M. H., 26 Marzano, R. J., 7
Holmes, R., 233
Feldman, A., 6 Holstein, J. A., 101 Mayer, E. E., 232
Fenstermacher, G. D., 28 McCabe, G. P., 202
Fink, A., 107, 116 Howard, V. F., 26 McDaniel, B. L., 25
Firmin, M. W., 42 McEvoy, B. T., 21, 27
Huck, S. W., 226, 228 McLaughlin, T. F., 26
Fisher, S., 138, 155 Huddleston, T., 25 McMaster, K. N., 26
Flick, U., 171, 176 Hulme, M., 2
Foddy, W., 101 185, 190, 203, 204, 226
Fowler, F. J., 109 McNamara, O., 125
Fox, M., 2 Jarvis, P., 2, 7 McNiff, J., 4, 7
Jenkins, J. R., 26 McQuillan, P. J., 25
Frank, C., 87, 100, 101 Johnson, A. P., 7, 215 McTighe, J., 16
Frank, S., 25
155 Merriam, S. B., 40, 85, 166, 167
Frey, N., 143, 153, 156 Mertler, C. A., 3, 7, 43, 45, 64, 73, 74,
Fuchs, D., 26 Jones, M., 7
Joseph, P. B., 28 225
Mertova, P., 42
Gall, J. P., 3 Kahne, J., 25
Kasten, W. C., 5 Mikel, E. R., 25
Gareis, C. R., 136, 142, 143, 145, 147 Keiser, D., 25
Gay, L. R., 43 Kelly, D. M., 105 Miller, D. M., 136
Kemmis, S., 7, 43
Gibson, W. J., 167, 168, 173, 176, 183 Kemper, A., 66 Minium, E. W., 197
Gillam, L., 57, 71, 125 Moore, D. S., 190, 202
Kottkamp, R. B., 28 Moreno, R., 232
Gilroy, P., 125 Krathwohl, D. R., 140 Morgan, D. L., 105
Glaser, B., 18 Krippendorff, K. H., 214 Morrison, K., 62
Kuhn, T., 40 Myers, J. L., 64
Good, T. L., 86, 87
Goodlad, J. I., 25 Kvale, S., 98, 101, 106 Nihlen, A. S., 2, 6, 7
Gort, M., 19 Nitko, A., 143
Lamprianou, I., 145, 150 Noddings, N., 27, 28
Green, G., 2 Lauer, P. A., 206, 207 Noffke, S. E., 4, 5, 6
LeCompte, M. D., 87
Greene, M., 28 Norris, N., 4
Gregory, D., 241 Leech, N. L., 62
Gronlund, N. E., 136 Lewin, J., 2
Guba, E. G., 183 Lewin, K., 6 Onwuegbuzie, A. J., 62
Gubrium, J. F., 101 Opdenakker, R., 99
Lincoln, Y. S., 43, 183 O’Reilly, K., 87
Ling R., 75 Osterman, K. F., 28
Hall, E., 7
Hancock, D. R., 42 Lofland, J., 88 Palmer, P., 28
Hansen, D. T., 28 Lofland, L. H., 88 Parker, W. C., 25
Lorch, R. F., 64
179, 182 Lytle, S. L., 2, 6, 7 187
Herr, K. G., 2, 6, 7
Hesse-Biber, S. N., 45, 214 Machi, L. A., 21, 27 Phillips, D. K., 225, 230
Madison, D. S., 42 Pine, G. J., 7
Hill, W. H., 140
Hinchey, P. H., 6, 225 Marshall, C., 40, 166, 167, 169, 174, Popham, W. J., 137, 138, 143, 145, 146,
182 , 183, 184 148, 149, 159
author index 259
Posch, P., 6 Schumacher, S., 45, 116, 123, 137, 185, Taylor, C. S., 145, 146, 154
Pressley, M., 236 190, 203, 226 Teddlie, C. B., 45, 66, 211, 213
Prior, L., 123 Tomlinson, C. A., 16
Pritchard, I. A., 74 Schutz, A., 25
Triola, M. F., 199
Rallis, S. F., 57, 125, 184 Senese, G., 25 Tyack, D. B., 25
208, 216
Shermis, M. D., 137, 138, 143, 152 Vadasy, P. F., 26
Reid, R., 26 Sikes, P., 233
Van Manen, M., 28
Richardson, V., 28 Slavin, R. E., 43, 206, 207, 227 Violas, P. C., 25
Robinson, J., 105 Smith, L. T., 43
Rodriguez, N. M., 87, 88 Wall, K., 7
Soder, R., 25 Wallen, N., 44
169, 174, 182 , 183, 184 Somekh, B., 6 Webster, L., 42
Rubin, H., 100, 101 Spradley, J. P., 179 Weeks, P., 7
Rubin, I., 100, 101 Spring, J., 25 Well, A. D., 64
Squire, C., 42
156, 159 Stake, R. E., 42 White, M. L., 94
Ryan, J. B., 26 Steinberg, S. R., 43 Whitehead, J., 4, 7
Stenhouse, L., 6 Williams, J. M., 27
Sagor, R., 7
Salant, P., 115 149, 156 225
Salend, S. J., 143
Salmons, J., 106 Stringer, E. T., 7, 180, 230, 236 Wolford, P. L., 26
Stringfield, S., 66 Wragg, E. C., 86, 87
Scanlon, D., 236
Schär, S. G., 232 152, 153 Yendol-Hoppey, D., 7
Schensul, J. J., 87 Yin, K., 42
Schreiber, J., 206 Tamboukou, M., 42
Tashakkori, A., 45, 211, 213 Zeichner, K., 6
Subject Index
Page numbers followed by f or t refer to figures or tabl
es.
Abbr 172f exercises and activ
eviati 5f–176 ities regarding,
ons, 3 178f 52–53
0 9t, 180
181f
8f, 189
research re 192t, 193Articles for review,
port, 230t 94f, 195 19–21, 36
Accountabi 6f, 197 Artifacts and docu
lity, 135 198f, 200ments in data
202f, 203
09f
research; T
opic for resear conclusions exercises and acti
ch , and implic vities regarding,
characteristics ations, 131–133
of, 7–9 215–216,
17f
a
n r documen
d ts, 123, 1
, 25t
4
9
cyclical steps of
on research and, data analysis, 125t, 126f, 127
8-9, 8f , 188f. See also–131, 128t
Analysis and teacher journals, 1
rpretation of 25–126
exercises and e o
ities regarding, s l
historical perspecti s s
ves, 4–7, 5t m
practitioners as e
earchers, 3– 4 n Analysis and interpr
t etation of data. See
a also Interpretin
s t g data; Presentation
s o of the data
2 139 –141, 140t,
0 c 141f, 142–160,
4 o 142f, 14 4f, 145
– l f, 146f, 147f, 1
2 l 48f,
0 e
5 c
t
i
data analysis, o
91, 201–205, n
202f, 203f.
also Analysis
nd 1
6
a 3
p
p –
r 1
o 6
a 4
c
h
standardized comm
ercial achievement
APA style, 30. tests, 137–139,
so Citation format39t
Appendix section
formal action
8
Reporting 1
– our research 5
9 ings 8
, Approaches to f
search. See also ,
8
f Qualitative 1
proach; 6
itative 0
2 approach t
2
0 qu
– ant
2 itat 140 –
2 ive 141, 14
3 , a 0t, 141
nd f
mi Assess
and, 210 –215, xe ment
210f, 212f, d measur
, me es, 73
214f, 215f tho
ds, choosing an approac
preparation for 48t h for your project
alysis step in, and, 51
168 –177, 169
172f, 175f–176
a 4 8
n 6 f
d ,
,
4
260
Subject index 261
qualitative educational research and, Cause-and-effect relationships Completion items in assessment, 148,
40, 48f experimental studies, 44, 64, 71 148f. See also Assessment data;
participant identification and, 64
43, 48f validity and trustworthiness and, 72 Computing measures of distribution
centers step in quantitative data
129. See also Observational Change, 3, 10 analysis, 191, 197–199, 198f. See
methods of data collection
120–121, 120f, 129. See also data; Quantitative approach
152f, 154t, 155t, 157f, 158f, 160t, Response choices on surveys; Computing measures of distribution
162. See also Assessment data Survey method of data collection
analysis, 191, 199–201, 200f. See
selection process for research problem statement, 17 also Analysis and interpretation of
for choosing a research approach, 50 data; Quantitative approach
Background information, 19–21 for assessing literature review, 31
Background/demographic interview analysis and interpretation of data
217 and, 180, 181f, 182f
methods of data collection
mixed-methods data, 215 221
Graphing data
qualitative data, 189 Conclusions, 225–226. See also
methods of data collection Reporting your research findings
overview, 92–93, 92f, 93f, 129 quantitative data, 209
Ethical guidelines
observations and, 94 in interview, 108
Biases. See also Subjectivity Ethical guidelines
See also Observational methods of Constructivist research, 7, 10
researcher role, 41, 48, 56, 58 data collection Content analysis, 214, 214f
trustworthiness, 70 Content validity, 150 –151, 162
project, 47
survey questions, 112 processi ng, 179, 179f
teacher journal, 125 personal worldview, 49 Control group, 72, 204, 207
research question, 50
formal action research report, 226 81. See also Sample selection
Bloom’s taxonomy, 140 –141, 140t your findings, 185. See also process
Reporting your research findings
choosing a topic for research and, 14 205, 206, 219
developing questions for interviews sources
206
exercises and activities regarding, 82 writing a formal action research
over view, 35 report, 229 also Quantitative approach
Criterion-referenced commercial tests,
Case study approach, 41– 42, 48f, 51. research
See also Qualitative approach Standardized testing
also Observational methods of data
and interpretation of data; collection also Qualitative approach
Preparation for analysis step in Cross-tabulation tables, 196–197,
data analysis 178f, 191–192, 218. See also
Analysis and interpretation of data; Curriculum-based measurement
exercises and activities regarding, Preparation for analysis step in (CBM), 155, 155t, 162, 164. See
221–222 also Assessment data; Teacher-
Collection of data. See Data collection made tests/assessments
178f, 188f, 218 Common qualitative methods, 41– 43.
Causal-comparative (ex post facto)
Community, research, 240 –241 Data analysis. See Analysis and
Quantitative approach Completing the action research project, interpretation of data
Cause-and-effect domain for the
Sharing the findings Trustworthiness of a study
262 Subject Index
Data collection. See also Artifacts historical perspectives, 4–7, 5t Final research report, 63, 78, 184
overview, 2–3, 10 Findings and results section of a formal
Interview methods of data
collection; Observational methods Electronic media, 232, 233–234, 234t, 230t, 241. See also Reporting your
of data collection; Survey method 244. See also Reporting your research findings
of data collection research findings
Survey method of data collection
and, 166 –167 Mixed-methods approach Focus group interview, 105–106, 130.
analysis and interpretation of data
cyclical steps of action research and, collection
8 –9, 8f overview, 46– 47, 48f, 51
Endnote software, 22 Survey method of data collection
131–133 Formal assessments, 136. See also
tabulating data approach step in
34, 34f quantitative data analysis, 191–197, Formative assessment, 136, 142, 162.
192t, 193f, 194f, 195f, 196f, 197t. See also Assessment data
overview, 10, 85–86, 127–131, 128t
research plan and, 56, 79, 80f of data; Quantitative approach Frequency distributions, 192, 192t
Episodic artifacts and documents, Frequency domain for the pattern-
report and, 228
Data entry, 191–192 documents in data collection Frequency polygon, 192. See also
ERIC database, 19 Graphing data
Demographic data, 115
Dependent variables, 44, 77 See also Assessment data; Supply- Gathering background information,
type assessment 8 –9, 8f, 10
91f, 129. See also Observational
methods of data collection exercises and activities regarding, 83 Interview methods of data collection
research plan and, 56, 74 –78, 79, 80f Graphing data
Nonexperimental research
Designing and planning the study, 8–9, Ethnographic research, 42, 48f, 51. See and, 192–196, 193f, 194f, 195f,
also Qualitative approach 196f, 219
Diagnostic assessment. See also
Assessment data in quantitative data analysis, 191, exercises and activities regarding,
205–208. See also Analysis and 222–223
and, 137 interpretation of data; Quantitative
overview, 136, 162 approach histogram, 192
line graph, 195
Digital portfolio, 231–232, 233, 234t, analysis and interpretation of data, 182 pie graph, 194
243–244. See also Reporting your exercises and activities regarding, 222
research findings over view, 218
High-stakes testing, 136, 137–138. See
See also Interview methods of data Experience/behavior interview also Assessment data; Standardized
collection questions, 102. See also Interview testing; Testing
methods of data collection
Trustworthiness of a study Graphing data
Discussion and implication section of a also Quantitative approach Hypotheses, 32, 34f, 206–207
External validity, 72. See also Validity
230t, 241–242. See also Reporting Immersing in the data, 168–169. See
your research findings Extraneous variables, 72. See also also Analysis and interpretation of
Validity of a study data; Preparation for analysis step
in data analysis
EBSCO Host database, 19 Feeling interview questions, 102. See
Educational electronic databases, also Interview methods of data your research findings; Sharing the
findings
Educational research Field notes, 88–90, 89f, 91f, 129. See
approaches to, 39– 40 also Observational methods of data 8 –9, 8f
collection
Subject Index 263
Implications of a study. See Reporting Introduction section of a formal action Measures of distribution variability
your research findings research report, 226–227, 230t, range, 199
241. See also Reporting your
Independent variables, 44, 71, 72 research findings Media, electronic, 232, 233–234,
Informal assessments, 136. See also
Journals, 125–126, 237t. See also research findings
Informed consent, 75, 76, 77. See also Artifacts and documents in data Median, 197, 198, 198f
Ethical guidelines collection
Trustworthiness of a study
defining research and, 2–3, 10 Methodology section of a formal action
research plan and, 55–56, 79 Knowledge interview questions, 102.
scope of, 56, 59– 60 See also Interview methods of data See also Reporting your research
collection findings
237t–238t
Leading questions, 103. See also Analysis and interpretation of data
141f Interview methods of data collection Mixed-methods approach. See
Mixed-methods approach
Internal validity, 72. See also Validity Liker t scales, 116 –118, 116f, 117f, Qualitative approach; Quantitative
118f. See also Response choices on approach
Internet surveys; Survey method of data
collection 210 –215, 210f, 212f, 213f, 214f,
215f
surveys and, 109, 134 Graphing data
websites for presenting action Literature map, 26f and, 219
Literature review
Interpreting data. See also Analysis and 36, 37
interpretation of data 23f, 24f, 25f, 26f
project, 47, 49–50, 50f
8 –9, 8f electronic databases, 19 data collection and, 86
example of, 25f, 26f, 28, 29
exercises and activities regarding, 52–53
223 identifying and organizing themes,
21-23, 23f, 24f, 26f participant identification and, 66– 67
217–2 20 questions in, 33, 35f
online search for sources, 19-20
validating, 182–184 over view, 36 validity and trustworthiness and,
73 –74
14 4, 145f. See also Assessment writing, 25, 27–30, 31f, 36, 37
data; Selection-type assessment writing a formal action research Multiple case study, 41– 42. See also
Case study approach
Interview methods of data collection.
See also Data collection Matching-format items in assessment, 143, 14 4f. See also Assessment
14 4 –146, 146f. See also Assessment data; Selection-type assessment
compared to observational methods of data; Selection-type assessment
data collection, 86 Narrative research, 42, 48f, 51. See also
Measures of association, 201–203, Qualitative approach
developing questions for, 101–103 202f, 203f. See also Analyzing
exercises and activities regarding, legislation, 136, 137–138
analysis Nonexperimental research, 44, 45, 48f,
focus group interview technique,
105–106 also Analyzing the data step in Norm-referenced commercial tests,
quantitative data analysis 137–138, 139t, 162. See also
over view, 68t, 86, 98–107, 100f, 108f,
127–131, 128t 198,198f Note-taking during interviews, 104–
mean 198 105. See also Interview methods of
Interview, structured, semistructured, median 198 data collection
unstructured, 98–99 mode 197
264 Subject index
Observational methods of data safety of, 77 ethical guidelines and, 78
collection. See also Data collection
report and, 227 reporting the study’s results,
exercises and activities regarding, conclusions, and implications,
131–133 interpretation of data; Preparation 215–216, 217f
for analysis step in data analysis
93f, 95f, 96f, 97f, 127–131, 128t thematic format of, 185
process of, 87–88 exercises and activities regarding, 221 thick description and, 186
over view, 17 7, 179 –180, 179t, 218
qualitative approach and, 87–95, 89f, analysis, 167, 188f. See also
91f, 92f, 93f, 95f See also Trustworthiness of a study Analysis and interpretation of data;
Performance assessment. See also Presentation of the data
95–96, 95f, 96f, 97f
steps for, 90 –92 tests/assessments quantitative data analysis, 191,
208. See also Analysis and
123, 125t. See also Artifacts and teacher-made tests/assessments, 162 interpretation of data; Quantitative
documents in data collection Performance presentation of research approach
also Interview methods of data
collection Reporting your research findings Assessment data
Permissions to conduct the study, Primary sources, 19, 36
also Observational methods of data Pro Quest database, 19
collection guidelines Probability, 205–207
Problem identification
123, 122f, 131. See also Survey 123, 125t. See also Artifacts and
method of data collection documents in data collection 13 –14, 36
questions, 102. See also Interview 129. See also Observational 8 –9, 8f
methods of data collection methods of data collection
33–34, 34f, 35f
119, 119f. See also Response data
choices on surveys; Survey method 34f, 35f
of data collection Research plan
statement, 15–17, 15f, 17f
selection process over view, 10
interpretation of data; Preparation
for analysis step in data analysis Research portfolio; Teacher-made example of, 16
tests/assessments
over view, 168, 169 –177, 169f, 172f, framing, 15–17, 15f, 17f
175f–176f, 178f over view, 157, 159 –160, 160t, 163, Process of research
233, 234t
and, 46, 48f
p values, 205–207 231, 233, 234t, 243. See also
Paired samples, 204 Reporting your research findings 41, 48f
Parental permission
Practical significance, 207–208 44, 48f
informed consent and, 75, 76, 77 Practitioner research, 2, 3– 4, 9, 10. See
Participant identification, 56, 60 – 67 choosing an approach for your project
Participants. See also Ethical guidelines Preparation for analysis step in data and, 49
analysis, 167, 168 –177, 169f, 172f,
175f–176f, 188f. See also Analysis and, 46, 48f
informed consent and, 75, 76, 77
in mixed-methods studies, 66 Presentation of the data. See also 40 – 41, 48f
Reporting your research findings
in quantitative studies, 64-66 43, 48f
research plan and, 79, 80f, 81 action research and, 230 –234
chronological format, 185 Sample selection process
Subject index 265
Qualitative approach. See also research plan and, 81, 82 Referencing sources. See also Citation
Approaches to research; Mixed- role of researcher and, 57 format
methods approach scope of inquiry and, 59
writing a formal action research
166 –187, 169f, 172f, 175f–176f, 213f, 214f report, 229
178f, 179t, 180f, 181f, 182 , 188f,
Questionnaires, 109. See also Survey also Observational methods of data
analysis and interpretation of data method of data collection collection
and, 218
103. See also Interview methods of analysis and interpretation of data,
choosing a topic for research and, 36 data collection 184
choosing an approach for your
analysis and interpretation of data Relationship between two or more
data collection and, 86, 127–131, 128t and, 217 variables, 45
exercises and activities regarding, 38,
50, 50f, 51 exercises and activities regarding, 82
literature review and, 18 over view, 73
observational methods of data example of, 33–34, 34f, 35f
exercises and activities regarding, teacher-made assessment tools and,
93f, 95f 150 –151, 151, 162
formulating for your topic for
66t research, 31–34, 34f, 35f, 37 See also Presentation of the data;
Sharing the findings
66t in qualitative studies, 31
in quantitative studies, 32 234t
research plan and, 81, 82 research plan and, 56
role of researcher and, 57 and, 215–216, 217f, 218, 220
scope of inquiry and, 59 method of data collection chronological format, 185
overview, 109, 131 exercises and activities regarding,
213f, 214f
writing the survey items and, 111– overview, 241–242
validity and trustworthiness and, 123, 113f, 114f, 116f, 117f, 118f,
70 –73 188f–189f
Questions for the pattern-seeking
Approaches to research; Mixed- process , 179 thematic format of, 185
methods approach thick description and, 186
Random samples, 64, 66t, 81. See also
166 Sample selection process report, 226–229, 230t
Representative sample, 65– 66, 81. See
and, 190 –208, 192t, 193f, 194f, Rank-ordered responses on surveys,
195f, 196f, 197f, 198f, 200f, 202f, 115, 121, 121f. See also Response Research
assessment and, 161
of data collection historical perspectives, 4–7, 5t
over view, 2 –3
choosing an approach for your 116 –118, 116f, 117f, 118f. See
project, 47, 49–50, 50f Research hypothesis, 206–207
Survey method of data collection Research participants. See Participant
128t Rating scales in observations, 96,
Research partners, 14, 17
52–53 methods of data collection
Rationality domain for the pattern- study
collection and, 95–96, 95f, 96f, 97f
overview, 10 –11, 43– 45, 48f, 51–52 References section of a formal action “to-do” list and, 56, 78, 78f
research report, 229, 230t, 242. ethical guidelines, 56, 74 –78
66t exercises and activities regarding,
findings
266 Subject Index
Research plan (cont.) observational methods of data Short writing-in responses on surveys,
finalizing, 78–79 collection and, 87–88 122, 122f. See also Response
choices on surveys; Survey method
participants, 56, 60 – 67, 66t 41, 48f of data collection
overview, 55–56, 79–82, 80f
43 – 44, 48f 148f. See also Assessment data;
scope of inquiry and, 59– 60 Supply-type assessment
80f
70 –74 64. See also Experimental research
report and, 227 Site for research. See Research site
See also Reporting your research Situational research, 7, 10
findings 158f, 162, 164. See also Assessment
data; Teacher-made tests/ Social life
in mixed-methods studies, 46 assessments
in qualitative studies, 41 mixed-methods educational research
also Observational methods of data and, 46
Research purpose collection
quantitative educational research and, 43
and, 49 Safety of the participants, 77, 83. See Sources. See Referencing sources
also Ethical guidelines Standard deviation, 200 –201, 219
and, 46, 48f Standardized testing, 135, 136, 137–
See also Participant identification
40 – 41, 48f in mixed-methods studies, 66 data; Testing
43, 48f
in quantitative studies, 64-66 Stratified samples, 64, 66t, 81. See also
Sample size, 64 Sample selection process
research
Research site Scope of inquiry. See also Inquiry 95–96, 95f, 96f, 97f, 129. See also
establishing, 59–60 Observational methods of data
exercises and activities regarding, 82 collection
identifying, 60 – 67, 66t Secondary sources, 19, 36
Selection-type assessment. See also 100f, 130. See also Interview
writing a formal action research methods of data collection
report and, 227 evaluation of, 149–152, 150t
See also Artifacts and documents
151–152, 152–153, 152f 146f, 147f, 162 in data collection
Response choices on surveys. See also writing, 142 –143, 142f
Survey method of data collection
of data collection Semistructured interviews, 130. See over view, 111, 131
over view, 131 also Interview methods of data
collection 118f, 119f, 120f
117f, 118f, 119f, 120f Subjectivity, 57
98–99. See also Observational
unstructured responses, 121–123, methods of data collection See also Assessment data
122f Supply-type assessment. See also
also Interview methods of data
122, 122f. See also Response collection evaluation of, 149–152, 150t
choices on surveys; Survey method
of data collection seeking process, 179, 179f writing, 142 –143, 142f
findings
your research findings also Data collection
definition, 39 exercises and activities regarding,
example of, 58 131–133
overview, 10, 225–226, 234 –236,
mixed-methods educational research 237t–238t, 241–242 114f, 116f, 117f, 118f, 119f, 120f,
and, 46, 48f 121f, 122f, 124f, 127–131, 128t
research, 243–244
Subject index 267
tabulating data and, 196–197, 197t identifying for literature review and, Unordered responses on surveys, 115,
websites for, 134 21–22 , 23f 120, 120f. See also Response
choices on surveys; Survey method
113f, 114f, 116f, 117f, 118f, 119f, Theoretical framework, 183 of data collection
120f, 121f, 122f, 124f
Trustworthiness of a study also Interview methods of data
step in data analysis, 167, 177–184, “ To - do” l i s t collection
178f, 179t, 180f, 181f, 188f, 218.
overview, 78, 78f See also Artifacts and documents
of data in data collection
Topic for research
Systematic samples, 64, 66t, 81. See choosing, 13–14 Observational methods of data
also Sample selection process examples of, 14 collection
Table of test specifications, 141, 141f.
See also Assessment data 37–38 qualitative educational research and,
87–95, 89f, 91f, 92f, 93f, 95f
Tally sheets in observations, 95, 95f, 34f, 35f
129. See also Observational 123, 122f, 131. See also Survey
methods of data collection statement, 15–17, 15f, 17f method of data collection
140 –141, 140t 25f, 26f, 31f Validity, content, 150 –151
over view, 35 –37 Validity of a study. See also
Artifacts and documents in data
collection Transforming data into readable analysis and interpretation of data
text, 168. See also Analysis and and, 218
Teacher-made tests/assessments. See
also Assessment data for analysis step in data analysis ensuring, 70–74
Triangulation. See also Trustworthiness
145f, 146f, 147f, 148f, 149f, 150t research plan and, 56, 79, 80f, 81–82
evaluation of, 149–152, 150t analysis and interpretation of data Videotapes in observations, 93, 94 –95,
and, 183, 210, 212–214, 213f, 214f,
selection-type assessment, 143–147, 219 methods of data collection
14 4f, 145f, 146f, 147f Visual mapping, 37
overview, 67, 70 –71
True/false items in assessment, Sample selection process
using, 152–160, 152f, 154t, 155t,
157f, 158f, 160t data; Selection-type assessment Worldview, 49–50, 51
Trustworthiness of a study
action research and, 2, 10 of the data; Reporting your
and, 182 –184, 218 research findings
Technology, 232, 233–234, 234t
Test blueprint, 141, 141f. See also ensuring, 70–74 Reporting your research findings
exercises and activities regarding,
Testing, 135. See also Assessment data; research plan and, 56, 79, 80f, 81–82
Standardized testing t-test, 203–204 overview, 225–226, 241–242
writing a formal action research
findings, 185. See also Reporting for paired samples, 204
your research findings
methods approach Yes/no responses on surveys, 115,
constructing an outline for literature
review and, 23 –24, 23f, 24f, 25f, 26f and, 210, 211–212 , 212f, 219 choices on surveys; Survey method
overview, 47, 48f, 51 of data collection
About the Authors
Sara Efrat Efron, EdD, is Professor of Educati
on at National Louis University,
where she teaches courses in qualitative researc
h, curriculum studies, and foun-
interest include teacher research, the role of the te
acher’s personal voice, and moral
democratic education. Dr. Efron has presented ex
tensively at multiple conferences,
and her articles have been published in such jour
nals as Curriculum and Inquiry,
Journal of Teacher Education, and Phi Delta Ka
ppan. She has also written several
language instructional books for middle and high
school students.
Ruth Ravid, PhD, is Professor Emerita of Educati
on at National Louis University.
Her areas of interest include educational research,
action research, assessment, and
university collaboration. Dr. Ravid’s boo
ks include Practical Statistics for
Educators (4th ed.), Study Guide for Practical
Statistics for Educators (4th ed.;
tion to Business Statistics (coauthored with Perry
Haan), Collaboration in Educa-
University
Collaboration (coedited with Marianne G. Hand
ler).
268
You might also like
- Second International Research Handbook On ValuesNo ratings yetSecond International Research Handbook On Values1,175 pages
- Action Research in Education A Practical Guide - (Chapter 1. Introduction To Action Research)No ratings yetAction Research in Education A Practical Guide - (Chapter 1. Introduction To Action Research)12 pages
- Implications For Educational Practice of The Science of Learning and Development Darling HammondNo ratings yetImplications For Educational Practice of The Science of Learning and Development Darling Hammond45 pages
- A Disruptive' Look at Competency-Based Education100% (1)A Disruptive' Look at Competency-Based Education12 pages
- Practical Research 2 Activity Sheets 1st QTR100% (2)Practical Research 2 Activity Sheets 1st QTR14 pages
- CEC Ethical Principles and Professional Practice Standards For Special EducatorsNo ratings yetCEC Ethical Principles and Professional Practice Standards For Special Educators6 pages
- Factors Influencing The Assessment Practices of Senior High School Teachers in Goa District, PhilippinesNo ratings yetFactors Influencing The Assessment Practices of Senior High School Teachers in Goa District, Philippines9 pages
- Book - (J - Scheerens - Cees - A - W - Glas - Sally - Thomas) - Education Evaluation, Assessment and Monitoring PDF100% (3)Book - (J - Scheerens - Cees - A - W - Glas - Sally - Thomas) - Education Evaluation, Assessment and Monitoring PDF425 pages
- News Letter January 2025 Scholars Forum UoK100% (1)News Letter January 2025 Scholars Forum UoK4 pages
- The University of Sydney: 2016-20 Strategic PlanNo ratings yetThe University of Sydney: 2016-20 Strategic Plan63 pages
- Increasing Secondary Student Engagement Millbury100% (1)Increasing Secondary Student Engagement Millbury34 pages
- Evaluation Policy and Evaluation PracticeNo ratings yetEvaluation Policy and Evaluation Practice20 pages
- Program Evaluation Models and Related Theories: AMEE Guide No. 67No ratings yetProgram Evaluation Models and Related Theories: AMEE Guide No. 6713 pages
- Directions in Educational Planning - UNESCONo ratings yetDirections in Educational Planning - UNESCO300 pages
- Conducting Educational Research Fifth: Bruce W. TuckmanNo ratings yetConducting Educational Research Fifth: Bruce W. Tuckman51 pages
- Teaching Global Competence in A Rapidly Changing WorldNo ratings yetTeaching Global Competence in A Rapidly Changing World37 pages
- Addressing Absenteeism Through A Positive Reinforcement Intervention100% (2)Addressing Absenteeism Through A Positive Reinforcement Intervention51 pages
- Handbook of Research For Teacher EducationNo ratings yetHandbook of Research For Teacher Education162 pages
- Mathison WhatIsDiffBetweenEvalAndResearchNo ratings yetMathison WhatIsDiffBetweenEvalAndResearch15 pages
- OCDE - Studying Pedagogical Knowledge Across Education SystemsNo ratings yetOCDE - Studying Pedagogical Knowledge Across Education Systems165 pages
- EFL Adult Learners' Perception of Learning English Vocabulary Through Pictures at A Private English CenterNo ratings yetEFL Adult Learners' Perception of Learning English Vocabulary Through Pictures at A Private English Center8 pages
- Physical Education and Health Curriculum GuidelinesNo ratings yetPhysical Education and Health Curriculum Guidelines7 pages
- Memories On The Move: Migration, Diasporas and CitizenshipNo ratings yetMemories On The Move: Migration, Diasporas and Citizenship301 pages
- A Sample Qualitative Research Proposal Written in The APA 5th Style100% (1)A Sample Qualitative Research Proposal Written in The APA 5th Style9 pages
- Marzano's Compendium: Acknowledging Lack of Adherence To Rules and ProceduresNo ratings yetMarzano's Compendium: Acknowledging Lack of Adherence To Rules and Procedures31 pages
- University of Gondar: Document Image RetrievalNo ratings yetUniversity of Gondar: Document Image Retrieval9 pages
- Formative Assessment and Self-Regulated Learning - A Model and Seven Principles of Good Feedback PracticeNo ratings yetFormative Assessment and Self-Regulated Learning - A Model and Seven Principles of Good Feedback Practice19 pages
- Instruments For Leadership in Children and YouthNo ratings yetInstruments For Leadership in Children and Youth6 pages
- Session 14 Slides - Evaluation Research PDFNo ratings yetSession 14 Slides - Evaluation Research PDF20 pages
- MCGINNIS Et OSTROM 2005 Social Ecological System FrameworkNo ratings yetMCGINNIS Et OSTROM 2005 Social Ecological System Framework12 pages
- Monitoring School Quality: An Indicators Report: National Center For Education StatisticsNo ratings yetMonitoring School Quality: An Indicators Report: National Center For Education Statistics75 pages
- 2022.module 3 - Communicative Language Ability - Bachman - CEFRNo ratings yet2022.module 3 - Communicative Language Ability - Bachman - CEFR31 pages
- Australian Professional Standards For TeachersNo ratings yetAustralian Professional Standards For Teachers2 pages
- An Exploration of The Practice Approach and Its Place in Information ScienceNo ratings yetAn Exploration of The Practice Approach and Its Place in Information Science13 pages
- Introduction: Biology Today: Powerpoint Lectures ForNo ratings yetIntroduction: Biology Today: Powerpoint Lectures For12 pages
- Supervisi Administrasi Pembelajaran Dalam Meningkatkan Mutu Pembelajaran Di Smks 6 Pertiwi CurupNo ratings yetSupervisi Administrasi Pembelajaran Dalam Meningkatkan Mutu Pembelajaran Di Smks 6 Pertiwi Curup12 pages
- Investigating Employee Turnover in The Construction Industry A Psychological Contract PerspectiveNo ratings yetInvestigating Employee Turnover in The Construction Industry A Psychological Contract Perspective9 pages
- Aligning The Goals of Community Engaged Research .14No ratings yetAligning The Goals of Community Engaged Research .147 pages
- Parental Attitude in Families With A Special ChildNo ratings yetParental Attitude in Families With A Special Child11 pages
- Classroom Assessment To Support Teaching and LearningNo ratings yetClassroom Assessment To Support Teaching and Learning18 pages
- 50 Years Later: A Conversation About The Biological Study of Language With Noam ChomskyNo ratings yet50 Years Later: A Conversation About The Biological Study of Language With Noam Chomsky13 pages
- 2003 - Design-Based Research An Emerging Paradigm For Educational Inquiry PDFNo ratings yet2003 - Design-Based Research An Emerging Paradigm For Educational Inquiry PDF4 pages
- Daniel R. Tomal - Action Research For Educators (2003) PDF100% (2)Daniel R. Tomal - Action Research For Educators (2003) PDF159 pages
