A Comparative Analysis of Reflection and Self-Assessment: Melissa Desjarlais, Peter Smith
A Comparative Analysis of Reflection and Self-Assessment: Melissa Desjarlais, Peter Smith
4
Reflection Methodology Discussion Self-Assessment Methodology Discussion
Pick a time and place for reflection. Define the purpose of the self-assessment.
In this step, the reflector identifies a time and place Here, the assessor establishes the outcomes for the self-
that will minimize distractions and lead to a quality assessment and restricts attention to certain aspects of
reflection. It may involve a mindless activity such as the performance being assessed, if appropriate. The
STEP 2
walking, chopping wood, weeding, etc. One needs to be motivation to perform the self-assessment may have
prepared to record insights as they come to light. This come from an earlier reflection, but the goal is always
recording can be in a written, electronic, or verbal format personal development and improved performance.
(such as a digital voice recorder). It may help to pair
up with another person who can listen and record the
components of the experience, and the insights gained.
This is especially important for people who do their best
thinking while speaking.
Play back the experience which triggered the reflection. Develop performance criteria for the self-assessment.
In this step the reflector goes back through the experience Using the outcomes identified in Step 2, the assessor
slowly enough to examine each aspect. This should not identifies the criteria by which to measure the success
STEP 3
be a mere recitation of the sequence of events, but an of the self-assessment. These should be understandable,
examination of components that may be significant. measurable, realistic, and relevant to the outcomes.
The reflector should try to engage all of the senses in These criteria will help keep the assessment process
this process, and pay particular attention to context focused. In most cases, there should be no more than
and behavior, accomplishments, failures, skill level, four criteria.
knowledge level, and personal and fixed factors (Elger,
2007).
Document all insights in a reflection log. Determine attributes that indicate quality for each
As the reflector replays the experience, all insights should criterion.
be listed in a reflection log without any initial judgment In this step, the assessor breaks down each criterion into
STEP 4
on their quality or usefulness. Even if the insights are attributes that can be easily measured. If the assessment
initially recorded orally, they should be transferred to a is narrowly focused, one or more of the criteria may be
visual format, either on paper or a computer. Steps 3 and clear and measurable enough in themselves that it will
4 may be iterated multiple times before moving on to the not be necessary to define their attributes.
next step, because one insight may prompt the reflector
to realize that earlier moments in the play-back need
more careful examination.
Play a lot of “what-if” games. For each attribute or simple criterion, determine the
This step allows the reflector to consider other possible evidence needed to perform the assessment.
STEP 5
outcomes to the experience. These alternate outcomes Evidence is important in order to judge whether the cri-
may come from the reflector’s own past performance teria are achieved successfully. The evidence should be
or something he or she has read or heard. These other readily accessible from the performance being assessed.
possibilities can be used to question the meaning and
significance of the actual sequence of events, thus
deepening and expanding the insights in the log.
5
Reflection Methodology Discussion Self-Assessment Methodology Discussion
Organize a list of insights into common themes. Select the scale and range to be used in looking at
In this step, the reflector looks back over the list of insights each piece of evidence.
STEP 6
generated and arranges them based on common elements. Measurement requires a scale and a range. If the
It may be useful to write the insights on separate slips of evidence is carefully selected, these should be self-
sticky paper and group them by themes before recording evident. The scale may be numerical or ordinal and
them in the log. This step is a preparation for Step 7 in should be sufficient to explain all gradations within the
which the reflector evaluates the quality of the insights. range. If in doubt, one should make the scale simple.
Identify key insights. Collect and measure the evidence identified in Step 5
Once the insights have been organized by common using the scale from Step 6.
STEP 7
themes, the reflector identifies those which are most For this step it would be helpful to have already engaged
significant and meaningful. This may involve rewriting in a reflection about the performance being assessed. The
them to combine several insights into one, and checking reflection or play-back will highlight evidence needed
that no important insight has been omitted. to conduct the assessment. The collected evidence
should be connected directly to the performance. Each
piece of evidence should be rated according to its scale.
Generalize key insights to a wider set of situations. Use the collected evidence to prepare a self-
The key insights which were identified in Step 7 may assessment report.
be somewhat specific to the past experience which In writing a self-assessment report, one determines
initiated the reflection, or they may apply to a wider set and documents strengths, areas for improvement,
of situations that can allow the reflector to derive greater and insights gained from conducting the assessment
value from the original experience. To raise the level of (Wasserman & Beyerlein, 2007). It is thus referred to as
STEP 8
significance of the insight, it helps to ask the question an SII report, and it is the heart of the assessment. The
“So what?” repeatedly, and then reword the generalized main purpose of self-assessment is to help the assessor/
insight according to the answer. assessee improve his or her performance and move
along the path to becoming a self-grower (Leise, 2007).
For each area for improvement, one should develop a
short-term (what can be done immediately) and a long-
term (what can be done in the future) plan of action. If
previous action plans have been developed, they should
now be assessed.
Determine whether there is a need to for other Determine whether there is a need to engage in other
processes. processes.
If, during the process of reflection, it becomes clear The self-assessment report for Step 8 may identify a
that an improvement in performance is necessary, the need to do further reflection or to engage in learning,
self-assessment process should be initiated to identify research, design, problem solving, or other processes
strengths, areas for improvement, and potential for in order to maximize growth or to fully implement the
STEP 9
an action plan to address some of the identified areas action plans. These processes are described in Beyerlein
for improvement. Reflection can also lead to learning, (2007).
problem-solving, research, design, and other processes.
Since the problem-solving, research, and design
processes are often confused with one another, it is useful
to reflect on past situations in which a particular process
has been identified and then decide which of these past
situations is most similar to the given situation (Cordon
& Williams, 2007).
Assess the quality of the reflection process. Assess the quality of the self-assessment process.
STEP 10
Identify the strengths, areas for improvement, and Identify the strengths, areas for improvement, and in-
insights gained as a result of this process, being careful sights gained as a result of this process, being careful to
to focus both on the process of reflection, and the product focus both on the self-assessment process and the prod-
that was generated (i.e., the reflection log). uct that was generated (i.e., the self-assessment report).
6
Example of the Methodologies unable to access any online references, nor can he look at
examples of other web pages while he designs his project.
To illustrate a practical application of the methodologies
Fortunately for him, he does have Dreamweaver™ on his
that might be used in a classroom situation, let us use
laptop, so he is able to create the code, but he is unable to
the example of a student procrastinating on a web design
test it in a real browser.
assignment. In our hypothetical situation, a project has
been assigned that is due after Thanksgiving break. It When he gets back to school and is again able to access the
involves the use of Dreamweaver™, which is a commonly- Internet, he discovers a number of errors which he does not
used web page design productivity software product. have time to correct before the paper is due. He explains
Although the project had been assigned several weeks the dilemma to his teacher who agrees to let him turn it in
before Thanksgiving, our student has put off starting it late with no penalty if he completes reflection and self-
until he has gone home for Thanksgiving weekend. He assessment reports in order to learn from his experience.
discovers when he gets home that the Internet will be The following is a description of his experience using the
down at his house for the whole weekend. As a result he is reflection and self-assessment methodologies.
Our student thinks that this instance of procrastination, when The performance being assessed is the preparation of the
analyzed, might help him produce better work in the future. web design project..
Pick a time and place for reflection. Define the purpose of the self-assessment.
He decides to do the reflection while taking a long walk in The self-assessment outcomes are to minimize future
the afternoon after class. He believes that this setting will be procrastination and to improve the quality of similar
relatively free from distractions. performances in the future.
Play back the experience which triggered the reflection. Develop performance criteria for the self-
He plays back the experience. He recalls how he had assessment.
received the assignment with a month of lead time; he Criteria for self-assessment:
remembers being too busy with other schoolwork and A. understanding the consequences of procrastination
social activities to start it before Thanksgiving vacation; B. trade-off between the quality of the online web
he replays his dismay at discovering that the Internet project vs. time spent in preparation
C. quality of the testing process for the validity of the
was down; he remembers doing his best to design the
STEP 3
7
Reflection Methodology Self-Assessment Methodology
Document all insights in a reflection log. Determine attributes that indicate quality for each
Since he forgets to bring a notebook on the walk to jot criterion.
down his insights, he lists them when he returns to his Attributes for criteria:
room. This is what he discovers as a result of his reflection: Criterion A: number of consequences identified,
1. He often avoids what he doesn’t want to do and connection of each to successful
replaces those activities with more desirable activities. performance
2. He conveniently forgets to do unpleasant tasks, and Criterion B: amount of time spent preparing,
should therefore write down daily tasks and tick them appearance of the web project, number
off. of errors not spotted
3. He realizes that his project involved sections of code Criterion C: number of errors spotted, amount of
that were repeated several times. He might have saved time spent testing
himself some time had he saved these, as he would
not have had to retype them or look back through the
code to find them.
STEP 4
timeliness, efficiency, web design criteria, project The only attributes whose scales are not numeric are
testing, time management, and setting priorities. “appearance” and “connections.” The scale for appear-
ance might be “sloppy,” “acceptable,” “attractive,”
and “spectacular.” The scale for connection might be
“remote,” “reasonable,” and “close.”
8
Reflection Methodology Self-Assessment Methodology
Identify key insights. Collect and measure the evidence identified.
He comes up with the following key insights: Listing of the evidence:
1. Keep a journal with daily responsibilities and use it to Consequences: The web project was completed several
set priorities. days past deadline and was not of the highest quality.
STEP 7
2. Test web projects in Firefox™, Internet Explorer™, To get full credit, he had to complete reflection and self-
assessment reports.
and Chrome™.
Time spent in preparation: 8 hours. The web pages
3. Use a sophisticated web page editor and learn how to
appeared acceptable. There was only one error not
use it well.
spotted after testing.
4. Procrastination can sometimes lead to a more efficient
He spotted four errors during preparation and six errors
performance.
while testing. Testing and error correcting time was 5
5. Preparation is the key to well-designed projects. hours.
Generalize key insights to a wider set of situations. Use the collected evidence to prepare a self-assessment
He arrives at these generalized insights: report.
Strengths:
1. Poor ability to judge time required to complete a task
contributes to a hurry-up-and-crash situation, so he • Despite the delay, the web project appearance and
needs to set aside more time to accomplish things or performance were acceptable.
be more efficient with the time he sets aside. • The preparation time was reasonable compared to
other projects.
2. Keeping organized lists either on paper or • Dreamweaver™ made it easier to test the code during
electronically can reduce procrastination. preparation.
3. Good preparation, use of productivity tools, and Areas for Improvement:
efficient testing can all improve the web design
• He needs to get the project finished by the deadline
process.
and improve its appearance to “attractive” or
4. Procrastination can sometimes lead to more efficient “spectacular.”
performance, but often at the expense of quality. • Better planning will help, as will checking to see that
Internet access will be available during preparation.
• He should not schedule so much on the days he will
be preparing the next project.
STEP 8
He observes that using a self-assessment process There is no need to employ further processes at
including a formal SII and short and long-term action this time. Perhaps there will be a need for problem
plans would be helpful in improving his project solving and design if the current action plans are not
performance in the future. effective.
Assess the quality of the reflection process. Assess the quality of the self-assessment process.
He assesses the reflection process itself. Assessment of the self-assessment process.
Strengths: Strengths:
• He gained insights that have helped him better • He developed workable criteria.
understand procrastination habits and their • He came up with practical action plans.
consequences.
Areas for Improvements:
• Walking helped develop a good flow of ideas.
• He should have identified the evidence specifically
• The rich set of insights will help him improve the for each attribute in Step 5.
project completion process in the future.
• He should have included insights in the self-
Areas for Improvement: assessment report.
• He must find a way to jot down insights while Insights:
walking, perhaps by carrying a notebook or by using
STEP 10
Comparative Analysis The two processes differ in terms of the initial motiva-
tions, situations which call for each process, how each
From a search of the literature, it has become evident
process should be done, and what their goals are. People
that most authors blur the distinction between reflection
use reflection when there is the expectation or desire to
and self-assessment, with a tendency to emphasize the
gain insights about themselves by reflecting, while they
former. Burke (2009), however, shows that while both
use self-assessment to improve future performance by
reflection and self-assessment can lead to learning from
identifying strengths and areas of improvement. This
an experience, they are distinct processes with different
initial motivation can come from different sources:
motivations or purposes. This paper expands on previous
people are often internally motivated to engage in re-
work by identifying some of the differences between the
flection, since individuals may suspect that insights can
processes, as specified in Table 2:
10
Table 2 Differences between Reflection and Self-Assessment
be gained through that process; and while these insights qualities. Some of the similarities between reflection
may indicate a need for self-assessment, there can and self-assessment include the following. Both are:
also be external motivation for self-assessment from • Structured
supervisors or colleagues.
• Sequential
The time required for doing these processes can differ,
• Targeted
both in terms of the starting time and the block of time
needed. It is important to do the reflection as soon as • Based on an earlier experience or performance
possible after the experience since the play-back of • Improved through analysis
the experience is a crucial step in the process. The
• Internal
experience should be “fresh” so that the reflector is able
to focus on significant components. On the other hand, in • Meaningful
conducting a self-assessment, it may be necessary to wait • Important in improving quality
to determine potential ramifications of the performance.
• Conducive to learning (about self or content)
Knowing these will aid in the self-assessment process.
The block of time available for each process can differ. The two processes are structured, sequential, and
In the process of reflection it is important to have an targeted. There is a methodology for each process that
uninterrupted period of time to allow for the play- describes the steps that should be taken and the order in
back of the experience and identifying insights. In the which they should be done, and these steps are targeted
process of self-assessment it is possible to stop and start; to help the individual achieve the desired outcomes
for example, someone can pause the process between of each process. Each process is based on an earlier
identifying strengths and areas for improvement. experience or performance and requires the analysis
The differences in motivation and goals of the two of the experience or performance, yet both can be very
processes lead to reflection being backward-looking and meaningful processes for improving the quality of life.
reactive, since people reflect on past experience; and Also, any of the possible outcomes of either process can
self-assessment being forward-looking and proactive, lead to learning, either about oneself or content that one
since the strengths and areas for improvement will be is to learn for a course. Thus, these two processes do
used to improve subsequent performances. Also, the have some significant similarities.
reflection process tends to be kept private, while self- It is also instructive to examine the similarities and
assessment is a tool leading to self-growth that should differences between the products of the reflection
be shared with a mentor if one is available. The goal of and self-assessment processes (i.e., the reflection log
reflection is “knowing”; the goal of self-assessment is and the self-assessment report). Table 3 illustrates the
“growing.” differences:
While there are some distinct differences between the Some of the similarities between the two products are
processes of reflection and self-assessment in terms of that both should be assessed and both lead to a better
the reasons or ways of doing them, they also share some understanding of a past experience.
11
Tips purposes, outcomes, work products, and tips for high
This section will help the reader to decide whether or quality implementation. It suggests many areas for
not to engage in reflection or self-assessment, which future study, including analysis of these methodologies
process to choose, and how to go about each process. in specific classroom settings. The formal methodologies
Once experienced, the value of these processes will be outlined in this paper for reflection and self-assessment,
appreciated, and, after consistent use, they will become along with the synthesis of ideas from different areas of
second nature. the Faculty Guidebook (2007), provide a foundation for
this work. Classroom studies might start by collecting
A key first step in the process is to identify the need to do initial data (both quantitative and qualitative) about the
either of these processes (Table 4). Sometimes there is a frequency and quality of reflection and self-assessment
critical or motivating event that can indicate this need. done by each student and his or her understanding and
Often doing one process can indicate the need for doing perceived importance of the two processes. This could be
the other, which indicates a cyclical component to the followed by providing orientation on two methodologies,
two processes. Even when there is no specific triggering including critical thinking about examples similar to
event, it can be beneficial to occasionally review these those used in this paper. Throughout an entire term,
tips to determine whether there may be a benefit gained students might then use both methodologies, generating a
from employing these processes.
collection of reflection logs and self-assessment reports.
Once it has been determined that one of the two processes At the end of the study, data could be collected again,
should be done, the implementation phase can be made similar to what had been initially collected. Some goals
much more productive and effective if one follows the of such a study might be to try to measure change in the
tips outlined in Table 5, and may result in success that quality of the reflection and self-assessment done by the
will lead a person to want to continue to employ these students, and how their understanding has changed.
processes in the future.
As a result of writing this paper, the authors came to
These first sets of tips help with either initiating or appreciate the cyclical nature of reflection and self-
performing the processes, while the next set of tips assessment. While discussing the role of reflection
apply after the processes are complete. Evaluating in transforming learning during the last few months,
their effectiveness can lead to the continual use of the it became clear how important this concept was to
processes.
many faculty and administrators dedicated to Process
Evaluation Education. The most helpful reference was the
After doing a reflection or self-assessment, it is theoretical treatise, “Improving Quality of Reflecting
important to evaluate the effectiveness of the process. on Performance” by Cy Leise (2010). Leise looks at
Table 6 provides some questions that can be answered to the history of reflection and develops a methodology
perform this evaluation. oriented toward improving the performance of
counseling professionals. Our reflection and self-
Determining that a process is effective can mean that assessment methodologies are more accessible to
someone will continue to reflect and self-assess to gain undergraduate students and all who are interested in
a better understanding of himself or herself, and to better understanding their experiences or improving
improve future performances. the quality of their performances. It is our thesis that
Conclusion reflection and self-assessment can quickly become
second nature, and are essential practices for anyone
This paper clarifies similarities and differences between who wishes to become a self-grower.
reflection and self-assessment with respect to their
12
Table 4 Tips for Deciding When to do Reflection or Self-Assessment
13
Acknowledgments
The authors would like to acknowledge the assistance provided by Cy Leise, through his doing a sample reflection
and providing feedback, and Steve Beyerlein, through his participation in multiple conversations about the paper and
offering helpful suggestions. Thanks to Dan Apple for being the stimulus for the idea of the paper.
References
Anderson, K., (2007). Assessing assessments. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty guidebook:
A comprehensive tool for improving faculty performance (4th ed.) (483-486). Lisle, IL: Pacific Crest.
Amulya, J. (2004). What is reflective practice? Boston, MA: Center for Reflective Community Practice at the
Massachusetts Institute of Technology.
Apple, D. K., & Baehr, M. (2007). Assessment methodology. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.),
Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (449-452). Lisle, IL: Pacific
Crest.
Beyerlein, S. W., Apple, D. K., & Holmes, C. (Eds.). (2007). Faculty guidebook: A comprehensive tool for improving
faculty performance (4th ed.). Lisle, IL: Pacific Crest.
Burke, K., Lawrence, B., El-Sayed, M., & Apple, D. (2009). Process Education: Past, present, and future.
International Journal of Process Education, 1, 35-42.
Cordon, D., & Williams, B. (2007). Distinguishing between problem solving, design, and research. In S.W. Beyerlein,
C. Holmes, & D. K. Apple (Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance
(4th ed. pp ). Lisle, IL: Pacific Crest.
Duncan, W., (2007). Framework for implementing Process Education. In S.W. Beyerlein, C. Holmes, & D. K. Apple
(Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (197-200). Lisle,
IL: Pacific Crest.
Elger, D. (2007). Theory of performance. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty guidebook:
A comprehensive tool for improving faculty performance (4th ed.) (19-22). Lisle, IL: Pacific Crest.
Hare, P. (2007). Team reflection. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty guidebook:
A comprehensive tool for improving faculty performance (4th ed.) (419-420). Lisle, IL: Pacific Crest.
Hurd, B., (2007). Annual professional growth plans. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty
guidebook: A comprehensive tool for improving faculty performance (4th ed.) (65-68 ). Lisle, IL: Pacific Crest.
Leise, C. (2007). Becoming a self-grower. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty guidebook:
A comprehensive tool for improving faculty performance (4th ed.) (479-482). Lisle, IL: Pacific Crest.
Leise, C. (2007a). Personal development methodology. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty
guidebook: A comprehensive tool for improving faculty performance (4th ed.) (483-486). Lisle, IL: Pacific Crest.
Leise, C. (2007b). Overview of learning theory. In S.W. Beyerlein, C. Holmes, & D. K. Apple (Eds.), Faculty
guidebook: A comprehensive tool for improving faculty performance (4th ed.) (139-142 ). Lisle, IL: Pacific Crest.
Leise, C. (2007c). Learning processes through the use of methodologies. In S.W. Beyerlein, C. Holmes, & D. K.
Apple (Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (217-220).
Lisle, IL: Pacific Crest.
Leise, C. (2010). Improving quality of reflecting on performance. International Journal of Process Education,
2, 65-74.
Miller, R. (2007). Practical implementation of self-assessment journals. In S.W. Beyerlein, C. Holmes, & D. K.
Apple (Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (431-434).
Lisle, IL: Pacific Crest.
14
Myrvaagnes, E. (2007). Performance levels for learners and self-growers. In S.W. Beyerlein, C. Holmes, & D. K.
Apple (Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (479-482).
Lisle, IL: Pacific Crest.
Pacific Crest (2009). Student success toolbox: Improving learning and performance through assessment. Lisle, IL:
Pacific Crest.
Raelin, J. A. (2002). “I don’t have time to think!” versus the art of reflective practice. Reflections, 4(1) 66-79.
Schon, D. A. (1983). The reflective practitioner: How professionals think in action. New York. Basic Books.
Stevens, D. D., & Cooper, J. E. (2009). Journal keeping: How to use reflective writing for learning, teaching,
professional insight, and positive change. Sterling, VA: Stylus.
Wasserman, J., & Beyerlein, S. W. (2007). SII method for assessment reporting. In S.W. Beyerlein, C. Holmes, &
D. K. Apple (Eds.), Faculty guidebook: A comprehensive tool for improving faculty performance (4th ed.) (465-
466). Lisle, IL: Pacific Crest.
Wiggins, G. P., & McTighe, J. (2005). Understanding by design (2nd ed.). Alexandria, VA: Association for Supervision
and Curriculum Development.
15
Appendix
16
3. Other Possibilities from What-If Analysis: 3. Assessment of Performance against Previous
What If― Action Plans
17
8. Assessment of the Process: 8. Knowing This Will Improve My Performance By:
Strengths: making it more likely I will start the next project in
• He gained insights that have helped him better un- time to complete it with high quality
derstand procrastination habits and its consequences
• Walking helped him develop a good flow of ideas
• The rich set of insights will help him improve the
project completion process in the future
Areas for Improvement:
• Find a way to jot down insights while walking;
perhaps carry a notebook
• It was hard to do the what-if games as a separate
step; perhaps combine Steps 4 & 5
• He did not allocate enough time for the reflection
process. He should set aside more time so that he
does not feel rushed
Insights:
• The reflection seemed to center less on the
procrastination problem and more on the efficient
production of the web project
• The reflection process is not really linear, as thinking
about one piece sends one off on a tangent. As a
result, some insights may not be directly connected
to the original triggering event.
18