Ail 604 - Evaluation Report
Ail 604 - Evaluation Report
AIL 604
The University of Alabama
Tracy Hinton
Part 1: Introduction
Participants
A panel of four colleagues that are trained in online learning principles and
techniques served as members of a peer review committee. Actually, I received full
feedback from five colleagues with an additional comment by a sixth colleague,
which was a pleasant surprise, as additional feedback was indeed helpful. Using the
provided instrument to evaluate my project, they provided critical feedback on the
organization of the course as well as suggestions for improvement. Peer evaluators
utilize both a checklist and short answer responses as they were encouraged to
provide commentary regarding course content and design. Each review should
lasted approximately 20-30 minutes.
Interpretation of Results
I will compiled the results from both instruments into an evaluation report
that assesses both course content and design. The peer reviewer results reflect a
need for minor changes which are explained in this report. Design issues will be
addressed in relation to the eLearning principles learned in this course.
Timeline
Peer Review
Interpretation of results
from peer review
Final Evaluation Report
Date
Saturday, July 26th from
1:00 5:00 pm
Sunday, July 27th
Completed by
4 peer reviewers
T. Hinton
T. Hinton
and beef up the 4th module to bring the discussion of different disciplines into play
earlier. Rather than focusing on a single example in each discipline, she suggests
focusing on a particular skills, such as synthesis or summarizing or something and
showing how those can be enacted in particular disciplines. In my opinion, those
suggestions are too specific for the targeted learners, as they already have lesson
ideas of their own, often based on years of experience in teaching library and
information retrieval skills.
Another suggestion offered by Rebecca is to chunk the summative
assignment that Ive given to teachers. Rather than having one big assignment
from them due at the end, perhaps you could ask them to create sample
assignments in each module, or connect a learning objective with an element of
digital storytelling. While at first I considered her chunking suggestion, I feel that
one larger lesson at the end is more appropriate to this set of learners. Throughout
the modules, the learners have been provided opportunities to brainstorm and link
apps to their own lesson ideas, so I feel that it is best to provide one activity at the
end from which they can choose to make connections with one of their own lessons.
Since librarians teach a wide variety of different skills to a wide range of learners,
usually based on teachers suggestions, it is difficult to focus on one or more
objective that every librarian teaches. For that reason, I feel that it is best that
learners develop a comprehensive lesson at the end of the modules.
In Juanitas peer evaluation, I also received valuable suggestions. In regards
to the instruction, she states, The presentation is visually challenging due to all the
different font colors. I am having a hard time seeing some colors. Would suggest
reconsider artful license for accommodation of visually challenged learners.
Orange, green, fuchsia, red, blue it is a lot of different colors. While I can respect
praise and negative comments in feedback that direct attention to the self rather
than to the task are not used at all.
instructional methods. This course is designed to be informational rather than skillbuilding, so that learners can explore various apps at their own pace. This course is
also advance and provides content topics that are not logically interdependent.
Although the modules progress from 1 5, the learner can review information from
any module. Finally, the learners are provided with review practice questions and a
final project that culminates in the learning of all information involved in the course.
this professional course did not incorporate such instructional methods. First, the
learners are adults that would not necessarily find games an appealing method of
learning. Next, the content of the course does not provide specific practice
activities that must be mastered before moving on to the next activity. Finally, this
type of instruction requires more advanced technology and programming skills,
which the programmer lacks. While games and simulations can certainly enhance
some classes, the designer did not feel that these methods of learning would be
valuable to this eLearning course.
Possibly, it is the K-12 educator in me that realizes that some learners require a
hook in order to grasp and hold their attention. Not all learners are adults that
are ready to learn, but I also need to create course material that adheres to
research-based design principles.
Overall, I agree with the design principles that we have learned throughout
this course. By sharing and evaluating other courses, I can certainly see the value
in applying particular principles according to the instructional method and desired
learning outcome. For instance, an interactive math course would require multiple
practice problems and mastery of specific concepts before progressing on to the
next learning goal.
I feel that I have learned so much in this course about design principles for
eLearning instruction. While this has been a challenging course that took many,
many hours, I have learned vast amounts of information that will be relevant to my
professional goals. I am thankful for the opportunity to have learned so much about
effective instructional design methods, through a combination of teacher-provided
information, course textbook, class discussions, and peer reviews. This has been a
wonderful learning experience!
References
Clark, R.C. & Meyer, R.E. (2011). e-Learning and the science of instruction: Proven
guidelines for
consumers and designers of multimedia learning (3 rd edition). San Francisco:
John Wiley & Sons.
Morrison, G. R., Ross, S. M., Kalman, H. K., & Kemp, J. E. (2011). Designing effective
instruction (6th ed.). Hoboken, NJ: John Wiley & Sons.
Appendix A
Peer Review from Rebecca Johnson
Evaluation Instrument
Part 1:
Questions
1. Does the course home page clearly state
the objectives?
2. Is there a clear connection between the
course material and the objectives?
3. Is the sequence of the instructional
activities logical?
4. Is the content of the instruction up to
date?
5. Is the instruction presented in a clear and
coherent manner?
Yes
X
X
X
X
X
No
N/A
Comments
X
X
X
X
X
Part 2:
1. What overall rating would you give this course?
Excellent
Good
Average
Poor
Very Poor
Overall, please rate the instructional design and online learning experience by
placing an (X) in the appropriate column.
Excellent
Good
Average
Fair
Poor
Accessibilit
X
y
Content
X
Presentatio X
n
Appendix B
Peer Review from Juanita McMath
Evaluation Instrument
Part 1:
Questions
12.Does the course home page clearly state
the objectives?
Yes
No
N/A
Comments
Goals, target
audience and
design
metaphor are
noted.
13.Is there a clear connection between the
course material and the objectives?
Materials
related to the
web site goals.
The sequence
is logical with
lectures first,
apps,
examples,
review
questions then
quiz.
Instructional
items yes.
The visuals,
no.
The
presentation is
visually
challenging
due to all the
different font
colors. I am
having a hard
time seeing
some colors.
Would suggest
reconsider
artful license
for
accommodatio
n of visually
challenged
learners.
Orange,
green, fuchsia,
red, blue it is
a lot of
different
colors.
17.Are learners given adequate
opportunities to practice or apply what
they learn?
Part 2:
1. What overall rating would you give this course?
Excellent
Good
Average
Poor
Very Poor
4.5/5
Maybe add
some
discussions at
the end of
each module
as teachers
like to discuss
new tools.
The open
scrolling menu
tabs are
somewhat an
issue if one
rolls over too
far. Would
suggest a
static
presentation
instead of
rolling.
Because teachers are sometimes reluctant to try new technology, you friendly
approach creates a comfortable climate for them to explore technology. Example
are always good items to have, but maybe use just your favorite three and then put
all the others in a linked page. I really liked the creativity of the infographic and
design metaphor.
_____________________________________________________________________________________
Appendix C
Peer Review from Katie Johnson
Evaluation Instrument
Part 1:
Questions
1. Does the course home page clearly state
the objectives?
2. Is there a clear connection between the
course material and the objectives?
3. Is the sequence of the instructional
activities logical?
4. Is the content of the instruction up to
date?
5. Is the instruction presented in a clear and
coherent manner?
6. Are learners given adequate
opportunities to practice or apply what
they learn?
7. Are the instructional strategies
appropriate for the targeted learners?
8. Is the online course navigation easy to
operate?
9. Did the user applications work properly?
Yes
X
No
N/A
Comments
X
X
X
X
X
X
X
X
Tracy, on
Module two
your Part C,
Storykit was
the only item
with a link that
worked in the
description. I
noticed you
X
You did a great
job! It is
obvious you
put a lot of
work in this!
Part 2:
1. What overall rating would you give this course?
Excellent
Good
Average
Poor
Very Poor
Appendix D
Peer Review from John Finley
Evaluation Instrument
Part 1:
Questions
1. Does the course home page clearly state
the objectives?
2. Is there a clear connection between the
course material and the objectives?
3. Is the sequence of the instructional
activities logical?
4. Is the content of the instruction up to
date?
5. Is the instruction presented in a clear and
coherent manner?
6. Are learners given adequate
opportunities to practice or apply what
they learn?
7. Are the instructional strategies
appropriate for the targeted learners?
8. Is the online course navigation easy to
operate?
9. Did the user applications work properly?
Yes
X
No
N/A
Comments
X
X
X
X
X
X
X
X
Great tools
xx
Part 2:
1. What overall rating would you give this course?
Excellent
Good
Average
Poor
Very Poor
Appendix E
Peer Review from Hunter Galloway
Evaluation Instrument
Part 1:
Questions
1. Does the course home page clearly state
the objectives?
2. Is there a clear connection between the
course material and the objectives?
3. Is the sequence of the instructional
activities logical?
4. Is the content of the instruction up to
date?
5. Is the instruction presented in a clear and
coherent manner?
6. Are learners given adequate
opportunities to practice or apply what
they learn?
7. Are the instructional strategies
Yes
X
X
X
X
X
X
X
No
N/A
Comments
X
X
X
Part 2:
1. What overall rating would you give this course?
Excellent
Good
Average
Poor
Very Poor
Appendix F
Additional Comment from V Dozier
Traci, how great is your project?!! All the work I know you put into it shines through.
The modules are clear & I love the separate assessment piece. Consider adding this
to your presentation rotation.