Developing Learning

Outcomes:
A Guide for University of Toronto Faculty
TABLE OF
CONTENTS
What are Learning Outcomes?.................................................................................................................. 3

Tools for Developing Learning Outcomes............................................................................................. 5

Characteristics of Good Learning Outcomes ....................................................................................... 8

Assessment - Following Through on Learning Outcomes............................................................... 10

Course, Program, Institution: Connecting Learning Outcomes..................................................... 12

Further Resources on Learning Outcomes............................................................................................ 15

APPENDIX A: Examples Of Learning Outcomes.................................................................................. 16

APPENDIX B: Useful verbs for developing learning outcomes....................................................... 19

APPENDIX C: Taxonomies of educational objectives......................................................................... 21

APPENDIX D: Worksheets - translating objectives into assessable outcomes.......................... 25

Acknowledgements
This publication was prepared by Emily Greenleaf for the Centre for Teaching Support & Innovation
with the assistance of Megan Burnett and Pamela Gravestock. We would also like to thank Cleo Boyd
and Corey Goldman for providing feedback on the various iterations of this document.

© Centre for Teaching Support & Innovation, University of Toronto, 2008

Please note that in addition to the content of this guide, we have also provided links to different resources that you can
access for further information. The nature of websites is that they are always changing and so it is possible that the links
will not work. If you find that one of the links in this document is broken, please contact [email protected].
 – DEVELOPING LEARNING OUTCOMES –

WHAT ARE LEARNING OUTCOMES?

“
… think first about what is essential that students know or be able to do after the
course or program – what students need to know and could make powerful use of
to enhance their lives and more effectively contribute to society. We believe that
such reflection will lead instructors to focus on a broad synthesis of abilities that
combine knowledge, skills and values into a whole that reflects how people really use
knowledge. “
So, what’s a learning outcome anyway? Mark Battersby, p. 1

Learning outcomes are statements that describe the knowledge or skills students should acquire by the end of a particular
assignment, class, course, or program, and help students understand why that knowledge and those skills will be useful
to them. They focus on the context and potential applications of knowledge and skills, help students connect learning
in various contexts, and help guide assessment and evaluation.
Good learning outcomes emphasize the application and integration of knowledge. Instead of focusing on coverage of
material, learning outcomes articulate how students will be able to employ the material, both in the context of the class
and more broadly.

Example of Learning Outcomes:

By the end of this course, students will be able to:
• identify and describe the political, religious, economic, and social uses of art in Italy during the Renaissance
• identify a range of works of art and artists
• analyze the role of art and of the artist in Italy at this time
• analyze the art of the period according to objective methods
• link different materials and types of art to the attitudes and values of the period
• evaluate and defend their response to a range of art historical issues

For more examples of learning outcomes, please see Appendix A.

LEARNING OUTCOMES VS. LEARNING OBJECTIVES?

The distinction between learning outcomes and learning objectives is not universally recognized, and many instructors
may find that the term ‘learning outcomes’ describes what they have already understood by the term ‘learning objectives’.
Some scholars make no distinction between the two terms; those who do usually suggest that learning outcomes are
a subset or type of learning objective. Learning objectives, for example, may outline the material the instructor intends
to cover or the disciplinary questions the class will address. By contrast, learning outcomes should focus on what the
student should know and realistically be able to do by the end of an assignment, activity, class, or course. The same goals
addressed by learning objectives can be equally addressed by learning outcomes, but by focusing on the application
and integration of the course content from the perspective of the student, learning outcomes can more explicitly and
directly address expectations for student learning.
Many instructors may find that the reflective process of developing learning outcomes is something that they have
already incorporated into their course planning processes. The phrase ‘learning outcomes’ thus simply offers a more
precise term for discussing the creation of learning aims and expectations that centre on application and integration of
course content.

Centre for Teaching Support & Innovation - University of Toronto 3

 – DEVELOPING LEARNING OUTCOMES–

Learning outcomes are valuable to learners, instructors, and

Why develop learning administrators. Mark Battersby (1999) of the Learning Outcomes Network
outcomes? explains that learning outcomes are more than simply several sentences
appended to existing lesson plans or curricula; instead, the development
of learning outcomes and their use within a unit of instruction shapes
“…students already know they want learning and assessment activities and can enhance student engagement
a degree. The challenge is to help and learning.
students become highly intentional Because of their ability to benefit many groups in postsecondary education,
about the forms of learning and the development of learning outcomes has become an increasing
priority for instructors and institutions over the course of the last decade.
accomplishment that the degree
Establishing a focus on integrated, generalizable, and transferable
should represent.” skills complements contemporary demands on graduates and builds a
College Learning for the New Global foundation for lifelong learning. As government and public attention
on the products of higher education increases, learning outcomes help
Century, AAC&U, p. 29
to define the goals and essential aspects of higher education within the
institution, to students, and to the general public.

FOR STUDENTS FOR INSTRUCTORS FOR INSTITUTIONS & ADMINISTRATORS

• By focusing on the • The process of developing • In order to determine what is essential
application of knowledge learning outcomes itself for students to know, an instructor must
and skills learned in offers an opportunity for consider the particular course or unit in
a course and on the reflection on the content of the context of future coursework and the
integration of knowledge the course in the context of curriculum as a whole. This contributes to
and skills with other areas its potential applications. the development of a coherent curriculum
of their lives, students are Developing learning within a decentralized institution while
more connected to their outcomes means that the maintaining instructor autonomy, and
learning and to the material context of the learning will helps to ensure that students are prepared
of the course. always be emphasized, for future work and learning.
• The emphasis on and courses focus on the • The application and integration of learning
integration and knowledge and skills that emphasized by learning outcomes reflect
generalizable skills helps will be most valuable to and support the contemporary nature
students draw connections the student now and in the and priorities of the university, enhancing
between courses and future. student engagement, uncovering
between coursework and • Learning outcomes point opportunities for interdisciplinary, and
other kinds of knowledge, to useful methods of providing guidance and support for
enhancing student assessment. students with many different kinds of
engagement. • Learning outcomes allow previous academic preparation.
• Students understand the instructors to set the • Learning outcomes provide structures
conditions and goals of standards by which the from which courses and programs can be
their assessment. success of the course will be evaluated and can assist in program and
evaluated. curricular design, identify gaps or overlap in
program offerings, and clarify instructional,
programmatic, and institutional priorities.

4 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

TOOLS FOR DEVELOPING LEARNING OUTCOMES

Learning outcomes should outline the most central and essential elements of a particular course or program.
They will also shape assessment. As such, the process of developing learning outcomes offers an opportunity
for reflection on what is most necessary to help learners gain this knowledge and these skills. Considering (1) key
words for the course, (2) desired types of learning, and (3) the context in which the knowledge and skills gained
in the course will be used, including possible applications, provides a foundation for the development of learning
outcomes.

1. Language: Articulating your outcomes

To begin the process of developing learning outcomes, it may be useful to brainstorm some key words central to the
disciplinary content and generalizable skills taught in the course. In addition to the information about context and types
of learning provided below, you may wish to consider the following questions as you develop this list of key words:
• What are the essential things students must know to be able to succeed in the course?
• What are the essential things students must be able to do to succeed in the course?
• What knowledge or skills do students bring to the course that the course will build on?
• What knowledge or skills will be new to students in the course?
• What other areas of knowledge are connected to the work of the course?

2. Educational objectives: Addressing levels of learning

Scholars working in pedagogy and epistemology offer us taxonomies of learning that can help make learning outcomes
more precise. These levels of learning can also help develop assessment and evaluation methods appropriate to the
learning outcomes for the course.

Bloom’s Taxonomy of Educational Objectives

Bloom’s Taxonomy of Educational Objectives is particularly useful because it associates particular verbs with each level
of learning. Although Bloom’s Taxonomy is a hierarchy, each type of learning can be a valuable aspect of a course.
Ultimately, however, learning outcomes should focus on the “higher order thinking” found in the highest levels of the
Taxonomy: analyze, evaluate, and create. Bloom’s Taxonomy was developed in 1956, and was revised in 2001 by Bloom’s
colleagues, Lorin Anderson and David Krathwohl. The revised Taxonomy is presented here.
For additional examples of verbs aligned with each type of learning, please see Appendix B.

USEFUL VERBS
1) Remember: recall of information define, identify, list, name, recall, repeat, state
2) Understand: demonstration of comprehension classify, describe, locate, report, restate,
summarize
3) Apply: applying knowledge in a new context employ, illustrate, solve, use
4) Analyze: supporting assertions through the use of evidence compare, contrast, criticize, distinguish,
and arguments; identifying causes and patterns examine, question, test
5) Evaluate: coming to a judgment on the value of information or appraise, argue, assess, defend, predict, select,
the validity of arguments support
6) Create: combining or grouping knowledge to come to new assemble, collect, construct, develop,
conclusions formulate, organize, propose

Centre for Teaching Support & Innovation - University of Toronto 5

 – DEVELOPING LEARNING OUTCOMES–

For an alternative taxonomy, please also see information on the Structure of Observed Learning Outcomes (SOLO)
taxonomy in Appendix C. For more information about Bloom’s original and the revised Taxonomy of Educational
Objectives, please see Appendix C.
[Information about Bloom’s revised taxonomy drawn from Anderson & Krathwohl (2001).]

Content, skills, values

These three areas can be used to identify and describe different aspects of learning that might take place in a course.
Content can be used to describe the disciplinary information covered in the course. This content might be vital to future
work or learning in the area. A learning outcome focused on content might read:

By the end of this course, students will be able recall the 5 major events leading
up to the Riel Rebellion and describe their role in initiating the Rebellion.

Skills can refer to the disciplinary or generalizable skills that students should be able to employ by the conclusion of the
class. A learning outcome focused on skills might read:

By the end of this course, students will be able to define the characteristics
and limitations of historical research.

Some learning outcomes might articulate desired values: attitudes or beliefs that are imparted or investigated in the
course of learning in a field or discipline. In particular, value-oriented learning outcomes might focus on ways that
knowledge or skills gained in the course will enrich students’ experiences throughout their lives. A learning outcome
focused on values might read:

By the end of this course, students will be able to articulate their personal
responses to a literary work they have selected independently.

“
More guidance is needed to support effective program planning and tie the goals of
individual programs to the overall degree objectives…. Appropriate statements of
learning objectives would help faculty with curriculum planning and ensure that our
[programs of study] are coherent.
Curriculum review and renewal final report, University of Toronto Faculty of Arts &
Science, p. 19.

6 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

3. Context - Connecting your outcomes

Learning outcomes help instructors and learners focus on
the potential applications of the knowledge and skills gained in
the course. In turn, this helps students perceive the value of their
learning, and helps instructors develop appropriate assessment
tools. In developing learning outcomes, some questions that
allow for reflection on the context of the learning taking place
in the course might include:

How does this course fit into the student’s program or

curriculum?
• If the course is part of the major or specialization,
what knowledge or skills should students have coming
into the course? What knowledge or skills must
they have by its conclusion in order to proceed through
their program?
• How can this course contribute to the student’s broad
learning and the student’s understanding of
other subjects or disciplines?
• What are the priorities of the department or faculty within which the course takes place? How does
the particular focus of the course contribute to those broader goals?
• Does the course play a particular role within the student’s program (introductory, elective, summative)? How is the
course shaped by this role?

How does this course fit into the student’s personal or professional future?
• What knowledge or skills gained in this course will serve students throughout their lives? How will the class shape the
student’s general understanding of the world?
• Which careers commonly stem from education in this field? What are the skills or knowledge essential to these
careers? What kinds of work are produced in those careers?
• How can this course enrich a student’s personal or professional life? How can the student employ the knowledge and
skills gained in the class to make his or her own life, or the lives of others, better?
• Where will the student encounter the subject matter of the course elsewhere in his or her life? In what situations
might the knowledge or skills gained in the course be useful to the student?

Centre for Teaching Support & Innovation - University of Toronto 7

 – DEVELOPING LEARNING OUTCOMES–

CHARACTERISTICS OF GOOD LEARNING OUTCOMES

Good learning outcomes focus on the application and integration of the knowledge and skills acquired in a particular
unit of instruction (e.g. activity, course program, etc.), and emerge from a process of reflection on the essential contents
of a course. More specifically, good learning outcomes:
• Are very specific, and use active language – and verbs in particular – that make expectations clear. This informs students
of the standards by which they will be assessed, and ensures that student and instructor goals in the course are
aligned. Where possible, avoid terms like understand, demonstrate, or discuss that can be interpreted in many ways.
Please see Appendix B for a list of useful verbs.
Please see Appendix B for a list of useful verbs.

Vague outcome More precise outcome

By the end of the course, I expect students to increase By the end of the course, students will be able to:
their organization, writing, and presentation skills. • produce professional quality writing
• effectively communicate the results of their research
findings and analyses to fellow classmates in an oral
presentation

By the end of this course, students will be able to use By the end of this course, students will be able
secondary critical material effectively and to think to evaluate the theoretical and methodological
independently. foundations of secondary critical material and employ
this evaluation to defend their position on the topic.

• Should be flexible: while individual outcomes should be specific, instructors should feel comfortable adding, removing,
or adjusting learning outcomes over the length of a course if initial outcomes prove to be inadequate.
• Are focused on the learner: rather than explaining what the instructor will do in the course, good learning outcomes
describe knowledge or skills that the student will employ, and help the learner understand why that knowledge and
those skills are useful and valuable to their personal, professional, and academic future.
• Are realistic, not aspirational: all passing students should be able to demonstrate the knowledge or skill described
by the learning outcome at the conclusion of the course. In this way, learning outcomes establish standards for the
course.
• Focus on the application and integration of acquired knowledge and skills: good learning outcomes reflect and indicate
the ways in which the described knowledge and skills may be used by the learner now and in the future.
• Indicate useful modes of assessment and the specific elements that will be assessed: good learning outcomes prepare
students for assessment and help them feel engaged in and empowered by the assessment and evaluation process.
• Offer a timeline for completion of the desired learning.

Each assignment, activity, or course might usefully employ between approximately five and ten learning outcomes; this
number allows the learning outcomes to cover a variety of knowledge and skills while retaining a focus on essential
elements of the course.

8 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

When writing your outcomes, keep in mind…

Learning outcomes should be SMART(TT):

learning outcomes should address what

S
the learner will know or be able to do at the
peak to the learner
completion of the course

learning outcomes must indicate how

M
learning will be assessed
easurable

The SMART(TT) method of

learning outcomes should emphasize ways
goal setting is adapted from
A
in which the learner is likely to use the
pplicable
knowledge or skills gained Blanchard, K., & Johnson, S.
(1981). The one minute manager.
all learners who complete the activity New York: Harper Collins.

R
or course satisfactorily should be able
ealistic
to demonstrate the knowledge or skills
addressed in the outcome

the learning outcome should set a deadline

by which the knowledge or skills should be
T ime - bound
acquired

should be easily understood by the learner

T ransparent

should address knowledge and skills that

T
will be used by the learner in a wide variety
ransferable
of contexts

Centre for Teaching Support & Innovation - University of Toronto 9

 – DEVELOPING LEARNING OUTCOMES–

ASSESSMENT - FOLLOWING THROUGH ON

LEARNING OUTCOMES
“Key to the outcomes approach to assessment is the use
of ‘authentic assessment’. This approach stresses creating
assignments and assessments that simulate as much as possible
the situations in which students would make use of the
knowledge, skills and values emphasized in the course.”
So, what’s a learning outcome anyway? Mark Battersby, p. 2

Through assessment, learning outcomes can become fully integrated in course design and delivery. Because learning
outcomes focus on the application and integration of knowledge and skills learned, learning outcomes point to
appropriate modes of assessment and ensure that assessment focuses on the essential knowledge or skills of the course.
Assignments and exams should match the knowledge and skills described in the course’s learning outcomes. A good
learning outcome can readily be translated into an assignment or exam question; if it cannot, the learning outcome may
need to be refined.

One way to match outcomes with appropriate modes of assessment is to return to Bloom’s Taxonomy of Educational
Objectives: the verbs associated with each level of learning indicate the complexity of the knowledge or skills that
students should be asked to demonstrate in an assignment or exam question. An outcome, for example, that asks
students to recall key moments leading up to an historical event might be assessed through multiple choice or short
answer questions. By contrast, an outcome that asks students to evaluate several different policy models might be
assessed through a debate or written essay. Through assessment, learning outcomes can become fully integrated in
course design and delivery.

Because learning outcomes focus on the application and integration of knowledge and skills learned, learning outcomes
point to appropriate modes of assessment and ensure that assessment focuses on the essential knowledge or skills of the
course. Assignments and exams should match the knowledge and skills described in the course’s learning outcomes. A
good learning outcome can readily be translated into an assignment or exam question; if it cannot, the learning outcome
may need to be refined.

One way to match outcomes with appropriate modes of assessment is to return to Bloom’s Taxonomy of Educational
Objectives: the verbs associated with each level of learning indicate the complexity of the knowledge or skills that
students should be asked to demonstrate in an assignment or exam question. An outcome, for example, that asks
students to recall key moments leading up to an historical event might be assessed through multiple choice or short
answer questions. By contrast, an outcome that asks students to evaluate several different policy models might be
assessed through a debate or written essay.

Learning outcomes may also point to more unconventional modes of assessment. Because learning outcomes can
connect student learning with its application both within and outside of an academic context, learning outcomes may
point to modes of assessment that parallel the type of work that students may produce with the learned knowledge and
skills in their career or later in life.

10 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

The following worksheet might help you translate your instructional goals or objectives for a unit of instruction into an
assessable learning outcome. Remember that each unit of instruction might have multiple learning outcomes.

Unit of Objective Outcome How do you know? A ssessment

instruction
E.g. lecture, What content or What should students How will you be able to What kind of work can
activity, skills will be covered know or be able to do tell that students have students produce to
exam, course, in this instruction? as a result of this unit of achieved this outcome? demonstrate this?
workshop instruction?
Examples:
Class activity • Identification and By completing this Student predictions Based on this standard
evaluation of severe assignment, students will be compared with weather map, please
weather patterns will be able to historical weather indicate where you would
• Use of weather accurately predict records expect to see severe
maps severe weather using a whether in the next 24-
standard weather map hour period. Your results
will be compared with
historical weather records
Exam Stylistic By the end of this unit, Students will be able Read this passage. Identify
characteristics and students will be able to to identify a passage which literary movement
common themes of identify the stylistic and from a Modernist it represents and which
Modernist literature thematic elements of novel they have not qualities drew you to that
Modernism read conclusion

For a full-page version of this worksheet, please see Appendix D.

For additional information on assessment:

Astin, A. (1991). Assessment for excellence. Toronto: Collier Macmillan Canada.
Assessment. London: Educational Development Unit, London Metropolitan University.
https://metranet.londonmet.ac.uk/fms/MRSite/psd/hr/capd/Assessment%20Framework/
Assessment%20Framework/University%20Assessment%20Framework.pdf
Core principles of effective assessment. Melbourne: Australian Universities Teaching Committee, Centre for the
Study of Higher Education (Australia). http://www.cshe.unimelb.edu.au/assessinglearning/docs/
AssessingLearning.pdf

Centre for Teaching Support & Innovation - University of Toronto 11

 – DEVELOPING LEARNING OUTCOMES–

COURSE, PROGRAM, INSTITUTION: CONNECTING

LEARNING OUTCOMES
Learning outcomes can also be implemented at the program or institutional level to assess
student learning over multiple courses, and to monitor whether students have acquired the
necessary knowledge and skills at one stage to be able to move onto the next.

Series of courses
Courses that require prerequisites may benefit from identifying a list of outcomes necessary for advancement from one
level to another. When this knowledge and these skills are identified as outcomes as opposed to topics, assessment in
the first level can directly measure preparation for the next level.

Program
Many major and specialist programs identify a list of discipline-specific and multi-purpose skills, values, and areas of
knowledge graduating students in the program will have. By articulating these as things that students will know or be
able to do, the benefits of a program of study can be clearly communicated to prospective students, to employers, and
to others in the institution.

Athabasca University develops learning outcomes for all its undergraduate major programs. Its outcomes for the
anthropology BA include:

Knowledge Outcomes
As a result of completing this program, students should be able to
• show evidence of a broad understanding of the past and present social, linguistic and cultural diversity of people
and their biological diversity and evolution.
• show familiarity with the nature of the four fundamental fields within anthropology (archaeology, biological
anthropology, anthropological linguistics and cultural anthropology) and their interrelationship. This familiarity will
lead students to adopt a holistic and comparative approach to understanding human differences and similarities
across the world and through time.
• demonstrate a familiarity with basic anthropological concepts, terminology and theory. This familiarity will lead
students to an appreciation of anthropology’s history and context. The application of anthropology to other
discussions will become a part of students’ general liberal arts and science university degree.

Skills Outcomes
As a result of completing this program, students should be able to
• show evidence of a familiarity with anthropological research methods and critically analyze their use in the research
of other research methods.
• demonstrate a facility in critical thinking and reasoning by applying these skills to anthropological problems and
issues.
• exhibit university-level skills in academic writing, including research and argumentation, and apply their academic
writing skills to anthropological problems and issues.
• employ basic research skills to access and critically evaluate information that bears on anthropological topics from
scholarly and popular sources, including electronic (web) sources, video and audio sources and printed sources.

12 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

Value Outcomes
As a result of completing this program, students should be able to demonstrate a fundamental awareness of
• the cultural and social bases of human prejudice and discrimination (e.g., racism, ethnocentrism, sexism,
anthropocentrism).
• anthropological insights and alternatives that foster tolerance for the diversity of human cultures, ways of life and
the value of human diversity.
[From http://www.athabascau.ca/programs/ba4anth/]

Institution
Academic plans increasingly include
a list of learning outcomes that apply
across programs of study and even
across degree levels. These outcomes
provide an academic vision for the
institution, serve as guidelines for new
programs and programs undergoing
review, and communicate to members
of the university and the public at large
the academic values and goals of the
university. As previously discussed, the
best learning outcomes address course-
specific learning within the context of a
student’s broader educational experience.
One way to contribute to a coherent learning experience is to align course outcomes, when appropriate, with institutional
priorities.

The University of Toronto’s academic plan, Stepping Up: A framework for academic planning at the University of Toronto,
2004-2010, outlines institutional goals in relation to the learning experience of our undergraduate and graduate students.
These priorities are further articulated in “Companion Paper 1: Enabling Teaching and Learning and the Student
Experience”. The skills outcomes meant to apply to all undergraduate programs follow.

Undergraduate students should leave the University of Toronto having acquired certain abilities, values, and commitments:
• knowing what one doesn’t know and how to seek information
• able to think: that is, to reason inductively and deductively, to analyze and to synthesize, to think through moral and
ethical issues, to construct a logical argument with appropriate evidence
• able to communicate clearly, substantively, and persuasively both orally and in writing
• able not only to answer questions through research and analysis but to exercise judgment about which questions
are worth asking
• knowledgeable about and committed to standards of intellectual honesty and use of information
• knowing how to authenticate information, whether it comes from print sources or through new technologies
• able to collaborate with others from different disciplines in the recognition that multidisciplinary approaches are
necessary to address the major issues facing society
• understanding the methods of scientific inquiry; that is, scientifically literate
[To see other learning outcomes from the U of T academic plan, please see
https://www.studentlife.utoronto.ca/research/learningoutcomes.htm]

Centre for Teaching Support & Innovation - University of Toronto 13

 – DEVELOPING LEARNING OUTCOMES–

Curriculum mapping: translating between local and global learning outcomes

At the global program or institutional level, learning outcomes are often necessarily vague to allow for flexibility in
their implementation and assessment. Consequently, in order to be effectively applied at the local level of a course or
class, they must be reformulated for the particular setting. Similarly, learning outcomes from individual courses may be
extrapolated and generalized in order to create program- or institution-wide learning outcomes. Both of these processes
are most frequently accomplished through a technique called “curriculum mapping”. When moving from programmatic
or institutional to course or class outcomes, curriculum mapping involves identifying which courses, portions of courses,
or series of courses fulfill each programmatic or institutional learning outcome. The global learning outcomes can then
be matched with course-specific outcomes that directly address the content and skills required for that particular subject
material. Identifying and locating all the learning outcomes encountered by a student over the course of their program
can help present learning as a coherent whole to students and others, and can help students make the connection
between their learning in one course and that in another. Maki (2004) notes that understanding where particular pieces
of learning take place can help students take charge of their own education:

A map reveals the multiple opportunities that students have to make

progress on collectively agreed-on learning goals, beginning with their
first day on campus. Accompanied by a list of learning outcomes, maps can
encourage students to take responsibility for their education as a process
of integration and application, not as a checklist of courses and educational
opportunities. Maps can also position students to make choices about
courses and educational experiences that will contribute to their learning
and improve areas of weakness.

For more information about and examples of curriculum mapping, please see Maki, P. (2004). Maps and inventories:
Anchoring efforts to track student learning. About Campus 9(4), 2-9.

14 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

FURTHER RESOURCES ON LEARNING OUTCOMES

Articles & Books:
Battersby, M. (1999). So, what’s a learning outcome anyway? Vancouver: Centre for Curriculum, Transfer and Technology,
British Columbia Ministry of Advanced Education.
College learning for the new global century. (2007). Washington, D.C.: Association of American Colleges & Universities.
Gosling, D & Moon, J. (2001). How to use learning outcomes & assessment criteria. London: Southern England Consortium
for Credit Accumulation and Transfer (SEEC).
Liberal education outcomes. (2007). Washington, D.C.: Association of American Colleges & Universities.
Maki, P. (2004). Maps and inventories: Anchoring efforts to track student learning. About Campus, 9(4), 2-9.
Marsh, P.A. (2007). What is known about student learning outcomes and how does it relate to the Scholarship of Teaching
and Learning? International Journal for the Scholarship of Teaching and Learning, 1(2).
Shipley, D. (1994). Learning outcomes: Another bandwagon or a strategic instrument of reform. College Quarterly, 1(4).

Websites:
Developing learning outcomes and assessing them. Atlanta: Teaching and Learning with Technology Center, Georgia State
University. http://www2.gsu.edu/~wwwltc/howto/developLO.htm
Guide to learning outcomes. Birmingham: University of Central England. www.infoskills2.pbworks.com/f/learning.
ppt
Instructional objective writing assistant. Atlanta: School of Civil and Environmental Engineering, Georgia Institute of
Technology. http://fie-conference.org/fie2000/papers/1186.pdf
Learning outcomes support. Winnipeg: Red River College. https://me.rrc.mb.ca/LearningOutcomeSupport/
Writing aims and learning outcomes. Southampton: University of Southampton. http://www.effectivepractitioner.
nes.scot.nhs.uk/media/298809/4.%20learning%20outcomes.pdf

Centre for Teaching Support & Innovation - University of Toronto 15

 – DEVELOPING LEARNING OUTCOMES–

APPENDIX A: EXAMPLES OF LEARNING OUTCOMES

Upon completing this assignment, students will be able to provide
Good learning outcomes are accurate diagrams of cells and be able to classify cells from microscopic
focused on what the learner images.
will know or be able to do by By the end of this course, students will be able to identify and develop
the end of a defined period of data collection instruments and measures for planning and conducting
time and indicate how that sociological research.
knowledge or skill will be
By the end of this workshop, participants will be able to identify and
demonstrated. classify their spending habits and prepare a personal budget.

By the end of this course, students will be able to:

• predict the appearance and motion of visible celestial objects One unit of instruction
• formulate scientific questions about the motion of visible celestial objects – whether a course,
• plan ways to model and/or simulate an answer to the questions chosen assignment, or workshop
– might have multiple
• select and integrate information from various sources, including electronic
learning outcomes that
and print resources, community resources, and personally collected data,
span a range levels of
to answer the questions chosen
learning as described by
• communicate scientific ideas, procedures, results, and conclusions using Bloom’s Taxonomy and
appropriate SI units, language, and formats
indicated by relevant,
• describe, evaluate, and communicate the impact of research and other active verbs.
accomplishments in space technology on our understanding of scientific
theories and principles and on other fields of endeavour.

Learning outcomes can address content, skills, and long-term attitudes or values.

CONTENT
By the end of this course, students will be able to categorize macroeconomic policies according to the economic theories
from which they emerge.
By the end of this unit, students will be able to describe the characteristics of the three main types of geologic faults (dip-
slip, transform, and oblique) and explain the different types of motion associated with each.
SKILLS
By the end of this course, students will be able to ask questions concerning language usage with confidence and seek
effective help from reference sources.
By the end of this course, students will be able to analyze qualitative and quantitative data, and explain how evidence
gathered supports or refutes an initial hypothesis.
VALUES
By the end of this course, students will be able to work cooperatively in a small group environment.
By the end of this course, students will be able to identify their own position on the political spectrum.

16 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

Learning outcomes should use specific language, and should clearly indicate
expectations for student performance.

Vague outcome More precise outcome

By the end of this By the end of this course, students will be able to:
course, students will • describe the research process in social interventions
have added to their
understanding of the • evaluate critically the quality of research by others
complete research • formulate research questions designed to test, refine, and build theories
process.
• identify and demonstrate facility in research designs and data collection strategies that
are most appropriate to a particular research project
• formulate a complete and logical plan for data analysis that will adequately answer the
research questions and probe alternative explanations
• interpret research findings and draw appropriate conclusions

By the end of this course, By the end of this course, students will be able to:
students will have a • identify and describe the major literary movements of the 20th century
deeper appreciation of
literature and literary • perform close readings of literary texts
movements in general. • evaluate a literary work based on selected and articulated standards

Beginning language course

By the end of this course students will be able to:
Learning outcomes • identify the most frequently encountered endings for nouns, adjectives and
are useful for all verbs, as well as some of the more complicated points of grammar, such as
levels of instruction, aspect of the verb
and in a variety of • translate short unseen texts from Czech
contexts. • read basic material relating to current affairs using appropriate reference
works, where necessary
• make themselves understood in basic everyday communicative situations

Graduate research methodologies class

By the end of this course, students will be able to:
• identify key measurement problems involved in the design and evaluation of social interventions and suggest
appropriate solutions
• assess the strengths and weaknesses of alternative strategies for collecting, analyzing and interpreting data from
needs analyses and evaluations in direct practice, program and policy interventions
• identify specific strategies for collaborating with practitioners in developmental projects, formulation of research
questions, and selection of designs and measurement tools so as to produce findings usable by practitioners at all
levels
• analyze qualitative data systematically by selecting appropriate interpretive or quantified content analysis
strategies
Centre for Teaching Support & Innovation - University of Toronto 17
 – DEVELOPING LEARNING OUTCOMES–

• evaluate critically current research in social work

• articulate implications of research findings for explanatory and practice theory development and for practice/
program implementation
• instruct classmates and others in an advanced statistical or qualitative data analysis procedure

Teaching development course for faculty

By the end of the course you will be able to:
• identify several learning style models and know how to use these models in your teaching
• construct and use learning objectives
• design a course and a syllabus
• implement the principles of Universal Instructional Design in the design of a course
• use strategies and instructional methods for effective teaching of small classes and large classes
• identify the advantages and disadvantages of different assessment methods
• construct a teaching portfolio
[Learning outcomes for CTSI course designed by Prof. Susan McCahan, “Fundamentals of University Teaching”]

18 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

APPENDIX B: USEFUL VERBS FOR DEVELOPING

LEARNING OUTCOMES
This list of useful verbs for creating learning outcomes is
arranged according to Bloom’s Taxonomy of Educational
Objectives, which identifies different cognitive domains
associated with levels of learning. Bloom’s taxonomy was
developed in 1956, and was revised in 2001 by Bloom’s
colleagues, Lorin Anderson and David Krathwahl. The
revised taxonomy is presented here.

REMEMBERING: recall of information

• arrange • enumerate • recognize • list • select
• cite • find • match • order • show
• collect • identify • relate • quote • state
• define • locate • select • recall
• describe • memorize • name • repeat
• duplicate • record • label • reproduce

UNDERSTANDING: demonstration of comprehension

• associate • estimate • interpret • recognize • trace

• classify • explain • justify • report • translate
• compare • extend • locate • restate
• contrast • generalize • outline • review
• convert • give examples • paraphrase • select
• describe • identify • predict • summarize

APPLYING: applying knowledge in a new context

• apply • compute • employ • interpret • show

• calculate • construct • experiment • modify • solve
• chart • contribute • extend • operate • teach
• choose • develop • illustrate • participate • test
• classify • discover • implement • practice • use
• complete • dramatize • instruct • predict

Centre for Teaching Support & Innovation - University of Toronto 19

 – DEVELOPING LEARNING OUTCOMES–

ANALYZING:
identifying causes and patterns
supporting assertions through the use of evidence and arguments

• advertise • compare • differentiate • identify • prioritize

• analyze • connect • distinguish • illustrate • question
• break down • contrast • divide • infer • select
• categorize • correlate • establish • investigate • separate
• classify • criticize • examine • order • verify
• collect • diagram • explain • outline

EVALUATING:
arguments
coming to a judgment on the value of information or the validity of

• appraise • criticize • discriminate • justify • score

• argue • critique • evaluate • predict • select
• assess • debate • grade • prioritize • support
• choose • decide • integrate • rate • value
• conclude • defend • interpret • recommend
• convince • determine • judge • reframe

CREATING: combining or grouping knowledge to come to new conclusions

• adapt • construct • generalize • negotiate • revise

• anticipate • decide • imagine • organize • select
• arrange • design • incorporate • plan • structure
• assemble • develop • individualize • propose • substitute
• collect • facilitate • integrate • rearrange • validate
• combine • formulate • invent • reconstruct
• compile • generate • modify • reorganize

[Verbs correlating to Bloom’s Taxonomy drawn from http://www.coun.uvic.ca/learn/program/hndouts/bloom.html]

20 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

APPENDIX C: TAXONOMIES OF EDUCATIONAL

OBJECTIVES
Bloom’s taxonomy
Taxonomy Information and quotations in this summary, except where otherwise noted, are drawn from Krathwohl, D. R.
(2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41 (4), 212-261. Krathwohl participated in the
creation of the original Taxonomy, and was the co-author of the revised Taxonomy.

“
The Taxonomy of Educational Objectives is a framework for classifying
statements of what we expect or intend students to learn as a result of
instruction. The framework was conceived as a means of facilitating the
exchange of test items among faculty at various universities in order to create
banks of items, each measuring the same educational objective (p. 212).”

The Taxonomy of Educational Objectives provides a common language with which to discuss educational goals.
Bloom’s original taxonomy
Benjamin Bloom of the University of Chicago developed the Taxonomy in 1956 with the help of several educational
measurement specialists.

Bloom saw the original Taxonomy as more than a measurement tool. He believed it could serve as a:
• common language about learning goals to facilitate communication across persons, subject matter, and grade levels;
• basis for determining in a particular course or curriculum the specific meaning of broad educational goals, such as
those found in the currently prevalent national, state, and local standards;
• means for determining the congruence of educational objectives, activities, and assessments in a unit, course, or
curriculum; and
• panorama of the range of educational possibilities against which the limited breadth and depth of any particular
educational course or curriculum could be contrasted (Krathwohl, 2002).

Bloom’s Taxonomy provided six categories that described the cognitive processes of learning: knowledge, comprehension,
application, analysis, synthesis, and evaluation. The categories were meant to represent educational activities of increasing
complexity and abstraction. Bloom and associated scholars found that the original Taxonomy addressed only part of
the learning that takes place in most educational settings, and developed complementary taxonomies for the Affective
Domain (addressing values, emotions, or attitudes associated with learning) and the Psychomotor Domain (addressing
physical skills and actions). These can provide other useful classifications of types of knowledge that may be important
parts of a course.

Centre for Teaching Support & Innovation - University of Toronto 21

 – DEVELOPING LEARNING OUTCOMES–

The Affective Domain Psychomotor Domain

1. Receiving 1. Reflex movements
2. Responding 2. Basic-fundamental movements
3. Valuing 3. Perceptual abilities
4. Organization 4. Physical abilities
5. Characterization by a value or value complex 5. Skilled movements
From Krathwohl, Bloom, & Masia. Taxonomy of 6. Nondiscursive communication
Educational Objectives, the Classification of Educational From Harrow. A taxonomy of psychomotor domain: a
Goals. Handbook II: Affective Domain. (1973). guide for developing behavioral objectives. (1972).

The Revised Taxonomy

Bloom’s Taxonomy was reviewed and revised by Anderson and Krathwohl, with the help of many scholars and practitioners
in the field, in 2001. They developed the revised Taxonomy, which retained the same goals as the original Taxonomy but
reflected almost half a century of engagement with Bloom’s original version by educators and researchers.

ORIGINAL TAXONOMY REVISED TAXONOMY

Knowledge Remember1
Comprehension Understand2
Application Apply
Analysis Analyze
Synthesis Evaluate
Evaluation Create

[1] Unlike Bloom’s original “Knowledge” category, “Remember” refers only to the recall of specific facts or procedures
[2] Many instructors, in response to the original Taxonomy, commented on the absence of the term “understand”. Bloom
did not include it because the word could refer to many different kinds of learning. However, in creating the revised
Taxonomy, the authors found that when instructors use the word “understand”, they were most frequently describing
what the original taxonomy had named “comprehension”.

22 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

Structure of the Cognitive Process Dimension

of the Revised Taxonomy

1.0 Remember - Retrieving relevant knowledge from 4.0 Analyze - Breaking material into its constituent
long-term memory parts and detecting how the parts relate to one
• 1.1 Recognizing another and to an overall structure or purpose

• 1.2 Recalling • 4.1 Differentiating

• 4.2 Organizing
• 4.3 Attributing

2.0 Understand - Determining the meaning of 5.0 Evaluate - Making judgments based on criteria
instructional messages, including oral, written, and and standards
graphic communication
• 5.1 Checking
• 2.1 Interpreting
• 5.2 Critiquing
• 2.2 Exemplifying
• 2.3 Classifying
• 2.4 Summarizing
• 2.5 Inferring
• 2.6 Comparing
• 2.7 Explaining

3.0 Apply - Carrying out or using a procedure in a 6.0 Create - Putting elements together to form a
given situation novel, coherent whole or make an original product
• 3.1 Executing • 6.1 Generating
• 3.2 Implementing • 6.2 Planning
• 6.3 Producing

One major change of the revised Taxonomy was to address Bloom’s very complicated “knowledge” category, the first
level in the original Taxonomy. In the original Taxonomy, the knowledge category referred both to knowledge of specific
facts, ideas, and processes (as the revised category “Remember” now does), and to an awareness of possible actions
that can be performed with that knowledge. The revised Taxonomy recognized that such actions address knowledge
and skills learned throughout all levels of the Taxonomy, and thus added a second “dimension” to the Taxonomy: the
knowledge dimension, comprised of factual, conceptual, procedural, and metacognitive knowledge.

Centre for Teaching Support & Innovation - University of Toronto 23

 – DEVELOPING LEARNING OUTCOMES–

Structure of the Knowledge Dimension of the Revised Taxonomy

• Factual knowledge – The basic elements that students must know to be acquainted with a discipline or solve problems
in it.
• Conceptual knowledge – The interrelationships among the basic elements within a larger structure that enable them
to function together.
• Procedural knowledge – How to do something; methods of inquiry; and criteria for using skills, algorithms, techniques,
and methods.
• Metacognitive knowledge – Knowledge of cognition in general as well as awareness and knowledge of one’s own
condition.
The two dimensions - knowledge and cognitive - of the revised Taxonomy combine to create a taxonomy table with
which written objectives can be analyzed. This can help instructors understand what kind of knowledge and skills are
being covered by the course to ensure that adequate breadth in types of learning is addressed by the course.
Taxonomy Table

Remember Understand Apply Analyze Evaluate Create

Factual Objective 1
Conceptual Objective 2
Procedural Objective 3
Metacognitive Objective 4

Structure of Observed Learning Outcomes (SOLO) taxonomy

Like Bloom’s taxonomy, the Structure of Observed Learning Outcomes (SOLO) taxonomy developed by Biggs
and Collis in 1992 distinguishes between increasingly complex levels of understanding that can be used to describe and
assess student learning. While Bloom’s taxonomy describes what students do with information they acquire, the SOLO
taxonomy describes the relationship students articulate between multiple pieces of information.
Atherton (2005) provides an overview of the five levels that make up the SOLO taxonomy:
1. Pre-structural: here students are simply acquiring bits of unconnected information, which have no organization and
make no sense.
2. Unistructural: simple and obvious connections are made, but their significance is not grasped.
3. Multistructural: a number of connections may be made, but the meta-connections between them are missed, as is
their significance for the whole.
4. Relational level: the student is now able to appreciate the significance of the parts in relation to the whole.
5. At the extended abstract level, the student is making connections not only within the given subject area, but also
beyond it, able to generalize and transfer the principles and ideas underlying the specific instance.
[From Atherton, J. (2005). Learning and teaching: SOLO taxonomy. http://www.learningandteaching.info/learning/solo.
htm

24 Centre for Teaching Support & Innovation - University of Toronto

 – DEVELOPING LEARNING OUTCOMES –

APPENDIX D: WORKSHEETS
Translating objectives into assessable outcomes
The following worksheet might help you translate your instructional goals or objectives for a unit of instruction into an
assessable learning outcome. Remember that each unit of instruction might have multiple learning outcomes.
to
What content or skills What should students How will you be able to tell What kind of work can
produce
this?
Assessment

demonstrate
E.g. lecture, activity, will be covered in this know or be able to do that students have acheived students
How do you know?

of this unit of this outcome?

Outcome

instruction?
instruction? as a result
of Objective

unit of
Instruction

exam, course
Unit

Centre for Teaching Support & Innovation - University of Toronto 25