D Kennedy Learning Outcomes
D Kennedy Learning Outcomes
D Kennedy Learning Outcomes
June 2011
Seminar for Bologna and Higher Eduation Reform
Experts
University of Oslo, Norway.
Dr Declan Kennedy,
Department of Education,
University College Cork
1
Training of university
staff in above areas
case studies
1.
22
Working Definition
Learning outcomes are statements of what a
student should know, understand and/or be
able to demonstrate after completion of a
process of learning
The learning activity could be, for example, a lecture, a
module or an entire programme.
Learning outcomes must not simply be a wish list of
what a student is capable of doing on completion of the
learning activity.
Learning outcomes must be simply and clearly
described.
Learning outcomes must be capable of being validly
assessed.
44
10
10
Benjamin Bloom
(1913 1999)
He looked on learning as a
process we build upon our former
learning to develop more complex levels of
understanding
Carried out research in the development of
classification of levels of thinking behaviours in the
process of learning. PhD University of Chicago in
1942.
Worked on drawing up levels of these thinking
behaviours from the simple recall of facts at the lowest
level up to evaluation at the highest level.
11
11
Blooms Taxonomy of
Educational Objectives
Blooms taxonomy (1956) is a very useful aid to
writing learning outcomes.
The taxonomy consists of a hierarchy of
increasingly complex processes which we want
our students to acquire.
Provides the structure for writing learning
outcomes
Blooms Taxonomy is frequently used by
teachers in writing learning outcomes as it
provides a ready made structure and list of
verbs.
12
12
Examples: Knowledge
Recall genetics terminology: homozygous, heterozygous,
phenotype, genotype, homologous chromosome pair, etc.
Identify and consider ethical implications of scientific
investigations.
Describe how and why laws change and the consequences
of such changes on society.
List the criteria to be taken into account when caring for a
patient with tuberculosis.
Define what behaviours constitute unprofessional practice
in the solicitor client relationship.
Outline the history of the Celtic peoples from the earliest
evidence to the insular migrations.
Describe the processes used in engineering when
preparing a design brief for a client.
Recall the axioms and laws of Boolean algebra.
16
16
2. Comprehension - ability to
understand and interpret learned
information
Use action verbs like:
6. Evaluation
5. Synthesis
4.Analysis
3. Application
2. Comprehension
1. Knowledge
Examples: Comprehension
Differentiate between civil and criminal law
Identify participants and goals in the development of electronic
commerce.
Discuss critically German literary texts and films in English.
Predict the genotype of cells that undergo meiosis and mitosis.
Translate short passages of contemporary Italian.
Convert number systems from hexadecimal to binary and vice versa.
Explain the social, economic and political effects of World War I on the
post-war world.
Classify reactions as exothermic and endothermic.
Recognise the forces discouraging the growth of the educational
system in Ireland in the 19th century.
Explain the impact of Greek and Roman culture on Western civilisation.
Recognise familiar words and basic phrases concerning
themselves.when people speak slowly and clearly.
18
18
6. Evaluation
5. Synthesis
4.Analysis
3. Application
2. Comprehension
1. Knowledge
Examples application
Construct a timeline of significant events in the history of
Australia in the 19th century.
Apply knowledge of infection control in the maintenance of
patient care facilities.
Select and employ sophisticated techniques for analysing the
efficiencies of energy usage in complex industrial processes.
Show proficiency in the use of vocabulary and grammar, as
well as the sounds of the language in different styles..
Relate energy changes to bond breaking and formation.
Modify guidelines in a case study of a small manufacturing
firm to enable tighter quality control of production.
Show how changes in the criminal law affected levels of
incarceration in Scotland in the 19th century.
Apply principles of evidence-based medicine to determine
clinical diagnoses.
20
20
Examples: Analysis
Analyse why society criminalises certain behaviours.
Compare and contrast the different electronic business
models.
Categorise the different areas of specialised interest within
dentistry.
Debate the economic and environmental effects of energy
conversion processes.
Identify and quantify sources of errors in measurements.
Calculate gradient from maps in m, km, % and ratio.
Critically analyse a broad range of texts of different genres
and from different time periods.
Compare the classroom practice of a newly qualified
teacher with that of a teacher of 20 years teaching
experience.
Calculate logical functions for coders, decoders and
multiplexers.
22
22
6. Evaluation
5. Synthesis
4.Analysis
3. Application
2. Comprehension
1. Knowledge
Examples: Synthesis
Recognise and formulate problems that are amenable to
energy management solutions.
Propose solutions to complex energy management
problems both verbally and in writing.
Assemble sequences of high-level evaluations in the
form of a program.
Integrate concepts of genetic processes in plants and
animals.
Summarise the causes and effects of the 1917 Russian
revolutions.
Relate the sign of enthalpy changes to exothermic and
endothermic reactions.
Organise a patient education programme.
24
24
6. Evaluation
5. Synthesis
4.Analysis
3. Application
2. Comprehension
1. Knowledge
Examples: Evaluation
Assess the importance of key participants in
bringing about change in Irish history
Evaluate marketing strategies for different
electronic business models.
Appraise the role of sport and physical education
in health promotion for young people.
Predict the effect of change in temperature on
the position of equilibrium
Summarise the main contributions of Michael
Faraday to the field of electromagnetic induction.
26
26
Anderson and
Krathwohl (2001)
To remember
To understand
To apply
To analyse
To evaluate
To create
27
4. Organisation
3. Valuing
2. Responding
1. Receiving
31
31
Laboratory skills
Operate the range of instrumentation specified in the module safely
and efficiently in the chemistry laboratory.
Perform titrations accurately and safely in the laboratory.
Construct simple scientific sketches of geological features in the field.
Clinical Skills
Perform a comprehensive history and physical examination of
patients in the outpatient setting and the general medical wards,
excluding critical care settings.
Perform venipuncture and basic CPR.
Presentation skills
Deliver an effective presentation.
Demonstrate a range of graphic and CAD communication techniques.
Perform basic voice and movement tasks (theatre studies).
32
32
Learning Outcomes
The ECTS credit system is the common
currency for education.
Learning Outcomes are the common language
for education.
Facilitate comparability across the various
systems in different countries.
Facilitate diversity formal learning, informal
learning, life long learning, etc.
The term competency is commonly used to
point the learner in the general direction but
caution must be exercised when using this term.
34
Words of advice ..
The key word is DO and the key need in drafting learning outcomes
is to use active verbs. (Jenkins and Unwin, Fry et al.)
They [Learning Outcomes] are statements describing observable
behaviour and therefore must use action verbs Words like
appreciate and understand do not help students because there
are so many interpretations of their meaning. It is more transparent
and helpful to be specific about expectations (Morss and Murray).
Avoid verbs like know, understand, be familiar with, be exposed
to (Osters and Tiu)
Try to avoid ambiguous verbs such as understand, know, be
aware and appreciate. (Sheffield Hallam Guide).
Care should be taken in using words such as understand and
know if you cannot be sure that students will understand what it
means to know or understand in a given context (Univ NSW).
Certain verbs are unclear and subject to different interpretations in
terms of what action they are specifying These types of verbs
should be avoided: know, become aware of, appreciate, learn,
understand, become familiar with. (American Association of Law
36
36
Libraries).
42
42
43
45
45
47
Formative Assessment
Assessment FOR learning gives
48
48
Summative Assessment
Assessment that
summarises student learning
at end of module or
programme Assessment
OF Learning.
Sums up achievement no
other use.
Generates a grade or mark.
Usually involves assessment
using the traditional
examination.
Only a sample of the
Learning Outcomes are
assessed cannot assess
all the Learning Outcomes.
49
49
Continuous Assessment
A combination of
summative and
formative assessment.
Usually involves
repeated summative
assessments.
Marks recorded.
Little or no feedback
given.
50
50
Learning outcomes
1. Demonstrate good
presentation skills.
2. Formulate food
product
3. Identify an area for
research
4. Identify signs and
symptoms of MS in
a patient
Assessment?
a) Multiple choice
questions
b) Prepare a 1000word research
proposal
c) Lab-based project
d) Make a presentation
to peers
51
On successful
completion of
this module,
students
should be able
to:
Summarise
evidence from
the science
education
literature to
support
development
of a line of
argument.
Assessment criteria
Grade 1
Grade 2 :
1
Grade 2 :
2
Pass
Fail
Outstanding
use of
literature
showing
excellent
ability to
synthesise
evidence in
analytical
way to
formulate
clear
conclusions.
Very good
use of
literature
showing
high ability
to
synthesise
evidence in
analytical
way to
formulate
clear
conclusions.
Good use
of
literature
showing
good
ability to
synthesis
e
evidence
in
analytical
way to
formulate
clear
conclusion
s
Limited
use of
literature
showing
fair
ability to
synthesi
se
evidence
to
formulat
e
conclusio
ns.
Poor use of
literature
showing
lack of
ability to
synthesise
evidence to
formulate
conclusions
53
Learning outcomes
Learning
Outcomes
Teaching
Activities
Learning Activities
Assessment
Outcomes
Constructive Alignment
(Biggs, 2005)
Constructive
The students construct understanding for themselves through
learning activities. Teaching is simply a catalyst for learning
(Biggs).
If students are to learn desired outcomes in a reasonably effective
manner, then the teachers fundamental task is to get students to
engage in learning activities that are likely to result in their
achieving those outcomes. It is helpful to remember that what
the student does is actually more important in determining what is
learned than what the teacher does (Shuell, 1986)
Alignment
Alignment refers to what the teacher does in helping to support the
learning activities to achieve the learning outcomes.
The teaching methods and the assessment are aligned to the
learning activities designed to achieve the learning outcomes.
Aligning the assessment with the learning outcomes means that
students know how their achievements will be measured.
56
3.
4.
If the learning
outcomes are
clearly written,
the assessment
is quite easy to
plan!
58
58
Assessment
Cognitive
(Demonstrate:
Knowledge, Comprehension,
Application, Analysis,
Synthesis, Evaluation)
Lectures
Tutorials
Discussions
Laboratory work
Affective
(Integration of beliefs, ideas and
attitudes)
Clinical work
Group work
Seminar
Psychomotor
(Acquisition of physical skills)
Learning outcomes
Module ED2100
Assessment
10 credit module
Mark = 200
Cognitive
Recognise and apply the basic
principles of classroom
management and discipline.
Identify the key characteristics of
high quality science teaching.
Develop a comprehensive
portfolio of lesson plans
Lectures (12)
Tutorials (6)
Affective
Display a willingness to cooperate with members of
teaching staff in their assigned
school.
Participate successfully in Peer
Assisted Learning project
Participation in mentoring
feedback sessions in school (4)
Psychomotor
Demonstrate good classroom
presentation skills
Perform laboratory practical
work in a safe and efficient
manner.
Participation in 3 sessions of
UCC Peer Assisted Learning
(PAL) Programme.
(50 marks)
Teaching practice
6 weeks at 2 hours per week.
Laboratory work
60
60
Writing Learning
Outcomes and linking
them to Teaching and
Learning Activities and to
Assessment is a Process
not an Event
61
61
learning outcome.
Discuss Blooms Taxonomy of Educational
Objectives.
Apply Blooms Taxonomy to help you to
write some learning outcomes.
Discuss the linking of Learning Outcomes
to Teaching and Learning activities and
Assessment.
62
62
References
Adam, S. (2004) Using Learning Outcomes: A consideration of the nature,
role, application and implications for European education of employing
learning outcomes at the local, national and international levels. Report on
United Kingdom Bologna Seminar, July 2004, Herriot-Watt University.
Allan, J (1996) Learning Outcomes in Higher Education. Studies in Higher
Education, 21 (1) 93 - 108
Boam, R. and Sparrow, P. (Eds) (1992) Designing and achieving
competency, London: McGraw-Hill
Boni A and Lozano F (2007) The generic competences: an opportunity for
ethical learning in the European convergence in higher education. Higher
Education 54: 819 831.
Baume, D. (1999). Specifying Aims and Learning Outcomes Milton Keynes:
Open University.
Biggs J, (2003) Aligning Teaching and Assessing to Course Objectives.
Teaching and Learning in Higher Education: New Trends and Innovations.
University of Aveiro, 13 17 April 2003
Biggs, J. (2005) Teaching for Quality Learning at University (2003).
Wiltshire: Open University Press ISBN 0335211682
Bingham, J. (1999) Guide to Developing Learning Outcomes, The Learning
and Teaching Institute Sheffield Hallam University, Sheffield.
Black, P and William, D (1998) Inside the Black Box: Raising Standards
through Classroom Assessment, London: Kings College.
63
64
66
Kendall Phillips L. (1994) The Continuing Education Guide: the CEU and
Other Professional Development Criteria. Iowa: Hunt Publishing.
Kennedy D, Hyland A and Ryan N (2006) Writing and using Learning
Outcomes, Bologna Handbook, Implementing Bologna in your Institution,
C3.4-1, 1 30.
Kennedy, D (2007) Writing and Using Learning Outcomes A Practical
Guide. Quality Promotion Unit, University College Cork. Available from
www.NAIRTL.ie
Kennedy D, Hyland A and Ryan N (2009) Learning Outcomes and
Competences, Bologna Handbook, Introducing Bologna Objectives and
Tools, B2.3-3, 1 18.
McBeath, G. (1990) Practical Management Development: Strategies for
Management Resourcing and Development in the 1990s, Oxford: Blackwell
Messick, S. (1975) The standard problem: meaning and values in
measurement and evaluation. American Psychologist October 1975 : 955966
Messick, S. (1982) Abilities and Knowledge in Educational Achievement
Testing: The Assessment of Dynamic Cognitive Structures. Princeton: New
Jersey: Education Testing Service.
Miller, C, Hoggan, J., Pringle, S. and West, C. (1988) Credit Where Credits
Due. Report of the Accreditation of Work-based Learning Project. Glasgow.
SCOTVEC.
Mitriani, A., Dalziel, M and Fitt, D. (1992) Competency Based Human
Resource Management, London: Kogan Page.
Morss, K and Murray R (2005) Teaching at University. London: Sage
Publications ISBN 1412902975
68
71
71