2 Presentation Material PO Co PSO
2 Presentation Material PO Co PSO
2 Presentation Material PO Co PSO
Washington Accord
It recognizes the substantial equivalency of programs accredited by those bodies and
recommends that graduates of programs accredited by any of the signatory bodies be
recognized by the other bodies as having met the academic requirements for entry
to the practice of engineering
Accreditation
Accreditation is a process of quality assurance and improvement, whereby a program in
an approved Institution is critically appraised to verify that the Institution or the program
continues to meet and/or exceed the Norms and Standards prescribed by regulator from
time to time.
It is a kind of recognition which indicates that a programme or Institution fulfils certain
standards.
Programs, and not Educational Institutions, are considered for accreditation.
Benefits of Accreditation
Facilitates continuous Quality Improvement
Demonstrates accountability to the public
Improves staff morale
Recognizes the achievements/innovations
Facilitates information sharing
Priority in getting financial assistance helps the Institution to know its strengths,
weaknesses and opportunities
Initiates Institutions into innovative and modern methods of pedagogy
Promotes intra and inter-Institutional interactions
Levels of Outcomes
Program Educational Objectives: PEOs are broad statements that describe the
career and professional accomplishments in five years after graduation that the
program is preparing graduates to achieve.
Program Outcomes: POs are statements that describe what the students graduating
from engineering programs should be able to do
Program Specific Outcomes: PSOs are statements that describe what the graduates
of a specific engineering program should be able to do
Course Outcomes: COs are statements that describe what students should be able to
do at the end of a course
Criteria Mark/
Criteria
No. Weightage
7. Continuous Improvement 50
Total 1000
Award of Accreditation
Full Accreditation for 5 Years: 750 out of 1000 points with a minimum of 60% points in
Criteria 1, 4, 5, 6, 7 and 8
Provisional Accreditation for 2 Years: Minimum 600 out of 1000 points
No Accreditation: < 600 points out of 1000 points
NBA Accreditation Workshop – Jan. 11-13, 2016
N.J. Rao/K. Rajanikanth 4
V, M, PEOs, POs, PSOs
Sections 1, 2, 3, and 8: Work Flow
PEOs
• What the Graduates of the program are expected to achieve within 3 to 4 years of completing
the program.
• Can be abstract to some extent; but must be smaller in number and must be achievable.
• Must follow from Vision and Mission
• Must follow an established process
• Typically, the process is similar to the one for Vision and Mission
• Process Documentation
• Records of Process Implementation
• Must be shared with all stake holders!
• Key elements (generally):
– Professional success
– Life-long learning, Higher Education, Research
– Ethical professional practice
– Communication skills
– Team player
– ……
• 3 to 5 PEOs may be arrived at following a well-defined and recorded process
• Measurement and closing the loop
M1 M2 ... Mk
PEO1 - 3 3
...
...
PEOn 1 1 1
• M1, M2, and so on are elements of the Mission
• Correlation levels: 1, 2, or 3 interpreted as follows: 1- Slight; 2- Moderate; 3 –
Substantial. If there is no correlation, indicate by a “–”
NBA Accreditation Workshop – Jan. 11-13, 2016
N.J. Rao/K. Rajanikanth 7
• Each mapping needs to be justified
• Example:
A PEO states that the Graduates will engage in life-long learning; this is mapped to an
element of the Mission statement, “environment conducive for self-directed learning”;
PEO3–M4: The mapping strength is “substantial”
Justification: The learning environment provided in the college is designed to promote
self-directed learning by the students; this coupled with the Program Curriculum will
lead Graduates to engage in continuous learning in their professional careers.
Course Outcomes
• We plan the activity; do it; measure the performance (CHECK); and finally based on what
was planned and what was actually achieved, initiate appropriate action commencing the
next round of the quality cycle.
ACTION:
• If the attainment lags behind the planned target, we need to further analyze the reasons
for the same and plan suitable corrective actions for the next round.
• If the achievement exceeds the planned target, we need to “raise the bar”! Further, we
need to examine:
• If the targets set were too easy; if so, we need to raise the bar in a realistic fashion
• If the targets set were reasonable, then we need to plan for achieving the new
target level.
NBA Accreditation Workshop – Jan. 11-13, 2016
N.J. Rao/K. Rajanikanth 10
• This concept of Quality Loop operates at all levels of attainment of outcomes. Will be
discussed elaborately in later sessions
• At Course Level:
• Target levels of attainment of Course Outcomes (COs) are set; Course is
delivered; actual attainment of COs is determined; AND
• The loop is closed either by increasing the target level for the next offering of the
course or
• By planning suitable improvements in the teaching /learning process to increase
the actual attainment so as to reach the target
• At PO, PSO Level:
• POs and PSOs are achieved through formal courses and other co-curricular and
extra-curricular activities
• Target levels of attainment of POs and PSOs are set; Program is delivered; actual
attainment of POs and PSOs is determined; AND
• The loop is closed either by increasing the target level for the next cycle of the
program or
• By planning suitable improvements in all the relevant activities to increase the
actual attainment
• “Closing the loop” must be carried out, in a similar manner, at the level of PEOs also!
• This concept applies even at higher levels of Mission and Vision though the time frames
involved are usually much larger!
• Thus Mission is revisited typically once in 5 to 6 years.
• It is much rarer to revisit the Vision in less than about 7 to 10 years!
Remember
Remembering involves retrieving relevant knowledge from long-term memory
The relevant knowledge may be factual, conceptual, procedural, or some combination of
these
Remembering knowledge is essential for meaningful learning and problem solving as that
knowledge is used in more complex tasks
Action verbs: Recognize, recall, list, mention, state, draw, label, define, name, describe,
prove a theorem etc.
Understand
We are said to understand when we are able to construct meaning from instructional
messages
Instructional messages can be verbal, pictorial/ graphic or symbolic
Instructional messages are received during lectures, demonstrations, field trips,
performances, or simulations, in books or on computer monitors
Action verbs for ‘Understanding’
Interpret: translate, paraphrase, represent and clarify
Exemplify: Illustrate and instantiate
Classify: Categorize and subsume
Summarize: Generalize and abstract
Infer: Find a pattern
Compare: Contrast, match, and map
Explain: Construct a model
Apply
Using procedures to perform exercises or solve problems
Closely linked with procedural knowledge
Action verbs:
Execute/Implement: determine, calculate, compute, estimate, solve, draw, relate,
modify, etc.
Analyse activities
refining generalizations and avoiding oversimplifications
developing one’s perspective: creating or exploring beliefs, arguments, or theories
clarifying issues, conclusions, or beliefs
developing criteria for evaluation: clarifying values and standards
evaluating the credibility of sources of information
questioning deeply: raising and pursuing root or significant questions
clarifying arguments, interpretations, beliefs, or theories
reading critically: clarifying or critiquing texts
examining or evaluating assumptions
distinguishing relevant from irrelevant facts
making plausible inferences, predictions, or interpretations
giving reasons and evaluating evidence and alleged facts
recognizing contradictions
exploring implications and consequences
Analysis in Engineering
Use of the verb ‘analyze’ in engineering is bit tricky
It is not easy to design any questions in this category in limited time written examinations
Analyse activities can be included in assignments related to case studies, projects, term
papers and field studies
Evaluate
Make judgments based on criteria and standards
Criteria used include quality, effectiveness, efficiency and consistency
The standards may be either quantitative or qualitative
Action Verbs
Check: Test, detect, monitor, coordinate
Critique: Judge (Accuracy, adequacy, appropriateness, clarity, cohesiveness,
completeness, consistency, correctness, credibility, organization, reasonableness,
Create
Involves putting elements together to form a coherent or functional whole
While it includes objectives that call for unique production, also refers to objectives
calling for production that students can and will do
Action verbs:
Generate: Classify systems, concepts, models, explanations, generalizations,
hypotheses, predictions, principles, problems, questions, stories, theories)
Plan (design)
Produce
Critical Thinking
Critical thinking refers to the deep, intentional and structured thinking process that is
aimed at analyzing and conceptualizing information, experiences, observation, and
existing knowledge for the purpose of creating original and creative solutions for the
challenges encountered
Critical thinking is systematic and holistic in the sense that while examining a proposed
solution, it examines its impact and consequences on other parts of the system thus
ensuring that a solution at one level of the system does not create challenges and
difficulties somewhere else
Thinking critically requires a positive open and fair mindset that is able to objectively
examine the available information and is aware of the laid assumptions and limitations
brought about by them.
Critical thinking is the art of analyzing and evaluating thinking with a view to improving it
Problem Solving
Problem solving involves Apply, Analyze, Evaluate and Create processes
Categories of Knowledge
Knowledge
The problem of characterizing knowledge is an enduring question of philosophy and
psychology
Knowledge is organized and structured by the learner in line with a cognitivist -
constructivist tradition
Knowledge is domain specific and contextualized
General Categories
Factual
Conceptual
Procedural
Metacognitive
Procedural Knowledge
is the “knowledge of how” to do something
it often takes the form of a series or sequence of steps to be followed.
includes knowledge of skills, algorithms, techniques, and methods, collectively known as
procedures
also includes knowledge of the criteria used to determine when to use various procedures
is specific or germane to particular subject matters or academic disciplines
Metacognitive Knowledge
is knowledge about cognition in general as well as awareness of and knowledge about
one’s own cognition?
Practical Constraints
an array of less sharply defined considerations derived from experience in practice,
considerations that frequently do not lend themselves to theorizing, tabulation, or
programming into a computer.
Examples
The legend should be written above the switch on the front panel
The indicator lamp should be above the switch
The clearances that must be allowed between physical parts in equipment for tools and
hands to reach different parts
Design Instrumentalities
Procedural knowledge including the procedures, way of thinking and judgmental skills by
which design is done.
Examples
1. Top-down approach to the design of a product
2. Phasing of development of a product
3. Structuring of an electronic product
4. Design walkthroughs.
5. Identify all members of the team early on and include every member in the group
communications from the outset.
Taxonomy Table
It is a table of six cognitive processes (columns) and eight categories of knowledge
(rows).
Each cell represents a specific combination of cognitive process and a category of
knowledge.
Cognitive Processes
Knowledge Categories
Remember Understand Apply Analyze Evaluate Create
Factual
Conceptual
Procedural
Practical Constraints
Design instrumentalities
Metacognitive
Alignment
Alignment refers to the correspondence of learning objectives, assessment and
instructional activities
Affective Domain
Proposed in 1956 by Krothwohl, Bloom, and Masia
Difficult to structure
Catch all: self-concept, motivation, interests, attitudes, beliefs, values, self-esteem,
morality, ego development, feelings, need achievement, locus of control, curiosity,
creativity, independence, mental health, personal growth, group dynamics, mental
imagery and personality
PSOs - Examples
CSE: (Stem as with POs)
• Design, develop, test, and maintain Software Systems for business applications
• Design, develop, test, and maintain Systems Software.
• Maintain legacy software systems
ECE: (Stem as with POs)
• Specify, design, prototype and test modern electronic systems that perform analog and
digital signal processing functions.
• Architect, partition, and select appropriate technologies for implementation of a specified
communication system
Assessment
Understanding what students know and are able to do as a result of their engineering
education is fundamental to students success and to the quality and effectiveness of
engineering education
Many academics still view
The assessment of student learning as an obligatory, externally imposed chore of
compliance and accountability
Gathering evidence of students learning is not compliance with external demands but
rather, an institutional strategy, a core function of continuous improvement and a means
for faculty to elevate student success and strengthen institutional health
Outcomes of Learning
When we teach we want our students to learn.
Outcomes of any learning: Outcomes, Course Outcomes, Learning Outcomes, Intended
Learning Outcomes, Instructional Objectives, Educational Objectives, Behavioral
Objectives, Performance Objectives, Terminal Objectives, Subordinate Skills,
Subordinate Objectives, General Instructional Objectives, Specific Learning Outcomes and
Competencies.
Structure of a CO Statement
Action: Represents a cognitive/ affective/ psychomotor activity the learner should
perform. An action is indicated by an action verb representing the concerned cognitive
process.
Knowledge: Represents the specific knowledge from any one or more of the eight
knowledge categories
Sample 1
Determine the input-output characteristics of active two-port networks using Microcap simulator and
TI Analog Laboratory unit and compare their characteristics as obtained by simulation and Lab Unit
Action: Determine (Apply)
Knowledge: input-output characteristics of active two-port networks (Conceptual)
Condition: using Microcap simulator and TI Analog Laboratory unit
Criteria: compare its characteristics as obtained by simulation and Lab Unit
Sample 2
Macro model signal processing functions of resistors, capacitors, inductors, crystals, diodes,
Amplifiers, Op Amps, Comparators and Multipliers as one-port and two-port networks
Action: Macro model (Understand)
Knowledge: signal processing functions of …… (Conceptual and Procedural)
Condition: One-port and two-port networks
Criteria: None
Sample 3
Calculate major and minor losses associated with fluid flow in piping networks
Action: Calculate (Apply)
Knowledge: major and minor losses associated with fluid flow in piping networks
(Conceptual and Procedural)
Condition: None
Criteria: None
Sample 4
Determine the dynamic unbalanced conditions of a given mechanical system of rigid objects
subjected to force and acceleration
Action: Determine (Apply)
Knowledge: Dynamic unbalanced conditions (Conceptual and Procedural)
Condition: given mechanical system of rigid objects subjected to force and acceleration
Criteria: None
Check List
1. Does the CO begin with an action verb (e.g., state, define, explain, calculate,
determine, identify, select, and design)?
2. Is the CO stated in terms of student performance (rather than teacher performance
or subject matter to be covered)?
3. Is the CO stated as a learning product (rather than in terms of the learning process)?
4. Is the CO stated at the proper level of generality and relatively independent of other
COs (i.e., is it clear, concise, and readily definable)?
5. Is the CO attainable (do they take into account students’ background, prerequisite
competences, facilities, time available and so on)?
Exercise
Write a set of COs a student should acquire at the end of your course, emphasizing particularly the
relevant higher cognitive levels.
Make sure that the CO does not appear to be like a single question.
Avoid using the action verbs Apply, Analyze, Evaluate and Create. Use the action verbs
associated with these cognitive levels.
Mark the number of classroom sessions you would need to conduct the instructional
activities for each competency
Assessment Pattern
All assessment items in all CIE assessment instruments are to be tagged with
Cognitive Level (CL)
Course Outcome (CO)
Marks
Sample Assessment Pattern for all the concerned CIE Instruments (assuming 25% weightage for
CIE) indicated.
CL A1 T1 T2
5 10 10
Analyze 0 0 0
Evaluate 0 0 0
Create 0 0 0
A1 T1 T2
CO 5 10 10 CIE Class Average
Cl. Ave Cl. Ave Cl. Ave
Targets
10 40 30 10
Example 3
Targets are set for each CO of a course and for different groups of students separately
Provides considerable details which can lead to specific plans for improvement
CO Targets
CO1 10 40 40 10
CO2 20 30 40 10
CO3 20 30 40 10
CO4 10 40 40 10
CO5 20 20 50 10
CO6 20 20 50 10
Example 4
Setting targets for Course Outcomes
Targets are set for each CO of a course separately.
CO1 60%
CO2 75%
CO3 70%
CO4 70%
CO5 80%
CO6 70%
It does not directly indicate the distribution of performance among the students. It has the
advantage of finding out the difficulty of specific COs
There are several ways setting targets for Course Outcomes
Note: When there are no attainment gaps or attainment gaps are negative it is expected that the
instructor will enhance the CO target next time he offers the course.
Closure of the Quality Loop
CO1 60 -2.3%
Attainment of PEOs
Evaluation of attainment of PEOs is generally based only on Indirect Methods!
Indirect Methods:
Alumni Surveys, and Employer Surveys are generally used to evaluate the attainment of PEOs.
Thus the data from Surveys is used for evaluating the attainment of POs and PSOs as well as
PEOs.
The actual responses useful for these two different purposes are not identical!
Course Surveys
Course Surveys: Mid-Course; Course-End
Written / Electronic; Signed / Anonymous
Mid-Course Survey:
– Typically, about a month after the start of the course; can be repeated after another
month!
– Useful for corrections in course delivery
Course-End Survey:
– At the end of the course
– Useful for “closing the quality loop”
– May be used in computing course attainment, though the manual does not explicitly
recognize this approach!
Course-End Survey
Helpful for: “closing the loop”
Can be used in computing attainments of COs
Questions generally cover:
– Course Management
– Learning Environment
– Attainment of COs
– Instructor characteristics.........
Typical Questions to be answered by all the students
(on a scale of 1 to 5 – most negative to most positive response):
– COs were clear
– Instructional activities helped in attaining Cos
– Pace of coverage was comfortable
Questions were encouraged
Had good access to learning resources
Examples were worked out well and also useful for Examinations
Instructor had good communication skills
Instructor’s attitude was supportive
How much did you learn?
Any specific CO(s) that you are not confident of? (Tick them in the list below)
The course helped you in improving your problem solving abilities.........
Rubrics
What?
– A Scoring Tool useful for subjective assessments
– A more systematic way of evaluating performance of students on tasks such as
Seminars, Projects, Term Papers...
Must be shared up front with students
– Enables students “do” what is expected
– Makes the process more transparent
– Allows self-evaluation by students
Components:
– Attributes
– Descriptors
– Scores
Rubrics - Attributes
The criteria by which the performance is to be evaluated
Are derived from the planned outcomes
Example:
For a Technical Seminar on Operating Systems, some of the attributes can be:
– Verbal Skills
– Body language
– Technical Content
– ...
The more clearly articulated the attributes, the better will be the usefulness of the rubrics
Descriptors
For each (sub) Attribute:
Provide descriptions of performance at different levels of “quality”
The levels can be 3 to 5 (typical)
Number of Levels
– Too small not much discrimination
– Too large Taxing for all
– No hard and fast rule
Avoid stand-alone vague descriptors
(Excellent, Creative, Weak,)
Descriptors need to be as specific as possible
Good descriptors
– More objective evaluation
– More helpful for students in preparing well
Scores
For each level of descriptor of each (sub) attribute:
Assign scores
Can be a single value or a range of values
Avoid a range that is too wide
Rubrics – Example
Rubric for Formal Oral Presentation:
Attributes:
Organization
Style
Use of tools
Depth of Content
Accuracy of Content
...
Descriptors and Scores:
Rubrics for Main / Mini Project:
Rubrics – Laboratory
Rubrics – Project
Attributes:
Technical
Requirements
Literature Survey
Design Alternatives
...
Report
...
Presentation
...
Team Work......
Rubrics – Exercises
Main Project
Seminar
Laboratory Work
PO3, PO4,
Design VCVS, CCVS, VCCS, CCCS, and
CO4 PO5, Ap 10 4
DC and SMPS voltage regulators
PSO1
PO3, PO4,
CO5 Design analog filters Ap 8 8
PO5, PSO1
Course-POs/PSO Mapping
POs and PSOs are addressed through core courses, projects etc.
A course/project etc. meets a subset of POs and PSOs to different strengths (1, 2 or 3)
Sample Course addresses a subset of POs and PSOs to varying strengths
Course PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO PO PO PSO1 PSO2
10 11 12
C302 1 1 3 3 3 0 0 0 0 1 0 0 3 0
Course PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2
C302 1 1 3 3 3 0 0 0 0 1 0 0 3 0
Program Curriculum, T-L and Other Processes; Highly Doable and Highly Useful
Criterion II: Program Curriculum and Teaching Learning Processes
From SAR and Evaluation Manual:
Program Curriculum and Teaching Learning Processes : 120
Program Curriculum : 20
Teaching Learning Process : 100
Program Curriculum
Program Curriculum 20
Process used to identify the extent of compliance of the University Curriculum for 10
attaining the POs and PSOs; mention the curricular gaps if any
State the delivery details of the content beyond the syllabus for the attainment of the 10
POs and PSOs
Curricular Gaps
Process (One possible approach):
Responsibility: Board of Studies
Board of Studies (Typical Composition):
HoD, Faculty, Alumni, Current Final-Year Students, Industry, University, Faculty from
other Academic Institutes,
Map all the COs (Core Subjects only) to POs and PSOs
If any POs / PSOs are addressed in common by all the electives, record them
Examine the strength of mappings to the POs and PSOs
Identify weakly addressed POs and PSOs!
Record the MoM
Communicate to the University (copy retained)
Brainstorm the additional content required to address the identified curricular gaps and
record the final decisions
Deliver the content beyond the curriculum as planned
Treat this as you would treat any other course! (Measure attainments, close the quality loop
etc)
NBA Accreditation Workshop – Jan. 11-13, 2016
N.J. Rao/K. Rajanikanth 42
(BoS can meet once a semester)
Example:
Analysis of mapping of all courses to POs and PSOs reveals that one of the PSOs that is not
being addressed adequately by the University Curriculum is “Maintain Legacy Software
Application Systems”
Planned additional content:
– An additional 4-Hour Module in the Software Engineering Course; Assessment is by
Group Discussion of a Case Study
– An additional 5-Day Hands-On Training Program on Software Maintenance delivered in
collaboration with Industry; Assessment is by a Lab Test.
Academic Calendar 3
Pedagogic Initiatives 3
Classroom Teaching 3
Laboratory Experiments 3
Industry-Institute Interaction:
Industry – supported laboratories (5)
Industry participation in Program Design and Course Delivery (even partial) (5)
Impact Analysis of III and action taken thereof (5)
To Do
Establish Student Chapters of relevant professional societies, organize some events, and
maintain full records
Bring out a technical magazine / news letter (Once or twice a semester?)
Faculty Performance Appraisal and Development System (FPADS) – Define, implement, and
record
Visiting / Adjunct Faculty (at least 50 hours of interaction per year): Organize, Record
Record the Maintenance Process (Preventive / Corrective / Calibration) and record data
Establish a Project Laboratory (Facilities, Rules for Usage etc)
Define Safety Procedures and display in Laboratories; Define Review process and record Mom
Establish an Academic Audit Cell, define its functions, articulate the process details, and
record the actions etc
Establish an Entrepreneurship Development Cell, define its functions, articulate the process
details, and record the actions etc
Conclusion
Additional efforts required to attain the POs and PSOs
Must follow the Quality Cycle
Involve all the stake holders
Maintain the Records