Quality Assurance: Air Cdre (R) Muhammad Ismail Director Quality Assurance (NUST) 07 March, 2008
Quality Assurance: Air Cdre (R) Muhammad Ismail Director Quality Assurance (NUST) 07 March, 2008
Quality Assurance: Air Cdre (R) Muhammad Ismail Director Quality Assurance (NUST) 07 March, 2008
ASSURANCE
• Quality Assurance:
Definition, Need & Improvement
• Self-Assessment
Definitions, Elements, Desired Outcomes, Requirement,
Current practice, Objectives, Model, Components
• Concluding Remarks
2
INTRODUCTION
3
CHALLENGE AND RESPONSE
5
QUALITY ENHANCEMENT
CELLS (QECs)
QECs are the Quality Assurance Units developed at
universities to put a focused attention on QA aspect of
HE
7
QUALITY ASSURANCE
Definition
Assurance of Quality in higher education is a
process of establishing stakeholder confidence that
provision (input, process and outcomes) fulfils
expectations or measures up to threshold minimum
requirements.
IT HAS TO BE PLANNED
CONTINUING
IMPROVEMENT
10
IMPROVEMENT THROUGH
QUALITY MANAGEMENT
Models of Excellence
Accreditation
Standards
University
(College) Ensuring
COMPLIANCE
QUALITY
ASSURANCE
Ensuring
REGULAR
IMPROVEMENT
12
QUALITY ASSURANCE MODEL
Priorities
External Academic,
Benchmarks Social &
National
Needs
Internal Quality SWOT
Benchmarks
Vision & Goals
Academic Framework
I Awards, degrees, legalities, Pre- E
N requisites X
T T
Curricula
E E
R Support Processes R
N Admissions, Hostel, Transportation, etc N
A A
Infra-structure
L L
Human, Capital, Information, Physical
Q Management Q
Stores, HRM, QM, Purchases, etc 13
A A
QA MECHANISM OF
EVALUATION
14
QEC FUNCTIONS
Cont’d…
QEC FUNCTIONS
Cont’d…
QEC FUNCTIONS
• QEC is responsible to develop procedures for the following:
QEC HEC
19
ELEMENTS OF ASSESSMENT
• Purpose identification
• Outcomes identification
• Measurements and evaluation design
• Data collection
• Analysis and evaluation
• Decision-making regarding actions to be taken.
20
ASSESSMENT MODEL
Inputs Output
Students
Curriculum
Faculty
Graduates that
Processing Perform Outcomes
Laboratories,
Computing & Library & that Achieve
Facilities Delivery Educational
Objectives
Processes
Institutional Facilities
21
Institutional Support Assessment / Feedback
SELF-ASSESSMENT OF PROGRAMS
22
DESIRED OUTCOMES OF
SELF ASSESSMENT
• To be proactive than reactive
23
ACCREDITATION BODIES
REQUIRING SELF ASSESSMENT
25
COMPONENTS OF THE
SELF-ASSESSMENT PROCESS
26
CRITERIA
27
CRITERIA AND STANDARDS
Crit Description No. of
No. Stds
PROGRAM MISSION, OBJECTIVES AND
1 OUTCOMES 4
2 CURRICULUM DESIGN AND ORGANIZATION 7
LABORATORIES AND COMPUTING
3 FACILITIES 3
4 STUDENT SUPPORT AND GUIDANCE 3
5 PROCESS CONTROL 5
6 FACULTY 3
7 INSTITUTIONAL FACILITIES 3
8 INSTITUTIONAL SUPPORT 3
28
SELF-ASSESSMENT PROCEDURE
29
Cont’d…
SELF- ASSESSMENT PROCEDURE
QEC initiates SA through the office
of dean / HoI, one semester prior to
the assessment
SAR Complete
NO
YES
Cont’d…
SELF- ASSESSMENT PROCEDURE
QEC plans and fixes AT visit
Department prepares
implementation plan
• State program objectives ( objectives are statements that describe the expected
accomplishments of graduates following graduation from the program)
• Outline the main elements of the strategic plan to achieve the program mission
and objectives.
• Provide for each objective how it was measured, when it was measured and
improvements identified and made.
33
PROGRAM OBJECTIVES ASSESSMENT
Improvements
When Identified (Based on Improveme
Objectives How Measured
Measured the Outcomes nts Made
examination)
1 Students’ Survey
2 Alumni Survey
Employers’
3
survey
4 ?
5 ?
35
OUTCOMES VERSES OBJECTIVES
Expected Program Objective
Learning
Outcomes
1 2 3 4
3
36
Table 4.2: Outcomes versus objectives
FILLING MATRIX RELATING
OUTCOMES TO OBJECTIVES
37
SAMPLE OF MATRIX RELATING
OUTCOMES TO OBJECTIVES
Program Objectives
Enable
Skills in critical
Initiate Understand organizations
Program thinking, Employ
and professional to make
Learning problem solving IS.
manage ethics and optimal
and Technology
Outcomes change responsibility decision
communication
making
x x x
x x
Use up to
date tools
x x
Life long
learning x x x
Professional
ethics and x x
responsibility
38
EXERCISE 1
Given your University’s mission:
Develop Program Mission
Objective 1:
Measurable Outcomes:
Objective 2:
Measurable Outcomes:
40
EXERCISE 3
Choose a course you are teaching currently or would like to
teach:
a)
b)
c)
a)
b)
41
c)
MEETING STANDARD 1-2
Describe the means for assessing the extent to which graduates are performing
the stated program outcomes / learning objectives:
• Indicate the median/average student evaluation for all courses and the % of
faculty awarded excellence in research award.
Cont’d…
CRITERION 2
C. Degree plan: attach a flow-chart showing the prerequisites, core, and elective
courses.
LIST OF COURSES
Core Courses
Total
Course / Credit Laboratory
S.N Title Credit Pre-Requisites
Code No. hours Hours
Hours
Elective Courses
Total
Course / Credit Laboratory
S.N Title Credit Pre-Requisites
Code No. hours Hours
Hours
2
3
47
Cont’d…
CRITERION 2
D. Complete Table 4.3 showing curriculum breakdown in terms of mathematics
and basic sciences, major requirements, social sciences and other
requirements.
Total
Minimum
Requirements
48
Table 4.3: Curriculum course requirements
Cont’d…
BS ENGINEERING PROGRAM
No. of No. of
Domain Knowledge Area Courses
% Overall
Crd hrs
Non- Humanities (Eng, Culture, Social Scs) 8 19-21
Engg Management Sciences (Engg Mgt) 2 6
Natural Sciences (Maths, Physics, 33.8- 34.6
6 19-20
Elective)
Sub Total 16 44-47
Engg Computing (Fundl, Prog, Design) 3 9
Engineering Foundation 8 29
Major Based Core (Breadth) 5 19-20
Major Based Core (Depth) 5 17-18
Inter-Disciplinary Engineering Breadth 2 6-7 66.2- 65.4
(Electives)
Senior Design Project 2 6
Industrial Training (Summer)
Sub Total 25 86-89
Total 41 130-136 100
49
CRITERION 2
E. For each course in the program that can be counted for credit
specify the following:
• Course title
• Course objectives and outcomes
• Catalog description (Course No.)
• Text book (s) and references
• Syllabus breakdown in lectures
• Computer usage
• Laboratory
• Content breakdown in credit hours (if applicable) as basic
science, math, engineering science, and design for engg
discipline. General education requirements, business
requirements and major requirements for the Business Studies
and others. 50
Standard 2-1:
51
PROGRAM OUTCOMES
Program Outcomes
Courses or
Group of
Courses
1 2 3 4
1
2
3
Table 4.4: Courses versus program outcomes 52
PROGRAM OUTCOMES - SAMPLE
Courses or Group of courses Program Outcomes
1 2 3 4 5 6 7
COE 200, COE 205, COE 305, COE 360 + + + + + + +
COE 400, COE 485 + + + + + + +
COE 399, COE 350, 351, 352 + + + + +
COE 390
COE 308 +
COE 342 + +
COE 442 + +
ICS Courses + + + +
Stat & Mathematics, Physics & Chemistry Courses + +
English Courses +
IAS Courses +
EE Courses + + + +
Technical Electives + + +
COE Electives + +
Courses Vs Program Outcomes
53
Standard 2-2
Elements Courses
Theoretical Background
Problem Analysis
Solution Design
Example:
Element Courses
COE 200, 205, 305, 360, 400, 485, ICS 202, 399,
Solution Design
(COE 350, 351, 351)
Standard 2-4
Standard 2-5
57
Standards 2-6
• Information technology component of the curriculum must
be integrated throughout the program:
◘ Indicate the courses within the program that will satisfy the
standard.
◘ Describe how they are applied and integrated through out the
program.
Standards 2-7
• Oral and written communication skills of the student must
be developed and applied in the program:
◘ Indicate the courses within the program that will satisfy the
standard.
o Laboratory Title
o Location and area
o Objectives
o Adequacy for Instructions
o Courses taught
o Manuals for experiments
o Software Available (if applicable)
o Major Apparatus
o Major Equipment
o Safety Regulations
59
CRITERION 3
Standard 3-1
Laboratory manuals/documentation/instructions for
experiments must be available and readily accessible to
faculty and students
Standard 3-2
There must be adequate support personnel for
instruction and maintaining the laboratories
Standard 3-3
The University computing infrastructure and facilities
must be adequate to support program’s objectives
60
CRITERION 4
STUDENT SUPPORT AND ADVISING
61
CRITERION 4
Standard 4-1
Standard 4-2
Standard 4-3
Standard 5-1
The process by which students are admitted to the
program must be based on quantitative and qualitative
criteria and clearly documented. This process must be
periodically evaluated to ensure that it is meeting its
objectives:
63
Cont’d…
Standard 5-2
The process by which students are registered in the
program and monitoring of students progress to
ensure timely completion of the program must be
documented This process must be periodically
evaluated to ensure that it is meeting its objectives
Standard 5-3
64
Cont’d…
Standard 5-4
The process and procedures used to ensure that
teaching and delivery of course material to the students
emphasizes active learning and that course learning
outcomes are met. The process must be periodically
evaluated to ensure that it is meeting its objectives:
Standard 5-5
The process that ensures that graduates have
completed the requirements of the program must be
based on standards, effective and clearly documented
procedures. This process must be periodically
evaluated to ensure that it is meeting its objectives:65
CRITERION 6
FACULTY
Faculty members must be current and active in
their discipline and have the necessary technical
depth and breadth to support the program. There
must be enough faculty members to provide
continuity and stability, to cover the curriculum
adequately and effectively, and to allow for scholarly
activities. To meet this criterion the standards in this
section must be satisfied.
66
Standard 6-1
There must be enough full time faculty who are committed to the
program to provide adequate coverage of the program
areas/courses with continuity and stability.
Cont’d…
FACULTY DISTRIBUTION BY
PROGRAM AREAS
Number of
Courses in the area Number of
Program’s area of faculty
and average number faculty with
specialization members in
of sections per year Ph.D. degree
each area
Area 1
Area 2
Area 3
Area 4
Total
Table 4.6: Faculty distribution by program areas.
68
Standard 6-2
All faculty members must remain current in the discipline
and sufficient time must be provided for scholarly activities
and professional development. Also, effective programs for
faculty development must be in place
Standard 6-3
All faculty members should be motivated and have job
satisfaction to excel in their profession:
70
Standard 7-1
Standard 8-1
There must be sufficient support and financial resources to attract and
retain high quality faculty and provide the means for them to maintain
competence as teachers and scholars
Standard 8-2
Standard 8-3
Financial resources must be provided to acquire and maintain Library
72
holdings, laboratories and computing facilities
CONCLUDING REMARKS
• Self assessment will:
74
QA SYSTEM MATURITY LOGIC
An S-Curve
Improvement
S
Y Embryonic
S
Maturity
T
E
M
76
MISSION STATEMENTS
Mission Statement of University / Institute)
To develop human resources by inculcating professional knowledge, skills
and ethical values, to bring-in prosperity and technological advancement
based on high-tech research in the individual’s life and society at large
Dept to form the Program Team (PT) for each program By the end of 2nd week of
offered by the dept (with info to HQ NUST) semester.
Each PT to prepare a Self Assessment Report (SAR) By the end of 10th week of
about the relevant program and submit to LQEC in semester
two months
LQEC to review the Documentation within one month By the end of 14th week of
(and send final copy of SAR to HQ NUST ) semester.
Head of the Institution (HoI) to form the program By the end of 14th week of
Assessment Team (AT) for each program (with info to semester
HQ NUST thro’ LQEC)
83
ACTION PLAN
ACTVITY DATE
LQEC to plan and schedule AT visit (with info to HQ By the end of 14th week
NUST) after semester
AT to conduct assessment and present its findings to By the end of 4th week
LQEC, Dean, PT and dept. faculty after the visit
LQEC to submit an executive summary to the HoI By the end of 6th week
(with a copy to HQ NUST) after the visit
Dept to prepare and submit implementation plan (as By the end of 6th week
per Table A.2) to LQEC (with a copy to HQ NUST) after the visit
Comprehension
Level
Knowledge
Level
Simple
I II III IV V VI
85
CAPACITY BUILDING
86
QUALITY CONTROL
Definition
Quality Control is the mechanism for
ensuring that an out (product or service)
conforms to a predetermined specification.
87