0% found this document useful (0 votes)
46 views30 pages

Unit-5 Evaluation New

Uploaded by

thanuja
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
46 views30 pages

Unit-5 Evaluation New

Uploaded by

thanuja
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 30

UNIT 5 (12)

EVALUATION & ASSESSMENT

 Purpose & scope of evaluation & assessment

 Criteria for selection of assessment techniques and methods

 Qualities of an evaluation tool

 Principles of evaluation and test construction.

 Assessment of knowledge: Essay type questions, Short answer question (SAQ) multiple
choice questions (MCQ)

 Assessment of skills: observation checklist, practical exam, Viva, Objective structured


clinical examination (OSCE)

 Assessment of Attitudes-Attitude Scales

 Evaluation of the course

INTRODUCTION

Education aims at an all-round development of a student and not merely imparting


knowledge to him. It is therefore, necessary that teachers and educators should be equipped,
not only with subject matter (content) and dynamic methods of teaching but also with
objectives and appropriate testing devices which will assess a student’s ability .Since, the
concept of evaluation in education is of recent origin the teacher must clearly understand its
importance and acquire an adequate knowledge of the necessary techniques.

MEANING

Evaluation is such an essential part of teaching and learning. Evaluation in education is the
process of judging the effectiveness of educational experience through careful appraisal, or
involves measurement but it is different from it. Measurement is appraisal in terms of a fixed
standard whereas evaluation implies the use of relative a flexible standards. Evaluation
involves a continuous process of collecting, recording, assembling and interpreting
information. Educational evaluation is made in relation to the objectives that have been
determined previously by faculty, individual teachers and students. It is a much broader
concept than making and giving of grades at the end of the course. It is a process by which
those concerned with goals, processes and programs may collect, make judgments and revise
an necessary.

The term evaluation is derived from the word ‘valoir’, which means ‘to be worth’. Thus,
evaluation in the process of judging the value or worth of an individual’s achievements or
characteristics. In broad sense, educational evaluation is concerned with judgeing the value or
worth of the goals attained by the education system.

DEFINITION

 Evaluation is the process of determining to what extent the educational objectives


are being realized- Ralph Tyler, 1950
 Evaluation is an assignment of symbols to a phenomenon in order to characterize the
worth or value of a phenomenon usually with reference to some social, cultural or
scientific standard. –Bradfield and Moredock, 1957
 Evaluation is a relatively new technical term introduced in designate a more
comprehensive concept of measurement that is implied in conventional tests and
examinations. –Writingston, Enchyclopedia of Educational Research
 Evaluation is the assessment of merit and or worth. – Scriven, 1963
 Evaluation is regarded as providing information and for decision making – Staffebeam et
al, 1971
 Evaluation is a value judgment on an observation, “performance test” or indeed any
‘data’ whether directly measured or inferred. – International Dictionary of Education,
1977
 Evaluation is a systematic examination of educational and social programs. –Conbach et
al, 1980

Purpose & scope of evaluation & assessment

Purpose of evaluation
The teacher of nursing students should have complete program of evaluation, which
should be considered as an integral, continuous part of the teaching, which enables them to
accomplish the following important purposes. The overall purpose of the evaluation will be
to provide information to enable each student to develop according to his potential within the
framework of educational objective.

Bloom stated the following main purposes of evaluations:

 To discover the extent of competence which the students have developed in initiating,
organizing and improving his day-to-day work and to diagnose his strengths and
weakness with a view to further guidance.
 To predict the educational practices which a particular student-teacher can best
participate in or organize.
 At the end of the career to certify student’s degree, proficiency in a particular
educational practice.
Thus the overall purposes of evaluation are as follows:
 To appraise the status of and changes in student’s behavior
 To make provision for guiding the growth of the individual student
 To diagnose the individual students educational weakness and strength
 To assess the student’s progress from time to time and discloses student’s needs and
possibilities.
 To predict the student’s future academic success or otherwise
 To provide basis for modification of the curriculum and courses
 To locate areas where remedial measures are needed
 To provide basis for the introduction of experiences to meet the needs of individuals
and groups of students
 Motivate students towards better attainment and growth
 Text the efficiency of teachers in providing learning experiences and the effectiveness
of instruction and classroom activities.
 Appraise the teachers and supervisors competence
 Improve instructions, measurements and measuring devices
 Bring out the inherent capabilities of a student, such as attitudes, habits, appreciation
and understanding manipulative skills in addition to conventional acquisition of
knowledge.
 Serves as method of self-improvement, improving school learning relations and as a
guiding principles for a selection of supervisor techniques.
 To determine the levels of knowledge and understanding of the students in her/his
classes at various times during the year or semester.
 To determine the level of the student’s clinical performances at various stages.
 To became aware of the specific difficulties of individual students, of an entire class,
as a basis for further teaching.
 To diagnose each student’s strengths and weaknesses and to suggest remedial
measure which may be needed.
 To encourage student’s learning by measuring their achievement and inform them of
their success.
 To help students to acquire the attitude of and skills in self-evaluation.
 To help students to become increasingly self-directing in their study.
 To provide the additional motivation of examinations that provide opportunity to
practice critical thinking, the application of principles, the making of judgment, etc.
 To estimate the effectiveness of teaching and learning technics, of subject content,
and of instructional media in reaching the goals of her course.
 To gather information needed for administrative purposes, such as selecting students
for higher courses, placement of students for advanced training, writing
recommendations, meeting graduation requirement, etc.

Principles of Evaluation

The following principles proposed by Grounlund will form a general framework within
which the ongoing process of evaluation may be viewed.

1. Determining and clarifying what is to be evaluated always has priority in the


evaluation process: No evaluation device should be selected or developed until the
purpose of evaluation have been carefully defined. In evaluating pupil progress, this
means that the first step is to identify and clearly specify the learning outcomes to be
measured.
2. Evaluation techniques should be selected according to the purposes to be served:
When the particular aspect to pupil performance to be evaluated has been precisely
defined, the evaluation technique that is most appropriate for evaluating the
performance should be selected all too frequently, evaluation to techniques are chosen
on the basis of how accurately they measure, how objective the results are or how
convenient they are to use. All of these criteria are important but secondary to the main
criterion – whether this evaluation technique is the most effective method for
determining what we want to know about the pupil? Each evaluation technique for the
intended purpose should be the first consideration in its selection.
3. Comprehensive evaluation requires a variety of evaluation technique: No single
evaluation technique is adequate for appraising pupil progress toward all of the
important outcomes of instruction In fact, most evaluation techniques are rather
limited in scope. To obtain a complete picture of pupil achievement, we typically need
to combine the results from a variety to techniques.
4. Proper use of evaluation techniques requires and awareness of both their limitations
and strengths: Evaluation techniques vary form fairly well developed measuring
instruments to rather crude observational methods. Even our best educational
measuring instruments, however, fall far short of the procession we would like them to
have, as all are subject to one or more types of error.
5. Evaluation is a means to an end, not an end it itself : The use of evaluation
techniques implies that some useful purpose will be served and that the user is clearly
aware of it. Most of the misuses of tests and other evaluation techniques can be
avoided by viewing evaluation as a process of obtaining information on which to base
educational decisions. This implies that the types of decisions to be made will be
identified before the evaluation procedures are selected so that the evaluation
procedures will be selected according to the decisions to be made and that no
evaluation procedure will be used unless it improves instructional guidance or
administrative decisions.

CHARACTERISTICS OF EVALUATION
1. Evaluation is a continuous process
2. Evaluation includes academic and non-academic subjects
3. Evaluation is procedure for improving the product
4. Discovering the needs of an individual and designing learning experiences
5. Evaluation is purpose oriented

Functions of evaluation

 To make provisions for guiding the growth of individuals and pupils.


 To diagnose the weakness and strength of the pupils.
 To locate areas where remedial measures are needed.
 To provide a basis for a modification of the curriculum and the
course.
 To motivate pupils toward better attainment and growth.
 To test the efficiency of teachers in providing learning experiences.
Scope of evaluation

 Evaluation and the teacher


 Evaluation and the students
 Evaluation and administrators
 Evaluation and parents

Criteria for selection of assessment techniques and methods

1. Initial acceptance
2. Practibality/feasibility
3. Realiability:
Test-retest reliability
It is a measure of reliability obtained by administering the same test twice
over a period of time to a group of individuals. The scores from Time 1
and Time 2 can then be correlated in order to evaluate the test for stability
over time.
Parallel forms reliability
Is a measure of reliability obtained by administering different versions of
an assessment tool (both versions must contain items that probe the same
construct, skill, knowledge base, etc.) to the same group of individuals.
The scores from the two versions can then be correlated in order to
evaluate the consistency of results across alternate versions
Inter rater reliability
It is a measure of reliability used to assess the degree to which different
judges or raters agree in their assessment decisions
Internal consistency reliability
Is a measure of reliability used to evaluate the degree to which different
test items that probe the same construct produce similar results.
A. Average inter-item correlation
B. Split-half reliability

4. Validity
Types of validity
A. Content validity
B. Criterian validity
C. Construct validity
D. Face validity
Content validity Content validity of a test reflects the extent to which student learn specific
content material in different subject. This type of validity is related to the content area that is
being tested
Predictive validity or criterion related validity
A tool that can be a written test is said to possess predictive validity to the extent the information
obtained through it serves the purpose of predicting the future performance of students in a
particular area of learning
Construct Validity is used to ensure that the measure is actually measure what it is intended to
measure (i.e. the construct), and no other variables.
Face Validity
When one looks at the test he thinks of the extent to which the test seems
logically related to what is being tested

5. Objectivity
6. Relevance
7. Specificity
8. Length
9. Comprehensiveness
10. Adequacy
11. Precise and clear
12. Usefulness
13. Equity

Components of evaluation

Types of evaluation

Evaluation is classified into various types

Based on time during which the evaluation is done

 Formative evaluation:
 Summative evaluation

Based on the purpose

 Criterion referenced evaluation


 Norm referenced evaluation

Based on the person who does evaluation

 Internal evaluation
 External evaluation

Based on the nature of measurement

 Maximum performance evaluation


 Typical performance evaluation

Formative evaluation

The term „formative‟ denotes the ongoing or systemic assessment of


student achievement while the term, course or program in progress.

• Formative evaluation is used to monitor learning progress during


instruction and to provide continuous feedback to both student and teacher
concerning learning success and failure. Feedback to student reinforces
learning and feedback to teacher provides information for modifying
instruction.

 Formative evaluation is done during an instructional programme.


 It is focus on molecular analysis.
 It is cause seeking.
 It is interested in the broader experiences of the program users.
 Formative evaluations design is exploratory and flexible.
 It tends to ignore local effects of particular programme.
 It seeks to identify influential variables.
 It requires analysis of instruction material for mapping the structure
of the learning tasks and actual teaching of course for a certain period.

SUMMATIVE EVALUATION

• The term “summative” refers to assigning a grade for student‟s


achievement at end of a term, course or programme.

 Summative Evaluation: It is done at the end of any program or instruction or


Course, term or semester. Annual examination andhalf yearly examination in school,
public examinationare the example of such evaluation. It is also called external
assessment.
 It is used to assign the grades for student's achievement
which can be used for promotion to the next gradeand judgement of high and low
performers within acertain group for passing or failing in an examination.
 It is vertical dimension seeing whether the student
has achieved educational objective and how much he has achieved. It help to grade, rank,
select the students and also help it curriculum evaluation.
 Summative evaluation typically comes at the end of a course of
instruction. It is designed to determine the extent to which the
instructional objective have been achieved and is used primarily for
assigning course grade or certifying student mastery of the intended
learning outcome.
 Purposes:
For certification
Determines the student's mastery on learning outcomes based on the objectives.

 Summative evaluation should check whether there has been learning or


not.

 It tends to use of well-defined evaluation designs.

 Summative evaluation focuses on analysis.

 It provides descriptive analysis.

 It is concerned with broad range of issues.

 Its instrument is valid and reliable.

 It tends to stress local effects.

Evaluation process

 Identifying the purpose of evaluation.

 Identifying the time frame.

 Determining when to evaluate.

 Selecting the evaluators

 Choosing an evaluation design/ framework or model.

 Selecting an evaluation instruments

 Collecting data.

 Interpreting data

 Reporting the findings

 Using the findings

 Considering the costs of evaluation.


There are three types of assessment methods mentioned as follows:-
A. ASSESSMENT OF KNOWLEDGE-
 Essay type questions,
 Short answer question,
 Multiple choice question.
B. ASSESSMENT OF SKILLS-
 Checklist
 Anecdotal record,
 Practical exam,
 Objective structured clinical examination(OSCE)
C. ASSESSMENT OF ATTITUDES-
Scaling techniques

Assessment of knowledge: Essay type questions, Short answer question (SAQ) multiple
choice questions (MCQ)

Assessment of knowledge
Various tools and techniques are used in evaluating the students’ performance in
clinical areas as well as in the classroom. The choice of the type of examination depends
upon the time available, setting in which the examination is conducted, the purpose of
evaluation and the feasibility of evaluation.
1. ESSAY EXAMINATIONS
The essay type examination seeks to measure the integrated knowledge of the examinees
and reveal certain traits such as originality, imagination, association of ideas, creativity etc.
Essay type questions are constructed response type questions and can be the best way to measure
the students’ higher order thinking skills, such as applying, organizing, synthesizing, integrating,
evaluating or projecting while at the same time providing a measure of writing skills.
Classification Of Essay Questions
Essay questions are subdivided into two major types i.e (i) extended response and (ii)
restricted response, depending upon the amount of latitude or freedom given to student to
organize his/her ideas and write their ideas.
Extended response: - In this type, no restriction is placed on the student as to the points he or
she will discuss and the type of organization student will use.
Eg; describe the health status of India and suggested measures by different health committees
constituted from time to time in India.
Restricted response: - In this type, student is more limited or restricted in or as to the form and
scope of his/her answer, because the student is specifically told the context in which his or her
answer to be made.
Eg; Describe in not more than 100 words, the recommendations made by the healthe survey and
development committee with regard to improvement of health care delivery system in India.
Merits Of Essay Type Examinations
The essay examinations are advantageous as;
 They measure complex learning outcomes that cannot be measured by other means.
 They are easy to construct and conduct.
 They test a teacher’s efficiency and a student’s mental; ability, including thinking and
problem solving skills, interpretation of facts, synthesis and analysis, etc.
 They help in organizing ideas and concepts.
 They promote application of knowledge in different spheres.
 They are useful to assess the knowledge of language and writing skills of the student.
 They provide the students, sufficient independence in answering without hesitance or
binding.
 They allow for free and effective expression.
 They give the students a good opprtunity to express their individual ideas and talents,
creativity and skills of presentation of a concept.
 It eliminates the possibility of the students’ guessing the correct answer.
Demerits Of Essay Type Examinations
 They stress only on intellectual attainment of the students, and do not measure their interests,
aptitudes etc.
 They examine the student in only one section of the curriculum.
 They do not aid in harmonious development of personality.
 They have limited range of applications.
 It offers less feed back to the teachers.
 It takes a long time to score.
 It presents difficulties in obtaining consistent judgement of performance.
 It leaves some scope of guess work by the students and scorring pattern shows halo/ an
antihalo effect (the first answer and its assessment influences the susequent ones).
 There is a risk that the grading of essay responses can be subjective and unreliable.
Guidelines For Construction Of Essay Questions
 The questions should be framed in such a way that the task is clearly and unambiguously
defined and can be completed within the stipulated time.
 It is preferable not to give too many or too lengthy questions.
 Phrases like “Discuss briefly”, “State everything that you know”, etc. should be avoided.
 It is preferable to set more number of questions requiring short answers of about a page or
two than a few questions requiring long answers of more than five pages.
 A range of difficulty and complexity should be maintained while setting the questions
according to the levels of students.
 It is preferable not to give overall choice on the questions (such as answer any five
questions out of 8) but internal choice between two questions of similar type can be given.
In the previuos one, construction of optional questions of equal difficulty is very difficult.
The advantage of the second option is that the important questions are not skipped out by
the students and comparison of scores of two students become easy.
 Prepare a marking system acceptable to other examiners by prior discussion with a checklist
of specific points against which marks are alloted.
 It is better to use point system of scoring based upon those elements that are expected to
appear in the answer.
Scoring Of Essay Type
The basis for scoring should be determined by the teacher prior to the administration of the
assessment. Directions to the student should specify if penalties will be assessed for errors in
spelling, punctuation, and grammer. The scoring of essay tests can be made more objective by
preparing a model answer as a common basis with subdivision of scores for each element,
checking the model answer a sample and revising it, if necessary. The scorring for all answers
to the same question should be done before proceeding to the next to avoid the carry over or
halo effect.
 Review the text and class notes; list the main points to be covered in the essay response.
 Develop a model answer first to determine what you are looking for.
 Score one essay item at atime for all students to increase consistency in scoring. ( score
everyones’s answer to essay question 1 before going to essay question number2).
 Rearrange the order of papers randomly after each item, and attempt to have students’
identities hidden from you, when grading papers.
 If possible, have another person independently grade the answers to see, if their scores
match yours.
Analytic scoring: - for analytic scoring, the score is based on the extent to which predetermined
essential components are present. Because it is more structured, scores are easier to justify
because students can determine specifically where they made errors or wrote inadequate or
incomplete responses.
In analytic scoring, essential parts of the answer are identified, and then parts are
scored individually. The main components and subcomponents of the desired response ar
assigned a specific point value.
After scoring the papers, there is still a question of how to convert the scores into
meaningful information for the students. How many points does it take to earn an “A” or are the
points converted to percentages.
Global or holistic scoring: - The response is scored as a whole in comparison with
characteirstics of answers representative of the preestablished score levels. Holistic scoring
tends to be more subjective than analytic scoring.
The first step in holistic scoring is to estimate the number of categories to which papers
will be assigned. The characteristics of an answer in each category should be described.
Next, the scorer reads a few papers to sample the quality of the responses. All papers
are then read and sorted into stacks representing the catogories used in grading. (excellent,
good, fair, poor; A,B,C,D,F etc.). finally, the scores are assigned to the papers.
A combined approach: - this involves scoring all responses holistically, then rescoring them
analytically, focussing on the apecific parts.

2. SHORT ANSWER QUESTIONS


Short answer questions, as the name indicates, is short and direct questions and the
students are expected to answer in a word or phrase or a numerical response to the question.
Principles of constructing SAQs
- Word the item in such a way so that the required answer is both brief and specific.
- Do not take statements directly from the textbooks. Textbook statements are frequently
too general and ambiguous to serve as short answer items.
- A direct question is generally more desirable than an incomplete statement.
- If the answer is to be expressed in numerical units, indicate the units in which the answer
is to be expressed.
- When completion items are used, do not include too many blanks. Key words are to be
omitted and the blank should come at the end of the sentence.
- Arrange spaces for recording answers on the right margin of the question paper.
- Give guidelines for answering each item very clearly.
- The weightage for each question should be written with the question.

Types Of Short Answer Questions


 Asking for a definition.
Eg; Definition of Nursing by ANA?
 Asking to draw a diagram.
Eg;Draw the structure of heart and mark the parts.
 Asking to complete an incomplete sentence.
Eg; The nurses’ day is celebrated on ………
 Asking for a unque answer to a direct question.
Eg; Who invented stethoscope?
Uses of SAQs
 Short answer questions are useful to test recall rather than recognition.
 They are used to test knowledge of factual information.
 In subjects where names of structures, substances and symbols have to be learnt, the short
answer questions are valuable assessment tools.
 They are easy to evaluate and reliability and validity are high.
3. OBJECTIVE TESTS
The objective tests seek to measure more consistently and accurately the knowledge of terms,
concepts, vocabulary facts and understanding and measure only what is intended to be
measured. They are highly structured and require the student to supply a word or two or to
select the correct answer from a number of alternatives.
Types Of Objective Type Tests
 Multiple choice items
 True or false items
 Matching type items
 Sentence completion items

MULTIPLE CHOICE ITEMS / SELECT THE BEST ANSWER


It is an objective type of test, where student is provided with several alternatives or
choices to a given question and asked to select the most appropriate one which is correct. It
contains two parts;
1. The base or stem which presents the problem in the form of an incomplete statement or
question.
2. The option list of possible/ correct answer/ distractors/ alternatives.
The stem may be a statement, question, situation, graph or picture. The suggested
answers other than one correct response or choice are called distractors. These incorrect
alternatives receive their intended fubction to distract those students, who are in doubt of the
correct answer. The correct answer is the key.
Uses Of Mcqs
 It is one of the most commonly used objective type tests
 It can measure a variety of learning outcomes from simple to complex.
 It is adaptable to most types of subject matter content.
 They are used for formative and summative assessment as well as for entrance examinations.
 It is easier to score.
 It makes comparison of the students more objective.
Principles For Preparation Of MCQs
o The stem should be meaningful and it should present a definite problem.
o Use positive statements as for as possible. If negative statement is used in the stem,
underline it.
o The stem should not be too long but the concept of the question should be completely
expressed in it.
o Make the stem simple and brief.
o The item should be relevant.
o The alternatives should be grammatically consistent with the stem .
o The distractors should be as short as possible.
o Make the distractors resemble the correct answer as for as possible.
o Try to avoid the phrases “all of the above” or “none of the above” etc.
o The number of distractors should be uniform for all the questions.
o Arrange the distractors in such a way that there is no pattern evident about the correct
answer.
o Represent only one concept in a single question.
o An item should contain only one correct answer.

Advantages Of Mcqs
 Can test large sample of knowledge in a short period of time.
 Easy to score.
 Objectivity and reliability in scoring is maintained.
Disadvantages
 It does not test the students’ ability to write logically and capability of expression.
 It cannot test motor skills like communication and interpersonal skills.
 It does not give freedom to the students.
Types Of MCQs
 One best response- This is one of the most frequently used MCQ. A series of 4 to 5
choices is preferred to reduce the chances of random guessing. Instructions to the students
should be given clearly to choose on right or appropriate response. ‘None of the above’ and
‘all of the above’ should be avoided.
Example; The world Health Day is celebrated every year on
1st April, 7th April, 1st May, 7th May
 Multiple completion type- This is another common format used and requires higher levels
of cognition than mere recall of facts. The stem is followed by four completion, one or more
of which are correct. This type of item is useful to test higher levels of cognition. This format
is also useful when an examiner can find only 4 plausible distractors instead of 5 for the best
response type of MCQ.
Example; live virus is used in immunization against influenza, the common cold, cholera, small
pox
- Responses 1,2 and 3 are correct.
- Responses 1, and 3 are correct
- Responses 2 and 4 are correct.
- Response 4 is correct
- All four are correct
 Relation analysis type- In this type the candidate has to decide individually whether each
statement is correct and then determine their cause effect relationship.
Exanple: Cow’s milk is preferable to breast milk for infant feeding. Because cow’s milk has
higher content of calcium.
- Both statements are true and causally related
- Both statement are true but not causally related
- First statement is true and second is false
- First statement is false and second is true
- Both statements are false.
 Multiple true-flase completion type- Each of these choices can be individually true or false
and are not interdependent. Hence the item can have from nil to five true or false responses.
Example: The consequences of Total parenteral nutrition in children include;
- Oral aversion T/F
- Electrolyte imbalance T/F
- Vitamin deficiency T/F
- Weight loss T/F
- Water retension T/F
 Matching type- This type of item consists of a list of three to four parameters on the left
hand side and list of five suggested matches on the right hand side of which only four
matches with one item each on the left. The number of choices on the right should be more
than the items on the left so that the last item to be matched would still have three options to
minimize guessing.
Example; Match the following vitamin deficiency diseases with its vitamin
 Scurvy - Vitamin B
 Rickets - Vitamin A
 Night blindness - Vitamin D
 Beriberi - Vitamin C
- Vitamin K

Number Of Items In MCQs


For an MCQ examination to have validity as well as to ensure breadth of sampling, it is
necessary to include sufficient number of items. Although there is no agreement on the exact
number, probably 60 to 100 items are optimum for an examination of 60 to 90 minutes. There is
a danger that with lesser numbers, the scores obtained may not indicate the depth of a
candidate’s knowledge.
Time
The time alloted should be sufficient for the candidate to attempt all the MCQ items in an
examination. Provision of too much time is an incentive to guess and too little time makes it a
test of speed rather than response based on cognitive acquisition. Different formats require
different time duration. In general, appropriate time required for different items are;
One best response type - 40 seconds
Multiple true/ false type - 45 to 50 seconds
Relationship analysis type - 50 seconds
Multiple response type - 50 seconds

Validating MCQ Question Paper


It is of two types;
Prevalidation :- It is the process to which a constructed item is subjected to validation prior to
appearing in an examination.
Postvalidation :- It is the analysis of the item after it has appeared in a test.

TRUE OR FALSE ITEMS


These are question or statements followed by yes/ no or true/false responses. The
student is asked to tick or mark the correct response.
Uses Of True Or False
They are used to test the misconceptions, beliefs and attitudes.
Principles Of Preparation Of True Or False Items
 Only a single concept or idea should be represented in a statement.
 Write clear and direct statements. Avoid ambiguous statements.
 Avoid using clues like ‘usually’, ‘sometimes’, ‘none’, and ‘nothing’, ‘no’, ‘should’,
‘always’, ‘may’ etc.
 Avoid tricky and catchy items.
 Have equal number of true or false items.
 Detectable pattern of answers should be avoided (T,F,T,F).
 The statement should not be taken directly from the text book.
 The direction of answering the question must be clear.
 Avoid using negative statement. When it is used underline the negative words.

MATCHING ITEMS
The matching type items are prepared in two columns- one called as the stimulus column and
other one is called the response column. The student has to go through the stimulus column and
match it with the correct response from the other side. These items are much easier to construct
and evaluate.

Principles For Preparation Of Matching Items


 The statements in the whole set of matching items should belong to the same kind or
nature.
 The number of choices should be more than the required answers.
 The stimuli and response column should be on the same page.
 A single response should not be used for more than one stimulus.
 Provide clear direction for matching.
 Arrange responses or both in alphabetical order, usually prevents clues to the responses.
If the responses are in numerical quantities, arrange them in order from low to high.
 Use the longer phrases as stimulus and shorter as response.

Assessment of skills: observation checklist, practical exam, Viva, Objective structured


clinical examination (OSCE)

1. OBSERVATION
Observation is the assessment method used most frequently in clinical performance
evaluation. Performance appraisal of the students is done to compare the clinical competency
expectations as designed in course objectives.
Observation can be defined as the direct visualization of performance of a talk or
behavior. It involves watching students carry out some activity or listening to pupils speech,
reading and discussing things. The process of observing and recording an individual’s behaviour
is called as ‘observational technique’. It is useful for evaluation of clinical performance, skill
competence, and development of attitudes and values.
On the basis of evidence drawn from observation of behaviour, and listening to oral
contribution, the teacher will draw inferences about a student’s attitudes, personal qualities,
abilities, motivation and commitment, learning speed and style, intelligence, attainments and
progress. These inferences in turn will help the teachers to make certain judgements and
decisions about students.
Principles Of Observational Method
 Observe the whole situation
 Select one student to observe at a time.
 Students should not be observed in the regular activities in the classroom and in the
clinical area.
 As for as possible, observation from several teachers ahould be combined.
 The observer must have an objective tool that can be used to collect information
accurately and without bias, to obtain accurate results.
Types Of Observational Method
Based on the fact, whether the observer makes his intention known to the persons observed or
not, the observation method is classified into
(i) Concealed observation
(ii) Nonconcealed observation
Based upon the role of observer, it is classified into:
(i) Participant observation:- The observer is a part of the social setting, where the
observation process takes place.
(ii) Non participant observation: - The observer makes the observation from periphery of a
social setting, he is not part of it.
Merits Of Observational Technique
* . It is more reliable and objective as it is being a record of actuaol behaviour of the student.
*. The information collected will be the firsthand information, that increases its reliability.
*. It is the assessment of the individual in a natural setting and therefore, it is useful than the
restricted *. study in a test situation.
*. It can be employed in all categories of students, in all contexts.
*. The technique does not require any special training or equipments for itsd conduction.
*. It allows immediate feedback and opportunity for remediation.
*. It is adaptable to both individuals and groups.
*. Frequent observation of a student’s behaviour can provide a continuous check on his
progress.
CHECKLIST
A checklist consists of a listing of steps, activities or behavior which the observer records when
an incident occurs.
A checklist enables the observer to note only whether or not a tra or characteristics is present
SUGGESTION TO FOLLOW WHILE USING CHECKLIST:-
Checklist should be directly related to learning objectives.
ii. It needs to be confined to performance areas that can be assessed by positive and negative
criteria.
ii. Use checklist when ascertaining a trait or characteristics is pi sent or absent.
iv. Clearly specify its to be observed.
v. Have a separate checklist for each candidate.
vi. Multiple observation provide a more accurate assessment.

PRACTICAL EXAMINATION
To develop approp iate professional skills over a period of time wi n consistent practice.
Transportation facilities should be provided to take the students to the place of
examination.
PURPOSES:
To assess:-
>The ability to give care in practical situation.
Attitude of student towards client.
Able to meet the ne is of client.
Expertise in nursing techniques.
Ability to give best care as possible
Skills in proper recording and reporting.
PHYSICAL ARRANGMENT FOR CONDUCTING EXAM:-
Permission from nursing superintendent and ward in-" charges to conduct examination in
the hospital.
Selection of examination on centre in advance depending on specialties offered.
Varieties of nursing care situation, facilities of equipment and supplies, place tor
examiners all things are to be kept in mind.
To practice nursing procedures required equipment has to be placed.
ADVANTAGES:
Provides the opportunity to test all the senses in realistic situation.
 Possibility of periodic evaluation in clinical situation.
 Tests for investigate abilities.
 Attitudes of the student can be observed and test Rapport will be established.
DISADVANTAGES:-
 Lacks standardization conditions in bedside examination/providing care/doing procedure
with patients of varying degrees of cooperativeness.
 Limited feasibility large groups.
 Difficulties in arrange for examiners to observe candidates demonstrating the skills to be
tested.
 Emergencies in the wards can be a hindrance.
 Takes longer time to complete the examination for the entire group.
OBJECTIVE STRUCTURED CLINICAL EXAMINATION
Objective Structured Clinical Examination
(OSCEs) is a form performance-based testing used to measure candidates' clinical
competence.
During an OSCE, candidates are observed and evaluated as they go through a series of
stations in which they interview, examine and treat standardized patients (SP) who
present with some type of medical problem.
Features of the Objective Structured Clinical Examination (OSCEs):-
Stations are short
Stations are numerous
A pre-set structured mark scheme is used hence. Reduced examiner input and discretion
Emphasis on what candidates can do rather than what they know
The application of knowledge rather than the recall of knowledge
5 minutes most common (3-20 minutes)/each patient(minimum) 18-20 stations/2 hours
for adequate reliability
Written answer sheets or observer assessed using checklists
Examination hall is a hospital ward

STEPS: -
Registration
Orientation
Escorting to exam position
Station Instruction time
The Encounter
Post Encounter Period
Repeat Steps 4 to6
Exam ended / Escorting to dismissal area
 Assessment of Attitudes-Attitude Scales
 SCALING TECHNIQUE
A Scale is a continuum from highest and lowest point and ha: intermediate points in
between two extend The Scaling technique consists of questionnaires where the score
of individual's responses gives him a particular place on the Scale.
USES:-
To utilize simultaneously a number of observation on a respondent.
Meaningful responsed logically arranged in the analysis of attitude and behavior.
To evaluate skills, outcomes, activities, attitudes and
Characteristics.
RATING SCALE:
Rating is a assessment of a person by another person.
Rating scale records how much or how well it happened. Quantitative or qualitative
terms will be used.
TYPES OF RATING SCALE:
Descriptive rating scale
Numerical rating scale
Graphic rating scale
PRINCIPLES:
i. Directly relate to learning objectives.Needs to confined to performance areas that
can be observed.
ii. Clearly define the specific trait.
iii. Trait should be readily observable.
iv 3 to 7 rating positions may need to be provided.
v. There should be provision of omitting items.
vi. All raters should be well oriented to the specific scale.
vii The rater should be unbiased and trained.
viii.Have expert and well informed raters.
Types of scale
The Likert Scale (Summated Ratings Scale)
 • A multiple item rating scale in which the degree of an attribute possessed by an object is
determined by asking respondents to agree or disagree with a series of positive and/or
negative statements describing the object
Example:
Totally disagree Disagree Neutral Agree Totally agree
a) Shopping takes much
longer on the Internet [ ] [ ] [ ] [ ] [ ]
b) It is a good thing that Saudi consumers have the
opportunity to buy products through the [ ] [ ] [ ][ ][ ]
c) Buying products over the Internet is not a sensible thing to do
[ ][ ][ ][ ][ ] [ ]
Characteristics of the Likert Scale
• The following procedure is used to analyze data from Likert scales:
1. First, weights are assigned to the responses options, e.g. Totally agree=1, Agree=2, etc
2. Then negatively-worded statements are reverse-coded (or reverse scored). E.g. a score
of 2 for a negatively-worded statement with a 5-point response options is equivalent to a
score of 4 on an equivalent positive statement.
3. Next, scores are summed across statements to arrive at a total (or summated) score. 4.
Each respondent’s score can then be compared with the mean score or the scores of other
respondents to determine his level of attitude, loyalty, or other construct that is being
measured • Note that the response for each individual statement is expressed on a
category scale.

Semantic Differential Scale


• A rating scale in which bipolar adjectives are placed at both ends (or poles) of the scale,
and response options are expressed as “semantic” space. Example: Please rate car model
A on each of the following dimensions:
Durable ---:-X-:---:---:---:---:---
Not durable Low fuel consumption ---:---:---:---:---:-X-:---
High fuel consumption
Characteristics
1. The scale has properties of an interval scale.
2. Sometimes descriptive phrases are used instead of bipolar adjectives, especially when
it is difficult to get adjectives that are exact opposites
3. It is often used to construct an image profile

Internal assessment

Internal assessment should comprehensively evaluate all the aspects of


students growth

Internal assessment should be very objective, unbiased and based on all


records of unit test, oral test, practical test, homework, class work,
observational scale inventory scale, participation in cultural activities and
various project

1. In education, evaluation plays an important role. It has become an


integral part of the instructional program. The total concept of
educational evaluation includes not only quantitative assessment but also
qualitative one and value judgment. This cannot be done by any external
body or board of examination alone.
2. Educational evaluation does not merely aim at improving the system of
examination, which maybe its limited function. Internal assessment is
not a substitute for but a supplement of this external examination.
Together with external examinations it gives us a comprehensive picture
of the student's learning. Thus internal assessment improves the teaching
learning process itself.
3. It is believed in principle that there is a place for oral tests, observational,
sociometric and self-report techniques and other types of testing in
education evaluation. Then internal assessment is must.
4. Unit tests function as motivating factors for students to study. Intermittently,
knowledge of the result also motivates students.
5. Unit tests, by way of internal assessment also provide a basis for feedback.
Diagnostic and remedial teachings are possible and would be more scientific
if there is internal assessment.
6. Reduce the tension associated with public examination.
7. To evaluate the sphere of activity which cannot be done through public
examination.
8. To provide opportunity to the teacher to evaluate his/ her student.
Significance of Internal Assessment

The system of internal assessment is of great significance and should be given


increasing importance.

1. Internal assessment should be comprehensive, evaluating all the aspects


of the student's growth, e.g. academic achievement, personality traits, achievement of
objectives from all the three domains-cognitive, affective and psychomotor.
2. The education commission recommends: Internal assessment should be
built into the total educational program and should be used for
improvement rather than for certifying the level of achievement of the
students.
3. All the items of internal assessment need not follow qualified scoring
procedures. Some of them may be assessed in descriptive terms. The result
should be kept separately and not to be combined artificially with other results to
form aggregate scores.
4. The system of internal assessment should be such as to help us in
changing the attitudes of students favorably towards the day-to-day-
school program.
5. Internal assessment should be such as to supplement the final examination.
6. Internal assessment should be, as far as possible, very objective, unbiased and
based on all the records of unit, tests, oral tests, practical tests, homework,
class work, observational scales and inventories, participation in
social and cultural activities, ingroup projects, etc.
PRINCIPLES:
Concentrate on only one on two behavior observation should be selective-
Record should be complete.
They should be kept by all teacher and not only by the student teacher.
Record the incident or action as soon as possible after it has happened.
They should have a compiled and field.
The teacher shoui nave practice and training in making observation and writing
Anecdotal Record.
Name of the student, Class and School, date of observation
Setting background of the incident. interoperaotion of the behaviour
recommendations concerning the behaviour.
ADVANTAGESS:-
Advantages of Internal Assessment

1. No undue weightage is given to the final or annual or external examination.


2. Proper study habits are likely to be developed; e.g.
 Students will be engaged in study throughout the year.
 They will be more regular, alert, sincere in their studies, e.g. in
doing classwork, homework, assignments.
3. Students will pay attention to all the activities organized by the
school, and they will try to participate in these activities.
4. Internal assessment helps to minimize anxiety and nervous breakdown on
the part of students, which otherwise are possible at the time of the
final examination.
5. It gives a comprehensive picture of a pupil's progress.
6. It helps to diagnose the weaknesses and strength of pupils. On the basis of
this, remedial teaching is possible.

1) Provision of insight into total behavioral incidents.
2Use of formative feedback
3) Economical and easy to develop.
DISADVANTAGES:
1) If careless recorded, the purpose will not be fulfilled.
2) Subjectivity.
3) Lack of standardization.
4) Difficulty in scoring.
5) Time consuming
For example:-
Dated : 09-10-2010 Reena iş seen in library, sitting in a comer, preparing nursing care
plan of cardiovascular disease.
Dated: 13-10-2010 Reena found to be only girl responding to the teacher's questio is on
cardiovascular Nursing.
Dated: 16-10-2010 Reena was caught reading a book
Medical-Surgical Nursing during "Community Health Nursing" and was asked to leave
the room.
Recommendation: Reena should been courage to do mean in
Medical Surgical Nursing and also not to neglect
Community Health Nursing and then other subjects

You might also like