Psy 311 - Topic - 1
Psy 311 - Topic - 1
Types of Evaluation
There are three types
1. Formative evaluation
2. Summative evaluation
3. Assessment
Formative Evaluation
• It is the progressive assessment of the success with which a program is being implemented. It
shows whether learning objectives are being achieved.
• It is done with a small group of people to "test run" various aspects of instructional materials.
• It is typically conducted during the development or improvement of a program and it is
conducted more than once.
• The purpose of formative evaluation is to validate or ensure that the goals of the instruction
are being achieved and to improve the instruction, if necessary, by means of identification
and subsequent remediation of problematic aspects.
• Formative evaluation is research-oriented.
• Formative evaluation provides information on the product's efficacy (its ability to do what it
was designed to do).
Summative Evaluation
Summative evaluation is a method of judging the worth of a program at the end of the
program activities. The focus is on the outcome.
It is typically quantitative and uses numeric scores or letter grades to assess learner
achievement.
It is action-oriented. That is, on the basis of the findings, the programme can be adopted
entirely, modified or abandoned altogether.
Advantages
i. It does not enforce any expectation of what all students should know or be able to do other
than what students can actually demonstrate.
ii. Present levels of performance and inequity are taken as fact but not as defects to be removed
by a redesigned system.
iii. Aims of student performance are not raised every year until all are proficient. Scores are not
required to show continuous improvement.
Limitations
(a) It cannot measure progress of the population of a whole, only where individuals fall within
the whole.
(b) It does not set what an individual should profess to prove a mastery of a skill being tested but
rather bases on the set norm.
(c) It judges set benchmarks around items of varying difficulty without considering the ability
level or age of the examinees.
(d) The difficulty level of items that determine the levels passing vary from year to year.
2. Criterion Assessment
PSY 311: MEASUREMENT AND EVALUATION. ACADEMIC YEAR: 2024/25 - GROUP- E.
DR.MAINA (PhD) EDUCATIONAL PSYCHOLOGY DEPARTMENT - 0725848469
It is where a decision is made as to whether a pupil has actually achieved specified level
of learning regardless of the performance of other pupils.
Here, the criterion or level of achievement which warrants a mastery of certain skills is
set in advance. It is not flexible.
Criterion-referenced assessment is often, but not always, used to establish a person’s
competence in doing something e.g. the driving test, when learner drivers are measured
against a range of explicit criteria.
It tells where the person stands in some population of persons who have taken the test.
Most criterion-referenced tests involve a cut score, where the examinee passes if their
score exceeds the cut score and fails if it does not (often called a mastery test).
However, not all criterion-referenced tests have a cut score, and the score can simply
refer to a person's standing on the subject domain.
Advantage
i. Many criterion-referenced tests are high-stakes tests since results of the test have serious
implications for the individual examinee.
ii. Criterion referenced tests are standard-based assessments where students are assessed
with regards to set standards that define what they "should" know.
Limitations
(a) They can be described as, "you lose a lot if you fail to pass” e.g. licensure testing where the
test must be passed in order to progress.
(b) Some tests set a standard that have failed 50 to 80 percent of students at the outset, a higher,
not lower failure rate than is possible with standard definition of 50 percent falling below
average.
3. Diagnostic Assessment
It is the process of finding out the exact nature of a person’s problem or difficulties. In
education, the aim is to give relevant remedial teaching to those who deserve it.
Disadvantage
i. The results may not be a true reflection of the learners’ ability since the teacher tends to
be subjective in his/her evaluation of the learners’ performance.
ii. Teacher may set the questions based on what has been covered in class hence syllabus
coverage is poor.
iii. Tends to be highly subjective since the setter (teacher) sets based on certain preferences.
B. External examination
Is prepared and marked by a person or body of experts not responsible for teaching the
subject being examined.(subject in question)
Advantages
i. It gives a more objective assessment of the learner since the examiners are unknown to the
examinee.
ii. There is good syllabus coverage since both the teacher and the learner cannot guess the
examinable areas.
iii. Due to objectivity in scoring of examinees abilities across the population, higher institutions
of learning and potential employers prefer selection on this basis.
Disadvantages
PSY 311: MEASUREMENT AND EVALUATION. ACADEMIC YEAR: 2024/25 - GROUP- E.
DR.MAINA (PhD) EDUCATIONAL PSYCHOLOGY DEPARTMENT - 0725848469
i. It invalidates the importance of learning and education since it often turns out examination
oriented.
ii. Encourages cramming of facts rather than application of learned materials.
iii. It increases emotional stress due to over concern about examinations results.
TYPES OF TESTS
A. Objectives Tests
Are questions that demand answers that are either right or wrong and for each of which there is
only one possible correct answer.
Advantages
1. Are easy to mark and grade.
2. Examine a wide coverage of the topics learned hence students read widely.
3. They are practical and handy for relatively large classes.
4. Human error, bias or prejudice by the marker is removed i.e. scoring is extremely reliable.
5. If well set, they have a strong discriminative power between the bright and weak students.
6. Learners obtain feedback on their performance much faster.
Disadvantages
i)Are difficult to set and therefore time consuming.
ii)They are open to guesswork.
ii)They limit the learner’s use of his/her acquired writing and literary skills e.g. creativity,
analysis or evaluation.
iv)They are relatively expensive in terms of materials needed to produce a complete test.
v)The selection of questions may greatly be influenced by the examiner’s bias.
1) Supply items
They are also called completion items. These types of tests require a student to recall or
recognize the appropriate term, concept or phrase or to complete a statement.
2) Selection Items
Require a student to choose one alternative from a range of alternatives.
Sub-types of selection item tests
a) True /False of Right Wrong of Yes/No
b) Matching pairs
c) Multiple choice
Disadvantages
a) Permit and occasionally allow bluffing and cheating.
b) They are tedious and difficult to mark and score
c) Encourage rote memorization as such may not show the extent to which a learner can
apply acquired knowledge.
This consists of two columns, the premises (problem to be answered) and the responses
(answers). The examinee needs to make some association between each premises and each
response.
The following suggestions need to taken into consideration when constructing matching
items
PSY 311: MEASUREMENT AND EVALUATION. ACADEMIC YEAR: 2024/25 - GROUP- E.
DR.MAINA (PhD) EDUCATIONAL PSYCHOLOGY DEPARTMENT - 0725848469
i. Do not have too many items on the list. A minimum of 5 and a maximum of 7 is
preferred.
ii. The responses should be more than the premises in order to reduce correct item
matching by elimination process.
iii. Materials selected should be from the same subject so that a given premise has
several possible matches in the responses.
iv. Names should be arranged in an alphabetical order while dates and numbers in
sequence. This saves the examinees’ time.
v. Watch for irrelevant but revealing association (clues) which may give away the
matching such as singulars and plurals.
C. True-False Items
Yes/No; Right/Wrong; + (Plus) or – (Minus) or Positive/Negative can also be used in the place
of true/false. To construct true/false items, consider the following suggestions:
i. Place the symbol “T” and “F” before each question. This will save time when marking.
ii. The number of true statements should equal those of false statements.
iii. When arranging the items, avoid any form of pattern of true and false answers.
iv. Do not use words which will provide clues or hints as this may give away the answer.
v. Use statements which are absolutely true or false and avoid items which express
opinions or which are trivial/tricky.
vi. Avoid the use of double negatives and single negatives should be used sparingly.
However, if they must be used, they should be underlined, capitalized or italicized.
vii. Do not lift statements/quotations from textbooks since they encourage rote memory and
turn out ambiguous when interpreted out of context.
Methods used.
Causes of Cheating
Academic weakness of some of the students/teachers.
Euphoria attached to exam results-goods grades are a source of pride to self, families
and institutions.
Need to excel due to stiff competition.
Corruption and lack of transparency especially those charged with the responsibility of
handling exam materials.
Cheating as an easy way out. Quest for knowledge has seemingly lost meaning.
Lack of commitment among students especially the lazy ones who don’t take studies
seriously.
Congested curriculum and the belief that some subjects are difficult or impossible to pass.
Uncertainty of employment among some course graduates leading to enrolment in others
which may be demanding.
Nature of examinations e.g. practicals. There is the temptation to look at one’s neighbor’s
work.
Traditional way of delivery lecturers with exams taking the same pattern. This makes it
easy to guess and cheat.
NB: Cheating in exams is just an aspect of moral decadence of the society. It is a manifestation
of a sick society, devoid of a working culture and whose moral fiber has degenerated to
irredeemable levels
“Truly, truly, I say to you, he who does not enter the sheep fold by the door, but climbs in by
another way, that man is a thief and a robber; but he who enters by the door is the shepherd of
the sheep.