Name: Nayab Amjad ROLL NO: MCF1900609 Program: Ma Education (Morning)
Name: Nayab Amjad ROLL NO: MCF1900609 Program: Ma Education (Morning)
Assessing goals
Conducting a need analysis
Identifying the knowledge gap
Conducting an audience analysis
2)Design
3)Develop
4)Implement
5)Evaluate
---Curriculum provides a "map" for how students will master the standards. Decisions about
what that map looks like are made by districts, schools, and teachers. This map includes the
materials (e.g. lesson plans, assignments, tests, resources) that will make learning possible.
Assessment for Learning Assessment of Learning
(Formative Assessment) (Summative Assessment)
---Nature of Assessment
Three major reasons why conduct assessment
1)Program Improvement
2)Recruitment
Provides parents with evidence of the value a program has for their child.
Gives prospective students evidence of why they should participate.
3)Accountability
Meets University and schools annual program reporting and program review
requirements.
Addresses accrediting agency program evaluation requirements.
May apply to other funding or regulatory agencies requirements.
---Purpose of Assessment\
---Forms of Assessment
Performance task
Classroom quizzes
Portfolios of student work
Teacher observations
Standardized test
METHODS:
Basically, teacher made tests are used to evaluate the progress of the students in school.
However, the specific use of tests may vary from school to school and teacher or teacher.The
test results can be used for students, teachers, and for other administrative purposes.
Standardized Tests
Lecture no 2:
Instruction aims goals and objectives:
Aims:
Aims are concerned with purpose whereas objectives are concerned with
achievement.
Usually an educational objective relates to gaining ability, a skill, some knowledge, a
new attitude etc. rather than having merely completed a given task.
Goals:
In broad terms, Educational Goals are statements that describe the competences,
skills, and attributes that students should possess upon completion of a course or
program.
They often operate within the interacting domains of knowledge, skills and attitude.
Objectives:
In education, learning objectives are brief statements that describe what students will
be expected to learn by the end of school year, course, unit, lesson, project, or class
period.
An instructional objective is a statement that will describe what the learner will be able to do
after completing the instruction. ... Instructional objectives are specific, measurable, short-
term, observable student behaviours. They indicate the desirable knowledge, skills, or
attitudes to be gained.
Good learning outcomes are focused on what the learner will know or be able to do by the
end of a defined period of time and indicate how that knowledge or skill will be demonstrated
Lecture no 3:
The TOS is typically constructed as a table that includes key information to help teachers
align the learning objectives that represent the content and cognitive levels intended for
students to achieve with class time spent and the number of test items.
---Preparing a list of instruction objectives:
Lecture no 5:
Taxonomy of educational objectives:
Cognitive domain:
The cognitive domain involves knowledge and the development of intellectual skills
This includes the recall or recognition of specific facts, procedural patterns, and
concepts that serve in the development of intellectual abilities and skills, Knowledge,
Comprehension.
Bloom's Taxonomy was created in 1956 under the leadership of educational psychologist Dr
Benjamin Bloom in order to promote higher forms of thinking in education, such as analysing
and evaluating concepts, processes, procedures, and principles, rather than just remembering
facts (rote learning). It is most often used when designing educational, training, and learning
processes.
Evaluation is concerned with the ability to judge the value of material (statement,
novel, poem, research report) for a given purpose. The judgments are to be based on
definite criteria.
The Three Domains of Learning
Lecture no 6:
Classification of basis of functional role in instruction:
A Guide to Types of Assessment:
Diagnostic
Formative
Interim
Summative
The multi-faceted nature of assessments means that educators can leverage them in a number
of ways to provide valuable formal or informal structure to the learning process.
The main thing to remember is that the assessment is a learning tool. What all assessments
have in common is that they provide a snapshot of student understanding at a particular time
in the learning process.
Iinstructional Models
Models represent the broadest level of instructional practices and present a
philosophical orientation to instruction.
Models are used to select and to structure teaching strategies, methods, skills, and
student activities for a particular instructional emphasis.
Instructional Strategies
Within each model several strategies can be used.
Strategies determine the approach a teacher may take to achieve learning objectives.
Strategies can be classed as direct, indirect, interactive, experiential, or independent.
Lecture no 7:
Restricted Response Test:
imposed restrictions on pupils regarding the freedom of expression.
From and scope of the answer is restricted.
Lecture no 8:
Rubric:
A scoring guide for the evaluation of performance, a product, or a project
Makes grading and ranking simpler, more transparent and fairer consists of a checklist
of items.
Lecture no 9:
Records and
Checklist
|
Interpretation
Hypothesis
Setting
|
Instruction
Decision to Assess:
Teach
assess
Adjust
Decision over time using Benchmark Rating
o Organize and summarize the data.
o What does the Information reveal about the child's development?
What the child can do.
What the child needs to learn.
Lecture no 10
Observation
An observation is the act of noticing something or a judgment or inference from something
seen or experienced.
EXAMPLE: A doctor watching a patient's reaction to a medication
Types of observation:
Naturalistic
Observe people or animals in their natural habitat. Observing behaviour in their natural
settings, without awareness or any manipulation or intervention
Participant
Observing behaviour in a natural setting, through active participation in the Situation and /or
manipulation of the environment
Laboratory
Observing behaviour in the lab. Observing behaviour in a controlled lab setting, with or
without participant's awareness and/or researches environment
Potential Issues
Reactance
In reactance naturalism doesn't fall, in participants and in the laboratory you may see the
reactance because in these two environments the situation is actively observed and you have
awareness and you can research and give reactions about it.
Expectancy effects
May include conscious or unconscious influences on subject behaviour including creation of
demand characteristics that influence subjects, and altered or selective recording of
experimental results themselves
Logistic issues
The results appear to support an increased use of participant observation in qualitative
logistics research, particularly when investigating inter organizational aspects. The analysis
highlights values, general limitations and challenges of using participant observation in
logistics
Unexpected events
An unexpected event means that Situation understanding is imperfect, it usually occurs in
naturalism and participant environments because in the laboratory you are fully aware.
Control (internal validity)
Laboratory observation, as opposed to naturalistic observation, refers to observing the
behaviour of subjects that are in a controlled environment. Because of the controlled
environment variable factors can be controlled which therefore leads to a limited number of
possible responses
Ecological validity
When research has high ecological validity it means that behaviour recorded within the
research can be applied to everyday life. This means that the results are more useful
Ecological validity is central to any laboratory assessment in order to ensure that the situation
is representative of the 'reality' of the family. The concept of ecological validity was first
proposed by Brunswick
DATA COLLECTION
An observation is a data collection method, by which you gather knowledge of the researched
phenomenon through making observations of the phenomena, as and when it occurs.
Sampling methods
Time sampling
Time samples are a useful way to collect and present observation data over a long period of
time. Time samples can be used to observe a child's behaviour to identify possible concerns.
Event sampling
Event sampling is used to determine how often a specified event or behaviour occurs. Thus, it
does not identify the causes of behaviour. A simple example would be to record how often
and for long a child engages with a play activity.
Lecture no 11:
TEACHER MADE TESTS
Teacher-made tests are normally prepared and administered for testing classroom
achievement of students, evaluating the method of teaching adopted by the teacher and other
curricular programmes of the school. Teacher-made test is one of the most valuable
instruments in the hands of the teacher to solve his purpose.
Types of Test:
Lecture No 12:
Benefits of Standardized assessment:
Lecture No 13:
Questionnaire Structure
Content questions:
In sections use filter questions, put more difficult questions towards the end and don't give
away answers to later questions.
Questionnaire Layout
Allow space, instructions and number for computer coding and one side of page only.
Telephone questionnaires:
Retention problem.
Provide guidance for interview on questionnaire.
Make clear what is to be read and what is not.
Types of Questions:
Leading (why don't you go more often to the supermarket)
Ambiguous (Is your work made more difficult because you are expected)
Multiple content (Have you suffered from headache or sickness)
Implicit (How old is your car)
Embarrassing (sexual more, alcohol assumptions)
o Over complex vocabulary: Avoid big words and technical terms.
o Over complex questions:
Vague
Too factual
Complex
Lecture no 14
Research Interview
Interviewer:
Encodes questions about knowledge and perceptions of respondent about self
Decodes answer taking into account own knowledge about respondent and perception of
respondent knowledge about self.
Respondent:
Encodes questions about knowledge and perceptions of interviewer about self
Decodes answer taking into account own knowledge about interviewer and perception of
interviewer knowledge about self.
Different interviews:
News
Talk shows
Documentary
o Interviews seen as making sense of our lives
Epistemology position.
Knowledge must be ontology.
Lecture no 15:
Measurement and Reliability
Measurement:
A process where numbers are assigned to an abstract concept according to set of rules
Objective measures
Measurement Errors:
Systematic
Unsystematic
Controlling error
Reduce inconsistency.
Reliability:
A degree of consistency of a measure.
Precision in measurement.
Test Retest:
Methods assess the external consistency of a test.
Interpreters:
The degree to which different rates give consistent estimates of same behaviour
Split half
A test splits into 2 parts and then both parts given to one group of students at the
same time.
Parallel forms:
Assess the consistency of results of two tests constructed in same way from same
content.
Lecture no 16:
Dispersion and variability;
The range
The smallest score subtracted from the largest
Example;
Number of friends of Face books users.
22, 40, 53, 93, 98 , 103, 108, 116, 121, 252.
Range = 252- 22= 230
Very biased by outliers.
Range;
Quartiles
The three values that spilt the sorted data into quartile= median
Lower quartile= median of lower half of the data.
Upper quartile= median of upper half of the data.
Need to order the individual first.
One quartile of the individual are in each inter quartile range.
Quartiles;
Example;
Number of friends on Face book
Lower quartile= 53
Median = 98
Upper quartile= 116
Used on box plot;
Age of health and illness students
Upper quartile
Median
Lower quartile
Histogram;
High / length of bar indicates frequency.
Variance and standard deviation;
Sum of each individual variation from the mean
Example;
Five rating 1, 2, 3, 4, mean = 26
Quartiles;
Example;
Score Mean. Deviation
1. 2.6. -1.6
2. 2.6. -0.6
3. 2.6. 0.4
4. 2.6. 0.4
5. 2.6. 1.4
Total 0
Variance;
So we square the deviation.
Score Mean Deviation Square
Lecture no 17, 18
Mean;
The arithmetic mean is the average of the values found by adding the values together and
dividing by the total number of values.
Median;
The middle values found by listing all numbers in numerical order if there are an add
number of values this is the values in the middle if there are an even number of values we
will average the two numbers which appear in the middle.
Mode;
The number or numbers that occurs most frequency.
Example;
The mean score an a set of 20 tests is 75 what is the subs of the 20 test score.
Sum
Mean. ______
# score
75. X
_____
20
X= 1500
Range;
Lecture no 19
Multiple item tests;
Easy to make
Can be improved
Easy to grade
Can be stored
Student’s performance;
Initial test
More difficult
Simpler test
Different learners;
Item answered correctly by low performance must be expected to be answered
correctly also by high performance.
Blooms taxonomy;
Create;
Produce new or original work.
Evaluate;
Justify a stand or decision.
Analyse;
Draw connection among ideas
Apply;
Use information in new situation
Understand;
Explain ideas or concept
Remember;
Recall facts and basic concept
Item and analysis components
Item difficulty;
Of examinees who answered correctly total of test takers.
Discrimination index;
A number representing how high performance students and low performing
students were able to answer the test item correctly
Distracter analysis
Numbers that tell something about the difficulty and discriminators ability of
both the correct choice and the alternative choices
What cells are used by cnidarians to capture prey?
Nematocyst
Echinocytes
Gametocytes
Leukocytes
Whether to retain, revise or eliminate items discrimination distracter information and your
instruction
Item difficulty
Item discrimination
Distracters
Instruction
Lecture no 20
Task 1
Represent the discrimination index range on a number line.
Label the number line to show the range where poor, good and very good items would
fall.
What would discrimination of a mean.
Task 2
CalcUlate the discrimination index of the question given in task 1.
Are the distracters good?
What would you suggest be done with this item keep it for future use, receive it or
discard it? Why
Distracter information can be analysed to determine which distracters were effective
and which ones were not
Complete the given worksheet.
Item analysis
Item analysis examining student’s responses to individual test items in order to assess the
quality of that item and the test on a whole
Difficult index;
This is a measure of the percentage of students who answered the item correctly.
Discrimination;
If the same proportion of high and low achievers make the correct or incorrect
response to an item, it suggest that the item is either to easy or is ambiguous.
Lecture no 21
Distracter analysis;
Thomas saffron, James Madison, and Han cook were all framers of the constitution.
○ James
○ Herbier
○ Philip
○ Terrance
Item writing guidance;
Validity of taxonomy of multiple choice item writing rules.
Quality over quantity;
As may plausible alternative that can be written.
There are more alternative is generation sufficient.
Be sure to analyse distribution of top and bottom 27%.
Index of discrimination
Item difficulty
Distracter analysis