0% found this document useful (0 votes)
175 views7 pages

Course Work 593

This document appears to be an assessment of an education course. It includes questions about assessment types, validity, reliability, and interpreting assessment results. The questions cover topics like the differences between formative, summative, diagnostic, and placement assessments; criterion-referenced versus norm-referenced interpretations; validity evidence including content, construct, predictive, and concurrent validity; reliability measures like inter-rater reliability and standard error of measurement; and interpreting normal curves and results from standardized tests.

Uploaded by

Muumbi Mutua
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
175 views7 pages

Course Work 593

This document appears to be an assessment of an education course. It includes questions about assessment types, validity, reliability, and interpreting assessment results. The questions cover topics like the differences between formative, summative, diagnostic, and placement assessments; criterion-referenced versus norm-referenced interpretations; validity evidence including content, construct, predictive, and concurrent validity; reliability measures like inter-rater reliability and standard error of measurement; and interpreting normal curves and results from standardized tests.

Uploaded by

Muumbi Mutua
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 7

Name

EDUC 593

1.On the line to the left of each assessment definition listed in Column A, write the letter of the corresponding assessment term in Column B.
Each term in Column B may be used once, more than once, or not at all.

Column A Column B
Assessments used to determine a. Criterion-Referenced Assessments
___ special needs
Assessments used to assess b. Diagnostic Assessments
___ progress during a class c. Formative Assessments
Assessments that use
___ measurements are called: d. Norm Referenced Assessments
Individual assessment results are
___ compared to a group
e. Placement Assessments
Assessments that are conducted f. Qualitative Assessments
___ without using measurements are called: g. Quantitative Assessments
h. Summative Assessments

2.What is the definition of a percentile?


__________________________________________
__________________________________________

3.For each of the following descriptions, please indicate which type of assessment is represented by circling the appropriate letter using the
following key. [6 points]

KEY: P = Placement F = Formative


D = Diagnostic S = Summative

P F D S An exam given to determine students’ writing competency level as a requirement for graduation.
P F D S A quiz designed to chart progress in this educational assessment course.
P F D S Johnnie might have a bad cold. His mother takes him in to the doctor for an examination to determine what is
wrong with him.
P F D S A mathematics competency test required of all students before registration in college calculus.
P F D S A state-wide high school exit examination.
P F D S An examination conducted to determine whether or not hearing loss could be a factor in a student’s speech
difficulties.

4. Please indicate whether each of the following statements represents a criterionreferenced (C) interpretation or a norm-referenced (N)
interpretation by circling the appropriate letter.
C N Jenny can name every continent.
C N Henry is the fastest runner in his class.
C N Becky received an 83% on the final exam.
C N Frank received the 11th highest score on the geography test.
C N Kate scored in the 87th percentile on the SAT 10 examination.
C N Don can speak seven different languages.

5. On the line to the left of each validity statement listed in Column A, write the letter of the corresponding validity term in Column B.
Each term in Column B may be used once, more than once, or not at all.

Column A Column B
Observable items are used to assess unmeasurable A. Predictive Validity
____psychological concerns B. Construct Validity
How accurately does the assessment address what we’re C. Content Validity
____seeking to know? D. Concurrent Validity
How accurately does the assessment predict future
_______ ____behavior?
6.For the next set of statements indicate if each is true or false by circling either true or false.
True False Correlations determine causation.

True False Correlations make predictions.


True False Increasing the number of assessment tasks increases reliability.
True False Using appropriate grammar and vocabulary increases assessment validity.

7.Inter-rater reliability assesses test quality by measuring the influence of which of the following human factors? (Please circle the letter
associated with the correct answer.)
a. Subjectivity
b. Intelligence
c. Responsibility
8.Standard Error of Measurement is a measure of: (Please circle the best answer)
a. Validity
b. Reliability
c. Usability
9.Please list three of the five issues that should be considered when evaluating the usability of a test?
a.
b.
c.

10.Please complete the following table by determining percents and percentiles based upon the examination scores provided.

FREQUENCY DISTRIBUTION OF SCORES


ON AN EDUCATIONAL ASSESSMENT TEST
Score f Percent Percentile
97-100 3
93-96 5
89-92 6
85-88 8
81-84 8
77-80 7
73-76 5
69-72 3
65-68 2
61-64 2
57-60 0
53-56 1

N=

Sally earned an 82 on the exam. What is her percentile on this test?

11.Using a mean of 75 and a Standard Deviation of 10, please identify the following [4 points]

2SD = -1SD =

-2SD -1SD 0SD 1SD 2SD

Page 2 of 7
12.the curve below, identify the 2nd stanine and the 7th stanine by shading in the appropriate regions and labeling them.

-2SD -1SD 0SD 1SD 2SD

13.Place the LETTERS that represent the following scores on the normal curve at the appropriate points:
a. Special Needs f. Median
b. 16th percentile g IQ score of 130
c. CEEB Score of 400 h. T score of 55
b. Z-score of -1 i. 5 out of 10 correct on quiz
c. third quartile j. mode

-2 SD - 1 SD 0 SD 1 SD 2SD

14.Draw a positively skewed curve and show the mean.

Which measure of central tendency would give you the most consistently accurate representation of average?

15.Please indicate which of the following 100 point sub-tests is more reliable using the following reliability information.

Sample Score Report


Test Score Std. Confidence Band
Error

15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90
Math 30 +/-10

Reading 50 +/-5

a. Math Sub-test
b. Reading Sub-test

Page 3 of 7
16.Using the following chart, indicate whether or not there is a statistically significant difference in performance between these two
students. (Please circle the correct answer.)

Sample Score Report


Student Score Percent- Percentile Range
ile Rank

15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90
Johnny 665 65

Wendy 625 58

Standard Error of Measurement = +/- 5 percentile

a. Significant Difference
b. No Significant Difference

17.Two Reviewers corrected an essay question using a 5-point scale (5-being best) (Their results are distributed as follows. Find Percent
Exact Agreement and percent 1-off.
Scores Assigned by Rater 2

Score 1 2 3 4 5 Row Total


Scores Assigned by Rater 1

5 0 1 2 4 9 16
4 0 2 6 14 3 25
3 1 5 12 4 4 26
2 4 11 7 5 1 28
1 10 5 1 2 0 18
Column Total 15 24 28 29 17 113
Percent Exact Agreement =
Percent 1 Off =

18.In the spaces below, please identify the approximate strength and direction of the correlations graphically displayed by the following
scattergrams.
High

High
Low

Low

Low High Low High

a. b.

19.Please identify the approximate strength and direction of each of the following correlation coefficients. (Ex. r = 0.95 is a Strong Positive
Correlation)
r = -0.45 a.
r = -0.80 b.
r = -0.25 c.
r = 0.1 d.

20.Please find the Coefficient of Determination for each of the following correlation coefficients.

Page 4 of 7
a. r = 0.8 R2 = __________

b. r = - 0.5 R2 = __________

21.Find the following information for the following set of scores.

8, 9, 6, 4, 8, 10, 9, 8, 7, 8, 5

Mean = _
Median = _
Mode = ___
Range = __
Standard Deviation = _
Z-score for 9 = _

Please identify the appropriate type of data used in the following:

22.Students list the items in their backpacks.


a. Nominal
b. Ordinal
c. Interval
23.Students are asked to list their ten favorite movies in order beginning with their most-liked.
a. Nominal
b. Ordinal
c. Interval
24.A teacher has prepared a 100-point written test to assess social science achievement.
a. Nominal
b. Ordinal
c. Interval

25.Please identify the five components of a research study.


a.
b.
c.
d.
e.

Please indicate which term best describes research being conducted in the following two scenarios:

26.A researcher conducts an in-depth study into the socialization difficulties 6 Afghani women experience in the months immediately
following their immigration from Afghanistan to the United States.
a. Quantitative
b. Qualitative

27.A principal studies student satisfaction with playground equipment using a brief questionnaire with a 5-point Likert scale.
a. Quantitative
b. Qualitative

28.Please identify the three types of measurement that are used in educational research.
i. ___________________________________________________
ii. ___________________________________________________
iii. ___________________________________________________

29.Which of the following procedures would provide the most appropriate method for studying the correlation between intelligence and
achievement? Administering an achievement test and an intelligence test to one sample of students.

a. Administering an achievement test to one sample of students and an intelligence test to another sample of students.
b. Administering an achievement test to a sample of students, all of whom have an intelligence of at least 100 on an IQ
scale.
c. Administering an achievement test to two samples of students and an intelligence test to two different samples of
students.
30.Which of the following would be the most accurate way to assess what effect a new 3 rd grade mathematics curriculum has on
achievement?
a. Implement the new curriculum during the school year and ask teachers to make observations on student success.

Page 5 of 7
b. Implement the curriculum during the school year, then have the students complete a questionnaire addressing their
perceptions of the curriculum’s effectiveness.
c. Implement the new curriculum into a sample class during the school year, then compare pre-test and post-test scores for
sample group and a control group.
d. Interview principals to find out if other schools have had success with the new curriculum.

Please indicate whether each of the following statements is True or False by circling the appropriate answer.
31. True False “The findings of this study will indicate that there is no relationship between teacher eye contact and student
motivation” is an example of a good null hypothesis.
32. True False “The findings of this study will indicate that there is a significant difference between teacher eye contact and
student motivation” is an example of a good research hypothesis.
33. True False A good operational definition doesn’t need to be reasonable as long as it is measurable.

34. True False It is more important to control external validity than internal validity.

Please identify the appropriate type of research in the following:


35.A researcher wants to know whether or not teacher experience has a positive effect on student achievement. She identifies a district
with 20 third grade classes who would be willing to participate in the study. She compares teacher experience in each class with CAT/6 test
scores and finds a weak positive relationship between teacher experience and student achievement. This is an example of:

a. Ex Post Facto
b. Correlational
c. Quasi-Experimental
d. Developmental
36.A principal removes all candy from his junior high school. He then makes observations to determine whether or not it decreases the
number of playground fights during afternoon recess. This is an example of:

a. True Experimental
b. Case Study
c. Action
d. Developmental
37.A business professor does research to find out demographic information about the incoming freshmen class. This is an example of:
a. Descriptive
b. Ex Post Facto
c. Historical
d. Quasi-Experimental
38.A P.E. teacher selects two groups of high school soccer players, the first 10 who arrive at practice are in one group and the second 10
arriving comprise the other group. She has one group participate in a week-long camp and the other group does not. She then measures
each player’s juggling, dribbling, passing, and shooting abilities. She compares their scores to see if the camp significantly improves skills.
This is an example of:

a. Correlational
b. Ex Post Facto
c. Quasi-Experimental
d. True-Experimental
Please identify the best source of information for each of the following scenarios:

39.Members of a city council want to remodel a park in their city. They commission research to determine if the deer that live in the park
use a reflecting pool as a regular source of water. The deer won’t come around when the researcher is present, so he decides to monitor
hoof prints around the pool’s edge. This source of information would be considered:
a. Tests
b. Observations
c. Unobtrusive Measures
d. Archival Data
40.A principal wants to study student perceptions about a proposed school dress code and he wants to give all 800 students a chance to
express their views. Unfortunately, he has limited time to gather data before he will be forced to make his decision about its
implementation. The best source of information in this case would be:
a. Interviews
b. Tests
c. Questionnaires
d. Archival Data
41.A superintendent has a school board meeting later in the day, and he will be proposing a new building project. Before making his pitch,
he wants to research school board decisions made in the past ten years regarding proposed building projects. His best source of information
would be:
a. Unobtrusive Measures
b. Archival Data
c. Questionnaires
d. Observations

Page 6 of 7
Please identify the variables for each of the following scenarios:
Is there a significant difference between genders in their time spent watching television?
42.Please identify the independent variables, if any?

43.Please identify the dependent variables, if any?

What is the relationship between feelings of depression and hours spent participating in outdoor activities?
44.Please identify the independent variables, if any?

45.Please identify the dependent variables, if any?

Is there a significant difference in people’s feelings of depression based upon the number of rainy days they experience?
46.Please identify the independent variables, if any?

47.Please identify the dependent variables, if any?

Please identify the appropriate type of sampling in each of the following questions.

48.A P.E. teacher divides her class into two teams by choosing names from a hat. This is an example of:

a. Simple Random Sampling


b. Stratified Proportional Random Sampling
c. Systematic Random Sampling
d. Purposive Sampling Sampling
49.Jay Leno conducts man on the street interviews. This is an example of:

a. Simple Random Sampling


b. Non-Probability Sampling
c. Cluster Sampling
d. Systematic Random Sampling
50.Gallup polls registered voters by selecting every 10,000 th name on a current voter registration list. This is an example of:
a. Non-probability Sampling
b. Purposive Sampling
c. Stratified Equal Size Random Sampling
d. Systematic Random Sampling
51.A researcher decides to conduct a study that requires her to sample golfers. To accomplish this, she spends a full day at Oak Valley Golf
Club and interviews as many golfers as possible. This is an example of:
a. Simple Random Sampling
b. Expert Sampling
c. Cluster Sampling
d. Stratified Proportional Random Sampling

Please identify 3 threats to internal validity in the following scenario.


XYZ Travel Company offers complete travel packages to beach resorts on the big island of Hawaii. They decided to learn which resort their
customers like best. They sent a lengthy questionnaire to one-third of the patrons (those who followed up with XYZ since their vacation)
who traveled with them between January 1, 2017 and October 31, 2018. As you will remember, the island began experienced a dramatic
increase in volcanic activity on its Southeast side in 2018. The instructions requested they fill it out and mail it back ASAP.
49. Explain:
50. Explain:
51. Explain:

Page 7 of 7

You might also like