0% found this document useful (0 votes)
53 views15 pages

Structure of The Report-S2

The document outlines the requirements and structure for a final project involving the construction and analysis of a multiple choice test. It includes instructions to: 1) Develop a test blueprint outlining the domains and item types to be covered; 2) Construct a 25 question multiple choice test covering listening, reading, grammar and vocabulary; 3) Administer the test to 30+ students; and 4) Analyze the results including item difficulty, discrimination and validity. The analysis must also include measures of test reliability.

Uploaded by

anita
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
53 views15 pages

Structure of The Report-S2

The document outlines the requirements and structure for a final project involving the construction and analysis of a multiple choice test. It includes instructions to: 1) Develop a test blueprint outlining the domains and item types to be covered; 2) Construct a 25 question multiple choice test covering listening, reading, grammar and vocabulary; 3) Administer the test to 30+ students; and 4) Analyze the results including item difficulty, discrimination and validity. The analysis must also include measures of test reliability.

Uploaded by

anita
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 15

Final Project of LTE

for S1
- Find a curriculum/syllabus of high school or higher
education
- Make test specification (blueprint)
- Construct a multiple-choice test of at least 25 items
- Try-out the test to at least 30 students
- Analyze the test result
- The test covers: Listening, Reading, Grammar and
Vocabulary (at least 10 items for each)
Test Specification (Blueprint)
Subject: ___English__________________________________
Semester/Class: ____________________________________
School: ___________________________________________
Test Techniques: __Multiple-Choice____________________
Test Type: __Written Test____________________________
Test description: ____________________________________
Basic Objective/ Types of
No. Domain Items
Competence Indicators Question
1. Listening … C1 Specific Info, 1–6
Explicit Info
… C3 Comparison 7 – 12
of Ideas
2. Reading … C2 Main Ideas
3. Gremmer … … … …
4. Vocablery … … … …
Structure of the Report
Chapter I: Introduction (background, coverage, and place of try-out)
Chapter II: Test Specifications, The Constructed Tests, Answer Keys,
and Scoring Rubric
Chapter III: Analysis:
- Data Presentation (Frequency Distribution),
- Mean Score & Standard Deviation
- Reliability (split-half or Test-retest)
- Validity,
- Difficulty Level,
- Discrimination Power, and
- Distractor Power
Chapter IV: Conclusion (the good and acceptable items)
Appendices: Surat Izin (if any)
Samples of Students’ Answer sheets (>4)
Curriculum/syllabus
Surat Keterangan telah melakukan ujicoba tes
Data Presentation
Raw Final
No. Tally Frequency Percentage
Score Score
1 23 92  1 2.5
2 22 88  1 2.5
3 20 80  2 5.0
4 19 76  1 2.5
5 18 72  4 10.0
6 17 68  2 5.0
7 16 64  4 10.0
8 15 60   6 15.0
9 14 56  5 12.5
10 13 52  3 7.5
11 12 48  2 2.5
12 11 44  3 7.5
13 10 40  1 2.5
14 9 36  2 5.0
15 8 32  1 2.5
16 7 28  1 2.5
17 5 20  1 2.5
Total 40 40 100
Calculation of Mean
No. x f fx
1 9.2 1 9.2
2 8.8 1 8.8
3 8.0 2 16.0
4 7.6 1 7.6
5 7.2 4 28.8
6 6.8 2 13.6
7 6.4 4 25.6
8 6.0 6 36.0
9 5.6 5 28.0
10 5.2 3 15.6
11 4.8 2 9.6
12 4.4 3 13.2
13 4.0 1 4.0
14 3.6 2 7.2
15 3.2 1 3.2
16 2.8 1 2.8
17 2.0 1 2.0
Total 239 N=40 Σfx = 231.2
Standard Deviation
No. x d d2 21 6.0 0.22 0.0484
1 9.2 3.42 11.6964 22 5.6 -0.18 0.0324
2 8.8 3.02 9.1204 23 5.6 -0.18 0.0324
3 8.0 2.22 4.9284 24 5.6 -0.18 0.0324
4 8.0 2.22 4.9284 25 5.6 -0.18 0.0324
s.d . 
d 2

5 7.6 1.82 3.3124 26 5.6 -0.18 0.0324 N


6 7.2 1.42 2.0164 27 5.2 -0.58 0.3364
7 7.2 1.42 2.0164 28 5.2 -0.58 0.3364
8 7.2 1.42 2.0164 29 5.2 -0.58 0.3364
9 7.2 1.42 2.0164 30 4.8 -0.98 0.9604
10 6.8 1.02 1.0404 31 4.8 -0.98 0.9604
11 6.8 1.02 1.0404 32 4.4 -1.38 1.9044
12 6.4 0.62 0.3844 33 4.4 -1.38 1.9044
13 6.4 0.62 0.3844 34 4.4 -1.38 1.9044
14 6.4 0.62 0.3844 35 4.0 -1.78 3.1684
15 6.4 0.62 0.3844 36 3.6 -2.18 4.7524
16 6.0 0.22 0.0484 37 3.6 -2.18 4.7524
17 6.0 0.22 0.0484 38 3.2 -2.58 6.6564
18 6.0 0.22 0.0484 39 2.8 -2.98 8.8804
19 6.0 0.22 0.0484 40 2.0 -3.78 14.2884
20 6.0 0.22 0.0484 Ttl 231.2 0 97.264
Table for Validity Calculation
TEST ITEM
No Testees SX
1 2 3 4 5 6 7 8 9 10
1 Taufik 1 0 0 1 1 1 1 1 1 0 7
2 Ahmad 1 1 1 1 1 1 1 1 1 0 9
3 Nurdin 0 0 0 0 1 1 1 1 1 0 5
4 Rini 0 1 0 1 0 0 1 1 1 1 6
5 Aminah 1 0 0 1 1 1 1 1 1 1 8
6 Andini 1 0 0 0 1 0 0 1 0 0 3
7 Karim 1 0 1 0 1 1 1 0 1 1 7
8 Fadli 1 0 0 0 1 1 1 1 1 0 6
9 Halim 1 1 0 1 1 1 0 0 1 0 6
10 Rahman 1 0 0 1 0 1 0 1 0 0 4
SX 8 3 2 6 8 8 7 8 8 3 61
Validity
Item # 1
M p  Mt p
 x 8 rpbi 
p   0.8 SDt q
1 N 10

2 q= 1-p= 1-0.8= 0.2


61
Mt   6.1
3 10
(9  8  7  7  6  6  4  3)
4 Mp   6.3
8

5 SD = 1.8
6.3  6.1 0.8
6 rpbi    0.17
1.8 0.2
Validity
ITEM Mp Mt SDt p q rpbi QUALITY
1 6.3 6.1 1.8 0.8 0.2 0.17 Not Valid
2
3
4
5
6
7
8
9
10
TABLE FOR RELIABILITY CALCULATION

X X Y X2 Y2 XY
1 7 8
2 5 6
3 6 6
4 9 8
5 6 7
6 8 8
7 4 5
8 7 6
9 6 7
10 8 7
11 6 7
X=11 SX= 72 SY= 75
TABLE FOR RELIABILITY CALCULATION

X X Y X2 Y2 XY
1 7 8 49 64 56
2 5 6 25 36 30
3 6 6 36 36 36
4 9 8 81 64 72
5 6 7 36 49 42
6 8 8 64 64 64
7 4 5 16 25 20
8 7 6 49 36 42
9 6 7 36 49 42
10 8 7 64 49 56
11 6 7 36 49 42
X=11 SX= 72 SY= 75 SX2= 492 SY2= 521 SFX= 502
Reliability
N  xy   x  y 
rxy 
[ N  x 2   x  ][ N  y 2   y  ]
2 2

(11  502)  (72  75)


rxy 
[(11  492).(72) 2 ][(11  521).(75) 2 ]

122 122
rxy    0.78
[228].[106] 155.46

For Split Half Reliability + the formula:

2rhh 2  0.78 1.56


rtt  rtt    0.87
1  rhh 1  0.78 1.78
Sample Table
• Validity: 0.304 – 1.000
• Difficulty: 0.25 – 0.75
• Discrimination: 0.25 – 1.00
ITEM VALIDITY DIFFICULTY DISCRIMINATION QUALITY
1 0.654 0.85 0.30 +V –D +S Improper
2 0.522 0.48 0.35 +V +D +S Proper
3 0.515 0.53 0.35 +V +D +S Proper
4 0.127 0.63 0.15 –V +D –S Improper
5 0.530 0.70 0.40 +V +D +S Proper
6 0.436 0.80 0.40 +V -D +S Improper
7 0.563 0.55 0.30 +V +D +S Proper
Item Difficulty and Discrimination
TEST ITEM
No Testees SX
1 2 3 4 5 6 7 8 9 10
1 Ahmad 1 1 1 1 1 1 1 1 1 0 9
2 Aminah 1 0 0 1 1 1 1 1 1 1 8 Upper
3 Karim 1 0 1 0 1 1 1 0 1 1 7 Group
(UG)
4 Taufik 1 0 0 1 1 1 1 1 1 0 7
5 Rini 0 1 0 1 0 0 1 1 1 1 6
6 Arif 1 0 0 1 0 0 1 1 1 1 6
7 Fadli 0 1 0 0 1 1 1 1 1 0 6
8 Halim 1 1 0 1 1 1 0 0 1 0 6 Lower
9 Nurdin 0 0 0 0 1 1 1 1 1 0 5 Group
10 Rahman 1 0 0 1 0 1 0 1 0 0 4 (LG)
11 Andini 1 0 0 0 1 0 0 1 0 0 3
UG 4 2 2 4 4 4 5 4 5 3 37
LG 3 2 0 2 4 4 2 4 3 0 24
Distractor Power
Item 1 UG LG UG+LG
A 2 5 7
B* 14 4 18 UG  LG 18
IF    0.45
C 1 4 5 N 40
D 3 7 10
O 0 0 0 UG  LG 10
Total 20 20 40 ID    0.50
n 20
Item No. 1 has good distractor power and good difficulty level and index of
discrimination

Item 2 UG LG UG+LG
A* 15 9 24 22
B 5 10 15 IF   0.55
40
C 0 0 0
D 0 0 0
O 0 1 1 6
ID   0.30
Total 20 20 40 20
Item No. 2 has good difficulty level and index of discrimination, but distractors C and
D do not work.

You might also like