The document discusses establishing test validity and reliability. It aims to teach learners how to establish test validity and reliability using statistical analysis. Some key points include defining test reliability as consistency of responses across items measuring the same characteristic. Factors like number of test items and individual differences can affect reliability. Methods to establish reliability include computing Pearson's r correlation coefficient and determining the strength and significance of correlations. The document also defines validity and lists types of validity including content, face, predictive, concurrent, construct, convergent, and divergent validity. It describes how to determine if a test item is easy or difficult.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0 ratings0% found this document useful (0 votes)
366 views29 pages
Establishing Test Validity and Reliability
The document discusses establishing test validity and reliability. It aims to teach learners how to establish test validity and reliability using statistical analysis. Some key points include defining test reliability as consistency of responses across items measuring the same characteristic. Factors like number of test items and individual differences can affect reliability. Methods to establish reliability include computing Pearson's r correlation coefficient and determining the strength and significance of correlations. The document also defines validity and lists types of validity including content, face, predictive, concurrent, construct, convergent, and divergent validity. It describes how to determine if a test item is easy or difficult.
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 29
Establishing Test Validity and
Reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Desired Learning Outcomes
- Use procedures and statistical analysis to establish test
validity and reliability. - Decide whether a test is valid or reliable. - Decide which test items are easy and difficult.
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability What is test reliability? - When retested on the same person - When retested on the same measure - Similarity of responses across items that measure the same characteristic
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Factors that affect the reliability of a measure - The number of items in a test - Individual differences of participants - External environment
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Ways to establish test reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability 1. Linear Regression This is demonstrated when you have two variables that are measured.
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability 2. Computation of Pearson r correlation The index of the linear regression is called a correlation coefficient. When the points in a scatterplot tend to fall within the linear line, the correlation is said to be strong. When the direction is directly proportional, the correlation coefficient will have a positive value. If the line is inverse, the correlation will have a negative value. Dr. Estelito J. Punongbayan Course Instructor Establishing Test Validity and Reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability 3. Difference between a positive and a negative correlation When the value of the correlation coefficient is positive, it means that the higher the scores in X, the higher the scores in Y. When the value of the correlation coefficient in negative, it means that the higher the scores in X, the lower the scores in Y, and vice versa.
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability 4. Determining the strength of a correlation The closer the value to 1.00 or -1.00, the stronger is the correlation. 0.80-1.00 Very strong relationship 0.6-0.79 Strong relationship 0.40-0.59 Substantial/marked relationship 0.2-0.39 Weak relationship 0.00-0.19 Negligible relationship Establishing Test Validity and Reliability 5. Determining the significance of the correlation The correlation obtained between two variables could be due to chance. Establishing Test Validity and Reliability Establishing Test Validity and Reliability Establishing Test Validity and Reliability Establishing Test Validity and Reliability Establishing Test Validity and Reliability Establishing Test Validity and Reliability What is validity?
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Types of Validity
Dr. Estelito J. Punongbayan
Course Instructor Establishing Test Validity and Reliability Types of Validity Establishing Test Validity and Reliability Types of Validity Establishing Test Validity and Reliability 1. Content Validity 2. Face Validity 3. Predictive Validity 4. Concurrent Validity 5. Construct Validity 6. Convergent Validity 7. Divergent Validity Dr. Estelito J. Punongbayan Course Instructor Establishing Test Validity and Reliability How to determine if an item is easy or difficult? 1. Get the total score of each student and arrange scores from highest to lowest. 2. Obtain the upper and lower 27% of the group. 3. Obtain the proportion correct for each item. 4. The item difficulty is obtained using ID = ph+pl/2 5. The index of discrimination is obtained using Dr. Estelito J. Punongbayan Course Instructor