Nunnally on Reliability Nunnally (1978, p. 245) recommends that instruments used in basic research have reliability of about .
70 or better. He adds that increasing reliabilities much beyond .80 is a waste of time with instruments used for basic research. On the other hand, with instruments used in applied settings, a reliability of .80 may not be high enough. Where important decisions about the fate of individuals is made on the basis of test scores, reliability should be at least .90, preferably .95 or better. Nunnally (1978, p. 244), shows how to calculate how many additional items one would need to raise the reliability of an instrument to the desired value (assuming that the additional items are as good as the items already on hand).
rd (1 re ) , where rd is the desired reliability , re is the reliability of the existing re (1 rd ) instrument, and k is the number of times the test would have to be lengthened to obtained the desired reliability. For example, suppose you have a 5 item test whose k=
reliability is .66. To raise the reliability to .70, k =
.7(1 66) = 1.2. Thus, you would .66(1 .7)
need a test with 1.2(5) = 6 items. To raise the reliability to .75, k = 1.5, you would need 7 or 8 items. To raise the reliability to .80, k = 2.06, you would need 10 or 11 items.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
Reliab-Nunnally.doc