Which of the following test characteristics would be most affected by using a short test rather than a longer one?
a. Objectivity
c. Reliability
b. Validity
d. Standardization
Ques. 2Which of the following would represent discriminant evidence for the score validity of a test of numerical aptitude?
a. The test has a high correlation with grades in math.
b. The test has a low correlation with grades in math.
c. The test has a high correlation with reading comprehension.
d. The test has a low correlation with reading comprehension.
Ques. 3In validating an inventory measure of need to achieve, a researcher correlated the scores from the inventory with a projective technique known to measure need to achieve. This is an example of
a. content evidence.
c. convergent evidence.
b. external evidence.
d. divergent evidence.
Ques. 4Ordinary correlational estimates of the score reliability of criterion-referenced tests may be quite low because
a. it is difficult to find suitable criteria. c.
the tests are typically speeded.
b. the scores have little variability.
d. the content is too heterogeneous.
Ques. 5A test has high score reliability if
a. it measures what it is supposed to measure.
b. it has a high correlation with an appropriate criterion.
c. individuals maintain their relative ranks when the test is administered a second time.
d. it is a representative sample of the content domain.
Ques. 6Miss Jones has constructed a mastery test to give after a unit on fractions. All students must have at least 85 percent of the items correct. Which of the following reliability coefficients would you recommend as being most appropriate for Miss Jones to use?
a. Test-retest
c. Agreement coefficient
b. Kuder-Richardson 20
d. Coefficient alpha
Ques. 7Which of the following is
not an internal consistency measure of reliability?
a. Split-half
c. Kuder-Richardson
b. Coefficient alpha
d. Coefficient of stability
Ques. 8If the reliability coefficient of a test was found to be 1.00, the standard error of measurement would be
a. zero.
c. 1.00.
b. .50.
d. equal to the standard deviation of the test.
Ques. 9Refer to Exhibit 9-8. What would the score reliability of the test be if we take
chance agreement into consideration (Kappa)?
a. .50
b. .52
c. .58
d. .60
e. .72
Ques. 10Refer to Exhibit 9-8. Express the score reliability of this test in terms of the simple agreement coefficient.
a. .40
b. .55
c. .75
d. .80
e. .82
Ques. 11Refer to Exhibit 9-7. Calculate the index that shows the extent of agreement
beyond that expected by chance (phi).
a. .61
b. .64
c. .68
d. .76
e. .78