A researcher who wants to establish score reliability in an observational study typically determines
a. how well observer-assigned scores correlate with an external criterion.
b. the extent of agreement among observers.
c. how well the observation predicts other events.
Ques. 2To investigate the interaction effect of several independent variables, a researcher would use a(n) _____ experimental design.
a. ABAB
b. factorial
c. Solomon four-group
d. single-subject
e. static group comparison
Ques. 3Which of the following summarizes the relationship between the standard error measurement and a test's score reliability?
a. The higher the test's reliability, the larger the standard error of measurement.
b. The higher the test's reliability, the smaller the standard error of measurement.
c. The standard error of measurement also provides an estimate of the correlation between true scores and error scores.
d. There is no direct relationship between standard error of measurement and reliability.
Ques. 4Every subject receives every treatment in the
a. counterbalanced design.
b. randomized Solomon four-group design.
c. randomized subjects pretest-posttest, control group design.
d. randomized subjects posttest-only, control group design.
e. nonrandomized control group pretest-posttest design.
Ques. 5Low correlations with tests measuring different constructs provide ____ evidence for the score validity of an instrument.
a. convergent c. discriminant
b. concurrent d. predictive
Ques. 6Cronbach's coefficient alpha is used for
a. determining the reliability of true-false tests.
b. determining concurrent validity.
c. computing reliability of tests having items with answers that are weighted differently.
d. obtaining an estimate of test equivalence and stability.
Ques. 7Indicate the type of reliability that would result from the procedures described below. Scores on odd items correlated with scores on even items across test takers.
a. test-retest c. split-half
b. alternate form d. Kuder-Richardson