Distinguish between score validity and reliability.
What will be an ideal response?
Ques. 2In a nonrandomized control group, pretest-posttest design, the recommended procedure for analyzing test results is a(n)
a. t-test of the difference between pretest and posttest means for both the experimental and the control group.
b. four-way analysis of variance.
c. analysis of covariance, in which the posttest means are compared using the pretest means as the covariate.
d. analysis of variance of the mean pretest-posttest change for the experimental and control groups.
Ques. 3A student has a score of 80 on a class test with a score reliability of .84 and a standard deviation of 10 . What is the band within which the student's true score is likely to fall? (Use the .95 confidence level).
a. 70 and 90 c. 75 and 85
b. 72 and 88 d. 76 and 84
Ques. 4(WWW) Which of the following would be the least acceptable research design?
a. Posttest only, control group design
b. One-group pretest-posttest design
c. Pretest-posttest control group design
d. Matched subjects, posttest only, control group design
Ques. 5You are considering two tests to be used for selection into a class for gifted students. Test A has a mean of 85, standard deviation of 10, and a score reliability of .91 . Test B has a mean of 85, standard deviation of 8, and a score reliability of .75 . On which test would a student's score be expected to fluctuate more on repeated administrations?
a. Test A b. Test B
Ques. 6Counterbalanced experimental designs are especially susceptible to the effect of
a. regression. c. instrumentation.
b. order. d. pretest sensitization.
Ques. 7The most meaningful way to consider test validity is
a. across parallel forms. c. for a specific purpose.
b. as a subtype of reliability. d. in terms of errors of measurement.
Ques. 8A research study has a design with two groups receiving a pretest, one of which receives treatment and two groups who are not pretested, one of which receives treatment. This design is called a
a. counterbalanced design. c. Solomon design.
b. multiple group pretest-posttest design. d. 2 2 factorial design.
Ques. 9The score validity problem in tests measuring hypothetical constructs such as need for achievement or anxiety is that the tests may
a. leave out aspects of the construct that the theory behind the construct says should be included.
b. include aspects that the underlying theory indicates should be left out.
c. be inconsistent measures of the important aspects of the construct.
d. a and b
e. a, b, and c
Ques. 10The major disadvantage of a simple ABA single-subject design is that it
a. concludes with subjects under baseline conditions.
b. concludes with subjects under experimental conditions.
c. needs more than two different treatments.
d. requires an excessive amount of time to complete the experiment.