To correct for the possibility that a high interrater reliability is actually due to different but ...

To correct for the possibility that a high interrater reliability is actually due to different but consistent ratings from raters, a statistic called ____ can be used.
 
  a. counterbalancing
  b. multiple time series
  c. Pearson's r
  d. Cohen's kappa

Question 2

The higher the correlation between the ratings of two independent observers in an experiment:
 
  a. the less the ratings represent inconsistent subjective factors of the raters.
  b. the more the ratings represent inconsistent subjective factors of the raters.
  c. the less the ratings represent consistent subjective factors of the raters.
  d. None of these