The kappa statistic in reliability studies: use, interpretation, and sample size requirements.

The issue of statistical testing of kappa is considered, including the use of confidence intervals, and appropriate sample sizes for reliability studies using kappa are tabulated.