Statistical methods for examining rater consistency include percent agreement and interrater reliability estimates (e.g., percent agreement, Pearson correlation, Spearman correlation, generalizability coefficient)
Estimating Rater Consistency Presentations.pdf
The instructor will review examples of research and evaluation questions and the statistical methods appropriate to developing a quantitative data-based response
quant_workshop 2012.ppt