CSPRED 2016: Computer-Supported Peer Review in Education
Workshop at EDM 2016
For peer assessments to be helpful, student reviewers need to submit reviews of good quality. This requires certain training or guidance from teaching staff, lest reviewers read each other's work uncritically, and assign good scores but offer few suggestions. One approach to improving the review quality is calibration. Calibration refers to comparing students' individual reviews to a standard—usually a review done by teaching staff on the same reviewed artifact. In this paper, we categorize two modes of calibration for peer assessment and discuss our experience with both of them in a pilot study with Expertiza system.
Original Publication Citation
Song, Y., Gehringer, E., Hu, Z., Morris, J., Kidd, J., & Ringleb, S. (2016). Toward Better Training in Peer Assessment: Does Calibration Help? Paper presented at the CSPRED 2016: Computer-Supported Peer Review in Education. Raleigh, NC.
Song, Yang; Hu, Zhewei; Gehringer, Edward F.; Morris, Julia; Kidd, Jennifer; and Ringleb, Stacie, "Toward Better Training in Peer Assessment: Does Calibration Help?" (2016). Teaching & Learning Faculty Publications. 24.