Toward Better Training in Peer Assessment: Does Calibration Help?

Authors

Yang Song
Zhewei Hu
Edward F. Gehringer
Julia Morris, Old Dominion UniversityFollow
Jennifer Kidd, Old Dominion UniversityFollow
Stacie Ringleb, Old Dominion UniversityFollow

Document Type

Conference Paper

Publication Date

2016

Publication Title

CSPRED 2016: Computer-Supported Peer Review in Education

Pages

1-5

Conference Name

Workshop at EDM 2016

Abstract

For peer assessments to be helpful, student reviewers need to submit reviews of good quality. This requires certain training or guidance from teaching staff, lest reviewers read each other's work uncritically, and assign good scores but offer few suggestions. One approach to improving the review quality is calibration. Calibration refers to comparing students' individual reviews to a standard—usually a review done by teaching staff on the same reviewed artifact. In this paper, we categorize two modes of calibration for peer assessment and discuss our experience with both of them in a pilot study with Expertiza system.

Original Publication Citation

Song, Y., Gehringer, E., Hu, Z., Morris, J., Kidd, J., & Ringleb, S. (2016). Toward Better Training in Peer Assessment: Does Calibration Help? Paper presented at the CSPRED 2016: Computer-Supported Peer Review in Education. Raleigh, NC.

Repository Citation

Song, Yang; Hu, Zhewei; Gehringer, Edward F.; Morris, Julia; Kidd, Jennifer; and Ringleb, Stacie, "Toward Better Training in Peer Assessment: Does Calibration Help?" (2016). Teaching & Learning Faculty Publications. 24.
https://digitalcommons.odu.edu/teachinglearning_fac_pubs/24