Learning From Peer Assessment |
|
|
|
Learning From Peer Assessment |
|
Peer assessment is increasingly used as a pedagogical strategy because of the learning it can produce and because it is often efficient for instructors. From a research perspective, it is wonderfully complex in terms of what cognitive processes it invokes and all the ways it might influence learners (e.g., changing the audience, seeing models of varying quality, reflecting on qualities of good writing, being persuaded by multiple reviewers, learning to be a feedback provider). Peer assessment can also be a supercollider for research on writing, which otherwise is limited to small N environments.
Key Lab Members
Other Collaborators
- Kevin AshleyUniv. of Pittsburgh
- Russell ClarkUniv. of Pittsburgh
- Amanda GodleyUniv. of Pittsburgh
- Diane LitmanUniv. of Pittsburgh
- Yao XiongImbellus
- Melissa PatchanWest Virginia Univ.
- Anita SchuchardtUniv. of Minnesota
- Sara DiMartinoUniv. of Pittsburgh
- Yanqing WangHarbin Institute of Tech.
- Ying GaoNortheast Normal Univ.
- Fuhui ZhangNortheast Normal Univ.
- Macy ZouBeihang Univ.
SWoRD |
|
|
|
SWoRD |
|
SWoRD is a web-based reciprocal peer assessment system that emphasizes 1) carefully structured end-comments and rubric ratings, 2) anonymity to encourage honesty, and 3) grade accountability algorithms for reviewing accuracy and helpfulness (see video). Iteratively studied and improved since 2002, it has been used by over 100,000 students across disciplines and educational levels around the world. SWoRD is now commercially distributed under the name of Peerceptiv, but research continues on SWoRD by many researchers at LRDC and elsewhere, developing new student and teacher tools, but also using the large SWoRD datasets to better understand how learning from peer review occurs.
RECENT FINDINGS
Looking across thousands of courses, when peers have high inter-rater reliability, the mean peer ratings are highly correlated with instructor ratings.
Feedback is rarely produced for issues that are challenging for the whole class.