Peer grading in a MOOC: Reliability, validity, and perceived effects
Published | July 2014 |
Journal | Online Learning Volume 18, Issue 2, Pages 1-14 |
ABSTRACT
Peer grading affords a scalable and sustainable way of providing assessment and feedback to a massive student population, and has been used in massive open online courses (MOOCs) on the Coursera platform. However, currently there is little empirical evidence to support the credentials of peer grading as a learning assessment method in the MOOC context. To address this research need, this study examined 1825 peer grading assignments collected from a Coursera MOOC with the purpose of investigating the reliability and validity of peer grading as well as its perceived effects on students’ MOOC learning experience. The empirical findings proved that the aggregate ratings of student graders can provide peer grading scores that were fairly consistent and highly similar to the instructor grading scores. Student responses to a survey also show that the peer grading activity was well received as the majority of MOOC students believed it was fair, useful, beneficial, and would recommend it to be included in future MOOC offerings. Based on the empirical results, this study concludes with a set of principles for designing and implementing peer grading activities in the MOOC context.Keywords | MOOC research · MOOCs · peer grading · reliability · validity |
ISSN | 2472-5730 |
Other number | 2 |
Refereed | Yes |
Rights | Open Access Policy This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge. |
DOI | 10.24059/olj.v18i2.429 |
URL | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/429 |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 53 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
![](interface/images/icons/star.png)
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
Enhancing the student experience: integrating MOOCs into campus based modules
Fair, Nicholas; Harris, Lisa; León-Urrutia, Manuel
Massive Open Online Courses (MOOCs) are continuing to expand in Higher Education Institutions (HEIs). According to Class Central, over 1500 courses started in May 2017 alone. In some cases, these courses are becoming ...
Match: MOOC research; MOOCs
How MOOC instructors view the pedagogy and purposes of massive open online courses
Evans, Suzannah; Myrick, Jessica Gall
Massive open online courses (MOOCs) have proliferated in recent years despite disagreement about the role of MOOCs in higher education and whether student outcomes are satisfactory. Taking a mixed-methods approach, the ...
Match: MOOC research; MOOCs
Open Educational Resources: Access to high-quality education for all
Evertse, Judith
This article deals with what Open Educational Resources (OER actually are, what the benefits are, and what points need to be considered.
Open Educational Resources (OER) are learning materials that are freely available ...
Match: reliability
MOOCs
Haber, Jonathan
Overview
The New York Times declared 2012 to be “The Year of the MOOC” as millions of students enrolled in massive open online courses (known as MOOCs), millions of investment dollars flowed to the companies making ...
Match: MOOCs
Output 9 SCORE2020: Evidence based practice for teachers and institutions using MOOCs
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Comparing institutional MOOC strategies 2015- Czech Republic report: Status report based on a mapping survey conducted in October – December 2015
Rohlíková, Lucie; Rohlík, Ondřej; Jansen, Darco; Goes-Daniels, Miriam; et al.
Executive Summary
Institutional MOOC involvement
Czech HEIs are mostly still in the process of finding their way to their own MOOC courses. The Czech Association of Distance Teaching Universities (ČADUV) at the ...
Match: MOOC research
Output 8 SCORE2020 : MOOC Quality and it’s use by different target groups
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Methodological approaches in MOOC research: Retracing the myth of Proteus
Raffaghelli, Juliana Elisa; Cucchiara, Stefania; Persico, Donatella
This paper explores the methodological approaches most commonly adopted in the scholarly literature on Massive Open Online Courses (MOOCs), published during the period January 2008–May 2014. In order to identify ...
Match: MOOC research
Output 4. SCORE2020 : Conditions for and characteristics of MOOCs design models
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research
Output 6 SCORE2020 : Train-the-trainer mOOC (micro open online course)
SCORE2020
The SCORE2020 project focused on (regional) support structures in the development and delivery of Open Education and especially of MOOCs. In total, thirteen intellectual outputs are ...
Match: MOOC research