Evaluating the validity and applicability of automated essay scoring in two massive open online courses
Published | November 2014 |
Type of work | Special Issue: Research into Massive Open Online Courses |
Journal | The International Review of Research in Open and Distributed Learning Volume 15, Issue 5, Pages 83-98 |
Original Publication | The International Review of Research in Open and Distance Learning |
Editors | McGreal, Rory and Conrad, Dianne |
ABSTRACT
The use of massive open online courses (MOOCs) to expand students’ access to higher education has raised questions regarding the extent to which this course model can provide and assess authentic, higher level student learning. In response to this need, MOOC platforms have begun utilizing automated essay scoring (AES) systems that allow students to engage in critical writing and free-response activities. However, there is a lack of research investigating the validity of such systems in MOOCs. This research examined the effectiveness of an AES tool to score writing assignments in two MOOCs. Results indicated that some significant differences existed between Instructor grading, AES-Holistic scores, and AES-Rubric Total scores within two MOOC courses. However, use of the AES system may still be useful given instructors’ assessment needs and intent. Findings from this research have implications for instructional technology administrators, educational designers, and instructors implementing AES learning activities in MOOC courses.Keywords | assessment · automated essay scoring systems · MOOC |
ISSN | 1492-3831 |
Other number | 5 |
Refereed | Yes |
Rights | by/4.0 |
URL | http://www.irrodl.org/index.php/irrodl/article/view/1857 |
Other information | IRRODL |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 129 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.
Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
Global times call for global measures: Investigating automated essay scoring in linguistically-diverse MOOCs
Reilly, Erin; Wiliams, Kyle; Stafford, Rose; Corliss, Stephanie; et al.
This paper utilizes a case-study design to discuss global aspects of massive open online course (MOOC) assessment. Drawing from the literature on open-course models and linguistic gatekeeping in education, we position ...
Match: Reilly, Erin; Stafford, Rose; Corliss, Stephanie; assessment
Assessment in Massive Open Online Courses
Admiraal, Wilfried; Pilli, Olga; Huisman, Bart
Open online distance learning in higher education has quickly gained popularity, expanded, and evolved, with Massive Open Online Courses (MOOCs) as the most recent development. New web technologies allow for scalable ...
Match: assessment; MOOC
Architecture of a MOOC: Assessment
Prabhakar, T V
Week 2: Architecture of a MOOC, module 4 of the MOOC on MOOC course offered by the Indian Institute of Technology Kanpur (IITK) & Commonwealth of Learning (COL) in September 2014. This resource contains a video link, ...
Match: assessment; MOOC
MOOCs in Europe: Overview of papers representing a collective European response on MOOCs as presented during the HOME conference in Rome November 2015
Bang, Joergen; Dalsgaard, Christian; Kjaer, Arne; O’Donovan, Maria; et al.
Table of contents
Foreword
Part 1: Regional MOOC initiatives
Building OOC layers on top of existing courses
(M)OOCs in Iceland: Language and learning communities
EduOpen network in Italy
Part 2: Role media ...
Match: assessment; MOOC
MOOCs - A review of the state-of-the-art
Yousef, Ahmed Mohamed Fahmy; Chatti, Mohamed Amine; Schroeder, Ulrik; Wosnitza, Marold; Jakobs, Harald
Massive open online courses (MOOCs) have drastically changed the way we learn as well as how we teach. The main aim of MOOCs is to provide new opportunities to a massive number of learners to attend free online courses ...
Match: assessment; MOOC
Developing a strategic approach to MOOCs
Ferguson, Rebecca; Scanlon, Eileen; Harris, Lisa
During the last eight years, interest in massive open online courses (MOOCs) has grown fast and continuously worldwide. Universities that had never engaged with open or online learning have begun to run courses in these ...
Match: assessment; MOOC
Presentation to UNCTAD's advisory group on "Developing skills, knowledge and capacities through innovation: E-Learning, M-Learning, cloud-Learning"
Downes, Stephen
Match: assessment; MOOC
Brief report on Open Praxis figures and data (2017)
Inés Gil-Jaurena
In the first Open Praxis issue in 2018 we briefly report on some statistics and information about Open Praxis development. The report covers the period January 2013 - December 2017, with a special focus in volume 9, ...
Match: assessment; MOOC
Development of OERs through international collaboration E-QUAL case study
Gupta, Parul
Development of Open Education Resources (OER) is similar to product development and it requires due attention to get the final product. Generally, the focus is laid on the final product and not on the process. However, ...
Match: assessment; MOOC
Special Issue: Open Facilitator Stories
Singh, Lenandlar; Nerantzi, Chrissi; Spiers, Alex; Cullen, Rod; et al.
Welcome to the Open Facilitator Project…
We are a team of open educators passionate about enhancing the learner and facilitator experience in open educational offers of different sizes, small, large or extra large. ...
Match: assessment