Meaningful learner information for MOOC instructors examined through a contextualized evaluation framework
Published | February 2019 |
Journal | The International Review of Research in Open and Distributed Learning Volume 20, Issue 1, Pages 204-220 |
Country | United States, North America |
ABSTRACT
Improving STEM MOOC evaluation requires an understanding of the current state of STEM MOOC evaluation, as perceived by all stakeholders. To this end, we investigated what kinds of information STEM MOOC instructors currently use to evaluate their courses and what kinds of information they feel would be valuable for that purpose. We conducted semi-structured interviews with 14 faculty members from a variety of fields and research institutions who had taught STEM MOOCs on edX, Coursera, or Udacity. Four major themes emerged related to instructors' desires: (1) to informally assess learners as an instructor might in a traditional classroom, (2) to assess learners’ attainment of personal learning goals, (3) to obtain in-depth qualitative feedback from learners, and (4) to access more detailed learner analytics regarding the use of course materials. These four themes contribute to a broader sentiment expressed by the instructors that they have access to a wide variety of quantitative data for use in evaluation, but are largely missing the qualitative information that plays a significant role in traditional evaluation. Finally, we provide our recommendations for MOOC evaluation criteria, based on these findings.Keywords | evaluation · MOOC instructor · MOOCs · STEM |
ISSN | 1492-3831 |
Refereed | Yes |
Rights | Attribution 4.0 International (CC BY 4.0) |
DOI | 10.19173/irrodl.v20i1.3717 |
URL | http://www.irrodl.org/index.php/irrodl/article/view/3717 |
Export options | BibTex · EndNote · Tagged XML · Google Scholar |
AVAILABLE FILES
Viewed by 101 distinct readers
CLOUD COMMUNITY REVIEWS
The evaluations below represent the judgements of our readers and do not necessarily reflect the opinions of the Cloud editors.










Click a star to be the first to rate this document
▶ POST A COMMENT
SIMILAR RECORDS
Open educational resources: on the web and free
Johnson, Doug
Match: evaluation
How video production affects student engagement: an empirical study of MOOC videos
Guo, Philip; Kim, Juho; Rubin, Rob
Videos are a widely-used kind of resource for online learning. This paper presents an empirical study of how video production decisions affect student engagement in online educational videos. To our knowledge, ours is ...
Match: united states; north america
Exploring OER: Internet information literacy, problem solving and analogical thinking
Ferranti, Cinzia
In adult learning education contexts, the Internet Information Literacy (IIL) process comprises not only of fundraising for its immediate use, but in particular conditions it also requires to “shed light” on a ...
Match: information
Case study: Open Educational Resources in information literacy
Borjesson, Anne; Forsberg, Asa; Malpica, F.; Tremante, A.; et al.
During 2007 the Lund University Libraries (LUB) administered a project to develop open educational resources (OER) in information literacy. The OERs that were developed treat different aspects of information literacy, ...
Match: information
Exploring MOOC from education and Information Systems perspectives: a short literature review
Saadatdoost, Robab; Sim, Alex Tze Hiang; Jafarkarimi, Hosein; Mei Hee, Jee
Massive Open Online Courses (MOOCs) have gained significance as a new paradigm in education. MOOCs are open to any interested person and provide education products for a scalable number of learners who have access to ...
Match: information; moocs
Measuring learners’ motivation level in Massive Open Online Courses
Huang, Biyun; Hew, Khe Foon; Division of Information and Technology Studies, Faculty of Education at the University of Hong Kong
Motivation stimulates and sustains learning behavior. It is important to understand learners’ motivation, and identify whether the instructional materials can motivate or demotivate students. However, there are ...
Match: moocs
Open science by design: Realizing a vision for 21st century research
Committee on Toward an Open Science Enterprise; Board on Research Data and Information; Policy and Global Affairs; National Academies of Sciences, Engineering, and Medicine
Openness and sharing of information are fundamental to the progress of science and to the effective functioning of the research enterprise. The advent of scientific journals in the 17th century helped power the ...
Match: united states; north america
Frugal MOOCs: An adaptable contextualized approach to MOOC designs for refugees
Shah, Mariam Aman; Calonge, David Santandreu
There is a growing body of literature that recognizes the role Massive Open Online Courses (MOOCs) can play in improving access to education globally, and particularly to thousands of people in developing and developed ...
Match: contextualized; moocs
MOOC's barriers and enables
Gulatee, Yuwanuch; Nilsook, Prachyanun; the Department of Management and Information Technology, Nakhophanom University, Thailand; the Department of Technological Education, King Mongkut's University of Technology North Bangkok, Bangkok, 10800, Thailand
MOOCs (massive open online course) become a very popular way of learning these days. People could access MOOCs from anywhere at any time with a fraction of the cost. In this study, we have examined both barriers and ...
Match: moocs
Use of Open Educational Resources in K-12 schools in 2018
SIMBA Information
Use of Open Educational Resources in K-12 Schools 2018 is a new look at how open educational resources are permeating classrooms in U.S. schools. Areas explored in the report include:
*an overview of the OER landscape, ...
Match: united states; north america