Peer-Reviewed Journal Details
Mandatory Fields
Costello E.;Holland J.;Kirwan C.
2018
December
BMC Research Notes
Evaluation of MCQs from MOOCs for common item writing flaws 11 Medical and Health Sciences 1117 Public Health and Health Services
Published
()
Optional Fields
Education Item writing MCQs MOOCs Pedagogy Quality Tests
11
1
© 2018 The Author(s). Objective: There is a dearth of research into the quality of assessments based on Multiple Choice Question (MCQ) items in Massive Open Online Courses (MOOCs). This dataset was generated to determine whether MCQ item writing flaws existed in a selection of MOOC assessments, and to evaluate their prevalence if so. Hence, researchers reviewed MCQs from a sample of MOOCs, using an evaluation protocol derived from the medical health education literature, which has an extensive evidence-base with regard to writing quality MCQ items. Data description: This dataset was collated from MCQ items in 18 MOOCs in the areas of medical health education, life sciences and computer science. Two researchers critically reviewed 204 questions using an evidence-based evaluation protocol. In the data presented, 50% of the MCQs (112) have one or more item writing flaw, while 28% of MCQs (57) contain two or more flaws. Thus, a majority of the MCQs in the dataset violate item-writing guidelines, which mirrors findings of previous research that examined rates of flaws in MCQs in traditional formal educational contexts.
1756-0500
10.1186/s13104-018-3959-4
Grant Details