Computer Testing, Formative or Summative, and Proctoring: Does it Matter? Lessons Learned From the Dutch Interuniversity Progress Test of Medicine During the Corona Pandemic

Perspectives on Medical Education, vol. 15, pp. 122–133

Abstract

Introduction: The COVID-19 pandemic prompted significant changes in the administration of the Dutch Interuniversity Progress Test of Medicine, offering a unique opportunity to investigate the effects of various test formats. This study explores the impact of transitioning from paper-based to computer-based testing, the shift from summative to formative testing, and the effectiveness of remote proctoring compared to live supervision. Methods: Data from over 10,000 participants across five medical schools were analyzed. Results: Results showed no significant difference in student performance between paper-based and computer-based tests. Additionally, remote proctoring proved to be as effective as live supervision in preventing dishonest behavior. Formative testing yielded slightly better results than summative testing in most schools, although the effect varied between institutions. Discussion: Overall, our study concludes that computer-based testing is a viable alternative to paper-based formats, and remote proctoring can effectively replace live invigilation, at least in our setting and under COVID-19-related circumstances.

Authors 8

1. Jan Hindrik Ravesloot

   Amsterdam University Medical Centers

   Affiliation as printed

   Amsterdam University Medical Center, location Amsterdam Medical Centre, Amsterdam, the Netherlands

2. Jeroen Donkers

   Maastricht University

   Affiliation as printed

   Department of Educational Development and Research of the Faculty of Health, Medicine and Life sciences of the University of Maastricht, Maastricht, the Netherlands

3. Ariadne A. Meiboom

   Amsterdam University Medical Centers

   Affiliation as printed

   Amsterdam University Medical Center, location Free University Medical School, Amsterdam, the Netherlands

4. Alexandra M. J. Langers Aachen

   Leiden University Medical Center

   Affiliation as printed

   Leiden University Medical Center, Leiden, the Netherlands

5. Bram Jacobs

   University Medical Center Groningen

   Affiliation as printed

   Department of neurology, University Medical Center, Groningen, the Netherlands

6. Rene Tio

   Catharina Ziekenhuis

   Affiliation as printed

   Department of cardiology, Catharinaziekenhuis Eindhoven, Eindhoven, the Netherlands

7. Cees van der Vleuten

   Maastricht University

   Affiliation as printed

   Department of educational development and research in the faculty of health, medicine and life sciences, Maastricht University, Maastricht, the Netherlands

8. Andreas J. A. Bremers corresponding

   Radboud University Medical Center

   Affiliation as printed

   Radboud University Medical Centre, Nijmegen, the Netherlands