The function of conducting a direct replication may be different than typically assumed: understanding contextuality and asymmetry

Journal of Clinical Epidemiology, vol. 183, pp. 111785

Abstract

Direct replication, that is, analysis of new data with the same study protocol, has a purpose in checking the reliability of earlier research findings. However, using a case study we show that direct replication can have an additional function. We find that identical numerical replication results can be the result of differential effects of biases across different data sources and we draw attention to the risk of asymmetric evaluation in such cases. We then show how exact replications have the important function to bring into focus the contextualities inherent in the generation of research findings. Understanding the contextuality allows for a better and richer understanding of what the results imply.

Authors 5

1. Stephanie Meirmans corresponding

   Amsterdam UMC Location University of Amsterdam · Amsterdam University Medical Centers · University of Amsterdam

   Affiliation as printed

   Department of Ethics, Law and Humanities, Amsterdam UMC, Amsterdam Medical Center, University of Amsterdam, Meibergdreef 9, Amsterdam 1105 AZ, The Netherlands. Electronic address: s.meirmans@amsterdamumc.nl

   Department of Ethics, Law and Humanities, Amsterdam UMC, Amsterdam Medical Center, University of Amsterdam, Meibergdreef 9, Amsterdam 1105 AZ, the Netherlands. Electronic address: s.meirmans@amsterdamumc.nl

2. Kim Luijken

   University Medical Center Utrecht

   Affiliation as printed

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, the Netherlands

3. Patricia C.J.L. Bruijning-Verhagen

   University Medical Center Utrecht

   Affiliation as printed

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, the Netherlands

4. Rolf H. H. Groenwold Aachen Department of Clinical Epidemiology

   Leiden University Medical Center

   Affiliation as printed

   Department of Clinical Epidemiology, Leiden University Medical Center, Albinusdreef 2, Leiden 2333 ZA, The Netherlands

   Department of Clinical Epidemiology, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, the Netherlands

5. Annemarijn R de Boer

   University Medical Center Utrecht

   Affiliation as printed

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands

   Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, the Netherlands