A

VALID: A Checklist-Based Approach for Improving Validity in Psychological Research

Advances in Methods and Practices in Psychological Science, vol. 8

Abstract

In response to the replication and confidence crisis across various empirical disciplines, ensuring the validity of research has gained attention. High validity is crucial for obtaining replicable and robust study outcomes when both exploring new questions and replicating previous findings. In this study, we aimed to address this issue by developing a comprehensive checklist to assist researchers in enhancing and monitoring the validity of their research. After systematically analyzing previous findings on validity, a comprehensive list of potential checklist items was compiled. Over the course of three rounds, more than 30 interdisciplinary and psychological-science experts participated in a Delphi study. Experts rated items on their importance and were given the opportunity to propose novel items as well as improve existing ones. This process resulted in a final set of 91 items, organized according to common stages of a research project. The VALID checklist is accessible online ( https://www.validchecklist.com/ ) and provides researchers with an adaptable, versatile tool to monitor and improve the validity of their research and to suit their specific needs. By focusing on adaptiveness during its development, VALID encompasses 331 unique checklist versions, making it a one-stop solution suitable for a wide range of projects, designs, and requirements.

Authors 30

  1. Susanne Kerschbaumer corresponding

    University of Vienna

    Affiliation as printed

    Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria

  2. University of Vienna

    Affiliation as printed

    Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria

  3. Eötvös Loránd University

    Affiliation as printed

    Institute of Psychology, ELTE Eotvos Lorand University, Budapest, Hungary

  4. Arizona State University

    Affiliation as printed

    Department of Psychology, Arizona State University, Tempe, Arizona

  5. University of Memphis

    Affiliation as printed

    Department of Computer Science, University of Memphis, Memphis, Tennessee

  6. Harrisburg University of Science and Technology

    Affiliation as printed

    Analytics, Harrisburg University of Science and Technology, Harrisburg, Pennsylvania

  7. Linnaeus University

    Affiliation as printed

    Department of Psychology, Linnaeus University, Kalmar, Sweden

  8. Philipps University of Marburg

    Affiliation as printed

    Department of Psychology, University of Marburg, Marburg, Germany

  9. KU Leuven

    Affiliation as printed

    Center for Contextual Psychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium

  10. University of Groningen

    Affiliation as printed

    Department of Educational Sciences, University of Groningen, Groningen, Netherlands

  11. Leiden University

    Affiliation as printed

    Methodology and Statistics Department, Institute of Psychology, Leiden University, Leiden, Netherlands

  12. KU Leuven

    Affiliation as printed

    Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium

  13. University of Science and Technology of China · Chinese University of Hong Kong, Shenzhen

    Affiliation as printed

    Department of Psychology, University of Science and Technology of China, Hefei, China

    School of Humanities and Social Science, The Chinese University of Hong Kong, Shenzhen, China

  14. University of California, Davis

    Affiliation as printed

    Department of Human Ecology, University of California Davis, Davis, California

  15. Arizona State University

    Affiliation as printed

    Department of Psychology, Arizona State University, Tempe, Arizona

  16. Northwestern University

    Affiliation as printed

    Department of Psychology, Northwestern University, Evanston, Illinois

  17. University of Auckland

    Affiliation as printed

    School of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand

  18. National and Kapodistrian University of Athens

    Affiliation as printed

    Department of Primary Education, National and Kapodistrian University of Athens, Athens, Greece

  19. University of Glasgow

    Affiliation as printed

    School of Psychology and Neuroscience, University of Glasgow, Glasgow, Scotland

  20. Virginia Commonwealth University

    Affiliation as printed

    Department of Biostatistics, School of Medicine, Virginia Commonwealth University, Richmond, Virginia

  21. HMU Health and Medical University

    Affiliation as printed

    Institute for Mind, Brain and Behavior, HMU Health and Medical University, Potsdam, Germany

  22. The University of Queensland

    Affiliation as printed

    School of Psychology, The University of Queensland, St Lucia, Australia

  23. University of Minnesota

    Affiliation as printed

    Department of Psychology, University of Minnesota, Minneapolis, Minnesota

  24. Purdue University West Lafayette

    Affiliation as printed

    Department of Psychological Sciences, Purdue University, West Lafayette, Indiana

  25. Hiroshima University

    Affiliation as printed

    Graduate School of Advanced Science and Engineering, Hiroshima University, Higashihiroshima, Japan

  26. University of Toledo

    Affiliation as printed

    Herb Innovation Center, University of Toledo, Toledo, Ohio

  27. KU Leuven

    Affiliation as printed

    Faculty of Psychology and Educational Sciences, KU Leuven, Leuven, Belgium

  28. University of Groningen

    Affiliation as printed

    Department of Psychometrics and Statistics, University of Groningen, Groningen, Netherlands

  29. Tilburg University

    Affiliation as printed

    Department of Methodology and Statistics, Tilburg University, Tilburg, Netherlands

  30. University of Vienna

    Affiliation as printed

    Department of Cognition, Emotion, and Methods in Psychology, Faculty of Psychology, University of Vienna, Vienna, Austria

Cited by 8 stored of 9

8 results

No patents citing this paper on Lens.org (checked 2026-10-11).

References 35