Increasing Internal and External Validity Through a Multimethod Evaluation With Qualitative Comparative Analysis (QCA) and Process Tracing: The Case of Training Transfer Effectiveness in Flemish SMEs

Evaluation Review, vol. 50, pp. 231–255

Abstract

This paper presents a methodological advancement by integrating Qualitative Comparative Analysis (QCA) and Process Tracing (PT) in the evaluation of training transfer effectiveness in Flemish SMEs. This multimethod approach leverages the strengths of both QCA and PT to enhance internal and external validity, offering a robust framework for capturing the conditions and causal mechanisms underlying policy interventions. By sequentially applying QCA to identify necessary and sufficient conditions and PT to unpack the causal processes, the study provides a comprehensive analysis that addresses both "what works" and "how it works." Our findings demonstrate that combining these methods allows for more nuanced insights into the effectiveness of training programs, ultimately contributing to the empirical validation of policy theories and the development of evidence-based interventions. This research underscores the potential of multimethod evaluations to produce more reliable and generalizable results, thereby offering valuable guidance for evaluators and policymakers seeking to enhance the impact of their programs.

Authors 4

1. Priscilla Álamos‐Concha corresponding

   Radboud University Nijmegen

   Affiliation as printed

   Radboud University

   Radboud University, Nijmegen, Netherlands

2. Valérie Pattyn Aachen

   Leiden University

   Affiliation as printed

   Leiden University

   Leiden University, Leiden, Netherlands

3. Bart Cambré

   University of Antwerp · Antwerp Management School

   Affiliation as printed

   University of Antwerp and Antwerp Management School

   University of Antwerp and Antwerp Management School, Antwerp, Belgium

4. Benoît Rihoux

   UCLouvain

   Affiliation as printed

   University of Louvain

   University of Louvain, Louvain-la-Neuve, Belgium