Increasing internal and external validity through a multimethod evaluation with Qualitative Comparative Analysis and Process Tracing

Increasing internal and external validity through a multimethod evaluation with Qualitative Comparative Analysis and Process Tracing: The Case of Training Transfer Effectiveness in Flemish SMEs

Speakers

Priscilla Alamos-Concha (Radboud University), Valerie Pattyn (Leiden University), Bart Cambré (Antwerp Management School) et Benoît Rihoux (Université catholique de Louvain). 

You must register for the seminar via Zoom. 

Summary

Recent toolboxes and methodological overviews in evaluation communities increasingly highlight the value of Qualitative Comparative Analysis (QCA) and Process Tracing (PT) for understanding how interventions work under different conditions. While the use of QCA and PT is growing, their combination in multimethod studies remains rare. Combining QCA and PT allows for both cross-case and within-case analysis, answering both "why" and "how" questions in one study. This approach enhances the external validity of evaluation findings, especially for process-level generalizations. However, it poses challenges requiring a well-designed research plan. The presentation outlines such a plan, offering guidance on combining QCA and PT within a system-oriented mechanistic approach to causality. Causal mechanisms are conceptualized as systems of interacting parts transferring causal forces from causes to outcomes. Unlike previous multimethod research focusing on difference-making causation, this approach emphasizes understanding how processes work. The presentation draws on an evaluation of ESF-subsidized training programs in Flemish firms, employing QCA to analyze a diverse set of cases and PT to delve deeply into key mechanisms. It contributes to mid-range theorizing with implications for similar programs. This webinar is divided into sections explaining the research approach, the evaluation context and model, the QCA methodology, the PT methodology, and concludes with advice for evaluators and supervision committees.