Critical examination of current response shift methods and proposal for advancing new methods

Quality of Life Research, vol. 30, pp. 3325–3342

Abstract

PURPOSE: This work is part of an international, interdisciplinary initiative to synthesize research on response shift in results of patient-reported outcome measures. The objective is to critically examine current response shift methods. We additionally propose advancing new methods that address the limitations of extant methods. METHODS: Based on literature reviews, this critical examination comprises design-based, qualitative, individualized, and preference-based methods, latent variable models, and other statistical methods. We critically appraised their definition, operationalization, the type of response shift they can detect, whether they can adjust for and explain response shift, their assumptions, and alternative explanations. Overall limitations requiring new methods were identified. RESULTS: We examined 11 methods that aim to operationalize response shift, by assessing change in the meaning of one's self-evaluation. Six of these methods distinguish between change in observed measurements (observed change) and change in the construct that was intended to be measured (target change). The methods use either (sub)group-based or individual-level analysis, or a combination. All methods have underlying assumptions to be met and alternative explanations for the inferred response shift effects. We highlighted the need to address the interpretation of the results as response shift and proposed advancing new methods handling individual variation in change over time and multiple time points. CONCLUSION: No single response shift method is optimal; each method has strengths and limitations. Additionally, extra steps need to be taken to correctly interpret the results. Advancing new methods and conducting computer simulation studies that compare methods are recommended to move response shift research forward.

Authors 8

1. Véronique Sebille corresponding

   Université de Tours · Inserm · methodS in Patient-centered outcomes and HEalth ResEarch · Université de Nantes · Nantes Université

   Affiliation as printed

   UMR INSERM 1246, SPHERE "methodS in Patient-Centered Outcomes and HEalth ResEarch", University of Nantes, University of Tours, Nantes, France. veronique.sebille@univ-nantes.fr

   UMR INSERM 1246, SPHERE "methodS in Patient-Centered Outcomes and HEalth ResEarch", University of Nantes, University of Tours, Nantes, France

2. Lisa Marie Lix

   University of Manitoba

   Affiliation as printed

   Department of Community Health Sciences, University of Manitoba, Winnipeg, Canada

3. Olawale F. Ayilara

   University of Manitoba

   Affiliation as printed

   Department of Community Health Sciences, University of Manitoba, Winnipeg, Canada

4. Tolulope T. Sajobi

   University of Calgary · O'Brien Institute for Public Health

   Affiliation as printed

   Department of Community Health Sciences and O'Brien Institute for Public Health, University of Calgary, Calgary, AB, Canada

5. A. Cecile J.W. Janssens

   Emory University

   Affiliation as printed

   Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, USA

6. Richard G. Sawatzky

   Trinity Western University

   Affiliation as printed

   School of Nursing, Trinity Western University, Langley, BC, Canada

7. Mirjam A. G. Sprangers

   Amsterdam UMC Location University of Amsterdam · Amsterdam Public Health · Amsterdam University Medical Centers

   Affiliation as printed

   Department of Medical Psychology, Amsterdam University Medical Centers, Location AMC, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

8. Mathilde G. E. Verdam Aachen Department of Methodology and Statistics Institute of Psychology, Leiden University

   Leiden University · Amsterdam UMC Location University of Amsterdam · Amsterdam Public Health · Amsterdam University Medical Centers

   Affiliation as printed

   Department of Medical Psychology, Amsterdam University Medical Centers, Location AMC, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands

   Department of Methodology and Statistics, Institute of Psychology, Leiden University, Leiden, The Netherlands