TY - JOUR
T1 - Examining the reliability of the scores of self-report instruments assessing problematic exercise
T2 - A systematic review and meta-analysis
AU - Alcaraz-Ibáñez, Manuel
AU - Paterna, Adrian
AU - Sicilia, Álvaro
AU - Griffiths, Mark D.
N1 - Publisher Copyright:
© 2022 The Author(s).
PY - 2022/6/30
Y1 - 2022/6/30
N2 - Background and aims: Problematic exercise (PE) has mainly been assessed with self-report instruments. However, summarized evidence on the reliability of the scores derived from such instruments has yet to be provided. The present study reports a reliability generalization meta-analysis of six well-known self-report measures of PE (Commitment to Exercise Scale, Compulsive Exercise Test, Exercise Addiction Inventory, Exercise Dependence Questionnaire, Exercise Dependence Scale, and Obligatory Exercise Questionnaire). Methods: Pooled effect sizes were computed using a random-effect model employing a restricted maximum likelihood estimation method. Univariable and multivariable meta-regressions analyses were employed for testing moderator variables. Results: Data retrieved from 255 studies (741 independent samples, Na =a 254,174) identified three main groups of findings: (i) pooled alpha values that, ranging from 0.768 to 0.930 for global scores and from 0.615 to 0.907 for subscale scores, were found to be sensitive to sociodemographic and methodological characteristics; (ii) reliability induction rates of 47.58%; and (iii) the virtually non-existent testing of the assumptions required for the proper applicability of alpha. Data unavailability prevented the provision of summarized reliability estimates in terms of temporal stability. Discussion: These findings highlight the need to improve reliability reporting of the scores of self-reported instruments of PE in primary studies. This implies providing both prior justification for the appropriateness of the index employed and reliability data for all the subpopulation of interest. The values presented could be used as a reference both for comparisons with those obtained in future primary studies and for correcting measurement-related artefacts in quantitative meta-analytic research concerning PE.
AB - Background and aims: Problematic exercise (PE) has mainly been assessed with self-report instruments. However, summarized evidence on the reliability of the scores derived from such instruments has yet to be provided. The present study reports a reliability generalization meta-analysis of six well-known self-report measures of PE (Commitment to Exercise Scale, Compulsive Exercise Test, Exercise Addiction Inventory, Exercise Dependence Questionnaire, Exercise Dependence Scale, and Obligatory Exercise Questionnaire). Methods: Pooled effect sizes were computed using a random-effect model employing a restricted maximum likelihood estimation method. Univariable and multivariable meta-regressions analyses were employed for testing moderator variables. Results: Data retrieved from 255 studies (741 independent samples, Na =a 254,174) identified three main groups of findings: (i) pooled alpha values that, ranging from 0.768 to 0.930 for global scores and from 0.615 to 0.907 for subscale scores, were found to be sensitive to sociodemographic and methodological characteristics; (ii) reliability induction rates of 47.58%; and (iii) the virtually non-existent testing of the assumptions required for the proper applicability of alpha. Data unavailability prevented the provision of summarized reliability estimates in terms of temporal stability. Discussion: These findings highlight the need to improve reliability reporting of the scores of self-reported instruments of PE in primary studies. This implies providing both prior justification for the appropriateness of the index employed and reliability data for all the subpopulation of interest. The values presented could be used as a reference both for comparisons with those obtained in future primary studies and for correcting measurement-related artefacts in quantitative meta-analytic research concerning PE.
KW - alpha
KW - exercise dependence
KW - internal consistency
KW - morbid exercise
KW - psychometric properties
UR - http://www.scopus.com/inward/record.url?scp=85137282908&partnerID=8YFLogxK
U2 - 10.1556/2006.2022.00014
DO - 10.1556/2006.2022.00014
M3 - Review
C2 - 35482912
AN - SCOPUS:85137282908
SN - 2062-5871
VL - 11
SP - 326
EP - 347
JO - Journal of Behavioral Addictions
JF - Journal of Behavioral Addictions
IS - 2
ER -