Bifactor Analysis of the Physical Activity Enjoyment Scale (PACES)
DOI:
https://doi.org/10.24265/liberabit.2024.v30n2.849Keywords:
Physical Activity Enjoyment Scale, internal structure, bifactor, physical exercise, enjoymentAbstract
Background: Enjoyment is an affective state that promotes physical exercise and involves feelings of pleasure, satisfaction and fun. The revised version of the Physical Activity Enjoyment Scale (PACES) revealed a unidimensional factor structure. However, its adaptation in multiple cultural contexts yielded discordances in its dimensionality Objective: The present study provides evidence on the internal structure of the PACES adapted to the Argentine cultural context. Method: 253 adult residents of the province of Buenos Aires participated. The comparison of different measurement models was implemented, including the analysis of a bifactor model. Confirmatory factor analysis was used to evaluate the fit of the different models. Evidence of discriminant validity was also obtained from self-reported physical exercise. Results: The exclusion of one item allowed a satisfactory fit of the model with a two-factor correlated structure. Likewise, the bifactor model presented an equally satisfactory fit χ2(89) = 179.589 with CFI = .98, TLI = .97 and RMSEA = .074, with values of LCA = .81 and PUC = .51. Conclusion: The evidence indicates good psychometric properties, allowing the calculation and interpretation of a total score that explains the variability of the items, simultaneously with the specific factors.
Downloads
References
Bonifay, W. E., Reise, S. P., Scheines, R., & Meijer, R. R. (2015). When Are Multidimensional Data Unidimensional Enough for Structural Equation Modeling? An Evaluation of the DETECT Multidimensionality Index. Structural Equation Modeling: A Multidisciplinary Journal, 22(4), 504-516. https://doi.org/10.1080/10705511.2014.938596
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2.a ed.). Guilford Publications.
Carraro, A., Young, M. C., & Robazza, C. (2008). A Contribution to the Validation of the Physical Activity Enjoyment Scale in an Italian Sample. Social Behavior and Personality, 36(7), 911-918. https://doi.org/10.2224/sbp.2008.36.7.911
Chen, C., Weyland, S., Fritsch, J., Woll, A., Niessner, C., Burchartz, A., Schmidt, S. C. E., & Jekauc, D. (2021). A Short Version of the Physical Activity Enjoyment Scale: Development and Psychometric Properties. International Journal of Environmental Research and Public Health, 18(21), 11035. https://doi.org/10.3390/ijerph182111035
Chung, P. K., & Leung, K. M. (2018). Psychometric Properties of Eight-Item Physical Activity Enjoyment Scale in Chinese Population. Journal of Aging and Physical Activity, 27(1), 61-66. https://doi.org/10.1123/japa.2017-0212
Crocker, P. R. E., Bouffard, M., & Gessaroli, M. E. (1995). Measuring Enjoyment in Youth Sport Settings: A Confirmatory Factor Analysis of the Physical Activity Enjoyment Scale. Journal of Sport and Exercise Psychology, 17(2), 200-205. https://doi.org/10.1123/jsep.17.2.200
De Gracia, M., & Marcó, M. (2000). Efectos psicológicos de la actividad física en personas mayores. Psicothema,12(2), 285-292. https://www.redalyc.org/pdf/727/72712221.pdf
Dominguez-Lara, S. A., & Rodriguez, A. (2017). Índices estadísticos de modelos bifactor. Interacciones, 3(2), 59-65. https://doi.org/10.24016/2017.v3n2.51
Ekelund, U., Brown, W. J., Steene-Johannessen, J., Fagerland, M. W., Owen, N., Powell, K. E., Bauman, A. E., & Lee, I. M. (2019). Do the Associations of Sedentary Behaviour with Cardiovascular Disease Mortality and Cancer Mortality Differ by Physical Activity Level? A Systematic Review and Harmonised Meta-Analysis of Data from 850 060 Participants. British Journal of Sports Medicine, 53(14), 886-894. https://doi.org/10.1136/bjsports-2017-098963
Gardner, L. A., Magee, C. A., & Vella, S. A. (2017). Enjoyment and Behavioral Intention Predict Organized Youth Sport Participation and Dropout. Journal of Physical Activity and Health, 14(11), 861-865. https://doi.org/10.1123/jpah.2016-0572
Godin, G. (2011). The Godin-Shephard Leisure-Time Physical Activity Questionnaire. Health & Fitness Journal of Canada, 4(1), 18-22. https://doi.org/10.14288/hfjc.v4i1.82
Godin, G., & Shephard, R. J. (1985). A Simple Method to Assess Exercise Behavior in the Community. Canadian Journal of Applied Sport Sciences, 10(3), 141-146.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate Data Analysis, Pearson New International Edition. Pearson Education Limited.
Hu, L. T., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Structural Equation Modeling, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Jekauc, D. (2015). Enjoyment during Exercise Mediates the Effects of an Intervention on Exercise Adherence. Psychology, 6(1), 48-54. https://doi.org/10.4236/psych.2015.61005
Jekauc, D., Nigg, C., Nigg, C. R., Reichert, M., Krell-Roesch, J., Oriwol, D., Schmidt, S., Wunsch, K., & Woll, A.(2020). Measurement Properties of the German Version of the Physical Activity Enjoyment Scale for Adults. PLoS ONE, 15(11), e0242069. https://doi.org/10.1371/journal.pone.0242069
Jekauc, D., Voelkle, M., Wagner, M. O., Mewes, N., & Woll, A. (2012). Reliability, Validity, and Measurement Invariance of the German Version of the Physical Activity Enjoyment Scale. Journal of Pediatric Psychology, 38(1), 104-115. https://doi.org/10.1093/jpepsy/jss088
Kendzierski, D., & DeCarlo, K. J. (1991). Physical Activity Enjoyment Scale: Two Validation Studies. Journal of Sport and Exercise Psychology, 13(1), 50-64. https://doi.org/10.1123/jsep.13.1.50
Kendzierski, D., & Morganstein, M. S. (2009). Test, Revision, and Cross-Validation of the Physical Activity Self-Definition Model. Journal of Sport and Exercise Psychology, 31(4), 484-504. https://doi.org/10.1123/jsep.31.4.484
Klompstra, L., Deka, P., Almenar, L., Pathak, D., Muñoz-Gómez, E., López-Vilella, R., & Marques-Sule, E. (2022). Physical Activity Enjoyment, Exercise Motivation, and Physical Activity in Patients with Heart Failure: A Mediation Analysis. Clinical Rehabilitation, 36(10), 1324-1331. https://doi.org/10.1177/02692155221103696
Kruk, M., Zarychta, K., Horodyska, K., Boberska, M., Scholz, U., Radtke, T., & Luszczynska, A. (2019). What Comes First, Negative Emotions, Positive Emotions, or Moderate-to-Vigorous Physical Activity? Mental Health and Physical Activity, 16, 38-42. https://doi.org/10.1016/j.mhpa.2019.03.002
Latorre-Román, P. Á., Martínez-López, E. J., Ruiz-Ariza, A., Izquierdo-Rus, T., Salas-Sánchez, J., & García-Pinillos, F. (2016). Validez y fiabilidad del cuestionario de disfrute por el ejercicio físico (PACES) en adolescentes con sobrepeso y obesidad. Nutrición Hospitalaria, 33(3), 595-601.
Lee, I. M., Shiroma, E. J., Lobelo, F., Puska, P., Blair, S. N., Katzmarzyk, P. T., Alkandari, J. R., Andersen, L. B., Bauman, A. E., Brownson, R. C., Bull, F. C., Craig, C. L., Ekelund, U., Goenka, S., Guthold, R., Hallal, P. C., Haskell, W. L., Heath, G. W., Inoue, S., … Wells, J. C. (2012). Effect of Physical Inactivity on Major Non-Communicable Diseases Worldwide: An Analysis of Burden of Disease and Life Expectancy. The Lancet, 380(9838), 219-229. https://doi.org/10.1016/S0140-6736(12)61031-9
Li, C. H. (2016). Confirmatory Factor Analysis with Ordinal Data: Comparing Robust Maximum Likelihood and Diagonally Weighted Least Squares. Behavior Research Methods, 48(3), 936-949. https://doi.org/10.3758/s13428-015-0619-7
Marsh, H. W. (1996). Positive and Negative Global Self-Esteem: A Substantively Meaningful Distinction or
Artifactors? Journal of Personality and Social Psychology, 70(4), 810-819. https://doi.org/10.1037/0022-3514.70.4.810
Monteiro, D., Nunes, G., Marinho, D. A., Couto, N., Antunes, R., Moutão, J., & Cid, L. (2017). Translation and Adaptation of the Physical Activity Enjoyment Scale (PACES) in a Sample of Portuguese Athletes, Invariance Across Genders Nature Sports and Swimming. Revista Brasileira de Cineantropometria & Desempenho Humano, 19(6), 631-643. http://dx.doi.org/10.5007/1980-0037.2017v19n6p631
Moore, J. B., Yin, Z., Hanes, J., Duda, J., Gutin, B., & Barbeau, P. (2009). Measuring Enjoyment of Physical Activity in Children: Validation of the Physical Activity Enjoyment Scale. Journal of Applied Sport Psychology, 21(1), 116-129. https://doi.org/10.1080/10413200802593612
Moreno, J. A., González-Cutre, D., Martínez, C., Alonso, N., & López, M. (2008). Propiedades psicométricas de la Physical Activity Enjoyment Scale (PACES) en el contexto español. Estudios de Psicologia, 29(2), 173-180. https://doi.org/10.1174/021093908784485093
Motl, R. W., Dishman, R. K., Saunders, R., Dowda, M., Felton, G., & Pate, R. R. (2001). Measuring Enjoyment of Physical Activity in Adolescent Girls. American Journal of Preventive Medicine, 21(2), 110-117. https://doi.org/10.1016/S0749-3797(01)00326-9
Mullen, S. P., Olson, E. A., Phillips, S. M., Szabo, A. N., Wójcicki, T. R., Mailey, E. L., Gothe, N. P., Fanning, J. T., Kramer, A. F., & McAuley, E. (2011). Measuring Enjoyment of Physical Activity in Older Adults: Invariance of the Physical Activity Enjoyment Scale (PACES) Across Groups and Time. International Journal of Behavioral Nutrition and Physical Activity, 8(103), 1-9. https://doi.org/10.1186/1479-5868-8-103
Oliden, P. E., & Zumbo, B. D. (2008). Coeficientes de fiabilidad para escalas de respuesta categórica ordenada.
Psicothema, 20(4), 896-901. https://reunido.uniovi.es/index.php/PST/article/view/8747
Peters, G. (2014). The Alpha and the Omega of Scale Reliability and Validity: Why and How to Abandon Cronbach’s Alpha and the Route Towards More Comprehensive Assessment of Scale Quality. The European Health Psychologist, 16(2), 56-69. https://doi.org/10.31234/osf.io/h47fv
R Core Team. (2020). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. https://www.R-project.org/
Raedeke, T. D. (2007). The Relationship Between Enjoyment and Affective Responses to Exercise. Journal of Applied Sport Psychology, 19(1), 105-115. https://doi.org/10.1080/10413200601113638
Rebar, A. L., Stanton, R., Geard, D., Short, C., Duncan, M. J., & Vandelanotte, C. (2015). A Meta-Meta-Analysis of
the Effect of Physical Activity on Depression and Anxiety in Non-Clinical Adult Populations. Health Psychology Review, 9(3), 366-378. https://doi.org/10.1080/17437199.2015.1022901
Reiner, M., Niermann, C., Jekauc, D., & Woll, A. (2013). Long-Term Health Benefits of Physical Activity - A Systematic Review of Longitudinal Studies. BMC Public Health, 13(1). https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-13-813
Reise, S. P. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47(5), 667-696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and Structural Coefficient Bias in Structural Equation Modeling: A Bifactor Perspective. Educational and Psychological Measurement, 73(1), 5-26. https://doi.org/10.1177/0013164412449831
Revelle, W. (2019). psych: Procedures for Personality and Psychological Research. Northwestern University. https://CRAN.R-project.org/package=psych
Rhodes, R. E., & Kates, A. (2015). Can the Affective Response to Exercise Predict Future Motives and Physical Activity Behavior? A Systematic Review of Published Evidence. Annals of Behavioral Medicine, 49(5), 715-731. https://doi.org/10.1007/s12160-015-9704-5
Rodrigues, F., Bento, T., Cid, L., Neiva, H. P., Teixeira, D., Moutão, J., Marinho, D. A., & Monteiro, D. (2018). Can Interpersonal Behavior Influence the Persistence and Adherence to Physical Exercise Practice in Adults? A Systematic Review. Frontiers in Psychology, 9, 2141. https://doi.org/10.3389/fpsyg.2018.02141
Rodrigues, F., Forte, P., Teixeira, D. S., Cid, L., & Monteiro, D. (2021). The Physical Activity Enjoyment Scale (Paces) as a Two-Dimensional Scale: Exploratory and Invariance Analysis. Montenegrin Journal of Sports Science and Medicine, 10(1), 61-66. https://doi.org/10.26773/mjssm.210309
Rodrigues, F., Teixeira, D. S., Cid, L., & Monteiro, D. (2021). Have you Been Exercising Lately? Testing the Role of Past Behavior on Exercise Adherence. Journal of Health Psychology, 26(10), 1482-1493. https://doi.org/10.1177/1359105319878243
Rodrigues, F., Teixeira, D. S., Neiva, H. P., Cid, L., & Monteiro, D. (2020). The Bright and Dark Sides of Motivation as Predictors of Enjoyment, Intention, and Exercise Persistence. Scandinavian Journal of Medicine & Science in Sports, 30(4), 787-800. https://doi.org/10.1111/sms.13617
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98(3), 223-237. https://doi.org/10.1080/00223891.2015.1089249
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Evaluating Bifactor Models: Calculating and Interpreting Statistical Indices. Psychologicl Methods, 21(2), 137-150. https://doi.org/10.1037/met0000045
Rosseel, Y. (2012). Lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. http://www.jstatsoft.org/v48/i02/
Ruby, M. B., Dunn, E. W., Perrino, A., Gillis, R., & Viel, S. (2011). The Invisible Benefits of Exercise. Health Psychology, 30(1), 67-74. https://doi.org/10.1037/a0021859
Scanlan, T. K., & Simons, J. P. (1992). The Construct of Sport Enjoyment. En G. C. Roberts (ed.), Motivation in sport and exercise (pp. 199-215). Human Kinetics.
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods of Psychological Research Online, 8(2), 23-74. https://www.stats.ox.ac.uk/~snijders/mpr_Schermelleh.pdf
Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107-120. https://doi.org/10.1007/s11336-008-9101-0
Steiger, J. H. (1990). Structural Model Evaluation and Modification: An Interval Estimation Approach. Multivariate Behavioral Research, 25(2), 173-180. https://doi.org/10.1207/s15327906mbr2502_4
Stenseng, F., Forest, J., & Curran, T. (2015). Positive Emotions in Recreational Sport Activities: The Role of Passion and Belongingness. Journal of Happiness Studies, 16(5), 1117-1129. https://doi.org/10.1007/s10902-014-9547-y
Stevens, C. J., Baldwin, A. S., Bryan, A. D., Conner, M., Rhodes, R. E., & Williams, D. M. (2020). Affective Determinants of Physical Activity: A Conceptual Framework and Narrative Review. Frontiers in Psychology, 11, 568331. https://doi.org/10.3389/fpsyg.2020.568331
Stucky, B. D., & Edelen, M. O. (2014). Using Hierarchical IRT Models to Create Unidimensional Measures from Multidimensional Data. En Handbook of Item Response Theory Modeling. Routledge.
Teixeira, D. S., Rodrigues, F., Cid, L., & Monteiro, D. (2022). Enjoyment as a Predictor of Exercise Habit, Intention to Continue Exercising, and Exercise Frequency: The Intensity Traits Discrepancy Moderation Role. Frontiers in Psychology, 13, 780059. https://doi.org/10.3389/fpsyg.2022.780059
Teixeira, D. S., Rodrigues, F., Machado, S., Cid, L., & Monteiro, D. (2021). Did You Enjoy It? The Role of Intensity-Trait Preference/Tolerance in Basic Psychological Needs and Exercise Enjoyment. Frontiers in Psychology, 12, 682480. https://doi.org/10.3389/fpsyg.2021.682480
Teques, P., Calmeiro, L., Silva, C., & Borrego, C. (2020). Validation and Adaptation of the Physical Activity Enjoyment Scale (PACES) in Fitness Group Exercisers. Journal of Sport and Health Science, 9(4), 352-357. https://doi.org/10.1016/j.jshs.2017.09.010
Wienke, B., & Jekauc, D. (2016). A Qualitative Analysis of Emotional Facilitators in Exercise. Frontiers in Psychology, 7, 1296. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2016.01296/full
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s α, Revelle’s β, and Mcdonald’s ωH: Their Relations with Each Other and Two Alternative Conceptualizations of Reliability. Psychometrika, 70(1), 123-133. https://doi.org/10.1007/s11336-003-0974-7
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Damián Javier Ursino, Gabriela Susana Lozzia, Facundo Juan Pablo Abal
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright: In the event that the manuscript is approved for future publication, the authors retain the copyright and assign to the journal the rights to publish, edit, reproduce, distribute, exhibit, and communicate nationally and internationally in the various databases, repositories and portals.
Self-archiving policy: The author can share, disseminate, and publicize his research published by the media (e.g., academic social networks, repositories, and portals) available on the web. During the editorial review process, the journal will provide the author with the previous versions (post-print) which should NOT be disclosed by any media, only for personal use and for final approval. Liberabit will send the author the final version of the article (published version) in PDF and HTML to be shared, disseminated and disclosed by the media available on the web. After the publication of the articles, the authors can make other independent or additional agreements for the non-exclusive dissemination of the version of the article published in this journal (publication in books or institutional repositories), provided that it is indicated with the respective reference that the work has been published for the first time in this journal.