Initial psychometric evaluation of the Perseverative Thinking Questionnaire in Peruvian undergraduates
DOI:
https://doi.org/10.24265/liberabit.2020.v26n2.05Keywords:
factor analysis, mental health, mental processes, psychological tests, validation studyAbstract
Background: the Perseverative Thinking Questionnaire (PTQ) is a global measure of repetitive negative thinking, a core transdiagnostic dimension of mental health. Objectives: this study sought to examine the factor structure, reliability, and evidence of associative validity of the PTQ in Peruvian undergraduates. Method: data from 240 undergraduates (Mage = 20.33, 59% female) were evaluated with confirmatory factor analysis. After finding the best factor structure, reliability was estimated with coefficient omega. The correlation between the PTQ’s latent variable and cognitive fusion was examined as evidence of associative validity. Results: the PTQ proved to be essentially unidimensional since acceptable fit was obtained by the one-factor model with three correlations between errors (CFI = .945; RMSEA = .079). Reliability was high (ω = .927). The correlation between the PTQ and cognitive fusion was very large (ϕ = .876). Conclusion: the PTQ is an essentially unidimensional measure, thus only a global score should be computed. Associative validity should be further examined in future studies.
Downloads
References
Arditte, K. A., Shaw, A. M., & Timpano, K. R. (2016). Repetitive negative thinking: A transdiagnostic correlate of affective disorders. Journal of Social and Clinical Psychology, 35(3), 181–201. https://doi.org/10.1521/jscp.2016.35.3.181
Auerbach, R. P., Mortier, P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D. D., Green, J. G., Hasking, P., Murray, E., Nock, M. K., Pinder-Amaker, S., Sampson, N. A., Stein, D. J., Vilagut, G., Zaslavsky, A. M., & Kessler, R. C. (2018). WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623–638. https://doi.org/10.1037/abn0000362
Azevedo, J., Pereira, A. T., Amaral, A. P., Nogueira, V., Soares, M. J., Mota, D., & Macedo, A. (2017). Perseverative Thinking Questionnaire: Confirmatory factor analysis with two different samples. European Psychiatry, 41, S377–S378. https://doi.org/10.1016/J.EURPSY.2017.02.401
Barlow, D. H., Sauer-Zavala, S., Carl, J. R., Bullis, J. R., & Ellard, K. K. (2014). The nature, diagnosis, and treatment of neuroticism: Back to the future. Clinical Psychological Science, 2(3), 344–365. https://doi.org/10.1177/2167702613505532
Bauer, E. A., Braitman, A. L., Judah, M. R., & Cigularov, K. P. (2020). Worry as a mediator between psychosocial stressors and emotional sequelae: Moderation by contrast avoidance. Journal of Affective Disorders, 266, 456–464. https://doi.org/10.1016/j.jad.2020.01.092
Blackledge, J. T. (2015). Cognitive defusion in practice: a clinician’s guide to assessing, observing, supporting change in your client. Context Press.
Borkovec, T. D., Robinson, E., Pruzinsky, T., & DePree, J. A. (1983). Preliminary exploration of worry: Some characteristics and processes. Behaviour Research and Therapy, 21(1), 9–16. https://doi.org/10.1016/0005-7967(83)90121-3
Brosseau-Liard, P. E., & Savalei, V. (2014). Adjusting incremental fit indices for nonnormality. Multivariate Behavioral Research, 49(5), 460–470. https://doi.org/10.1080/00273171.2014.933697
Brosseau-Liard, P. E., Savalei, V., & Li, L. (2012). An investigation of the sample performance of two nonnormality corrections for RMSEA. Multivariate Behavioral Research, 47(6), 904–930. https://doi.org/10.1080/00273171.2012.715252
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Routledge.
Canty, A., & Ripley, B. (2020). boot: Bootstrap R (S-Plus) Functions (1.3-25). https://cran.r-project.org/package=boot
Černis, E., Dunn, G., Startup, H. M., Kingdon, D., Wingham, G., Evans, N., Lister, R., Pugh, K., Cordwell, J., Mander, H., & Freeman, D. (2016). The Perseverative Thinking Questionnaire in patients with persecutory delusions. Behavioural and Cognitive Psychotherapy, 44(4), 472–481. https://doi.org/10.1017/S1352465815000533
Chaves, B., Castro, J., Pereira, A. T., Soares, M. J., Amaral, A. P., Bos, S., Madeira, N., Nogueira, V., Roque, C., & Macedo, A. (2013). Preservative Thinking Questionnaire: Validation of the Portuguese version. I Congresso Mundial de Comportamentos de Saúde Infanto-Juvenil.
Chen, F., Bollen, K. A., Paxton, P., Curran, P. J., & Kirby, J. B. (2001). Improper solutions in structural equation models: Causes, consequences, and strategies. Sociological Methods & Research, 29(4), 468–508. https://doi.org/10.1177/0049124101029004003
Devynck, F., Kornacka, M., Baeyens, C., Serra, É., Neves, J. F. das, Gaudrat, B., Delille, C., Taquet, P., Depraete, O., Tison, P., Sgard, F., Rousseau, A., & Romo, L. (2017). Perseverative Thinking Questionnaire (PTQ): French validation of a transdiagnostic measure of repetitive negative thinking. Frontiers in Psychology, 8, 2159. https://doi.org/10.3389/fpsyg.2017.02159
Drost, J., van der Does, W., van Hemert, A. M., Penninx, B. W., & Spinhoven, P. (2014). Repetitive negative thinking as a transdiagnostic factor in depression and anxiety: A conceptual replication. Behaviour Research and Therapy, 63, 177–183. https://doi.org/10.1016/J.BRAT.2014.06.004
Duffy, A., Saunders, K. E. A., Malhi, G. S., Patten, S., Cipriani, A., McNevin, S. H., MacDonald, E., & Geddes, J. (2019). Mental health care for university students: a way forward? The Lancet Psychiatry, 6(11), 885–887. https://doi.org/10.1016/S2215-0366(19)30275-5
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
Ehring, T., Raes, F., Weidacker, K., & Emmelkamp, P. M. G. (2012). Validation of the Dutch version of the Perseverative Thinking Questionnaire (PTQ-NL). European Journal of Psychological Assessment, 28(2), 102–108. https://doi.org/10.1027/1015-5759/a000097
Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy, 1(3), 192–205. https://doi.org/10.1521/ijct.2008.1.3.192
Ehring, T., Zetsche, U., Weidacker, K., Wahl, K., Schönfeld, S., & Ehlers, A. (2011). The Perseverative Thinking Questionnaire (PTQ): Validation of a content-independent measure of repetitive negative thinking. Journal of Behavior Therapy and Experimental Psychiatry, 42(2), 225–232. https://doi.org/10.1016/J.JBTEP.2010.12.003
Epskamp, S. (2019). semPlot: Path diagrams and visual analysis of various SEM packages’ output (1.1.2). https://cran.r-project.org/package=semPlot
Erickson, T. M., Newman, M. G., & Tingey, J. L. (2020). Worry and rumination. In J. S. Abramowitz & S. M. Blakey (Eds.), Clinical handbook of fear and anxiety: Maintenance processes and treatment mechanisms. (pp. 133–151). American Psychological Association. https://doi.org/10.1037/0000150-008
Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., Masley, S., Roach, L., Lloyd, J., May, L., Clarke, S., & Remington, B. (2014). The development and initial validation of the Cognitive Fusion Questionnaire. Behavior Therapy, 45(1), 83–101. https://doi.org/10.1016/J.BETH.2013.09.001
Harvey, A. G., Watkins, E. R., Mansell, W., & Shafran, R. (2004). Cognitive behavioural processes across psychological disorders. Oxford University Press.
Hayduk, L. A., & Littvay, L. (2012). Should researchers use single indicators, best indicators, or multiple indicators in structural equation models? BMC Medical Research Methodology, 12(1), 159. https://doi.org/10.1186/1471-2288-12-159
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2012). Acceptance and Commitment Therapy: The process and practice of mindful change (2nd ed.). Guilford Press.
Hong, R. Y., & Cheung, M. W.-L. (2015). The structure of cognitive vulnerabilities to depression and anxiety: Evidence for a common core etiologic process based on a meta-analytic review. Clinical Psychological Science, 3(6), 892–912. https://doi.org/10.1177/2167702614553789
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Hur, J., Heller, W., Kern, J., & Berenbaum, H. (2016). A bi-factor approach to modeling the structure of worry and rumination. Journal of Experimental Psychopathology, 8(3), 252–264. https://doi.org/10.5127/jep.057116
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2019). semTools: Useful tools for structural equation modeling (0.5-2.912). https://cran.r-project.org/package=semTools
Kami, M., Moloodi, R., Mazidi, M., Ehring, T., Mansoori, A. K., Nodooshan, M. B., Mazinani, Z., Molavi, M.-R., & Momeni, F. (2019). Measuring repetitive thinking in Iran: Psychometric properties of Persian version of Perseverative Thinking Questionnaire. Personality and Individual Differences, 148, 101–109. https://doi.org/10.1016/J.PAID.2019.05.012
Kornacka, M., Buczny, J., & Layton, R. L. (2016). Assessing repetitive negative thinking using categorical and transdiagnostic approaches: A comparison and validation of three Polish language adaptations of self-report questionnaires. Frontiers in Psychology, 7, 322. https://doi.org/10.3389/fpsyg.2016.00322
Kotov, R., Gamez, W., Schmidt, F., & Watson, D. (2010). Linking “big” personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin, 136(5), 768–821. https://doi.org/10.1037/a0020327
Liu, C., Liu, Z., & Yuan, G. (2020). The longitudinal influence of cyberbullying victimization on depression and posttraumatic stress symptoms: The mediation role of rumination. Archives of Psychiatric Nursing. https://doi.org/10.1016/j.apnu.2020.05.002
Mansell, W., & McEvoy, P. M. (2017). A test of the core process account of psychopathology in a heterogenous clinical sample of anxiety and depression: A case of the blind men and the elephant? Journal of Anxiety Disorders, 46, 4–10. https://doi.org/10.1016/J.JANXDIS.2016.06.008
McEvoy, P. M., & Brans, S. (2013). Common versus unique variance across measures of worry and rumination: Predictive utility and mediational models for anxiety and depression. Cognitive Therapy and Research, 37(1), 183–196. https://doi.org/10.1007/s10608-012-9448-5
McLaughlin, K. A., & Nolen-Hoeksema, S. (2011). Rumination as a transdiagnostic factor in depression and anxiety. Behaviour Research and Therapy, 49(3), 186–193. https://doi.org/https://doi.org/10.1016/j.brat.2010.12.006
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
Meyer, T. J., Miller, M. L., Metzger, R. L., & Borkovec, T. D. (1990). Development and validation of the Penn State Worry Questionnaire. Behaviour Research and Therapy, 28(6), 487–495. https://doi.org/10.1016/0005-7967(90)90135-6
Morgan, G., Hodge, K., Wells, K., & Watkins, M. (2015). Are fit indices biased in favor of bi-factor models in cognitive ability research?: A comparison of fit in correlated factors, higher-Order, and bi-factor models via Monte Carlo simulations. Journal of Intelligence, 3(1), 2–20. https://doi.org/10.3390/jintelligence3010002
Nolen-Hoeksema, S., Wisco, B. E., & Lyubomirsky, S. (2008). Rethinking rumination. Perspectives on Psychological Science, 3(5), 400–424. https://doi.org/10.1111/j.1745-6924.2008.00088.x
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Reise, S. P., Moore, T. M., & Haviland, M. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
Revelle, W. (2018). psych: Procedures for Personality and Psychological Research (1.8.12). https://cran.r-project.org/package=psych
Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Ruiz, F. J., Flórez, C. L., García-Martín, M. B., Monroy-Cifuentes, A., Barreto-Montero, K., García-Beltrán, D. M., Riaño-Hernández, D., Sierra, M. A., Suárez-Falcón, J. C., Cardona-Betancourt, V., & Gil-Luciano, B. (2018). A multiple-baseline evaluation of a brief acceptance and commitment therapy protocol focused on repetitive negative thinking for moderate emotional disorders. Journal of Contextual Behavioral Science, 9, 1-14. https://doi.org/10.1016/j.jcbs.2018.04.004
Ruiz, F. J., Riaño-Hernández, D., Suárez-Falcón, J. C., & Luciano, C. (2016). Effect of a one-session ACT protocol in disrupting repetitive negative thinking: A randomized multiple-baseline design. International Journal of Psychology and Psychological Therapy, 16(3), 213–233.
Ruiz, F. J., Suárez-Falcón, J. C., Riaño-Hernández, D., & Gillanders, D. T. (2017). Psychometric properties of the Cognitive Fusion Questionnaire in Colombia. Revista Latinoamericana de Psicología, 49(1), 80–87. https://doi.org/10.1016/J.RLP.2016.09.006
Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66(4), 507–514. https://doi.org/10.1007/BF02296192
Savalei, V., & Reise, S. P. (2019). Don’t forget the model in your model-based reliability coefficients: A reply to McNeish (2018). Collabra: Psychology, 5(1), 36. https://doi.org/10.1525/collabra.247
Spinhoven, P., Drost, J., van Hemert, B., & Penninx, B. W. (2015). Common rather than unique aspects of repetitive negative thinking are related to depressive and anxiety disorders and symptoms. Journal of Anxiety Disorders, 33, 45–52. https://doi.org/10.1016/j.janxdis.2015.05.001
Topper, M., Molenaar, D., Emmelkamp, P. M. G., & Ehring, T. (2014). Are rumination and worry two sides of the same coin? A structural equation modelling approach. Journal of Experimental Psychopathology, 5(3), 363–381. https://doi.org/10.5127/jep.038813
Treynor, W., Gonzalez, R., & Nolen-Hoeksema, S. (2003). Rumination reconsidered: A psychometric analysis. Cognitive Therapy and Research, 27(3), 247–259. https://doi.org/10.1023/A:1023910315561
Valencia, P. D., & Falcón, C. (2019). Estructura factorial del Cuestionario de Fusión Cognitiva en universitarios de Lima. Interacciones. Revista de Avances En Psicología, 5(2), e167. https://doi.org/10.24016/2019.v5n2.167
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017). A journey around alpha and omega to estimate internal consistency reliability. Anales de Psicología, 33(3), 755–782. https://doi.org/10.6018/analesps.33.3.268401
Watkins, E. R. (2008). Constructive and unconstructive repetitive thought. Psychological Bulletin, 134(2), 163–206. https://doi.org/10.1037/0033-2909.134.2.163
Yang, Y., & Green, S. B. (2011). Coefficient Alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29(4), 377–392. https://doi.org/10.1177/0734282911406668
Yuan, K.-H., & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30(1), 165–200. https://doi.org/10.1111/0081-1750.00078
Zvolensky, M. J., Kauffman, B. Y., Bogiaizian, D., Viana, A. G., Bakhshaie, J., & Peraza, N. (2019). Worry among Latinx college students: relations to anxious arousal, social anxiety, general depression, and insomnia. Journal of American College Health, 1–8. https://doi.org/10.1080/07448481.2019.1686004
Published
Issue
Section
License
Copyright: In the event that the manuscript is approved for future publication, the authors retain the copyright and assign to the journal the rights to publish, edit, reproduce, distribute, exhibit, and communicate nationally and internationally in the various databases, repositories and portals.
Self-archiving policy: The author can share, disseminate, and publicize his research published by the media (e.g., academic social networks, repositories, and portals) available on the web. During the editorial review process, the journal will provide the author with the previous versions (post-print) which should NOT be disclosed by any media, only for personal use and for final approval. Liberabit will send the author the final version of the article (published version) in PDF and HTML to be shared, disseminated and disclosed by the media available on the web. After the publication of the articles, the authors can make other independent or additional agreements for the non-exclusive dissemination of the version of the article published in this journal (publication in books or institutional repositories), provided that it is indicated with the respective reference that the work has been published for the first time in this journal.