Abstract
The factor structure, reliability, and concurrent validity of the Emotion Regulation Questionnaire were evaluated in a large clinical sample (N = 1,294). Confirmatory factor analysis was used to test the previously supported two-factor solution distinguishing two emotion regulation strategies: cognitive reappraisal and expressive suppression. The total sample was randomly split into two subsamples to permit cross-validation of the confirmatory factor analysis solution (Ns = 633 and 661). Although the initial two-factor model revealed poor model fit, fit was acceptable after re-specifying the model to freely estimate a substantively interpretable correlated residual between items 1 and 3. Acceptable fit of the correlated residual model was replicated in the cross-validation subsample. Both factors had strong scale reliability. In support of its concurrent validity, Reappraisal was moderately (positively) correlated with a measure of mood repair (Trait Meta Mood Scale) and was more strongly associated with mood repair and neuroticism than with symptoms of anxiety or depression. Suppression was more strongly (negatively) correlated with extraversion than mood repair and most symptom measures, except for self-reported social anxiety. The current study extends the literature by demonstrating the favorable psychometric properties Emotion Regulation Questionnaire in a large clinical sample.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aldao, A. (2013). The future of emotion regulation research: Capturing context. Perspectives on Psychological Science, 8(2), 155–172. https://doi.org/10.1177/1745691612459518.
Aldao, A., Nolen-Hoeksema, S., & Schweizer, S. (2010). Emotion-regulation strategies across psychopathology: A meta-analytic review. Clinical Psychology Review, 30(2), 217–237. https://doi.org/10.1016/j.cpr.2009.11.004.
Aldao, A., Sheppes, G., & Gross, J. J. (2015). Emotion regulation flexibility. Cognitive Therapy and Research, 39(3), 263–278. https://doi.org/10.1007/s10608-014-9662-4.
Anderson, G. N., Tung, E. S., Brown, T. A., & Rosellini, A. J. (2021). Facets of emotion regulation and emotional disorder symptom dimensions: Differential associations and incremental validity in a large clinical sample. Behavior Therapy, 52(4), 917–931. https://doi.org/10.1016/j.beth.2020.11.003.
Antony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the Depression anxiety stress scales in clinical groups and a community sample. Psychological Assessment, 10(2), 176–181. https://doi.org/10.1037/1040-3590.10.2.176.
Berking, M., & Wupperman, P. (2012). Emotion regulation and mental health: Recent finding, current challenges, and future directions. Current Opinion in Psychiatry, 25(2), 128–134. https://doi.org/10.1097/YCO.0b013e3283503669.
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.
Brown, T. A., & Barlow, D. H. (2014). Anxiety and related disorders interview schedule for DSM–5 (ADIS-5L): Client interview schedule. Lifetime Version).
Brown, T. A., Chorpita, B. F., Korotitsch, W., & Barlow, D. H. (1997). Psychometric properties of the Depression anxiety stress scales (DASS) in clinical samples. Behaviour Research and Therapy, 35(1), 79–89. https://doi.org/10.1016/s0005-7967(96)00068-x.
Brown, T. A., Di Nardo, P. A., Lehman, C. L., & Campbell, L. A. (2001). Reliability of DSM-IV anxiety and mood disorders: Implications for the classification of emotional disorders. Journal of Abnormal Psychology, 110(1), 49–58. https://doi.org/10.1037//0021-843x.110.1.49.
Burr, D. A., & Samanez-Larkin, G. R. (2020). Advances in emotion-regulation choice from experience sampling. Trends in Cognitive Sciences, 24(5), 344–346. https://doi.org/10.1016/j.tics.2020.02.008.
Cho, M., & Keltner, D. (2020). Power, approach, and inhibition: Empirical advances of a theory. Current Opinion in Psychology, 33, 196–200. https://doi.org/10.1016/j.copsyc.2019.08.013.
Colombo, D., Pavani, J. B., Fernandez-Alvarez, J., Garcia-Palacios, A., & Botella, C. (2021). Savoring the present: The reciprocal influence between positive emotions and positive emotion regulation in everyday life. PloS One, 16(5), e0251561. https://doi.org/10.1371/journal.pone.0251561.
Costa, P. T., & McCrae, R. R. (1992). Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO-FFI). Psychological Assessment Resources.
DiStefano, C., & Motl, R. W. (2006). Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling, 13(3), 440–464. https://doi.org/10.1207/s15328007sem1303_6.
Fernandez, K. C., Jazaieri, H., & Gross, J. J. (2016). Emotion regulation: A transdiagnostic perspective on a new RDoC domain. Cognitive Therapy and Research, 40(3), 426–440. https://doi.org/10.1007/s10608-016-9772-2.
Garnefski, N., Kraaij, V., & Spinhoven, P. (2001). Negative life events, cognitive emotion regulation and emotional problems. Personality and Individual Differences, 30(8), 1311–1327. https://doi.org/10.1016/S0191-8869(00)00113-6.
Gold, A. K., Stathopoulou, G., & Otto, M. W. (2020). Emotion regulation and motives for illicit drug use in opioid-dependent patients. Cognitive Behaviour Therapy, 49(1), 74–80. https://doi.org/10.1080/16506073.2019.1579256.
Grice, J. W. (2001). Computing and evaluating factor scores. Psychological Methods, 6(4), 430–450. https://doi.org/10.1037/1082-989X.6.4.430.
Gross, J. J. (1998). The emerging field of emotion regulation: An integrative review. Review of General Psychology, 271–299.
Gross, J. J. (2001). Emotion regulation in adulthood: Timing is everything. Current Directions in Psychological Science, 10(6), 214–219. https://doi.org/10.1111/1467-8721.00152.
Gross, J. J. (2015). Emotion regulation: Current status and future prospects. Psychological Inquiry, 26(1), 1–26. https://doi.org/10.1080/1047840X.2014.940781.
Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348–362. https://doi.org/10.1037/0022-3514.85.2.348.
Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But… Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/19312458.2020.1718629.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Hu, T., Zhang, D., Wang, J., Mistry, R., Ran, G., & Wang, X. (2014). Relation between emotion regulation and mental health: A meta-analysis review. Psychological Reports, 114(2), 341–362. https://doi.org/10.2466/03.20.PR0.114k22w4.
Jazaieri, H., Morrison, A. S., Goldin, P. R., & Gross, J. J. (2014). The role of emotion and emotion regulation in social anxiety disorder. Current Psychiatry Reports, 17(1), 531. https://doi.org/10.1007/s11920-014-0531-3.
John, O. P., & Gross, J. J. (2004). Healthy and unhealthy emotion regulation: Personality processes, individual differences, and life span development. Journal of Personality, 72(6), 1301–1333. https://doi.org/10.1111/j.1467-6494.2004.00298.x.
Joormann, J., & Gotlib, I. H. (2010). Emotion regulation in depression: Relation to cognitive inhibition. Cognition and Emotion, 24(2), 281–298. https://doi.org/10.1080/02699930903407948.
Keltner, D., Gruenfeld, D. H., & Anderson, C. (2003). Power, approach, and inhibition. Psychological Review, 110(2), 265–284. https://doi.org/10.1037/0033-295X.110.2.265.
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression anxiety stress scales (DASS) with the Beck Depression and anxiety inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1016/0005-7967(94)00075-U.
Mattick, R. P., & Clarke, J. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455–470. https://doi.org/10.1016/S0005-7967(97)10031-6.
Mauss, I. B., Butler, E. A., Roberts, N. A., & Chu, A. (2010). Emotion control values and responding to an anger provocation in asian-american and european-american individuals. Cognition and Emotion, 24(6), 1026–1043. https://doi.org/10.1080/02699930903122273.
McDonald, R. P. (1999). Test theory: A unified treatment. Psychology Press. https://doi.org/10.4324/9781410601087.
Melka, S. E., Lancaster, S. L., Bryant, A. R., & Rodriguez, B. F. (2011). Confirmatory factor and measurement invariance analyses of the emotion regulation questionnaire. Journal of Clinical Psychology, 67(12), 1283–1293. https://doi.org/10.1002/jclp.20836.
Meng, X., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111(1), 172–175. https://doi.org/10.1037/0033-2909.111.1.172.
Mesquita, B., De Leersnyder, J., & Albert, D. (2014). The cultural regulation of emotions. Handbook of emotion regulation (2nd ed., pp. 284–301). Guilford Press.
Moore, S. A., Zoellner, L. A., & Mollenholt, N. (2008). Are expressive suppression and cognitive reappraisal associated with stress-related symptoms? Behaviour Research and Therapy, 46(9), 993–1000. https://doi.org/10.1016/j.brat.2008.05.001.
Pencea, I., Munoz, A. P., Maples-Keller, J. L., Fiorillo, D., Schultebraucks, K., Galatzer-Levy, I., Rothbaum, B. O., Ressler, K. J., Stevens, J. S., Michopoulos, V., & Powers, A. (2020). Emotion dysregulation is associated with increased prospective risk for chronic PTSD development. Journal of Psychiatric Research, 121, 222–228. https://doi.org/10.1016/j.jpsychires.2019.12.008.
Preece, D. A., Becerra, R., Robinson, K., & Gross, J. J. (2020). The emotion regulation questionnaire: Psychometric properties in general community samples. Journal of Personality Assessment, 102(3), 348–356. https://doi.org/10.1080/00223891.2018.1564319.
Preece, D. A., Becerra, R., Hasking, P., McEvoy, P. M., Boyes, M., Sauer-Zavala, S., Chen, W., & Gross, J. J. (2021). The emotion regulation questionnaire: Psychometric properties and relations with affective symptoms in a United States general community sample. Journal of Affective Disorders, 284, 27–30. https://doi.org/10.1016/j.jad.2021.01.071.
Pruessner, L., Barnow, S., Holt, D. V., Joormann, J., & Schulze, K. (2020). A cognitive control framework for understanding emotion regulation flexibility. Emotion, 20(1), 21–29. https://doi.org/10.1037/emo0000658.
Roberts, N. A., Levenson, R. W., & Gross, J. J. (2008). Cardiovascular costs of emotion suppression cross ethnic lines. International Journal of Psychophysiology, 70(1), 82–87. https://doi.org/10.1016/j.ijpsycho.2008.06.003.
Rosellini, A. J., & Brown, T. A. (2011). The NEO five-factor inventory: Latent structure and relationships with dimensions of anxiety and depressive disorders in a large clinical sample. Assessment, 18(1), 27–38. https://doi.org/10.1177/1073191110382848.
Salovey, P., Mayer, J. D., Goldman, S. L., Turvey, C., & Palfai, T. P. (1995). Emotional attention, clarity, and repair: Exploring emotional intelligence using the Trait Meta-Mood Scale. Emotion Disclosure & Health, 125–154. https://doi.org/10.1037/10182-006.
Sheppes, G., Suri, G., & Gross, J. J. (2015). Emotion regulation and psychopathology. Annual Review of Clinical Psychology, 11, 379–405. https://doi.org/10.1146/annurev-clinpsy-032814-112739.
Silton, R. L., Kahrilas, I. J., Skymba, H. V., Smith, J., Bryant, F. B., & Heller, W. (2020). Regulating positive emotions: Implications for promoting well-being in individuals with depression. Emotion, 20(1), 93–97. https://doi.org/10.1037/emo0000675.
Soto, J. A., Levenson, R. W., & Ebling, R. (2005). Cultures of moderation and expression: Emotional experience, behavior, and physiology in Chinese americans and Mexican americans. Emotion, 5(2), 154–165. https://doi.org/10.1037/1528-3542.5.2.154.
Spaapen, D. L., Waters, F., Brummer, L., Stopa, L., & Bucks, R. S. (2014). The emotion regulation questionnaire: Validation of the ERQ-9 in two community samples. Psychological Assessment, 26(1), 46–54. https://doi.org/10.1037/a0034474.
Werner, K. H., Goldin, P. R., Ball, T. M., Heimberg, R. G., & Gross, J. J. (2011). Assessing emotion regulation in social anxiety disorder: The emotion regulation interview. Journal of Psychopathology and Behavioral Assessment, 33(3), 346–354. https://doi.org/10.1007/s10862-011-9225-x.
Wilms, R., Lanwehr, R., & Kastenmüller, A. (2020). Emotion regulation in everyday life: The role of goals and situational factors. Frontiers in Psychology, 11, 877. https://doi.org/10.3389/fpsyg.2020.00877.
Wiltink, J., Glaesmer, H., Canterino, M., Wölfling, K., Knebel, A., Kessler, H., Brähler, E., & Beutel, M. E. (2011). Regulation of emotions in the community: Suppression and reappraisal strategies and its psychometric properties. GMS Psycho-Social-Medicine, 8. https://doi.org/10.3205/psm000078.
Funding
This research was funded by a grant from the National Institute of Mental Health (R01 MH039096; PI: Brown).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Data analyses and interpretation were performed by Alexandra M. Andrea, and Anthony J. Rosellini. The first draft of the manuscript was written by Alexandra M. Andrea and all authors commented on previous versions of the manuscript. Table construction was performed by Christina S. Galiano. All authors read and approved the final manuscript. Funding was acquired by Timothy A. Brown, and supervision was provided by Anthony J. Rosellini and Timothy A. Brown.
Corresponding author
Ethics declarations
Ethics Approval
All study procedures were approved by the governing Institutional Review Board.
Consent to Participate
Written informed consent was obtained from all participants.
Competing Interests
The authors have no relevant financial or non-financial competing interests to disclose.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Andrea, A.M., Galiano, C.S., Rosellini, A.J. et al. Psychometric Evaluation of the Emotion Regulation Questionnaire in a Clinical Sample. J Psychopathol Behav Assess (2023). https://doi.org/10.1007/s10862-023-10108-x
Accepted:
Published:
DOI: https://doi.org/10.1007/s10862-023-10108-x