Skip to main content
SpringerLink
Log in

Reliability and Validity of the Therapy Attitude Inventory in Caregivers Receiving Internet-Delivered Parent Child Interaction Therapy for Young Children with Developmental Delay

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

Despite common use of the Therapy Attitude Inventory (TAI) to measure satisfaction with parenting interventions, psychometric support has only been demonstrated in predominantly White caregivers of typically developing children following clinic-based treatments. Additionally, the reliability and validity of the Spanish version of the TAI have not been assessed. The present study examined the reliability and validity of the English and Spanish versions of the TAI among mostly Hispanic/Latinx caregivers of children with developmental delay (DD; n = 65) following Internet-delivered Parent-Child Interaction Therapy (iPCIT). Internal consistency was excellent for both versions. Convergent validity was demonstrated by a strong correlation with the Client Satisfaction Questionnaire-8. Satisfaction was predicted by improvements in child behavior and parenting skills, as well as reductions in caregivers’ negative feelings about parenting, following treatment. These findings support use of the TAI with Spanish-speaking families, families from minoritized backgrounds and with children with DD, and following telehealth interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability

The data presented here represent a secondary data analysis from a larger project led by Drs. Bagner and Comer (R01HD084497). Materials and analysis code for this study are not available. However, further information about the larger project can be found at the ClinicalTrials.gov Identifier: NCT03260816, where the study is registered.

References

  • Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2001). Ratings of relations between DSM-IV diagnostic categories and items of the CBCL/6–18, TRF, and YSR (pp. 1–9). University of Vermont.

  • Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5(3), 233–237.

    Article  PubMed  CAS  Google Scholar 

  • Bagner, D. M., & Eyberg, S. M. (2007). Parent–child interaction therapy for disruptive behavior in children with mental retardation: A randomized controlled trial. Journal of Clinical Child and Adolescent Psychology, 36(3), 418–429.

    Article  PubMed  Google Scholar 

  • Bagner, D. M., Sheinkopf, S. J., Vohr, B. R., & Lester, B. M. (2010). Parenting intervention for externalizing behavior problems in children born premature: An initial examination. Journal of Developmental and Behavioral Pediatrics: JDBP, 31(3), 209.

    Article  PubMed  Google Scholar 

  • Bagner, D. M., Coxe, S., Hungerford, G. M., Garcia, D., Barroso, N. E., Hernandez, J., & Rosa-Olivares, J. (2016). Behavioral parent training in infancy: A window of opportunity for high-risk families. Journal of Abnormal Child Psychology, 44, 901–912.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bagner, D. M., Berkovits, M. D., Coxe, S., Frech, N., Garcia, D., Golik, A., & Comer, J. S. (2023). Telehealth Treatment of Behavior Problems in Young Children With Developmental Delay: A Randomized Clinical Trial. JAMA pediatrics.

  • Bailey, D. B. Jr., Skinner, D., Rodriguez, P., Gut, D., & Correa, V. (1999). Awareness, use, and satisfaction with services for latino parents of young children with disabilities. Exceptional Children, 65(3), 367–381.

    Article  Google Scholar 

  • Borrego, J. Jr., Anhalt, K., Terao, S. Y., Vargas, E. C., & Urquiza, A. J. (2006). Parent-child interaction therapy with a spanish-speaking family. Cognitive and Behavioral Practice, 13(2), 121–133.

    Article  Google Scholar 

  • Brestan, E. V., Jacobs, J. R., Rayfield, A. D., & Eyberg, S. M. (1999). A consumer satisfaction measure for parent-child treatments and its relation to measures of child behavior change. Behavior Therapy, 30(1), 17–30.

    Article  Google Scholar 

  • Butler, A. M., Brestan, E. V., & Eyberg, S. M. (2008). Examination of the Eyberg child behavior inventory discrepancy hypothesis. Child & Family Behavior Therapy, 30(3), 257–262.

    Article  Google Scholar 

  • Cantor, J., McBain, R. K., Kofner, A., Hanson, R., Stein, B. D., & Yu, H. (2022). Telehealth adoption by mental health and substance use disorder treatment facilities in the COVID-19 pandemic. Psychiatric Services, 73(4), 411–417.

    Article  PubMed  Google Scholar 

  • Comer, J. S. (2021). Rebooting mental health care delivery for the COVID-19 pandemic (and beyond): Guiding cautions as telehealth enters the clinical mainstream. Cognitive and Behavioral Practice, 28(4), 743–748.

    Article  PubMed  PubMed Central  Google Scholar 

  • Comer, J. S., Chow, C., Chan, P. T., Cooper-Vince, C., & Wilson, L. A. (2013). Psychosocial treatment efficacy for disruptive behavior problems in very young children: A meta-analytic examination. Journal of the American Academy of Child & Adolescent Psychiatry, 52(1), 26–36.

    Article  Google Scholar 

  • Comer, J. S., Furr, J. M., Cooper-Vince, C., Madigan, R. J., Chow, C., Chan, P. T., & Eyberg, S. M. (2015). Rationale and considerations for the internet-based delivery of parent–child interaction therapy. Cognitive and Behavioral Practice, 22(3), 302–316.

    Article  PubMed  Google Scholar 

  • Comer, J. S., Furr, J. M., Miguel, E. M., Cooper-Vince, C. E., Carpenter, A. L., Elkins, R. M., & Chase, R. (2017). Remotely delivering real-time parent training to the home: An initial randomized trial of internet-delivered parent–child interaction therapy (I-PCIT). Journal of Consulting and Clinical Psychology, 85(9), 909.

    Article  PubMed  Google Scholar 

  • Comer, J. S., Furr, J. M., Busto, D., Silva, C., Hong, K., Poznanski, N., & Puliafico, B., A (2021). Therapist-led, internet-delivered treatment for early child social anxiety: A waitlist-controlled evaluation of the iCALM telehealth program. Behavior Therapy, 52(5), 1171–1187.

    Article  PubMed  Google Scholar 

  • Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale: SRS-2. Western Psychological Services Torrance.

  • Copeland, V. C., Koeske, G., & Greeno, C. G. (2004). Child and mother client satisfaction questionnaire scores regarding mental health services: Race, age, and gender correlates. Research on Social Work Practice, 14(6), 434–442.

    Article  Google Scholar 

  • Donenberg, G., & Baker, B. L. (1993). The impact of young children with externalizing behaviors on their families. Journal of Abnormal Child Psychology, 21, 179–198.

    Article  PubMed  CAS  Google Scholar 

  • Eyberg, S. M. (1993). Consumer satisfaction measures for assessing parent training programs. In L. VandeCreek, S. Knapp, & T. L. Jackson (Eds.), Innovations in clinical practice: A source book (Vol. 12). Professional Resource Press.

  • Eyberg, S. M., & Johnson, S. M. (1974). Multiple assessment of behavior modification with families: Effects of contingency contracting and order of treated problems. Journal of Consulting and Clinical Psychology, 42, 594–606.

    Article  PubMed  CAS  Google Scholar 

  • Eyberg, S. M., & Pincus, D. (1999). Eyberg Child Behavior Inventory and Sutter Eyberg Student Behavior Inventory: Professional manual. Psychological Assessment Resources.

  • Eyberg, S. M., Nelson, M. M., Duke, M., & Boggs, S. R. (2004). Manual for the dyadic parent-child interaction coding system third edition.

  • Eyberg, S. M., Nelson, M. M., Ginn, N. C., Bhuiyan, N., & Boggs, S. R. (2013). Dyadic parent–child Interaction Coding System (DPICS) Comprehensive manual for research and training (4.). PCIT International. Gainesville, FL.

  • Foote, R., Eyberg, S., & Schuhmann, E. (1998). Parent-child interaction approaches to the treatment of child behavior problems. Advances in Clinical Child Psychology: Volume, 20, 125–151.

    Article  Google Scholar 

  • Griffith, A. K. (2010). The Use of a behavioral parent training program for parents of adolescents. Journal of At-Risk Issues, 15(2), 1–8.

    Google Scholar 

  • Gurwitch, R. H., Salem, H., Nelson, M. M., & Comer, J. S. (2020). Leveraging parent–child interaction therapy and telehealth capacities to address the unique needs of young children during the COVID-19 public health crisis. Psychological Trauma: Theory Research Practice and Policy, 12(S1), S82.

    Article  PubMed  Google Scholar 

  • Harkey, L. C., Jung, S. M., Newton, E. R., & Patterson, A. (2020). Patient satisfaction with telehealth in rural settings: A systematic review. International Journal of Telerehabilitation, 12(2), 53.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hasler, G., Moergeli, H., Bachmann, R., Lambreva, E., Buddeberg, C., & Schnyder, U. (2004). Client satisfaction with outclient psychiatric treatment: The role of diagnosis, pharmacotherapy, and perceived therapeutic change. The Canadian Journal of Psychiatry, 49(5), 315–321.

    Article  PubMed  Google Scholar 

  • IBM Corp. Released 2021. IBM SPSS statistics for Windows, Version 28.0. Armonk, NY: IBM Corp.

  • Kaminski, J. W., & Claussen, A. H. (2017). Evidence base update for psychosocial treatments for disruptive behaviors in children. Journal of Clinical Child & Adolescent Psychology, 46(4), 477–499.

    Article  Google Scholar 

  • Lebow, J. (1982). Consumer satisfaction with mental health treatment. Psychological Bulletin, 91(2), 244.

    Article  PubMed  CAS  Google Scholar 

  • Matos, M., Torres, R., Santiago, R., Jurado, M., & Rodríguez, I. X. A. (2006). Adaptation of parent–child interaction therapy for Puerto Rican families: A preliminary study. Family Process, 45(2), 205–222.

    Article  PubMed  Google Scholar 

  • McCabe, K., Yeh, M., Lau, A., & Argote, C. B. (2012). Parent-child interaction therapy for Mexican americans: Results of a pilot randomized clinical trial at follow-up. Behavior Therapy, 43(3), 606–618.

    Article  PubMed  Google Scholar 

  • Moore, K. E., & Kenning, M. (1996). Assessing client satisfaction in a psychology training clinic. The Journal of Mental Health Administration, 23, 180–189.

    Article  PubMed  CAS  Google Scholar 

  • Morgan, P. L., Farkas, G., Hillemeier, M. M., & Maczuga, S. (2012). Are minoritized children disproportionately represented in early intervention and early childhood special education? Educational Researcher, 41(9), 339–351.

    Article  PubMed  Google Scholar 

  • Neece, C. L., Green, S. A., & Baker, B. L. (2012). Parenting stress and child behavior problems: A transactional relationship across time. American Journal on Intellectual and Developmental Disabilities, 117(1), 48–66.

    Article  PubMed  PubMed Central  Google Scholar 

  • Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983). Assessment of client satisfaction: Development and refinement of a service evaluation questionnaire. Evaluation and Program Planning, 6(3–4), 299–313.

    Article  PubMed  CAS  Google Scholar 

  • O’Reilly, A., Donnelly, A., Rogers, J., Maloney, O., O’Brien, G., & Doyle, E. (2021). Measuring parent satisfaction in youth mental health services. Mental Health Review Journal, 26(3), 213–225.

    Article  Google Scholar 

  • Petrenko, C. L. (2013). A review of intervention programs to prevent and treat behavioral problems in young children with developmental disabilities. Journal of Developmental and Physical Disabilities, 25, 651–679.

    Article  Google Scholar 

  • Pons, J. I., Matías-Carrelo, L., Rodríguez, M., Rodríguez, J. M., Herrans, L. L., Jiménez, M. E., & Yang, J. (2008). Estudios De validez de la Escala De Inteligencia Wechsler para Adultos Versión III, Puerto Rico (EIWA-III). Revista Puertorriqueña De Psicología, 19, 75–111.

    Google Scholar 

  • Qi, C. H., & Kaiser, A. P. (2003). Behavior problems of preschool children from low income families: Review of the literature. Topics in Early Childhood Special Education, 23.

  • Ramos, G., Blizzard, A. M., Barroso, N. E., & Bagner, D. M. (2018). Parent training and skill acquisition and utilization among spanish-and English-speaking latino families. Journal of Child and Family Studies, 27, 268–279.

    Article  PubMed  Google Scholar 

  • Rey, J. M., O’brien, M., & Walter, G. (2002). Is the satisfied customer one who also ‘does well’? The relationship between outcome and parent satisfaction in a child and adolescent mental health service. Australasian Psychiatry, 10(3), 1–4.

    Google Scholar 

  • Roberts, R. E., & Attkisson, C. C. (1983). Assessing client satisfaction among hispanics. Evaluation and Program Planning, 6(3–4), 401–413.

    Article  PubMed  CAS  Google Scholar 

  • Roberts, R. E., Attkisson, C. C., & Stegner, B. L. (1983). A client satisfaction scale suitable for use with hispanics? Hispanic Journal of Behavioral Sciences, 5(4), 461–475.

    Article  Google Scholar 

  • Roberts, R. E., Atrkisson, C. C., & Mendias, R. M. (1984). Assessing the client satisfaction questionnaire in English and Spanish. Hispanic Journal of Behavioral Sciences, 6(4), 385–396.

    Article  Google Scholar 

  • Rosenberg, S. A., Zhang, D., & Robinson, C. C. (2008). Prevalence of developmental delays and participation in early intervention services for young children. Pediatrics, 121(6).

  • Ryan, C. L. (2013). Language use in the United States: 2011.

  • Schulte, S. J., Meier, P. S., & Stirling, J. (2011). Dual diagnosis clients’ treatment satisfaction-a systematic review. BMC Psychiatry, 11(1), 1–12.

    Article  Google Scholar 

  • Shapiro, J. P., Welker, C. J., & Jacobson, B. J. (1997). The youth client satisfaction questionnaire: Development, construct validation, and factor structure. Journal of Clinical Child Psychology, 26(1), 87–98.

    Article  PubMed  CAS  Google Scholar 

  • Stewart, C. D., Quinn, A., Plever, S., & Emmerson, B. (2009). Comparing cognitive behavior therapy, problem solving therapy, and treatment as usual in a high risk population. Suicide and Life-Threatening Behavior, 39(5), 538–547.

    Article  PubMed  Google Scholar 

  • Suhr, D. D. (2006). Exploratory or confirmatory factor analysis?.

  • Sullivan, A. D., Forehand, R., Acosta, J., Parent, J., Comer, J. S., Loiselle, R., & Jones, D. J. (2021). COVID-19 and the acceleration of behavioral parent training telehealth: Current status and future directions. Cognitive and Behavioral Practice, 28(4), 618–629.

    Article  PubMed  PubMed Central  Google Scholar 

  • United States Department of Health and Human Services. Poverty guidelines computations.

  • Webster-Stratton, C. (2001). The incredible years: Parents, teachers, and children training series. Residential Treatment for Children & Youth, 18(3), 31–45.

    Article  Google Scholar 

  • Webster-Stratton, C., Reid, M. J., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in Head Start. Journal of Clinical Child Psychology, 30(3), 283–302.

    Article  PubMed  CAS  Google Scholar 

  • Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence (WASI). Psychological Corp.

Download references

Acknowledgements

This work was supported by a research project grant from the National Institute of Child Health and Human Development (NICHD) to the third and fourth authors (R01HD084497). We thank all the families who participated in this research.

Funding

This work was supported by a research project grant from the National Institute of Child Health and Human Development (NICHD) to Drs. Comer and Bagner (R01HD084497).

Author information

Authors and Affiliations

  1. Department of Psychology, Center for Children and Families, Florida International University, 11200 SW 8th St, Miami, FL, 33199, USA

    Keara J. Neuman, Timothy Hayes, Jonathan S. Comer & Daniel M. Bagner

Authors
  1. Keara J. Neuman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Timothy Hayes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jonathan S. Comer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniel M. Bagner
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Methodology: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Formal analysis and investigation: Keara J. Neuman, Timothy Hayes; Writing – original draft preparation: Keara J. Neuman; Writing – review and editing: Keara J. Neuman, Timothy Hayes, Jonathan S. Comer, Daniel M. Bagner; Funding acquisition: Jonathan S. Comer, Daniel M. Bagner; Resources: Jonathan S. Comer, Daniel M. Bagner; Supervision: Daniel M. Bagner

Corresponding author

Correspondence to Keara J. Neuman.

Ethics declarations

Ethics Approval and Consent to Participate

This study was performed in line with the principles of the Declaration of Helsinki. Approval was obtained from the Institutional Review Board (IRB) of Florida International University.

Consent to Participate

Informed consent, which was approved by the IRB, was obtained from all caregivers prior to screening.

Competing Interests

Dr. Bagner reported receiving grants from the National Institutes of Health and personal fees from PCIT International to train clinicians in PCIT supported by a grant from the Florida Department of Children and Families outside the submitted work. Dr. Comer reported receiving grants from the National Institutes of Health; personal fees from Macmillan Learning for textbook royalties; and personal fees from Association for Behavioral and Cognitive Therapies for an editorial stipend outside the submitted work. No other disclosures were reported.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The data presented in this manuscript come from a research project grant (R01HD084497) entitled “Advancing Child Competencies by Extending Supported Services (ACCESS) for Families Program” which was provided to Drs. Bagner and Comer by the National Institute of Child Health and Human Development (NICHD). The data presented here represent a secondary data analysis from this project. Materials and analysis code for this study are not available. However, further information about the larger project can be found at the ClinicalTrials.gov Identifier: NCT03260816, where the study is registered. Portions of the data in this manuscript have been accepted for presentation at the Association for Behavioral and Cognitive Therapies Annual Convention in November 2023.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Neuman, K.J., Hayes, T., Comer, J.S. et al. Reliability and Validity of the Therapy Attitude Inventory in Caregivers Receiving Internet-Delivered Parent Child Interaction Therapy for Young Children with Developmental Delay. J Psychopathol Behav Assess 46, 25–34 (2024). https://doi.org/10.1007/s10862-023-10104-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-023-10104-1

Keywords

Search

Navigation