Hostname: page-component-76fb5796d-45l2p Total loading time: 0 Render date: 2024-04-27T13:38:51.671Z Has data issue: false hasContentIssue false

Psychometric reliability, validity, and generalizability of 3MSE scores among American Indian adults: the Strong Heart Study

Published online by Cambridge University Press:  24 January 2024

Astrid M. Suchy-Dicey*
Affiliation:
Huntington Medical Research Institutes, Pasadena, CA, USA Washington State University, Elson S Floyd College of Medicine, Seattle, WA, USA
Thao T. Vo
Affiliation:
Washington State University, College of Education, Pullman, WA, USA
Kyra Oziel
Affiliation:
Washington State University, Elson S Floyd College of Medicine, Seattle, WA, USA
Dedra S. Buchwald
Affiliation:
Washington State University, Elson S Floyd College of Medicine, Seattle, WA, USA
Lonnie A. Nelson
Affiliation:
Washington State University, College of Nursing, Spokane, WA, USA
Steven P. Verney
Affiliation:
University of New Mexico, Albuquerque, NM, USA
Brian F. French
Affiliation:
Washington State University, College of Education, Pullman, WA, USA
*
Corresponding author: Astrid M. Suchy-Dicey; Email: astrid.suchy-dicey@hmri.org

Abstract

Objective:

Modified Mini-Mental State Examination (3MSE) is often used to screen for dementia, but little is known about psychometric validity in American Indians.

Methods:

We recruited 818 American Indians aged 65–95 for 3MSE examinations in 2010–2013; 403 returned for a repeat examination in 2017–2019. Analyses included standard psychometrics inferences for interpretation, generalizability, and extrapolation: factor analysis; internal consistency-reliability; test-retest score stability; multiple indicator multiple cause structural equation models.

Results:

This cohort was mean age 73, majority female, mean 12 years education, and majority bilingual. The 4-factor and 2nd-order models fit best, with subfactors for orientation and visuo-construction (OVC), language and executive functioning (LEF), psychomotor and working memory (PMWM), verbal and episodic memory (VEM). Factor structure was supported for both research and clinical interpretation, and factor loadings were moderate to high. Scores were generally consistent over mean 7 years. Younger participants performed better in overall scores, but not in individual factors. Males performed better on OVC and LEF, females better on PMWM. Those with more education performed better on LEF and worse on OVC; the converse was true for bilinguals. All differences were significant, but small.

Conclusion:

These findings support use of 3MSE for individual interpretation in clinic and research among American Indians, with moderate consistency, stability, reliability over time. Observed extrapolations across age, sex, education, and bilingual groups suggest some important contextual differences may exist.

Type
Research Article
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of International Neuropsychological Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Avila, J. F., Renteria, M. A., Witkiewitz, K., Verney, S. P., Vonk, J. M. J., & Manly, J. J. (2020). Measurement invariance of neuropsychological measures of cognitive aging across race/ethnicity by sex/gender groups. Neuropsychology, 34(1), 314. https://doi.org/10.1037/neu0000584 CrossRefGoogle Scholar
Bassuk, S. S., & Murphy, J. M. (2003). Characteristics of the modified mini-mental state exam among elderly persons. Journal of Clinical Epidemiology, 56(7), 622628. https://doi.org/10.1016/S0895-4356(03)00111-2 CrossRefGoogle ScholarPubMed
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x Google Scholar
Bialystok, E., Craik, F. I. M., & Freedman, M. (2007). Bilingualism as a protection against the onset of symptoms of dementia. Neuropsychologia, 45(2), 459464. https://doi.org/10.1016/j.neuropsychologia.2006.10.009 CrossRefGoogle ScholarPubMed
Bialystok, E., Craik, F. I. M., Luk, G. (2008). Lexical access in bilinguals: Effects of vocabulary size and executive control. Journal of Neurolinguistics, 21(6), 522538.CrossRefGoogle Scholar
Brave Heart, M. Y., & DeBruyn, L. M. (1998). The American Indian Holocaust: Healing historical unresolved grief. American Indian and Alaska Native Mental Health Research, 8(2), 5678.Google ScholarPubMed
Bravo, G., & Hébert, R. (1997). Age- and education-specific reference values for the Mini-Mental and modified Mini-Mental State Examinations derived from a non-demented elderly population. International Journal of Geriatric Psychiatry, 12(10), 10081018. https://doi.org/10.1002/(sici)1099-1166(199710)12: 3.0.CO;2-A>CrossRefGoogle ScholarPubMed
Brickman, A. M., Cabo, R., & Manly, J. J. (2006). Ethical issues in cross-cultural neuropsychology. Applied Neuropsychology, 13(2), 91100. https://doi.org/10.1207/s15324826an1302_4 CrossRefGoogle ScholarPubMed
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd edn). The Guilford Press.Google Scholar
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230258. https://doi.org/10.1177/0049124192021002005 CrossRefGoogle Scholar
Byrd, D. A., & Rivera-Mindt, M. G. (2022). Neuropsychology’s race problem does not begin or end with demographically adjusted norms. Nature Reviews Neurology, 18(3), 125126. https://doi.org/10.1038/s41582-021-00607-4 CrossRefGoogle ScholarPubMed
Cappeliez, P., Quintal, M., Blouin, M., Gagne, S., Bourgeois, A., Finlay, M., & Robillard, E. T. A. (1996). Les Propriétés Psychométriques De La Version Française Du Modified Mini-Mental State (3Ms) Avec Des Patients âgés Suivis En Psychiatrie Gŕriatrique. The Canadian Journal of Psychiatry, 41(2), 114121. https://doi.org/10.1177/070674379604100209 CrossRefGoogle Scholar
Census (2020). United States Census. United States Census Bureau. Retrieved from census.gov.Google Scholar
Cizek, G., Rosenberg, S., & Koons, H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397, 412. https://doi.org/10.1177/0013164407310130 CrossRefGoogle Scholar
Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis (2nd edn). L. Erlbaum Associates.Google Scholar
Cook, D. A., Brydges, R., Ginsburg, S., & Hatala, R. (2015). A contemporary approach to validity arguments: A practical guide to Kane’s framework. Medical Education, 49(6), 560575. https://doi.org/10.1111/medu.12678 CrossRefGoogle ScholarPubMed
Costa, A., Hernandez, M., & Sebastian-Galles, N. (2008). Bilingualism aids conflict resolution: Evidence from the ANT task. Cognition, 106(1), 5986. https://doi.org/10.1016/j.cognition.2006.12.013 CrossRefGoogle ScholarPubMed
Costumero, V., Marin-Marin, L., Calabria, M., Belloch, V., Escudero, J., Baquero, M., Hernandez, M., de Miras, J.R., Costa, A., Parcet, M. A., & Avila, C. (2020). A cross-sectional and longitudinal study on the protective effect of bilingualism against dementia using brain atrophy and cognitive measures. Alzheimers Research & Therapy, 12(11). https://doi.org/10.1186/s13195-020-0581-1.CrossRefGoogle ScholarPubMed
Craik, F. I., Bialystok, E., & Freedman, M. (2010). Delaying the onset of Alzheimer disease: Bilingualism as a form of cognitive reserve. Neurology, 75(19), 17261729. https://doi.org/10.1212/WNL.0b013e3181fc2a1c CrossRefGoogle ScholarPubMed
Crane, P. K., Gruhl, J. C., Erosheva, E. A., Gibbons, L. E., McCurry, S. M., Rhoads, K., Nguyen, V., Arani, K., Masaki, K., White, L. (2010). Use of spoken and written Japanese did not protect Japanese-American men from cognitive decline in late life. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 65(6), 654666. https://doi.org/10.1093/geronb/gbq046 CrossRefGoogle Scholar
Crum, R. M., Anthony, J. C., Bassett, S. S., & Folstein, M. F. (1993). Population-based norms for the Mini-Mental State Examination by age and educational level. JAMA, 269(18), 23862391, https://doi.org/10.1001/jama.1993.03500180078038.CrossRefGoogle ScholarPubMed
Diedenhofen, B., & Musch, J. (2015). cocor: A comprehensive solution for the statistical comparison of correlations. PLoS One, 10(3), e0121945. https://doi.org/10.1371/journal.pone.0121945 CrossRefGoogle ScholarPubMed
Fernandes, M., Ayede, A. I., & Blackmon, K. (2022). Addressing racial inequities in neuropsychological assessment requires international prescriptive standards, not demographically adjusted norms. Nature Reviews Neurology, 18(6), 377377. https://doi.org/10.1038/s41582-022-00652-7 CrossRefGoogle Scholar
Finney, S. J., & DiStefano, C. (2013). Nonnormal and categorical data in structural equation modeling. In Structural equation modeling: A second course (2nd ed. pp. 439492). IAP Information Age Publishing.Google Scholar
Folstein, M. F., Robins, L. N., & Helzer, J. E. (1983). The mini-mental state examination. Archives of General Psychiatry, 40(7), 812. https://doi.org/10.1001/archpsyc.1983.01790060110016 CrossRefGoogle ScholarPubMed
Galvin, J. E., Chrisphonte, S., & Chang, L. C. (2021). Medical and social determinants of brain health and dementia in a multicultural community cohort of older adults. Journal of Alzheimers Disease, 84(4), 15631576. https://doi.org/10.3233/JAD-215020 CrossRefGoogle Scholar
Grace, J., Nadler, J. D., White, D. A., Guilmette, T. J., Giuliano, A. J., Monsch, A. U., & Snow, M. G. (1995). Folstein vs modified Mini-Mental State Examination in geriatric stroke. Stability, validity, and screening utility. Arch Neurol, 52(5), 477484. https://doi.org/10.1001/archneur.1995.00540290067019 CrossRefGoogle ScholarPubMed
Guzman-Velez, E., & Tranel, D. (2015). Does Bilingualism contribute to cognitive reserve? Cognitive and neural perspectives. Neuropsychology, 29(1), 139150. https://doi.org/10.1037/neu0000105 CrossRefGoogle ScholarPubMed
Jervis, L. L., Beals, J., Fickenscher, A., & Arciniegas, D. B. (2007). Performance on the mini-mental state examination and mattis dementia rating scale among older American Indians. The Journal of Neuropsychiatry and Clinical Neurosciences, 19(2), 173178. https://doi.org/10.1176/jnp.2007.19.2.173 CrossRefGoogle ScholarPubMed
Jervis, L. L., Fickenscher, A., Beals, J., Cullum, C. M., Novins, D. K., Manson, S. M., & Arciniegas, D. B. (2010). Predictors of performance on the MMSE and the DRS-2 among American Indian elders. Journal of Neuropsychiatry, 22(4), 417425. https://doi.org/10.1176/appi.neuropsych.22.4.417 CrossRefGoogle ScholarPubMed
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 173. https://doi.org/10.1111/jedm.12000 CrossRefGoogle Scholar
Kim, G., Bryant, A. N., Goins, R. T., Worley, C. B., & Chiriboga, D. A. (2012). Disparities in health status and health care access and use among older American Indians and Alaska Natives and non-Hispanic Whites in California. Journal of Aging and Health, 24(5), 799811. https://doi.org/10.1177/0898264312444309 CrossRefGoogle ScholarPubMed
Klyce, D. W., Pugh, M., & Perrin, P. B. (2021). Factor structure of the Modified Mini Mental State (3MS) exam among participants in inpatient neurorehabilitation. Brain Injury, 35(11), 14251432. https://doi.org/10.1080/02699052.2021.1972449 CrossRefGoogle ScholarPubMed
Lee, E. T., Welty, T. K., Fabsitz, R., Cowan, L. D., Le, N. A., Oopik, A. J., Cucchiara, A., Savage, P., & Howard, B. V. (1990). The Strong Heart Study. A study of cardiovascular disease in American Indians: Design and methods. American Journal of Epidemiology, 132(6), 11411155. https://doi.org/10.1093/oxfordjournals.aje.a115757 CrossRefGoogle ScholarPubMed
Lenhard, W., & Lenhard, A. (2016). Computation of effect sizes,Google Scholar
Lezak, M. D. (2012). Neuropsychological assessment (5th edn). Oxford University Press.Google Scholar
Liu, H., & Wu, L. (2021). Lifelong bilingualism functions as an alternative intervention for cognitive reserve against Alzheimer’s disease. Frontiers in Psychiatry, 12, 696015. https://doi.org/10.3389/fpsyt.2021.696015 CrossRefGoogle ScholarPubMed
Livingston, G., Huntley, J., Sommerlad, A., Ames, D., Ballard, C., Banerjee, S., Brayne, C., Burns, A., Cohen-Mansfield, J., Cooper, C., Costafreda, S. G., Dias, A., Fox, N., Gitlin, L. N., Howard, R., Kales, H. C., Kivimäki, M., Larson, E. B., Ogunniyi, A., Orgeta, V., Ritchie, K., Rockwood, K., Sampson, E. L., Samus, Q., Schneider, L. S., Selbæk, G., Teri, L., Mukadam, N. (2020). Dementia prevention, intervention, and care: 2020 report of the Lancet Commission. Lancet, 396(10248), 413446. https://doi.org/10.1016/S0140-6736(20)30367-6 CrossRefGoogle ScholarPubMed
Manly, J. J., Jacobs, D. M., Sano, M., Bell, K., Merchant, C. A., Small, S. A., & Stern, Y. (1998). Cognitive test performance among nondemented elderly African Americans and whites. Neurology, 50(5), 12381245. https://doi.org/10.1212/wnl.50.5.1238 CrossRefGoogle ScholarPubMed
McCann, A., McNulty, H., Rigby, J., Hughes, C. F., Hoey, L., Molloy, A. M., Cunningham, C. J., Casey, M. C., Tracey, F., O’Kane, M. J., McCarroll, K., Ward, M., Moore, K., Strain, J. J., Moore, A. (2018). Effect of area-level socioeconomic deprivation on risk of cognitive dysfunction in older adults. Journal of The American Geriatrics Society, 66(7), 12691275. https://doi.org/10.1111/jgs.15258 CrossRefGoogle ScholarPubMed
McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum Associates Publishers.Google Scholar
McDowell, I., Kristjansson, B., Hill, G. B., & Hébert, R. (1997). Community screening for dementia: The Mini Mental State Exam (MMSE) and modified Mini-Mental State Exam (3MS) compared. Journal of Clinical Epidemiology, 50(4), 377383. https://doi.org/10.1016/S0895-4356(97)00060-7 CrossRefGoogle ScholarPubMed
Mehta, K. M., & Yeo, G. W. (2017). Systematic review of dementia prevalence and incidence in United States race/ethnic populations. Alzheimers & Dementia, 13(1), 7283. https://doi.org/10.1016/j.jalz.2016.06.2360 CrossRefGoogle ScholarPubMed
Muthén, B. (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54(4), 557585.CrossRefGoogle Scholar
Nunnally, J. C. B. I. H. (1994). Psychometric theory. McGraw-Hill.Google Scholar
Petrill, S. A., Luo, D., Thompson, L. A., & Detterman, D. K. (1996). The independent prediction of general intelligence by elementary cognitive tasks: Genetic and environmental influences. Behavior Genetics, 26(2), 135147. https://doi.org/10.1007/BF02359891 CrossRefGoogle ScholarPubMed
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis : The use of factor analysis for instrument development in health care research. Sage Pub.CrossRefGoogle Scholar
Prior, A. M., & B (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 13(2), 253262. https://doi.org/10.1017/S1366728909990526 CrossRefGoogle ScholarPubMed
Ramakrishnan, S., Mekala, S., Mamidipudi, A., Yareeda, S., Mridula, R., Bak, T. H., Alladi, S., Kaul, S. (2017). Comparative effects of education and bilingualism on the onset of mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 44(3-4), 222231. https://doi.org/10.1159/000479791 CrossRefGoogle ScholarPubMed
Rapp, S. R., Espeland, M. A., Hogan, P., Jones, B. N., & Dugan, E. (2003). Baseline experience with Modified Mini Mental State Exam: The Women’s Health Initiative Memory Study (WHIMS). Aging & Mental Health, 7(3), 217223. https://doi.org/10.1080/1360786031000101201 CrossRefGoogle ScholarPubMed
Ryan, J., Woods, R. L., Britt, C., Murray, A. M., Shah, R. C., Reid, C. M., Kirpach, B., Wolfe, R. S., Nelson, M. R., Lockery, J. E., Orchard, S. G., Trevaks, R. E., McNeil, J. J., Storey, E. (2019). Normative performance of healthy older individuals on the Modified Mini-Mental State (3MS) examination according to ethno-racial group, gender, age, and education level. Clinical Neuropsychologist, 33(4), 779797. https://doi.org/10.1080/13854046.2018.1488996 CrossRefGoogle ScholarPubMed
Schweizer, T. A., Ware, J., Fischer, C. E., Craik, F. I., & Bialystok, E. (2012). Bilingualism as a contributor to cognitive reserve: Evidence from brain atrophy in Alzheimer’s disease. Cortex, 48(8), 991996. https://doi.org/10.1016/j.cortex.2011.04.009 CrossRefGoogle ScholarPubMed
Sink, K. M., Craft, S., Smith, S. C., Maldjian, J. A., Bowden, D. W., Xu, J., Freedman, B. I., Divers, J. (2015). Montreal cognitive assessment and modified mini mental state examination in African Americans. Journal of Aging Research, 2015, 872018–6. https://doi.org/10.1155/2015/872018.CrossRefGoogle ScholarPubMed
Suchy-Dicey, A., Oziel, K., Sawyer, C., Olufadi, Y., Ali, T., Fretts, A. M., & Umans, J. G., Shibata, D. K., Longstreth, W. T., & Grabowski, T. J. (2022). Educational and clinical associations with longitudinal changes in cognitive function and brain imaging among American Indians: the Strong Heart Study. Neurology, 99(24), e2637e2647.CrossRefGoogle ScholarPubMed
Suchy-Dicey, A., Verney, S. P., Nelson, L. A., Barbosa-Leiker, C., Howard, B. A., Crane, P. K., & Buchwald, D. S. (2020). Depression symptoms and cognitive test performance in older American Indians: The strong heart study. Journal of The American Geriatrics Society, 68(8), 17391747. https://doi.org/10.1111/jgs.16434 CrossRefGoogle ScholarPubMed
Suchy-Dicey, A. M., Oziel, K., Sawyer, C., Olufadi, Y., Ali, T., Fretts, A. M., Umans, J. G., Shibata, D. K., Longstreth, W. T., Rhoads, K., Buchwald, D. S., & Grabowski, T. J. (2022). Educational and clinical associations with longitudinal cognitive function and brain imaging in American Indians: The strong heart study. Neurology, 99(24), e26372647. https://doi.org/10.1212/WNL.0000000000201261 CrossRefGoogle ScholarPubMed
Suchy-Dicey, A. M., Shibata, D., Best, L. G., Verney, S. P., Longstreth, W. T., Lee, E. T., Okin, P. M., Devereux, R., O'Leary, M., Ali, T., Jensen, P. N., Muller, C., Nelson, L. A., Rhoades, E., Madhyastha, T., Grabowski, T. J., Beauchamp, N., Umans, J. G., Buchwald, D. (2016). Cranial magnetic resonance imaging in elderly American Indians: Design, methods, and implementation of the cerebrovascular disease and its consequences in American Indians study. Neuroepidemiology, 47(2), 6775. https://doi.org/10.1159/000443277 CrossRefGoogle ScholarPubMed
Suchy-Dicey, A. M., Shibata, D. K., Madhyastha, T. M., Grabowski, T. J., Longstreth, W. T., & Buchwald, D. S. (2017). Findings of vascular brain injury and structural loss from cranial magnetic resonance imaging in elderly American Indians: The strong heart study. Neuroepidemiology, 48(1-2), 3947. https://doi.org/10.1159/000459624 CrossRefGoogle ScholarPubMed
Teng, E. L., & Chang Chui, H. (1987). The modified mini-mental (3MS) examination. Journal Clinical Psychiatry, 48(8), 314318.Google ScholarPubMed
Tombaugh, T. N. (2005). Test-retest reliable coefficients and 5-year change scores for the MMSE and 3MS. Archives of Clinical Neuropsychology, 20(4), 485503. https://doi.org/10.1016/j.acn.2004.11.004 CrossRefGoogle ScholarPubMed
Tombaugh, T. N., McDowell, I., Kristjansson, B., & Hubley, A. M. (1996). Mini-Mental State Examination (MMSE) and the Modified MMSE (3MS): A psychometric comparison and normative data. Psychological Assessment, 8(1), 4859. https://doi.org/10.1037/1040-3590.8.1.48.CrossRefGoogle Scholar
Tschanz, J. T., Welsh-Bohmer, K. A., Plassman, B. L., Norton, M. C., Wyse, B. W., & Breitner, J. C. (2002). An adaptation of the modified mini-mental state examination: Analysis of demographic influences and normative data: The cache county study. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 15(1), 2838.Google ScholarPubMed
Tsoi, K. K., Chan, J. Y., Hirai, H. W., Wong, S. Y., & Kwok, T. C. (2015). Cognitive tests to detect dementia: A systematic review and meta-analysis. JAMA Internal Medicine, 175(9), 14501458. https://doi.org/10.1001/jamainternmed.2015.2152 CrossRefGoogle ScholarPubMed
Van Patten, R., Britton, K., & Tremont, G. (2019). Comparing the Mini-Mental State Examination and the modified Mini-Mental State Examination in the detection of mild cognitive impairment in older adults. International Psychogeriatrics, 31(5), 693701. https://doi.org/10.1017/S1041610218001023 CrossRefGoogle ScholarPubMed
Verney, S., Bennett, J., & Hamilton, J. M. (2015). Cultural considerations in the neuropsychological assessment of American Indians/Alaska natives. In Minority and cross-cultural aspects of neuropsychological sssessment: Enduring and emerging trends (2nd ed. pp. 115158).Google Scholar
Verney, S. P., Suchy-Dicey, A. M., Cholerton, B., Calhoun, D., Nelson, L., Montine, T. J., Ali, T., Longstreth, W. T., Buchwald, D. (2019). The associations among sociocultural factors and neuropsychological functioning in older American Indians: The Strong Heart Study. Neuropsychology, 33(8), 10781088. https://doi.org/10.1037/neu0000574 CrossRefGoogle ScholarPubMed
Zahodne, L. B., Sharifian, N., Kraal, A. Z., Zaheed, A. B., Sol, K., Morris, E. P., Schupf, N., Manly, J. J., Brickman, A. M. (2021). Socioeconomic and psychosocial mechanisms underlying racial/ethnic disparities in cognition among older adults. Neuropsychology, 35(3), 265275. https://doi.org/10.1037/neu0000720 CrossRefGoogle ScholarPubMed
Zahodne, L. B., Sol, K., & Kraal, Z. (2019). Psychosocial pathways to racial/ethnic inequalities in late-life memory trajectories. The Journals of Gerontology: Series B, 74(3), 409418. https://doi.org/10.1093/geronb/gbx113 CrossRefGoogle ScholarPubMed