Skip to main content
SpringerLink
Log in

Preliminary Evidence of the Reliability and Validity of a Sense of Belonging in STEM Scale for College Students

  • Published:
Journal of Science Education and Technology Aims and scope Submit manuscript

Abstract

This study tested the psychometric properties of the Sense of Belonging in STEM Scale (SOB-STEM), a new scale measuring students’ subjective evaluation of their academic and social experiences in STEM learning contexts, primarily focusing on purposeful interpersonal interactions. Data from 758 college students were analyzed, yielding several key results. Internal consistency reliability of the SOB-STEM was fairly strong (⍶ = 0.801). Convergent validity was supported, with the SOB-STEM correlating moderately (r = 0.49, p < 0.01) with the University Environment Scale. Implications for STEM teaching, program reform, and future research are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability

Due to the nature of this research, supporting data are not available. Participants in this study did not give written consent for their data to be shared publicly.

References

  • Anderman, E. M. (2002). School effects on psychological outcomes during adolescence. Journal of Educational Psychology, 94(4), 795–809. https://doi.org/10.1037/0022-0663.94.4.795

    Article  Google Scholar 

  • Anderman, L. H. (2003). Academic and social perceptions as predictors of change in middle school students’ sense of belonging. Journal of Experimental Education, 72, 5–23.

    Article  Google Scholar 

  • Anderman, L. H., & Freeman, T. M. (2004). Students’ sense of belonging in school. Motivating students, improving schools: The legacy of Carol MidgleyIn M. L. Maehr & P. R. Pintrich (Eds.), Advances in motivation and achievement (Vol. 13, pp. 27–63). Elsevier.

    Google Scholar 

  • Astin, A. W., Parrott, S. A., Korn, W. S., & Sax, L. J. (1997). The American freshman: Thirty-year trends. Los Angeles: Higher Education Research Institute.

  • Bartlett, M. S. (1954). A note on the multiplying factors for various chi square approximations. Journal of the Royal Statistical Society, 16(Series B), 296–298.

  • Baskaya, Y., Sayiner, F. D., & Filiz, Z. (2020). How much do I belong to my profession? A scale development study: Midwifery belonging scale. Health Care for Women International, 41(8), 883–898. https://doi.org/10.1080/07399332.2020.1716765

    Article  Google Scholar 

  • Binkley, C. (2023). The labor shortage is pushing American colleges into crisis, with the plunge in enrollment the worst ever recorded. Fortune. Retrieved July 1, 2023, from https://fortune.com/2023/03/09/american-skipping-college-huge-numbers-pandemic-turned-them-off-education

  • Blum, L. (2001). Transforming the culture of computing at Carnegie Mellon. Computing Research News, 13, 2–9.

    Google Scholar 

  • Bodzin, A., & Gehringer, M. (2001). Breaking science stereotypes. Science and Children, 38, 36–41.

    Google Scholar 

  • Borrego, M., Froyd, J. E., & Hall, T. S. (2010). Diffusion of engineering education innovations: A survey of awareness and adoption rates in U.S. engineering departments. Journal of Engineering Education, 99(3), 185–207.

  • Bottia, M. C., Stearns, E., Mickelson, R. A., Moller, S., & Parler, A. D. (2015). The relationships among high school STEM learning experiences and students’ intent to declare and declaration of a STEM major in college. Teachers College Record, 117(3), 1–46.

    Article  Google Scholar 

  • Burke, R. J. (2007). Women and minorities in STEM: A primer. In R. J. Burke & M. C. Mattis (Eds.), Women and minorities in science, technology, engineering, and mathematics: Upping the numbers (pp. 3–27). Edward Elgar Publishing.

    Chapter  Google Scholar 

  • Carli, L. L., Alawa, L., Lee, Y., Zhao, B., & Kim, E. (2016). Stereotypes about gender and science: Women≠scientists. Psychology of Women Quarterly, 40(2), 244–260. https://doi.org/10.1177/0361684315622645

    Article  Google Scholar 

  • Casad, B. J., Petzel, Z. W., & Ingalls, E. A. (2018). A model of threatening academic environments predicts women STEM majors’ self-esteem and engagement in STEM. Sex Roles, 80(7–8), 469–488. https://doi.org/10.1007/s11199-018-0942-4

    Article  Google Scholar 

  • Clewell, B. C., & Campbell, P. B. (2002). Taking stock: Where we’ve been, where we are, where we’re going. Journal of Women and Minorities in Science & Engineering, 8, 255–284.

    Article  Google Scholar 

  • Clewell, B. C., Decohen, C. C., Tsui, L., & Deterding, N. (2006). Revitalizing the nation’s talent pool in STEM. The Urban Institute.

    Book  Google Scholar 

  • Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. Erlbaum.

    Google Scholar 

  • Cohoon, J. M. (2001). Toward improving female retention in the computer science major. Communications of the ACM, 44(5).

  • Crawford, S. D., Couper, M. P., & Lamia, M. J. (2001). Web surveys: Perceptions of burden. Social Science Computer Review, 19, 146–162.

    Article  Google Scholar 

  • Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Harcourt Brace Jovanovich College Publishers.

    Google Scholar 

  • Cronbach, L. J. (1961). Essentials of psychological testing (2nd ed.). Harper & Row.

    Google Scholar 

  • Danielak, B. A., Gupta, A., & Elby, A. (2014). Marginalized identities of sense-makers: Reframing engineering student retention. Journal of Engineering Education, 103(1), 8–44.

    Article  Google Scholar 

  • Dortch, D., & Patel, C. (2017). Black undergraduate women and their sense of belonging in STEM at predominantly White institutions. NASPA Journal about Women in Higher Education, 10(2), 202–215. https://doi.org/10.1080/19407882.2017.1331854

    Article  Google Scholar 

  • Elrod, S., & Kezar, A. (2017). Increasing student success in STEM: Summary of a guide to systemic institutional change. Change: The Magazine of Higher Learning, 49(4), 26–34. https://doi.org/10.1080/00091383.2017.1357097

  • Espinosa, L. (2011). Pipelines and pathways: Women of color in undergraduate STEM majors and the college experiences that contribute to persistence. Harvard Educational Review, 81(2), 209–241. https://doi.org/10.17763/haer.81.2.92315ww157656k3u

  • George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference (4th ed.). Allyn & Bacon.

    Google Scholar 

  • Georgi, H. (2000). Who will do the science in the future? National Academy Press.

    Google Scholar 

  • Gerkensmeyer, J. E., & Austin, J. K. (2005). Development and testing of a scale measuring parent satisfaction with staff interactions. Journal of Behavioral Health Services & Research, 32(1), 61–73.

    Article  Google Scholar 

  • Gloria, A. M., & Robinson Kurpius, S. E. (1996). The validation of the cultural congruity scale and the university environment scale with Chicano/a students. Hispanic Journal of Behavioral Sciences, 18(4), 533–554.

    Article  Google Scholar 

  • Goodenow, C. (1993). The psychological sense of school membership among adolescents: Scale development and educational correlates. Psychology in the Schools, 30, 79–90.

    Article  Google Scholar 

  • Gopalan, M., & Brady, S. T. (2020). College students’ sense of belonging: A national perspective. Educational Researcher, 49(2), 134–137. https://doi.org/10.3102/0013189X19897622

    Article  Google Scholar 

  • Hagerty, B. M. K., & Patusky, K. (1995). Developing a measure of sense of belonging. Nursing Research, 44(1), 9–13.

    Article  Google Scholar 

  • Hausmann, L. R. M., Schofield, J. W., & Woods, R. L. (2007). Sense of belonging as a predictor of intentions to persist among African American and White first-year college students. Research in Higher Education, 48(7), 803–839.

    Article  Google Scholar 

  • Heilbronner, N. N. (2011). Stepping onto the STEM pathway: Factors affecting talented students’ declaration of STEM majors in college. Journal for the Education of the Gifted, 34(6), 876–899. https://doi.org/10.1177/0162353211425100

    Article  Google Scholar 

  • Hoffman, M., Richmond, J., Morrow, J., & Salomone, K. (2002–2003). Investigating sense of belonging in first-year college students. Journal of College Student Retention: Research, Theory & Practice, 4(3), 227–256.

  • Hulin, C., Netemeyer, R., & Cudeck, R. (2001). Can a reliability coefficient be too high? Journal of Consumer Psychology, 10, 55–58.

    Article  Google Scholar 

  • Hurtado, S., & Carter, D. F. (1997). Effects of college transition and perceptions of campus racial climate on Latino college students’ sense of belonging. Sociology of Education, 70(4), 324–345.

    Article  Google Scholar 

  • Kaiser, H. (1970). A second generation little jiffy. Psychometrika, 35(4), 401–415. https://doi.org/10.1007/BF02291817

    Article  Google Scholar 

  • Kaiser, H. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575

    Article  Google Scholar 

  • Kim, J., & Mueller, C. W. (1978). Factor analysis. Sage.

    Book  Google Scholar 

  • LaCosse, J., Canning, E. A., Bowman, N. A., Murphy, M. C., & Logel, C. (2020). A social-belonging intervention improves STEM outcomes for students who speak English as a second language. Science Advances, 6(40), eabb6543. https://doi.org/10.1126/sciadv.abb6543

  • LaCosse, J., Murphy, M. C., Garcia, J. A., & Zirkel, S. (2021). The role of STEM professors’ mindset beliefs on students’ anticipated psychological experiences and course interest. Journal of Educational Psychology, 113(5), 949–971. https://doi.org/10.1037/edu0000620

    Article  Google Scholar 

  • Lee, D. M., & Harmon, K. (2013). The Meyerhoff Scholars Program: Changing minds, transforming a campus. Metropolitan Universities, 24(2), 55–70.

    Google Scholar 

  • Ma, J., Batterham, P. J., Clear, A. L., & Sunderland, M. (2019). The development and validation of the thwarted belongingness scale (TBS) for interpersonal suicide risk. Journal of Psychopathology and Behavioral Assessment, 41, 456–469. https://doi.org/10.1007/s10862-019-09721-6

    Article  Google Scholar 

  • Margolis, J., & Fisher, A. (2002). Unlocking the clubhouse: Women in computing. Massachusetts Institute of Technology Press.

    Google Scholar 

  • Maslow, A. H. (1962). Toward a psychology of being. von Nostrand Reinhold.

    Book  Google Scholar 

  • Maton, K. I., Hrawbowski, F. A., Ozdemir, M., & Wimms, H. (2008). Enhancing representation, retention, and achievement of minority students in higher education: A social transformation theory of change. In M. Shinn & H. Yoshikawa (Eds.), Towards positive youth development: Transforming schools and community programs. New York: Oxford University Press.

  • Murphy, M. C., Gopalan, M., Carter, E. R., Emerson, K. T. U., Bottoms, B. L., & Walton, G. M. (2020). A customized belonging intervention improves retention of socially disadvantaged students at a broad-access university. Science Advances, 6(29), 40–47. https://doi.org/10.1126/sciadv.aba4677

    Article  Google Scholar 

  • Museus, S. D., Yi, V., & Saelua, N. (2018). How culturally engaging campus environments influence sense of belonging in college: An examination of differences between White students and students of color. Journal of Diversity in Higher Education, 11(4), 467–483.

    Article  Google Scholar 

  • National Academy of Engineering. (2004). The engineer of 2020: Visions of engineering in the new century. National Academies Press.

    Google Scholar 

  • National Center for Science and Engineering Statistics (NCSES). (2023). Diversity and STEM: Women, minorities, and persons with disabilities 2023. Special Report NSF 23–315. Alexandria, VA: National Science Foundation.

  • National Research Council. (2011). Expanding underrepresented minority participation: America’s science and technology talent at the crossroads. National Academies Press.

    Google Scholar 

  • National Science Board. (2006). Science and engineering indicators, 2006. Arlington, VA: National Science Foundation.

    Google Scholar 

  • Newman, C. B. (2011). Access and success for African American engineers and computer scientists: A case study of two predominantly White public research universities [Unpublished doctoral dissertation]. University of California.

    Google Scholar 

  • Nichols, A. L., & Webster, G. D. (2013). The single-item need to belong scale. Personality & Individual Differences, 55, 189–192. https://doi.org/10.1016/j/paid.2013.02.018

    Article  Google Scholar 

  • O’Brien, L. T., Bart, H. L., & Garcia, D. M. (2020). Why are there so few ethnic minorities in ecology and evolutionary biology? Challenges to inclusion and the role of sense of belonging. Social Psychology of Education, 23, 449–477. https://doi.org/10.1007/s11218-019-09538-x

    Article  Google Scholar 

  • Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (Vol. 2). Jossey-Bass.

    Google Scholar 

  • Piatek-Jimenez, K., Cribbs, J., & Gill, N. (2018). College students’ perceptions of gender stereotypes: Making connections to the underrepresentation of women in STEM fields. International Journal of Science Education, 40(12), 1432–1454. https://doi.org/10.1080/09500693.2018.1482027

    Article  Google Scholar 

  • Powell, A., Bagilhole, B., & Dainty, A. (2009). How women engineers do and undo gender: Consequences for gender equality. Gender, Work & Organization, 16(4), 411–428. https://doi.org/10.1111/j.1468-0432.2008.00406.x

    Article  Google Scholar 

  • Rainey, K., Dancy, M., Mickelson, R., Stearns, E., & Moller, S. (2018). Race and gender differences in how sense of belonging influences decisions to major in STEM. International Journal of STEM Education, 5, 10. https://doi.org/10.1186/s40594-018-0115-6

    Article  Google Scholar 

  • Rhee, B. (2008). Institutional climate and student departure: A multinomial multilevel modeling approach. The Review of Higher Education, 31(2), 161–183. https://doi.org/10.1353/rhe.2007.0076

    Article  Google Scholar 

  • Rhee, J., Johnson, C., & Oyamot, C. M. (2017). Preliminary findings using growth mindset and belonging interventions in a freshman engineering class. Proceedings of the American Society for Engineering Education. Retrieved July 1, 2023, from https://peer.asee.org/preliminary-findings-using-growth-minset-and-belonging-interventions-in-a-freshman-engineering-class.pdf

  • Rodriguez, S. L., & Blaney, J. M. (2021). We’re the unicorns in STEM: Understanding how academic and social experiences influence sense of belonging for Latina undergraduate students. Journal of Diversity in Higher Education, 14(3), 441–455. https://doi.org/10.1037/dhe0000176

  • Rosenberg, M., & McCullough, B. C. (1981). Mattering: Inferred significance and mental health among adolescents. Research in Community Mental Health, 2, 163–182.

    Google Scholar 

  • Salzman, H. (2013). What shortages? The real evidence about the STEM workforce. Issues in Science & Technology, 58–67. https://doi.org/10.7282/T3JS9S2T

  • Sax, L. J., Zimmerman, H. B., Blaney, J. M., Toven-Lindsey, B., & Lehman, K. J. (2017). Diversifying undergraduate computer science: The role of department chairs in promoting gender and racial diversity. Journal of Women and Minorities in Science & Engineering, 23(2), 101–119.

    Article  Google Scholar 

  • Schulte, L. E., Brown, R. D., & Wise, S. L. (1991). The development and validation of the ethical climate index for graduate and professional school programs. Research in Higher Education, 32(4), 479–498.

    Article  Google Scholar 

  • Seymour, E., & Hewitt, N. M. (1997). Talking about leaving: Why undergraduates leave the sciences. Westview Press.

    Google Scholar 

  • Smith, J., & Lucena, J. (2016). Invisible innovators: How low-income, first-generation students use their funds of knowledge to belonging in engineering. Engineering Studies, 8(1), 1–26. https://doi.org/10.1080/19378629.2016.1155593

    Article  Google Scholar 

  • Strayhorn, T. L. (2015). Factors influencing Black males’ preparation for college and success in STEM majors: A mixed methods study. Western Journal of Black Studies, 39(1), 45–63.

    Google Scholar 

  • Strayhorn, T. L. (2019). College students’ sense of belonging: A key to educational success for all students (2nd ed.). Routledge.

    Google Scholar 

  • Strayhorn, T. L. (2020). Exploring the role of race in Black males’ sense of belonging in medical school: A qualitative pilot study. Medical Science Educator, 30, 1383–1387. https://doi.org/10.1007/s40670-020-01103-y

    Article  Google Scholar 

  • Strayhorn, T. L. (2022). Exploring ethnic minority first-year college students’ well-being and sense of belonging: A qualitative investigation of a brief intervention. American Journal of Qualitative Research, 6(1), 42–58. https://doi.org/10.29333/ajqr/11422

  • Strayhorn, T. L. (2023). Widening the aperture on college students’ sense of belonging: A critical ecological perspective. In T. Lowe (Ed.), Advancing student engagement in higher education: Reflection, critique, and challenge. New York: Routledge. https://doi.org/10.4324/9781003271789-23

  • Streiner, D. L., & Kottner, J. (2014). Recommendations for reporting the results of studies of instrument and scale development and testing. Journal of Advanced Nursing, 70(9), 1970–1979.

    Article  Google Scholar 

  • Thompson, B. (2004). Exploratory and confirmatory factor analysis. American Psychology Association.

    Google Scholar 

  • Trenor, J. M., Simmons Grant, D. R., & Archer, E. (2010). The role of African American fraternities and sororities in engineering students’ educational experiences at a predominantly White institution. Paper presented at the 40th ASEE/IEEE Frontiers in Education Conference.

  • Walton, G. M., & Cohen, G. L. (2011). A brief social-belonging intervention improves academic and health outcomes of minority students. Science, 331, 1447–1451.

    Article  Google Scholar 

  • Weaver, J. P., DeCaro, M. S., & Ralston, P. A. (2021). Limited support for use of a social-belonging intervention with first-year engineering students. Journal for STEM Education Research, 4, 47–72. https://doi.org/10.1007/s41979-020-00041-z

    Article  Google Scholar 

  • Weiner, B. (2018). Why the U.S. has a STEM shortage and how we fix it. Recruiting. Retrieved July 1, 2023, from https://recruitingdaily.com/why-the-u-s-has-a-stem-shortage-and-how-we-fix-it-part-1

  • Wilkins-Yel, K. G., Arnold, A., Bekki, J., Natarajan, M., Bernstein, B., & Randall, A. K. (2022). I can’t push off my own mental health: Chilly STEM climates, mental health, and STEM persistence among Black, Latina, and White graduate women. Sex Roles, 86, 208–232. https://doi.org/10.1007/s111199-021-01262-1

    Article  Google Scholar 

  • Wilson, Z. S., Holmes, L., Sylvain, M. R., Batiste, L., Johnson, M., McGuire, S. Y., & Warner, I. M. (2012). Hierarchical mentoring: A transformative strategy for improving diversity and retention in undergraduate STEM disciplines. Journal of Science Education & Technology, 21(1), 148–156. https://doi.org/10.1007/s10956-011-9292-5

    Article  Google Scholar 

  • Wyer, M. (2003). The importance of field in understanding persistence among science and engineering majors. Journal of Women and Minorities in Science and Engineering, 9(3–4), 273–286. https://doi.org/10.1615/JWomenMinorScienEng.v9.i34.50

    Article  Google Scholar 

  • Xue, Y., & Larson, R. C. (2015). STEM crisis or STEM surplus? Yes and yes. Monthly Labor Review. https://doi.org/10.21916/mlr.2015.14

Download references

Funding

This paper represents independent research funded, in part, by the National Science Foundation (NSF) CAREER Award (#1132141), Education and Human Resources Division. Opinions represent those of the principal investigator (Terrell Strayhorn) and not necessarily the funding agency.

Author information

Authors and Affiliations

  1. Departments of Urban Education and Psychology; Center for the Study of HBCUs; The Belonging Lab, Virginia Union University, 1500 N Lombardy Street, Richmond, VA, 23220, USA

    Terrell Lamont Strayhorn

Authors
  1. Terrell Lamont Strayhorn
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All author(s) have approved the manuscript for submission.

Corresponding author

Correspondence to Terrell Lamont Strayhorn.

Ethics declarations

Ethics Approval

This study complied with ethical standards for research involving human subjects, including informed consent and institutional research board (IRB) approval.

Consent for Publication

This manuscript should be published in the Journal of Science Education and Technology given its focus on a belonging in STEM scale that extends what we know from research in the field. There are no issues relating to journal policies. Content of this manuscript has not been published, or submitted for publication elsewhere. Manuscript is submitted for general issue, not a particular special issue.

Conflict of Interest

The author declares no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Strayhorn, T.L. Preliminary Evidence of the Reliability and Validity of a Sense of Belonging in STEM Scale for College Students. J Sci Educ Technol 33, 84–93 (2024). https://doi.org/10.1007/s10956-023-10076-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-023-10076-7

Keywords

Search

Navigation