Abstract
The significance of higher-order thinking (HOT) is becoming increasingly prominent in the twenty-first century, as reflected in the framework of most recent competency models. Blended learning models are universally recognized as promising endeavors to promote learners’ HOT in the contemporary higher education field. To ensure that such learning models function as intended, a thorough and systematic study is required to determine the variables that most influence learners’ development of HOT in a blended learning environment. A sample of 422 Chinese vocational college students with blended learning experience completed a survey in which their perceptions of teaching presence, social presence, self-regulated learning (SRL), information and communication technology (ICT) self-efficacy, and HOT were measured. Structural equation modeling (SEM) revealed that students’ SRL directly and significantly influenced their HOT in a blended learning environment. Furthermore, teaching presence, social presence, and ICT self-efficacy all indirectly affect HOT through their impact on SRL. Based on these findings, this study recommends that instructors teaching in a blended learning environment should focus on improving learners’ SRL abilities, social interaction techniques, ICT competencies, and teaching presence to help learners develop HOT.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The raw data supporting the results and conclusions of this study will be provided by the corresponding author upon reasonable request.
Abbreviations
- CoI:
-
Community of Inquiry
- CFI:
-
Comparative fit index
- DF:
-
Degree of freedom
- HOT:
-
Higher-order thinking
- ICT:
-
Information and communication technologies
- LMS:
-
Learning management system
- SRL:
-
Self-Regulated Learning
- SRLSQ:
-
SRL Skills Questionnaire
- SP:
-
Social presence
- SEM:
-
Structural equation modeling
- TP:
-
Teaching presence
References
Aesaert, K., & van Braak, J. (2014). Exploring factors related to primary school pupils’ ICT self-efficacy: A multilevel approach. Computers in Human Behavior, 41, 327–341. https://doi.org/10.1016/j.chb.2014.10.006
Aesaert, K., Van Nijlen, D., Vanderlinde, R., Tondeur, J., Devlieger, I., & van Braak, J. (2015). The contribution of pupil, classroom and school level characteristics to primary school pupils’ ICT competences: A performance-based approach. Computers & Education, 87, 55–69. https://doi.org/10.1016/j.compedu.2015.03.014
Aesaert, K., Voogt, J., Kuiper, E., & van Braak, J. (2017). Accuracy and bias of ICT self-efficacy: An empirical study into students’ over- and underestimation of their ICT competences. Computers in Human Behavior, 75, 92–102. https://doi.org/10.1016/j.chb.2017.05.010
Almerich, G., Suárez-Rodríguez, J., Díaz-García, I., & Cebrián-Cifuentes, S. (2020). 21st-century competences: The relation of ICT competences with higher-order thinking capacities and teamwork competences in university students. Journal of Computer Assisted Learning, 36(4), 468–479. https://doi.org/10.1111/jcal.12413
Al-Samarraie, H., & Saeed, N. (2018). A systematic review of cloud computing tools for collaborative learning: Opportunities and challenges to the blended-learning environment. Computers & Education, 124, 77–91. https://doi.org/10.1016/j.compedu.2018.05.016
Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3). https://doi.org/10.1037/0033-2909.103.3.411
Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives (Complete ed.). Longman.
Anderson, T., Rourke, L., Garrison, R., & Archer, W. (2019). Assessing teaching presence in a computer conferencing context. Online learning, 5(2). https://doi.org/10.24059/olj.v5i2.1875.
Armellini, A., & Padilla Rodriguez, B. C. (2021). Active Blended Learning: Definition, Literature Review, and a Framework for Implementation. In B. C. Padilla Rodriguez & A. Armellini (Eds.), Advances in Educational Technologies and Instructional Design (pp. 1–22). IGI Global. https://doi.org/10.4018/978-1-7998-7856-8.ch001
Ay, K., & Dağhan, G. (2023). The effect of the flipped learning approach designed with community of inquiry model to the development of students’ critical thinking strategies and social, teaching and cognitive presences. Education and Information Technologies, 28(11), 15267–15299. https://doi.org/10.1007/s10639-023-11809-2
Azevedo, R., & Cromley, J. G. (2004). Does training on self-regulated learning facilitate students’ learning with hypermedia? Journal of Educational Psychology, 96(3), 523–535. https://doi.org/10.1037/0022-0663.96.3.523
Bandura, A. (1995). Self-efficacy in changing societies. Cambridge university press.
Blaine, A. M. (2019). Interaction and presence in the virtual classroom: An analysis of the perceptions of students and teachers in online and blended advanced placement courses. Computers & Education, 132, 31–43. https://doi.org/10.1016/j.compedu.2019.01.004
Bliuc, A.-M., Casey, G., Bachfischer, A., Goodyear, P., & Ellis, R. A. (2012). Blended learning in vocational education: Teachers’ conceptions of blended learning and their approaches to teaching and design. The Australian Educational Researcher, 39(2), 237–257. https://doi.org/10.1007/s13384-012-0053-0
Bloom, B. (1956). Taxonomy of Educational Objectives: The Classification of Educational Goals (1st ed.). New York: Longsman, Green & Co., Publishers.
Bollen, K. A. (1989). Structural equations with latent variables (Vol. 210). Wiley.
Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21(2), 205–229. https://doi.org/10.1177/0049124192021002004
Bradley, R. V., Sankar, C. S., Clayton, H. R., Mbarika, V. W., & Raju, P. (2007). A study on the impact of gpa on perceived improvement of higher-order cognitive skills. Decision Sciences Journal of Innovative Education, 5(1), 151–168. https://doi.org/10.1111/j.1540-4609.2007.00131.x
Broadbent, J. (2017). Comparing online and blended learner’s self-regulated learning strategies and academic performance. The Internet and Higher Education, 33, 24–32. https://doi.org/10.1016/j.iheduc.2017.01.004
Broadbent, J., & Poon, W. L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13. https://doi.org/10.1016/j.iheduc.2015.04.007
Budsankom, P., Sawangboon, T., Damrongpanit, S., & Chuensirimongkol, J. (2015). Factors affecting higher order thinking skills of students: A Meta-analytic structural equation modeling study. Educational Research and Reviews, 10(19), 2639–2652. https://doi.org/10.5897/ERR2015
Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: Testing the linkages*. Research in Higher Education, 47(1), 1–32. https://doi.org/10.1007/s11162-005-8150-9
Caskurlu, S., Maeda, Y., Richardson, J. C., & Lv, J. (2020). A meta-analysis addressing the relationship between teaching presence and students’ satisfaction and learning. Computers & Education, 157, 103966. https://doi.org/10.1016/j.compedu.2020.103966
Chang, C.-C., Tseng, K.-H., Liang, C., & Liao, Y.-M. (2013). Constructing and evaluating online goal-setting mechanisms in web-based portfolio assessment system for facilitating self-regulated learning. Computers & Education, 69, 237–249. https://doi.org/10.1016/j.compedu.2013.07.016
Chin, W. (1998). Issues and opinion on structural equation modeling management. Information Systems Quarterly, 22(1), 19–24. https://doi.org/10.2307/249676
Cirak Kurt, S., Yildirim, I., & Cucuk, E. (2018). The effects of blended learning on student achievement: A meta-analysis study. Hacettepe Universitesi Egitim Fakultesi Dergisi-Hacettepe University Journal of Education, 33(3), 776–802.
Collins, R. (2014). Skills for the 21st century: Teaching higher-order thinking. Curriculum & Leadership Journal, 12(14), 1–8.
Courtois, C., Montrieux, H., De Grove, F., Raes, A., De Marez, L., & Schellens, T. (2014). Student acceptance of tablet devices in secondary education: A three-wave longitudinal cross-lagged case study. Computers in Human Behavior, 35, 278–286. https://doi.org/10.1016/j.chb.2014.03.017
Demirbag, M., & Bahcivan, E. (2021). Comprehensive exploration of digital literacy: embedded with self-regulation and epistemological beliefs. Journal of Science Education and Technology, 30(3), 448–459. https://doi.org/10.1007/s10956-020-09887-9
Duncan, T. G., & McKeachie, W. J. (2005). The making of the motivated strategies for learning questionnaire. Educational Psychologist, 40(2), 117–128. https://doi.org/10.1207/s15326985ep4002_6
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Fraillon, J., Schulz, W., & Ainley, J. (2013). International computer and information literacy study 2013: Assessment framework. IEA.
Fraillon, J., Ainley, J., Schulz, W., Friedman, T., & Gebhardt, E. (2014). Preparing for life in a digital age: The IEA international computer and information literacy study international report. Springer Nature.
Garrison, D. R. (2011). E-learning in the 21st century (0th ed.). Routledge. https://doi.org/10.4324/9780203838761
Garrison, D. R., & Arbaugh, J. B. (2007). Researching the community of inquiry framework: Review, issues, and future directions. The Internet and Higher Education, 10(3), 157–172. https://doi.org/10.1016/j.iheduc.2007.04.001
Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/S1096-7516(00)00016-6
Gewerc, A., & Montero, L. (2013). Cultures, training and career development. The integration of ICT in educational institutions. Revista De Educacion, (362), 323–347. https://doi.org/10.4438/1988-592X-RE-2011-362-163
Gong, D., Yang, H. H., & Cai, J. (2020). Exploring the key influencing factors on college students’ computational thinking skills through flipped-classroom instruction. International Journal of Educational Technology in Higher Education, 17, 1–13. https://doi.org/10.1186/s41239-020-00196-0
Guskey, T. R. (2002). Professional development and teacher change. Teachers and teaching, 8(3), 381–391. https://doi.org/10.1080/135406002100000512
Han, F., & Ellis, R. A. (2023). Self-reported and digital-trace measures of computer science students’ self-regulated learning in blended course designs. Education and Information Technologies, 28(10), 13253–13268. https://doi.org/10.1007/s10639-023-11698-5
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Hwang, G.-J., Lai, C.-L., Liang, J.-C., Chu, H.-C., & Tsai, C.-C. (2018). A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Educational Technology Research and Development, 66(1), 75–93. https://doi.org/10.1007/s11423-017-9540-3
Ivie, S. D. (1998). Ausubel’s learning theory: An approach to teaching higher order thinking skills. The High School Journal, 82(1), 35–42.
Jackson, D. L., Gillaspy, J. A., Jr., & Purc-Stephenson, R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6. https://doi.org/10.1037/a0014694
Janneck, M., Vincent-Höper, S., & Ehrhardt, J. (2013). The computer-related self concept: A gender-sensitive study. International Journal of Social and Organizational Dynamics in IT (IJSODIT), 3(3), 1–16. https://doi.org/10.4018/ijsodit.2013070101
Jiang, Y. (2017). Constructing model for development of higher order thinking in technology rich classroom environment (PhD Thesis). Northeast Normal University.
Kim, H. J., Yi, P., & Hong, J. I. (2020). Students’ academic use of mobile technology and higher-order thinking skills: The role of active engagement. Education Sciences, 10(3), 47. https://doi.org/10.3390/educsci10030047
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publications.
Lan, G., Zhong, Q., Lv, C., Song, Y., & Wei, J. (2018). Construction of a Chinese version of the Community of Inquiry Measurement Instrument. Open Education Research, 24(03), 68–76. https://doi.org/10.13966/j.cnki.kfjyyj.2018.03.008
Law, K. M. Y., Geng, S., & Li, T. (2019). Student enrollment, motivation and learning performance in a blended learning environment: The mediating effects of social, teaching, and cognitive presence. Computers & Education, 136, 1–12. https://doi.org/10.1016/j.compedu.2019.02.021
Lee, J., & Choi, H. (2017). What affects learner’s higher-order thinking in technology-enhanced learning environments? The effects of learner factors. Computers & Education, 115, 143–152. https://doi.org/10.1016/j.compedu.2017.06.015
Lee, J., Moon, J., & Cho, B. (2015). The mediating role of self-regulation between digital literacy and learning outcomes in the digital textbook for middle school English. Educational Technology International, 15(1), 58–83.
Letchumanan, M., Husain, S. K. S., Chau, K. T., & Ayub, A. F. M. (2020). Investigating the use of ICT tools by academicians to promote higher order thinking skills among university students. AIP Conference Proceedings, 2266, 020002. AIP Publishing LLC. https://doi.org/10.1063/5.0019887
Lewis, A., & Smith, D. (1993). Defining higher order thinking. Theory Into Practice, 32(3), 131–137. https://doi.org/10.1080/00405849309543588
Lim, C., Ab Jalil, H., Ma’rof, A., & Saad, W. (2020). Peer learning, self-regulated learning and academic achievement in blended learning courses: A structural equation modeling approach. International Journal of Emerging Technologies in Learning (IJET), 15(3), 110–125. https://doi.org/10.3991/ijet.v15i03.12031
Lin, J.-W., Lai, Y.-C., Lai, Y.-C., & Chang, L.-C. (2016). Fostering self-regulated learning in a blended environment using group awareness and peer assistance as external scaffolds: Self-regulated learning in blended environment. Journal of Computer Assisted Learning, 32(1), 77–93. https://doi.org/10.1111/jcal.12120
Lipman, M. (1991). Thinking in education. Cambridge. The reflective model of educational practice. NY, 7–25.
Liu, X. (2009). Essentials of science classroom assessment. Sage Publications.
Lu, K., Yang, H. H., Shi, Y., & Wang, X. (2021). Examining the key influencing factors on college students’ higher-order thinking skills in the smart classroom environment. International Journal of Educational Technology in Higher Education, 18(1), 1–13. https://doi.org/10.1186/s41239-020-00238-7
Machumu, H. J., Zhu, C., & Sesabo, J. K. (2016). Blended learning in the vocational education and training system in Tanzania: Understanding vocational educators’ perceptions. International Journal of Multicultural and Multireligious Understanding, 3(2), 30. https://doi.org/10.18415/ijmmu.v3i2.46
Marzano, R. J. (1993). How classroom teachers approach the teaching of thinking. Theory Into Practice, 32(3), 154–160. https://doi.org/10.1080/00405849309543591
Müller, F. A., & Wulf, T. (2020). Technology-supported management education: A systematic review of antecedents of learning effectiveness. International Journal of Educational Technology in Higher Education, 17(1), 47. https://doi.org/10.1186/s41239-020-00226-x
Muthupoltotage, U. P., & Gardner, L. (2018). Analysing the relationships between digital literacy and self-regulated learning of undergraduates—A preliminary investigation. In Advances in information systems development (pp. 1–16). Springer.
Newmann, F. M. (1990). Higher order thinking in teaching social studies: A rationale for the assessment of classroom thoughtfulness. Journal of Curriculum Studies, 22(1), 41–56. https://doi.org/10.1080/0022027900220103
Opelt, F., & Schwinger, M. (2020). Relationships between narrow personality traits and self-regulated learning strategies: Exploring the role of mindfulness, contingent self-esteem, and self-control. AERA Open, 6(3). https://doi.org/10.1177/2332858420949
Owston, R., & York, D. N. (2018). The nagging question when designing blended courses: Does the proportion of time devoted to online activities matter? The Internet and Higher Education, 36, 22–32. https://doi.org/10.1016/j.iheduc.2017.09.001
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, 422. https://doi.org/10.3389/fpsyg.2017.00422
Panadero, E., & Alonso-Tapia, J. (2014). How do students self-regulate? Review of Zimmerman‟s cyclical model of self-regulated learning. Anales De Psicología, 30(2), 450–462. https://doi.org/10.6018/ANALESPS.30.2.167221
Phoong, S. W., Phoong, S. Y., Moghavvemi, S., & Sulaiman, A. (2020). Measuring the influence of hedonic value, social presence and teaching presence on students’ cognitive presence through the implementation of the smart classroom. International Journal of Learning Technology, 15(2), 130. https://doi.org/10.1504/IJLT.2020.109571
Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16(4), 385–407. https://doi.org/10.1007/s10648-004-0006-x
Puustinen, M., & Pulkkinen, L. (2001). Models of self-regulated learning: A review. Scandinavian Journal of Educational Research, 45(3), 269–286. https://doi.org/10.1080/00313830120074206
Rasheed, R. A., Kamsin, A., & Abdullah, N. A. (2020). Challenges in the online component of blended learning: A systematic review. Computers & Education, 144, 103701. https://doi.org/10.1016/j.compedu.2019.103701
Resnick, L. B. (2010). Nested learning systems for the thinking curriculum. Educational Researcher, 39(3), 183–197.
Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological Bulletin, 138(2), 353–387. https://doi.org/10.1037/a0026838
Rogers, E. M. (2010). Diffusion of innovations. Simon and Schuster.
Rogers, P. L., Berg, G. A., Boettcher, J. V., Howard, C., Justice, L., & Schenk, K. D. (Eds.). (2009). Encyclopedia of Distance Learning (2nd ed.). IGI Global. https://doi.org/10.4018/978-1-60566-198-8
Rovai, A. (2002). Building sense of community at a distance. International Review of Research in Open and Distance Learning, 16. https://doi.org/10.19173/IRRODL.V3I1.79
Saqr, M., Fors, U., Tedre, M., & Nouri, J. (2018). How social network analysis can be used to monitor online collaborative learning and guide an informed intervention. PLoS One, 13(3), e0194777. https://doi.org/10.1371/journal.pone.0194777
Schumacker, R. E., & Lomax, R. G. (2004). A beginner’s guide to structural equation modeling. Psychology Press.
Sitzmann, T., & Ely, K. (2011). A Meta-analysis of self-regulated Leaming in work-related training and educational attainment: What we know and where we need to go. Psychological Bulletin, 137(3), 421–442. https://doi.org/10.1037/a0022777
Strømsø, H. I., & Bråten, I. (2010). The role of personal epistemology in the self-regulation of internet-based learning. Metacognition and Learning, 5(1), 91–111. https://doi.org/10.1007/s11409-009-9043-7
Sukatiman, A., Siswandari, M., & Roemintoyo. (2020). Enhancing higher-order thinking skills in vocational education through scaffolding-problem based learning. Open Engineering, 10(1), 612–619. https://doi.org/10.1515/eng-2020-0070
Sung, H.-Y., Hwang, G.-J., & Chen, S.-F. (2019). Effects of embedding a problem-posing-based learning guiding strategy into interactive e-books on students’ learning performance and higher order thinking tendency. Interactive Learning Environments, 27(3), 389–401. https://doi.org/10.1080/10494820.2018.1474235
Taylor, M. C., Atas, S., & Ghani, S. (2019). Alternate dimensions of cognitive presence for blended learning in higher education. International Journal of Mobile and Blended Learning, 11(2), 1–18. https://doi.org/10.4018/IJMBL.2019040101
Thai, N. T. T., De Wever, B., & Valcke, M. (2020). Face-to-face, blended, flipped, or online learning environment? Impact on learning performance and student cognitions. Journal of Computer Assisted Learning, 36(3), 397–411. https://doi.org/10.1111/jcal.12423
Tishman, S., Jay, E., & Perkins, D. N. (1993). Teaching thinking dispositions: From transmission to enculturation. Theory Into Practice, 32(3), 147–153. https://doi.org/10.1080/00405849309543590
Tu, C.-H. (2000). On-line learning migration: From social learning theory to social presence theory in a CMC environment. Journal of Network and Computer Applications, 23(1), 27–37. https://doi.org/10.1006/jnca.1999.0099
van Alten, D. C. D., Phielix, C., Janssen, J., & Kester, L. (2020). Effects of self-regulated learning prompts in a flipped history classroom. Computers in Human Behavior, 108, 106318. https://doi.org/10.1016/j.chb.2020.106318
Vilkova, K., & Shcheglova, I. (2021). Deconstructing self-regulated learning in MOOCs: In search of help-seeking mechanisms. Education and Information Technologies, 26(1), 17–33. https://doi.org/10.1007/s10639-020-10244-x
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017). Socio-cognitive scaffolding with computer-supported collaboration scripts: A meta-analysis. Educational Psychology Review, 29(3), 477–511. https://doi.org/10.1007/s10648-016-9361-7
Widana, I. W. (2017). Higher order thinking skills assessment (HOTS). Journal of Indonesian Student Assessment and Evaluation, 3(1), 32–44. https://doi.org/10.21009/JISAE.031.04
Wilson, L. O. (2016). Anderson and Krathwohl–Bloom’s taxonomy revised. Understanding the New Version of Bloom’s Taxonomy. Leslie Owen Wilson.
Winters, F. I., & Azevedo, R. (2005). High-school students’ regulation of learning during computer-based science inquiry. Journal of Educational Computing Research, 33(2), 189–217. https://doi.org/10.2190/F7HM-9JN5-JUX8-4BM9
Wu, D., Xing, D. X., & Lu, C. (2019). The effects of learner factors on higher-order thinking in the smart classroom environment. Journal of Computers in Education, 6(4), 483–498. https://doi.org/10.1007/s40692-019-00146-4
Zimmerman, B. J. (2000). Attaining self-regulation. In Handbook of self-regulation (pp. 13–39). Elsevier. https://doi.org/10.1016/B978-012109890-2/50031-7
Zimmerman, B. J. (2002). Becoming a Self-Regulated Learner: An Overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166–183. https://doi.org/10.3102/0002831207312909
Zimmerman, B. J. (2015). Self-regulated learning: Theories, measures, and outcomes. In International Encyclopedia of the Social & Behavioral Sciences (pp. 541–546). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.26060-1
Zohar, A., & Dori, Y. J. (2003). Higher order thinking skills and low-achieving students: Are they mutually exclusive? The Journal of the Learning Sciences, 12(2), 145–181. https://doi.org/10.1207/S15327809JLS1202_1
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, Y., Liu, L. Learning elements for developing higher-order thinking in a blended learning environment: A comprehensive survey of Chinese vocational high school students. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12572-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-024-12572-8