Abstract
The two main trends in the development of higher education worldwide are universal access and digital transformation. These trends are bringing about an increase in class sizes and the growth of online higher education. Previous studies indicated that both the large-class setting and online delivery threaten the quality, and the exploration of strategies to ensure quality teaching and learning in the large-class setting was in face-to-face or blended learning mode. This study contributes to this topic by exploring the quality of teaching and learning in a new scenario: the fully online large university class. Furthermore, it proposes to use student engagement as a new means to explore the quality of teaching and learning in a large-class setting as it offers evidence on quality from the in-itinere perspective rather than the more commonly ex-post perspective offered by existing studies, collected, for example, from student feedback or course grades. This study was conducted in a mandatory course at an Italian university. Both the Moodle log data and students’ reflective diaries are collected to analyze the presence of students’ behavioral, emotional, and cognitive engagement. Tableau and NVivo handle the quantitative and qualitative data, respectively. By confirming the presence of all three types of engagement, the result indicates quality teaching and learning happens in the fully online large university class. Since we select both “high-grade” and “low-grade” students as representative samples, the Tableau visualization also indicates that only using behavioral engagement to predict students’ academic performance is unreliable.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Abbreviations
- SE:
-
Student engagement
- DOL:
-
Online learning design
- MRDs:
-
Personal meta-reflective diaries
- GPA:
-
General point average
References
Alammary, A., Sheard, J., & Carbone, A. (2014). Blended learning in higher education: Three different design approaches. Australasian Journal of Educational Technology, 30(4). https://doi.org/10.14742/ajet.693
Alpert, W. T., Couch, K. A., & Harmon, O. R. (2016). A randomized assessment of online learning. American Economic Review, 106(5), 378–382. https://doi.org/10.1257/aer.p20161057
Anderson, T. (2008). The theory and practice of online learning. Athabasca University Press.
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives (Complete ed). Longman Retrieved 05 Oct 2020 from http://bvbr.bib-bvb.de:8991/F?func=service&doc_library=BVB01&doc_number=009385460&line_number=0001&func_code=DB_RECORDS&service_type=MEDIA
Anderson, A. R., Christenson, S. L., Sinclair, M. F., & Lehr, C. A. (2004). Check & Connect: The importance of relationships for promoting engagement with school. Journal of school psychology, 42(2), 95–113.
Andresen, M. A. (2009). Asynchronous discussion forums: Success factors, outcomes, assessments, and limitations. Journal of Educational Technology & Society, 12(1), 249–257.
Anstine, J., & Skidmore, M. (2005). A small sample study of traditional and online courses with sample selection adjustment. The Journal of Economic Education, 107–127.
Arvanitakis, J. (2014). Massification and the large lecture theatre: From panic to excitement. Higher Education, 67(6), 735–745. https://doi.org/10.1007/s10734-013-9676-y
Ballen, C. J., Aguillon, S. M., Brunelli, R., Drake, A. G., Wassenberg, D., Weiss, S. L., Zamudio, K. R., & Cotner, S. (2018). Do small classes in higher education reduce performance gaps in STEM? BioScience, 68(8), 593–600. https://doi.org/10.1093/biosci/biy056
Bangurah, F. M. (2004). A study of completion and passing rates between traditional and Web -based instruction at a two - year public community college in northeast Tennessee—ProQuest [East Tennessee State University]. https://www.proquest.com/openview/e911fed744e438734c1e5b4629351989/1?pq-origsite=gscholar&cbl=18750&diss=y
Beattie, I. R., & Thiele, M. (2016). Connecting in class? College class size and inequality in academic social capital. The Journal of Higher Education, 87(3), 332–362.
Bedard, K., & Kuhn, P. (2008). Where class size really matters: Class size and student ratings of instructor effectiveness. Economics of Education Review, 27(3), 253–265. https://doi.org/10.1016/j.econedurev.2006.08.007
Bettinger, E. P., Fox, L., Loeb, S., & Taylor, E. S. (2017). Virtual classrooms: How online college courses affect student success. American Economic Review, 107(9), 2855–2875. https://doi.org/10.1257/aer.20151193
Biggs, J. (1999). What the student does: Teaching for enhanced learning. Higher Education Research & Development, 18(1), 57–75. https://doi.org/10.1080/0729436990180105
Bikowski, D., Park, H. K., & Tytko, T. (2022). Teaching large-enrollment online language courses: Faculty perspectives and an emerging curricular model. System, 105, 102711. https://doi.org/10.1016/j.system.2021.102711
Bloom, B. S. (1980). The new direction in educational research: Alterable variables. The Journal of Negro Education, 49(3), 337–349. https://doi.org/10.2307/2295092
Carbone, E., & Greenberg, J. (1998). Teaching large classes: Unpacking the problem and responding creatively. To Improve the Academy, 17(1), 311–326. https://doi.org/10.1002/j.2334-4822.1998.tb00355.x
Cash, C. B., Letargo, J., Graether, S. P., & Jacobs, S. R. (2017). An analysis of the perceptions and resources of large university classes. CBE—Life Sciences Education, 16(2), ar33. https://doi.org/10.1187/cbe.16-01-0004
Chi, M. T., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/10.1080/00461520.2014.965823
Christenson, S., Reschly, A. L., Wylie, C., & others. (2012). Handbook of research on student engagement 840. Springer.
Coates, H. (2006). Student engagement in campus-based and online education: University connections. Routledge.
Crabtree, L. F. (2000). A comparison of community college student performance, retention, and demographics in online and onground courses [Ed.D., University of Missouri]. https://www.proquest.com/docview/304609935/abstract/11696563523246C5PQ/1
Creswell, J. W. (1999). Mixed-method research: Introduction and application. In Handbook of educational policy (pp. 455–472). Elsevier.
Cuseo, J. (2007). The empirical case against large class size: Adverse effects on the teaching, learning, and retention of first-year students. The Journal of Faculty Development, 21(1), 5–21.
Dewan, M., Murshed, M., & Lin, F. (2019). Engagement detection in online learning: a review. Smart Learning Environments, 6(1), 1–20.
Dewey, J. (1933). How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process. D.C. Heath.
Eberle, T. S. (2014). Phenomenology as a research method. In The SAGE Handbook of Qualitative Data Analysis (pp. 184–202). https://doi.org/10.4135/9781446282243.n13
Edmonson, J., & Muldek, F. (1924). Size of class as a factor in university instruction. The Journal of Educational Research, 9(1), 1–12. https://doi.org/10.1080/00220671.1924.11431606
European Commission. (2013). High Level Group on the Modernisation of Higher Education :report to the European Commission on improving the quality of teaching and learning in Europe’s higher education institutions. Publications Office of the European Union Retrieved 18 Jun 2018, from https://data.europa.eu/doi/10.2766/42468
Exeter, D. J., Ameratunga, S., Ratima, M., Morton, S., Dickson, M., Hsu, D., & Jackson, R. (2010). Student engagement in very large classes: The teachers’ perspective. Studies in Higher Education, 35(7), 761–775. https://doi.org/10.1080/03075070903545058
Farrell, A. M. (2021). Embedding universal design for learning in the large class context: Reflections on practice. In F. Fovet (Ed.), Advances in Educational Technologies and Instructional Design (pp. 365–388) IGI Global. https://doi.org/10.4018/978-1-7998-7106-4.ch019
Farrell, A. M., & Logan, A. (2018). Increasing engagement and participation in a large, third-level class setting using co-teaching. In Proceedings of the 4th International Conference on Higher Education Advances (HEAd’18) (pp. 1–8). https://doi.org/10.4995/HEAD18.2018.8209
Feldman, K. A. (1984). Class size and college students’ evaluations of teachers and courses: A closer look. Research in Higher Education, 21, 45–116. https://doi.org/10.1007/BF00975035
Fendler, R. J., Ruff, C., & Shrikhande, M. (2011). Online versus in-class teaching: Learning levels explain student performance. Journal of Financial Education, 45–63.
Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5–6), 304–317. https://doi.org/10.1504/IJTEL.2012.051816
Figlio, D., Rush, M., & Yin, L. (2013). Is it live or is it internet? Experimental estimates of the effects of online instruction on student learning. Journal of Labor Economics, 31(4), 763–784. https://doi.org/10.1086/669930
Fleiss, J. L., Levin, B., & Paik, M. C. (2003). Statistical Methods for Rates and Proportions (1st ed.). Wiley. https://doi.org/10.1002/0471445428
Flynn, K. (2021). Archives and special collections instruction for large classes. Portal: Libraries and the Academy, 21(3), 573–602. https://doi.org/10.1353/pla.2021.0031
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Gaytan, J., & McEwen, B. C. (2007). Effective online instructional and assessment strategies. American Journal of Distance Education, 21(3), 117–132. https://doi.org/10.1080/08923640701341653
Ghislandi, P. (2012). eLearning—Theories, Design, Software and Applications. InTechOpen. https://doi.org/10.5772/2533
Ghislandi, P., Raffaghelli, J., & Yang, N. (2013). Mediated quality: An approach for the eLearning quality in higher education. International Journal of Digital Literacy and Digital Competence (IJDLDC), 4(1), 56–73. https://doi.org/10.4018/jdldc.2013010106
Gibbs, G. (2014). Control and independence. In Teaching large classes in higher education (pp. 37–62). Routledge.
Grion, V., & Tino, C. (2018). Verso una “valutazione sostenibile” all’università: Percezioni di efficacia dei processi di dare e ricevere feedback fra pari. Lifelong Lifewide Learning, 14(31), 38–55.
Hart, C. M. D., Friedmann, E., & Hill, M. (2018). Online course-taking and student outcomes in California Community Colleges. Education Finance and Policy, 13(1), 42–71. https://doi.org/10.1162/edfp_a_00218
Hattingh, T., Dison, L., & Woollacott, L. (2019). Student learning behaviours around assessments. Australasian Journal of Engineering Education, 24(1), 14–24. https://doi.org/10.1080/22054952.2019.1570641
Heaslip, G., Donovan, P., & Cullen, J. G. (2014). Student response systems and learner engagement in large classes. Active Learning in Higher Education, 15(1), 11–24. https://doi.org/10.1177/1469787413514648
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015). Measuring student engagement in technology-mediated learning: A review. Computers & Education, 90, 36–53. https://doi.org/10.1016/j.compedu.2015.09.005
Herington, C., & Weaven, S. (2008). Action research and reflection on student approaches to learning in large first year university classes. Australian Educational Researcher, 35(3), 111–134. https://doi.org/10.1007/BF03246292
Hornsby, D. J., & Osman, R. (2014). Massification in higher education: Large classes and student learning. Higher Education, 67(6), 711–719. https://doi.org/10.1007/s10734-014-9733-1
Hu, S., & McCormick, A. C. (2012). An engagement-based student typology and its relationship to college outcomes. Research in Higher Education, 53, 738–754. https://doi.org/10.1007/s11162-012-9254-7
Hudelson, E. (1928). Class size at the college level (pp. xxii, 299). Univ. Minnesota Press.
Hung, A. C. Y. (2017). A critique and defense of gamification. Journal of Interactive Online Learning, 15(1).
Huntington-Klein, N., Cowan, J., & Goldhaber, D. (2017). Selection into online community college courses and their effects on persistence. Research in Higher Education, 58(3), 244–269. https://doi.org/10.1007/s11162-016-9425-z
Johnson, I. Y. (2010). Class size and student performance at a public research university: A cross-classified model. Research in Higher Education, 51, 701–723. https://doi.org/10.1007/s11162-010-9179-y
Johnson, H. P., & Mejia, M. C. (2014). Online learning and student outcomes in California’s community colleges. Public Policy Institute Washington, DC.
Junco, R., Heiberger, G., & Loken, E. (2011). The effect of Twitter on college student engagement and grades. Journal of Computer Assisted Learning, 27(2), 119–132. https://doi.org/10.1111/j.1365-2729.2010.00387.x
Karatas, H., Alci, B., & Aydin, H. (2013). Correlation among high school senior students' test anxiety, academic performance and points of university entrance exam. Educational Research and Reviews, 8(13), 919.
Kaupp, R. (2012). Online penalty: The impact of online instruction on the Latino-White achievement gap. Journal of Applied Research in the Community College, 19(2), 3–11.
Kokkelenberg, E. C., Dillon, M., & Christy, S. M. (2008). The effects of class size on student grades at a public university. Economics of Education Review, 27(2), 221–233. https://doi.org/10.1016/j.econedurev.2006.09.011
Kuh, G. D. (2009). The national survey of student engagement: Conceptual and empirical foundations. New Directions for Institutional Research, 141, 5–20. Retrieved 25 Aug 2021, from https://doi.org/10.1002/ir.283
Kuh, G. D. (2001). The National Survey of Student Engagement: Conceptual framework and overview of psychometric properties. Indiana University Center for Postsecondary Research. https://scholarworks.iu.edu/dspace/handle/2022/24268
Laurillard, D. (2012). Teaching as a Design Science: Building Pedagogical Patterns for Learning and Technology. Taylor & Francis http://public.ebookcentral.proquest.com/choice/publicfullrecord.aspx?p=957058
Lee, L. W., Lee, N., & King, G. (2022). Distance learning at the conventional campus-based college: Online instruction as an alternative during the pandemic. International Journal for Innovation Education and Research, 10(12), 287–300. https://doi.org/10.31686/ijier.vol10.iss12.4037
Lewis, S. E., & Lewis, J. E. (2008). Seeking effectiveness and equity in a large college chemistry course: An HLM investigation of Peer-Led Guided Inquiry. Journal of Research in Science Teaching, 45(7), 794–811. https://doi.org/10.1002/tea.20254
Lipnevich, A. A., & Smith, J. K. (2009). Effects of differential feedback on students’ examination performance. Journal of Experimental Psychology: Applied, 15(4), 319. https://doi.org/10.1037/a0017841
Lu, G., Xie, K., & Liu, Q. (2022). What influences student situational engagement in smart classrooms: Perception of the learning environment and students’ motivation. British Journal of Educational Technology, 53(6), 1665–1687. https://doi.org/10.1111/bjet.13204
Lund Dean, K., & Wright, S. (2017). Embedding engaged learning in high enrollment lecture-based classes. Higher Education, 74, 651–668. https://doi.org/10.1007/s10734-016-0070-4
Lynch, R. P., & Pappas, E. (2017). A model for teaching large classes: Facilitating a “small class feel”. International Journal of Higher Education, 6(2), Article 2. https://doi.org/10.5430/ijhe.v6n2p199
Maringe, F., & Sing, N. (2014). Teaching large classes in an increasingly internationalising higher education environment: Pedagogical, quality and equity issues. Higher Education, 67(6), 761–782. https://doi.org/10.1007/s10734-013-9710-0
Matta, B. N., Guzman, J. M., Stockly, S. K., & Widner, B. (2015). Class size effects on student performance in a Hispanic-serving institution. The Review of Black Political Economy, 42(4), 443–457. https://doi.org/10.1007/s12114-015-9214-5
Mayer, R. E. (2002). Rote versus meaningful learning. Theory into Practice, 41(4), 226–232. https://doi.org/10.1207/s15430421tip4104_4
Mezirow, J. (1990). Fostering Critical Reflection in Adulthood: A Guide to Transformative and Emancipatory Learning. Wiley.
Millea, M., Wills, R., Elder, A., & Molina, D. (2018). What matters in college student success? Determinants of college retention and graduation rates. Education, 138(4), 309–322.
Mulryan-Kyne, C. (2010). Teaching large classes at college and university level: Challenges and opportunities. Teaching in Higher Education, 15(2), 175–185. https://doi.org/10.1080/13562511003620001
Nagel, L., & Kotze, T. G. (2010). Supersizing e-learning: What a CoI survey reveals about teaching presence in a large online class. Internet and Higher Education, 13(1–2), 45–51. https://doi.org/10.1016/j.iheduc.2009.12.001
Newmann, F. M. (1992). Student engagement and achievement in American secondary schools. Teachers College Press.
Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122. https://doi.org/10.1080/02602938.2013.795518
Nystrand, M., & Gamoran, A. (1989). Instructional discourse and student engagement. National Center on Effective Secondary Schools; Office of Educational Research and Improvement. U.S. Dept. of Education Retrieved 30 Jan 2019, from http://eric.ed.gov/?id=ED319780
Ojha, M., & Rahman, M. A. (2020). Do Online Courses Provide an Equal Educational Value Compared to In-Person Classroom Teaching? Evidence from US Survey Data using Quantile Regression (arXiv:2007.06994). arXiv. http://arxiv.org/abs/2007.06994
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42, 533–544. https://doi.org/10.1007/s10488-013-0528-y
Pamphlett, R., & Farnill, D. (1995). Effect of anxiety on performance in multiple choice examination. Medical Education, 29(4), 297–302. https://doi.org/10.1111/j.1365-2923.1995.tb02852.x
Pham, T., Beloncle, F., Piquilloud, L., Ehrmann, S., Roux, D., Mekontso-Dessap, A., & Carteaux, G. (2021). Assessment of a massive open online course (MOOC) incorporating interactive simulation videos on residents’ knowledge retention regarding mechanical ventilation. BMC Medical Education, 21(1), 1–11. https://doi.org/10.1186/s12909-021-03025-8
Prosser, M., & Trigwell, K. (2014). Qualitative variation in approaches to university teaching and learning in large first-year classes. Higher Education, 67(6), 783–795. https://doi.org/10.1007/s10734-013-9690-0
Raimondo, H. J., Esposito, L., & Gershenberg, I. (1990). Introductory class size and student performance in intermediate theory courses. The Journal of Economic Education, 21(4), 369–382.
Ramsden, P. (2003). Learning to teach in higher education. Routledge.
Rissanen, A. (2018). Student engagement in large classroom: The effect on grades, attendance and student experiences in an undergraduate biology course. Canadian Journal of Science, Mathematics and Technology Education, 18, 136–153. https://doi.org/10.1007/s42330-018-0015-2
Ritz, E.; Wambsganss, T.; Rietsche, R.; Schmitt, A.; Oeste-Reiß, S.; Leimeister, J. M. (2022): Unleashing Process Mining for Education: Designing an IT-Tool for Students to Self-Monitor their Personal Learning Paths. Internationale Tagung Wirtschaftsinformatik (WI). Nuremberg, Germany Retrieved March 6, 2023, from https://www.alexandria.unisg.ch/server/api/core/bitstreams/44a62249-28f8-4f24-8f60-43d59a286b25/content
Roughton, D. M. (2018). The Relationship Between Course Delivery Mode and Location with Course Success for Dual Enrolled Students. Doctoral Dissertation, Old Dominion University. Retrieved 30 Jul 2021, from https://digitalcommons.odu.edu/efl_etds/56
Schlechty, P. C. (2002). Working on the work: An action plan for teachers, principals, and superintendents. The jossey-bass education series. .
Schlechty, P. C. (2011). Engaging students: The next level of working on the work. John Wiley & Sons.
Schumacher, C., & Ifenthaler, D. (2018). Features students really expect from learning analytics. Computers in Human Behavior, 78, 397–407. https://doi.org/10.1016/j.chb.2017.06.030
Skinner, B. T. (2017). Virtually the same: Using Bayesian methods to investigate the relationships between online course delivery and postsecondary student enrollment, course outcomes, and degree attainment. Vanderbilt University.
Snowball, J. D. (2014). Using interactive content and online activities to accommodate diversity in a large first year class. Higher Education, 67(6), 823–838. https://doi.org/10.1007/s10734-013-9708-7
Sublett, C. (2019). What do we know about online coursetaking, persistence, transfer, and degree completion among community college students? Community College Journal of Research and Practice, 43(12), 813–828. https://doi.org/10.1080/10668926.2018.1530620
Sümer, Ö., Goldberg, P., D’Mello, S., Gerjets, P., Trautwein, U., & Kasneci, E. (2021). Multimodal engagement analysis from facial videos in the classroom. IEEE Transactions on Affective Computing. https://doi.org/10.1109/TAFFC.2021.3127692
Taft, S. H., Kesten, K., & El-Banna, M. M. (2019). One size does not fit all: Toward an evidence-based framework for determining online course enrollment sizes in higher education. Online Learning, 23(3). https://doi.org/10.24059/olj.v23i3.1534
Taylor, J. C. (2001). Fifth generation distance education. Instructional Science and Technology, 4(1), 1–14.
Tobin, K. (1984). Student engagement in science learning-tasks. European Journal of Science Education, 6(4), 339–347. https://doi.org/10.1080/0140528840060404
Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276. https://doi.org/10.3102/00346543068003249
UNESCO. (2020). Towards universal access to higher education: International trends. Retrieved 07 Apr 2021, from https://unesdoc.unesco.org/ark:/48223/pf0000375686
Vytasek, J. M., Patzak, A., & Winne, P. H. (2020). Analytics for student engagement. Machine Learning Paradigms: Advances in Learning Analytics, 23–48. https://doi.org/10.1007/978-3-030-13743-4_3
Ward, A., & Jenkins, A. (2014). The problems of learning and teaching in large classes. Teaching Large Classes in Higher Education, 23–36.
Westerlund, J. (2008). Class size and student evaluations in Sweden. Education Economics, 16(1), 19–28. https://doi.org/10.1080/09645290701419532
White, K. W. (1999). The online teaching guide: A handbook of attitudes, strategies, and techniques for the virtual classroom. Allyn & Bacon, Inc.
Xu, D., & Jaggars, S. S. (2013). The impact of online learning on students’ course outcomes: Evidence from a large community and technical college system. Economics of Education Review, 37, 46–57. https://doi.org/10.1016/j.econedurev.2013.08.001
Yang, N. (2020). eLearning for Quality Teaching in Higher Education: Teachers’ Perception, Practice, and Interventions. Springer Singapore. https://doi.org/10.1007/978-981-15-4401-9
Yang, N., Ghislandi, P., & Dellantonio, S. (2018). Online collaboration in a large university class supports quality teaching. Educational Technology Research and Development, 66, 671–691. https://doi.org/10.1007/s11423-017-9564-8
Acknowledgements
We would like to thank Mr. Adrian Belton for proofreading.
Funding
This work was supported by Beijing Municipal Social Science Foundation, Beijing, China (20JYC017), and the University of Trento, Trento, Italy (40600132).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yang, N., Ghislandi, P. Quality teaching and learning in a fully online large university class: a mixed methods study on students’ behavioral, emotional, and cognitive engagement. High Educ (2024). https://doi.org/10.1007/s10734-023-01173-y
Accepted:
Published:
DOI: https://doi.org/10.1007/s10734-023-01173-y