Tracking the Evolution of the Knowledge Base on Problem-based Learning: A Bibliometric Review, 1972-2019

Main Article Content

Philip Hallinger
https://orcid.org/0000-0002-5935-7544

Abstract




The current review employed bibliometric review methods to analyze 14,130 Scopus-indexed documents on problem-based learning published from 1972 through the end of 2019. The goals of the review were to describe the landscape and analyze the evolution of topical foci of interdisciplinary research on PBL over the past five decades. The review identified the accumulation of a substantial interdisciplinary corpus of research on PBL that is significantly larger than the literature on other approaches to active learning. The growth trajectory of the literature on PBL started out “low and flat” during the 1970s and 1980s but steadily gained momentum in subsequent decades, with 58% of the PBL literature published between 2010 and 2019. PBL has achieved an impressive scope of global research over the past 45 years, with a significant number of studies published from emerging regions of the world, especially during the past decade. While a long-term body of research has accumulated on the learning outcomes of PBL, the research front has begun to shift towards the study of self-directed learning, student satisfaction, self-efficacy, critical thinking, and cooperation. Research and practice challenges identified in the review focus on establishing the scope of use and efficacy of PBL across different cultural contexts and more systematically summarizing and synthesizing the use of PBL outside of the health professions.




Article Details

Section
Articles

References

Albanese, M. (2000). Problem‐based learning: Why curricula are likely to show little effect on knowledge and clinical skills. Medical Education, 34(9), 729-738.
Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68(1), 52-81.
Al-Eraky, M. (2013). The cultural flavours of problem-based learning. Medical Education, 47(10), 1049.
Alrahlah, A. (2016). How effective the problem-based learning (PBL) in dental education. A critical review. The Saudi Dental Journal, 28(4), 155-161.
Azer, S. A. (2017). Top-cited articles in problem-based learning: A bibliometric analysis and quality of evidence assessment. Journal of Dental Education, 81(4), 458-478.
Baker, C. M. (2000). Problem-based learning for nursing: Integrating lessons from other disciplines with nursing experiences. Journal of Professional Nursing, 16(5), 258-266.
Balslev, T., De Grave, W. S., Muijtjens, A. M., & Scherpbier, A. J. J. A. (2005). Comparison of text and video cases in a postgraduate problem‐based learning format. Medical Education, 39(11), 1086-1092.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Macmillan.
Barnes, L. B., Barnes, L. B., Barnes, L. B., Christensen, C. R., Hansen, A. J., & Hansen, T. L. (1994). Teaching and the case method: Text, cases, and readings. Cambridge, MA: Harvard Business Press.
Barrows, H. S. (1986). A taxonomy of problem‐based learning methods. Medical Education, 20(6), 481-486.
Barrows, H. S. (1985). How to design a problem-based curriculum for the preclinical years (Vol. 8). New York: Springer.
Barrows, H. S., & Tamblyn, R. M. (1980). Problem-based learning: An approach to medical education. New York: Springer.
Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House, 83(2), 39-43.
Biggs, J. B. (2011). Teaching for quality learning at university: What the student does. London: McGraw-Hill Education (UK).
Bishop, J. L., & Verleger, M. A. (2013, June). The flipped classroom: A survey of the research. In ASEE National Conference Proceedings, Atlanta, GA (Vol. 30, No. 9, pp. 1-18).
Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991). Motivating project-based learning: Sustaining the doing, supporting the learning. Educational Psychologist, 26(3-4), 369-398.
Bok, D. (1989). Needed: A new way to train doctors. In H. Schmidt, M. Lipkin, M. de Vrie, & J. Greep (Eds.), New directions for medical education (pp. 17-38). New York: Springer.
Boud, D., & Felletti, G. (Eds.; 1997). The challenge of problem-based learning. London: Kogan Page.
Bransford, J. D. (1993). Who ya gonna call? Thoughts about teaching problem solving. In P. Hallinger, K. Leithwood & J. Murphy (Eds.), Cognitive perspectives on educational leadership (pp. 171-191). New York: Teachers College Press.
Bridges, E. M., & Hallinger, P. (1995). Implementing problem based learning in leadership development. Eugene, OR: ERIC Clearinghouse on Educational Management.
Bridges, E. M., & Hallinger, P. (1991). Problem-based learning in medical and managerial education. In P. Hallinger, K. Leithwood, & J. Murphy (Eds.), Cognitive perspectives on educational leadership. New York: Teachers College Press.
Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32-42.
Carvalho, A. (2016). The impact of PBL on transferable skills development in management education. Innovations in Education and Teaching International, 53(1), 35-47.
Cisneros, R. M., Salisbury-Glennon, J. D., & Anderson-Harper, H. M. (2002). Status of problem-based learning research in pharmacy education: A call for future research. American Journal of Pharmaceutical Education, 66(1), 19-26.
Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: Research and theory. Academic Medicine, 75(3), 259-266.
De Graaf, E., & Kolmos, A. (2003). Characteristics of problem-based learning. International Journal of Engineering Education, 19(5), 657-662.
De Grave, W. S., Dolmans, D. H., & Van Der Vleuten, C. P. (1999). Profiles of effective tutors in problem‐based learning: Scaffolding student learning. Medical Education, 33(12), 901-906.
Dewey, J. (1986, September). Experience and education. The Educational Forum, 50(3), 241-252).
Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: A meta-analysis. Learning and Instruction, 13(5), 533-568.
Dolmans, D. H., De Grave, W., Wolfhagen, I. H., & Van Der Vleuten, C. P. (2005). Problem‐based learning: Future challenges for educational practice and research. Medical Education, 39(7), 732-741.
Dolmans, D. H., Snellen-Balendong, H., & van der Vleuten, C. P. (1997). Seven principles of effective case design for a problem-based curriculum. Medical Teacher, 19(3), 185-189.
Dym, C. L., Agogino, A. M., Eris, O., Frey, D. D., & Leifer, L. J. (2005). Engineering design thinking, teaching, and learning. Journal of Engineering Education, 94(1), 103-120.
Ertmer, P. A., & Simons, K. D. (2006). Jumping the PBL implementation hurdle: Supporting the efforts of K-12 teachers. Interdisciplinary Journal of Problem-based learning, 1(1), 5-14.
Frambach, J. M., Driessen, E. W., Beh, P., & Van der Vleuten, C. P. (2014). Quiet or questioning? Students' discussion behaviors in student-centered education across cultures. Studies in Higher Education, 39(6), 1001-1021.
Frambach, J. M., Driessen, E. W., Chan, L. C., & van der Vleuten, C. P. (2012). Rethinking the globalisation of problem‐based learning: how culture challenges self‐directed learning. Medical Education, 46(8), 738-747.
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410-8415.
Gandhi, S., & Dass, D. P. (2019). A study to evaluate the effectiveness of problem based learning (PBL) module on knowledge and attitude among nursing students. International Journal of Nursing Education, 11(3).
Geitz, G., Joosten-ten Brinke, D., & Kirschner, P. A. (2016). Changing learning behaviour: Self-efficacy and goal orientation in PBL groups in higher education. International Journal of Educational Research, 75, 146-158.
Gijbels, D., Dochy, F., Van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27-61.
Guerra, A. (2017). Integration of sustainability in engineering education: Why is PBL an answer? International Journal of Sustainability in Higher Education, 18(3), 436-454.
Hallinger, P., & Bridges, E. M. (2007). A problem-based approach for management education: Preparing managers for action. Dordrecht, Netherlands: Springer Science & Business Media.
Hallinger, P., & Bridges, E. M. (2017). A systematic review of research on the use of problem-based learning in the preparation and development of school leaders. Educational Administration Quarterly, 53(2), 255-288.
Hallinger, P., & Kovačević, J. (2019). A bibliometric review of research on educational administration: Science mapping the literature, 1960 to 2018. Review of Educational Research, 89(3), 335-369.
Hallinger, P., & Lu, J. (2011). Implementing problem-based learning in higher education in Asia: Challenges, strategies and effect. Journal of Higher Education Policy and Management, 33(3), 267-285.
Hallinger, P., & Lu, J. (2012). Overcoming the Walmart syndrome: Adapting problem-based management education in East Asia. Interdisciplinary Journal of Problem-Based Learning, 6(1), 4.
Hallinger, P., & Wang, R. (2019). The evolution of simulation-based learning across the disciplines, 1965–2018: A science map of the literature. Simulation & Gaming, 1046878119888246.
Harzing, A.W. & Alakangas, S. (2016). Google Scholar, Scopus and the Web of Science: A longitudinal and cross-disciplinary comparison, Scientometrics, 106(2), 787-804.
Hmelo-Silver, C.E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235-266
Hmelo-Silver, C.E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark. Educational Psychologist, 42(2), 99-107.
Hmelo-Silver, C. E., & Eberbach, C. (2012). Learning theories and problem-based learning. In D. Evensen & C. Hmelo-Silver (Eds.), Problem-based learning in clinical education (pp. 3-17). Springer: Dordrecht.
Jippes, M., & Majoor, G. D. (2008). Influence of national culture on the adoption of integrated and problem‐based curricula in Europe. Medical Education, 42(3), 279-285.
Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work. Theory into Practice, 38(2), 67-73.
Kang, K. A., Kim, S., Kim, S. J., Oh, J., & Lee, M. (2015). Comparison of knowledge, confidence in skill performance (CSP) and satisfaction in problem-based learning (PBL) and simulation with PBL educational modalities in caring for children with bronchiolitis. Nurse Education Today, 35(2), 315-321.
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75-86.
Koh, G. C. H., Khoo, H. E., Wong, M. L., & Koh, D. (2008). The effects of problem-based learning during medical school on physician competency: A systematic review. CMAJ, 178(1), 34-41.
Kolb, D. A. (1984). Experience as the source of learning and development. Upper Saddle River: Prentice Hall.
Kolodner, J. L., Camp, P. J., Crismond, D., Fasse, B., Gray, J., Holbrook, J., ... & Ryan, M. (2003). Problem-based learning meets case-based reasoning in the middle-school science classroom: Putting learning by design (tm) into practice. The Journal of the Learning Sciences, 12(4), 495-547.
Lave, J., & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press.
Maitland, B. (1997). Problem-based learning for architecture and construction management. In D. Boud & G. Felletti (Eds.), The challenge of problem-based learning (pp. 211-217). London: Kogan Page.
Maudsley, G. (1999). Do we all mean the same thing by" problem-based learning"? A review of the concepts and a formulation of the ground rules. Academic Medicine: Journal of the Association of American Medical Colleges, 74(2), 178-185.
Mayer, R. E. (2004). Should there be a three-strikes rule against pure discovery learning? American Psychologist, 59(1), 14.
Mills, J. E., & Treagust, D. F. (2003). Engineering education—Is problem-based or project-based learning the answer. Australasian Journal of Engineering Education, 3(2), 2-16.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264-269.
Mongeon, P., & Paul-Hus, A. (2016). The journal coverage of Web of Science and Scopus: A comparative analysis. Scientometrics, 106(1), 213-228.
Nerur, S. P., Rasheed, A. A., & Natarajan, V. (2008). The intellectual structure of the strategic management field: An author co‐citation analysis. Strategic Management Journal, 29(3), 319-336.
Neufeld, V. R., & Barrows, H. S. (1974). The “McMaster Philosophy”: an approach to medical education. Academic Medicine, 49(11), 1040-50.
Neville, A. J. (2009). Problem-based learning and medical education forty years on. Medical Principles and Practice, 18(1), 1-9.
Norman, G. R., & Schmidt, H. G. (2000). Effectiveness of problem‐based learning curricula: Theory, practice and paper darts. Medical Education, 34(9), 721-728.
Norman, G. T., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine, 67(9), 557-565.
Oliveira, L. B. D., Díaz, L. J. R., Carbogim, F. D. C., Rodrigues, A. R. B., & Püschel, V. A. D. A. (2016). Effectiveness of teaching strategies on the development of critical thinking in undergraduate nursing students: a meta-analysis. Revista da Escola de Enfermagem da USP, 50(2), 355-364.
Pinho, L. A. D., Mota, F. B., Conde, M. V. F., Alves, L. A., & Lopes, R. M. (2015). Mapping knowledge produced on problem-based learning between 1945 and 2014: A bibliometric analysis. Creative Education, 6, 576-584.
Price, D.D.S. (1965). Networks of scientific papers. Science, 149(3683), 510-515.
Prince, K. J., Van Mameren, H., Hylkema, N., Drukker, J., Scherpbier, A. J., & Van Der Vleuten, C. P. (2003). Does problem‐based learning lead to deficiencies in basic science knowledge? An empirical case on anatomy. Medical Education, 37(1), 15-21.
Prince, K. J., Van Eijs, P. W., Boshuizen, H. P., Van Der Vleuten, C. P., & Scherpbier, A. J. (2005). General competencies of problem‐based learning (PBL) and non‐PBL graduates. Medical Education, 39(4), 394-401.
Prince, M. (2004). Does active learning work? A review of the research. Journal of Engineering Education, 93(3), 223-231.
Prince, M. J., & Felder, R. M. (2006). Inductive teaching and learning methods: Definitions, comparisons, and research bases. Journal of Engineering Education, 95(2), 123-138.
Puntambekar, S., & Hubscher, R. (2005). Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed? Educational Psychologist, 40(1), 1-12.
Savery, J. R. (2006). Overview of problem-based learning: Definition and distinctions. Interdisciplinary Journal of Problem-Based Learning, 1(1), 9-20.
Savery, J. R., & Duffy, T. M. (1995). Problem based learning: An instructional model and its constructivist framework. Educational Technology, 35(5), 31-38.
Schmidt, H. G. (1993). Foundations of problem‐based learning: Some explanatory notes. Medical Education, 27(5), 422-432.
Schmidt, H. G. (1983). Problem‐based learning: Rationale and description. Medical Education, 17(1), 11-16.
Slavin, R. E. (2011). Instruction based on cooperative learning. In R. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (pp. 358-374). London: Routledge.
Small, H. (1973). Co‐citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for information Science, 24(4), 265-269.
Smalheiser, N. R., & Torvik, V. I. (2009). Author name disambiguation. Annual Review of Information Science and Technology, 43(1), 1–43.
Smith, K. A., Sheppard, S. D., Johnson, D. W., & Johnson, R. T. (2005). Pedagogies of engagement: Classroom‐based practices. Journal of Engineering Education, 94(1), 87-101.
Strobel, J., & Van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-based Learning, 3(1), 4.
Ungaretti, T., Thompson, K. R., Miller, A., & Peterson, T. O. (2015). Problem-based learning: Lessons from medical education and challenges for management education. Academy of Management Learning & Education, 14(2), 173-186.
Van der Vleuten, C., Verwijnen, G. M., & Wijnen, W. H. F. W. (1996). Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher, 18(2), 103-109.
Van Eck, N. J., & Waltman, L. (2014). Visualizing bibliometric networks. In Y. Ding, R. Rousseau, & D. Wolfram (Eds), Measuring scholarly impact (pp. 285-320). Springer, Cham.
van Eck, N. J., & Waltman, L. (2013). VOSviewer manual. Leiden: Univeristeit Leiden, 1(1).
Verhoeven, H., Verwijnen, A., Scherpbier, R., Holdrinet b. Oeseburg, J., Bulte, C., & van der vleuten, B. (1998). An analysis of progress test results of PBL and non-PBL students. Medical Teacher, 20(4), 310-316.
Vernon, D. T., & Blake, R. L. (1993). Does problem-based learning work? A meta-analysis of evaluative research. Academic Medicine, 68(7), 550-63.
Vygotsky, L. S. (1980). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
Walker, A., Bridges, E., & Chan, B. (1996). Wisdom gained, wisdom given: instituting PBL in a Chinese culture. Journal of Educational Administration, 34(5), 12-31.
Walker, A., & Leary, H. (2009). A problem based learning meta-analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem-based Learning, 3(1), 6-19.
Walton, H. J., & Matthews, M. B. (1989). Essentials of problem‐based learning. Medical Education, 23(6), 542-558.
White, H. D., & McCain, K. W. (1998). Visualizing a discipline: An author co‐citation analysis of information science, 1972–1995. Journal of the American society for information science, 49(4), 327-355.
Xian, H., & Madhavan, K. (2013). Building on and honoring forty years of PBL scholarship from Howard Barrows: A scientometric, large-scale data, and visualization-based analysis. Interdisciplinary Journal of Problem-Based Learning, 7(1), 10-28.
Zhou, J., Zhou, S., Huang, C., Xu, R., Zhang, Z., Zeng, S., & Qian, G. (2016). Effectiveness of problem-based learning in Chinese pharmacy education: A meta-analysis. BMC medical education, 16(1), 23.
Zupic, I., & Čater, T. (2015). Bibliometric methods in management and organization. Organizational Research Methods, 18(3), 429-472.