Skip to main content
SpringerLink
Log in

Design criticism and eye movement strategy in reading: a comparative study of design and non-design students

  • Published:
International Journal of Technology and Design Education Aims and scope Submit manuscript

Abstract

Design criticism plays a crucial role in fostering critical thinking and boosting creativity among design students, highlighting its significance in college design education. Engaging with design-related critical materials is a prevalent approach to strengthen design criticism. This study aims to investigate the eye movement strategies employed by both design and non-design students when reading critical materials, aiming to discern their impact on design criticism. A total of 26 product design students (male = 16, female = 10) and 26 non-design students (male = 11, female = 15) participated in the study. The participants wore eye trackers and read two design proposals with critical viewpoints, followed by a critical report for each proposal. Additionally, they completed the Design Criticism Scale. The study compared differences between design and non-design students, explored correlations among various factors, and conducted a lag sequential analysis of eye movement behaviors. Design students outperformed non-design students in personal insights and self-evaluation of design criticism. Compared to non-design students, design students exhibited a higher focus on the images during reading, as evidenced by more fixations shifting from other regions to the images. The degree of attention to images was positively correlated with personal insights. Design students’ design criticism skills were positively correlated with the recall of perspectives, whereas non-design students’ design criticism skills were positively associated with personal insights. The focus on images played a pivotal role in the formation of critical thinking. Additionally, the study offers recommendations for enhancing university design education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

References

  • Ahmed, M. A., & Said, E. A. (2014). The Effect of Using a Web Quest Program on Developing Some EFL Critical Reading Process Writing Skills and Decreasing Writing Apprehension of the First Year Experimental Secondary School Students. Arab World English Journal, 5(1), 197–210.

    Google Scholar 

  • Babic, D., Dijanic, H., Jakob, L., Babic, D., & Garcia-Garzon, E. (2020). Driver Eye Movements in Relation to Unfamiliar Traffic Signs: An Eye Tracking Study. Applied Ergonomics, 89(November), 103191. https://doi.org/10.1016/j.apergo.2020.103191

    Article  Google Scholar 

  • Barry, A., Parvan, K., Sarbakhsh, P., Safa, B., & Allahbakhshian, A. (2020). Critical Thinking in Nursing Students and Its Relationship with Professional Self-Concept and Relevant Factors. Research and Development in Medical Education, 9(1), 7–7. https://doi.org/10.34172/rdme.2020.007

    Article  Google Scholar 

  • Blackler, A. 2001. “Teaching Industrial Design Criticism.” In Proceedings of the ICSID Educational Seminar 2001 Seongnam, 96–103. Seoul, Korea: Seongnam City, Korea. https://eprints.qut.edu.au/1830/. Accessed 30 Oct 2022

  • Bråten, I., & Braasch, J. L. 2017. “Key Issues in Research on Students’ Critical Reading and Learning in the 21st Century Information Society.” In Improving Reading and Reading Engagement in the 21st Century: International Research and Innovation, edited by Clarence Ng and Brendan Bartlett, 77–98. Singapore: Springer. https://doi.org/10.1007/978-981-10-4331-4_4.

  • Burbach, M. E., Matkin, G. S., & Fritz, S. M. (2004). Teaching Critical Thinking in an Introductory Leadership Course Utilizing Active Learning Strategies: A Confirmatory Study. College Student Journal, 38(3), 482.

    Google Scholar 

  • Butler, H. A., Pentoney, C., & Bong, M. P. (2017). Predicting Real-World Outcomes: Critical Thinking Ability Is a Better Predictor of Life Decisions than Intelligence. Thinking Skills and Creativity, 25(September), 38–46. https://doi.org/10.1016/j.tsc.2017.06.005

    Article  Google Scholar 

  • Carter, B. T., & Luke, S. G. (2020). Best Practices in Eye Tracking Research. International Journal of Psychophysiology, 155(September), 49–62. https://doi.org/10.1016/j.ijpsycho.2020.05.010

    Article  Google Scholar 

  • Chen, B. (2016). Research on Teaching Methods Based on Creative Thinking Ability Cultivation: Taking Design Thinking Course as an Example. Northwest Fine Arts: Journal of Xi’an Academy of Fine Arts, 0(4), 41–43.

    Google Scholar 

  • Chen, C. H., Occena, L. G., & Fok, S. C. (2001). CONDENSE: A Concurrent Design Evaluation System for Product Design. International Journal of Production Research, 39(3), 413–433. https://doi.org/10.1080/00207540010002397

    Article  Google Scholar 

  • Conti, A. (2020). Why Are Designers Not Comfortable in Talking About Their Design Process? Exploration of Students’ Perception of Their Design Experience. In Bo-Ricerche E Progetti per Il Territorio La Citta E L Architettura, 11, 84–90. https://doi.org/10.6092/issn.2036-1602/9977

    Article  Google Scholar 

  • Cristino, F., Mathôt, S., Theeuwes, J., & Gilchrist, I. D. (2010). ScanMatch: A Novel Method for Comparing Fixation Sequences. Behavior Research Methods, 42(3), 692–700. https://doi.org/10.3758/BRM.42.3.692

    Article  Google Scholar 

  • Crosby, A., Kane Pham, J., Peterson, F., & Lee, T. (2020). Digital Work Practices: Affordances in Design Education. International Journal of Art & Design Education, 39(1), 22–37. https://doi.org/10.1111/jade.12231

    Article  Google Scholar 

  • Doppelt, Y. (2009). Assessing Creative Thinking in Design-Based Learning. International Journal of Technology and Design Education, 19(1), 55–65. https://doi.org/10.1007/s10798-006-9008-y

    Article  Google Scholar 

  • Durugbo, C. M. (2021). Eye Tracking for Work-Related Visual Search: A Cognitive Task Analysis. Ergonomics, 64(2), 225–240. https://doi.org/10.1080/00140139.2020.1822547

    Article  Google Scholar 

  • Fan, Y., Xue, S., & Yutong, Yi. (2020). An eye movement study for the guidance mechanism of long-distance regressions in Chinese reading. Acta Psychologica Sinica, 52(8), 921–932. https://doi.org/10.3724/SP.J.1041.2020.00921

    Article  Google Scholar 

  • Faraone, S. V., & Dorfman, D. D. (1987). Lag Sequential Analysis: Robust Statistical Methods. Psychological Bulletin, 101, 312–323. https://doi.org/10.1037/0033-2909.101.2.312

    Article  Google Scholar 

  • Folk, J. R., & Eskenazi, M. A. (2018). Eye-Tracking to Distinguish Comprehension-Based and Oculomotor-Based Regressive Eye Movements During Reading. Jove-Journal of Visualized Experiments, 140(October), e58442. https://doi.org/10.3791/58442

    Article  Google Scholar 

  • Ghanizadeh, A. (2017). The Interplay between Reflective Thinking, Critical Thinking, Self-Monitoring, and Academic Achievement in Higher Education. Higher Education, 74(1), 101–114. https://doi.org/10.1007/s10734-016-0031-y

    Article  Google Scholar 

  • Glucksberg, S. (2003). The Psycholinguistics of Metaphor. Trends in Cognitive Sciences, 7(2), 92–96. https://doi.org/10.1016/s1364-6613(02)00040-2

    Article  Google Scholar 

  • Gray, C. M. (2019). Democratizing Assessment Practices through Multimodal Critique in the Design Classroom. International Journal of Technology and Design Education, 29(4), 929–946. https://doi.org/10.1007/s10798-018-9471-2

    Article  Google Scholar 

  • Guerard, K., Saint-Aubin, J., Maltais, M., & Lavoie, H. (2014). The Role of Verbal Memory in Regressions during Reading Is Modulated by the Target Word’s Recency in Memory. Memory & Cognition, 42(7), 1155–1170. https://doi.org/10.3758/s13421-014-0424-z

    Article  Google Scholar 

  • Gumbo, Mishack T. 2017. “Alternative Knowledge Systems.” In Critique in Design and Technology Education, edited by P John Williams and Kay Stables, 87–105. Contemporary Issues in Technology Education. Singapore: Springer. https://doi.org/10.1007/978-981-10-3106-9_6.

  • Guo, F., J. Chen, M. Li, L. Wei, and J. Zhang. 2021. “Effects of Visual Complexity on User Search Behavior and Satisfaction: An Eye-Tracking Study of Mobile News Apps.” Universal Access in the Information Society, no. 3. https://doi.org/10.1007/s10209-021-00815-1.

  • Hafner, L. E. (1974). Improving Reading in Middle and Secondary Schools: Selected Readings (2d ed.). Macmillan.

    Google Scholar 

  • Hao, Q., Sbert, M., & Ma, L. (2019). Gaze Information Channel in Cognitive Comprehension of Poster Reading. Entropy, 21(5), 444. https://doi.org/10.3390/e21050444

    Article  Google Scholar 

  • Hoppe, D., and C. A. Rothkopf. 2019. “Multi-Step Planning of Eye Movements in Visual Search.” Scientific Reports 9(1). https://doi.org/10.1038/s41598-018-37536-0.

  • Hu, Zhigang, Suihuai Yu, Xianling Qiao, and Qing Zhang. 2011. “The Analysis of Design Criticism in View of Industrial Design.” In 2011 Ieee 12th International Conference on Computer-Aided Industrial Design & Conceptual Design, Vols 1 and 2: New Engines for Industrial Design: Intelligence - Interaction - Services, edited by Y. H. Pan, S. Q. Sun, M. Q. Zhou, F. H. Pan, Z. K. Lin, and Z. Y. Hu, 1034-+. New York: Ieee. https://www.webofscience.com/wos/woscc/full-record/WOS:000309378300264. Accessed 5 Jan 2023.

  • Hwang, A.D., E.C. Higgins, and M. Pomplun. 2009. “A Model of Top-down Attentional Control during Visual Search in Complex Scenes.” Journal of Vision 9(5). https://doi.org/10.1167/9.5.25.

  • Hyona, Jukka, and Johanna K. Kaakinen. 2019. “Eye Movements During Reading.” In Eye Movement Research: An Introduction to Its Scientific Foundations and Applications, edited by C. Klein and U. Ettinger, 239–74. Cham: Springer International Publishing Ag. https://doi.org/10.1007/978-3-030-20085-5_7.

  • Jacobs, S. S. (1995). Technical Characteristics and Some Correlates of the California Critical Thinking Skills Test, Forms A and B. Research in Higher Education, 36(1), 89–108. https://doi.org/10.1007/BF02207768

    Article  Google Scholar 

  • Jiang, J.-Y., Guo, Fu., Chen, J.-H., Tian, X.-H., & Lv, W. (2019). Applying Eye-Tracking Technology to Measure Interactive Experience Toward the Navigation Interface of Mobile Games Considering Different Visual Attention Mechanisms. Applied Sciences-Basel, 9(16), 3242. https://doi.org/10.3390/app9163242

    Article  Google Scholar 

  • Keirl, Steve. 2017. “Critiquing as Design and Technology Curriculum Journey: History, Theory, Politics and Potential.” In Critique in Design and Technology Education, edited by P John Williams and Kay Stables, 109–33. Contemporary Issues in Technology Education. Singapore: Springer. https://doi.org/10.1007/978-981-10-3106-9_7.

  • Kennedy, A., & Pynte, J. (2008). The Consequences of Violations to Reading Order: An Eye Movement Analysis. Vision Research, 48(21), 2309–2320. https://doi.org/10.1016/j.visres.2008.07.007

    Article  Google Scholar 

  • Lampert, N. (2006). Critical Thinking Dispositions as an Outcome of Art Education. Studies in Art Education, 47(3), 215–228. https://doi.org/10.1080/00393541.2006.11650083

    Article  Google Scholar 

  • Landis, J. R., & Koch, G. G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

    Article  Google Scholar 

  • Li, G. (2016). On the Necessity of Design Education as General Education. Art Education, 0(2), 172–172.

    Google Scholar 

  • Lutnaes, Eva. 2017. “Responsible Creativity in Design Education.” In Building Community: Design Education for a Sustainable Future, edited by A. Berg, E. Bohemia, L. Buck, T. Gulden, A. Kovacevic, and N. Pavel, 668–73. Glasgow: Design Soc. https://www.webofscience.com/wos/woscc/full-record/WOS:000441174300112. Accessed 24 Jan 2023.

  • Maker, J., & Lenier, M. (1992). College Reading (4th ed.). Wadsworth Pub. Co.

    Google Scholar 

  • Nair, G. G., Hellsten, L.-A., & Stamler, L. L. (2017). Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale. Journal of Nursing Measurement, 25(1), 156–170. https://doi.org/10.1891/1061-3749.25.1.156

    Article  Google Scholar 

  • Nicholl, Bill. 2017. “Empathy as an Aspect of Critical Thought and Action in Design and Technology.” In Critique in Design and Technology Education, edited by P John Williams and Kay Stables, 153–71. Contemporary Issues in Technology Education. Singapore: Springer. https://doi.org/10.1007/978-981-10-3106-9_9.

  • Noor, Harrinni Md, and Zarina Samsudin. 2016. “Visual Thinking Courseware: Enhancing Critical Thinking Skills Through Art Criticism.” In Proceedings of the 2nd International Colloquium of Art and Design Education Research (i-CADER 2015), edited by Shahriman Zainal Abidin, Rafeah Legino, Harrinni Md Noor, Verly Veto Vermol, Rusmadiah Anwar, and Muhamad Fairus Kamaruzaman, 339–49. Singapore: Springer. https://doi.org/10.1007/978-981-10-0237-3_34.

  • Ojanp, H., Näsänen, R., & Kojo, I. (2002). Eye Movements in the Visual Search of Word Lists. Vision Research, 42(12), 1499–1512. https://doi.org/10.1016/S0042-6989(02)00077-9

    Article  Google Scholar 

  • Parente, D. (2001). Implicit and Explicit Memory in Junior High and College Students. Psychological Reports, 88(1), 313–315. https://doi.org/10.2466/PR0.88.1.313-315

    Article  Google Scholar 

  • Raney, G. E., Campbell, S. J., & Bovee, J. C. (2014). Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension. JoVE (Journal of Visualized Experiments), 83(January), e50780. https://doi.org/10.3791/50780

    Article  Google Scholar 

  • Redifer, J. L., Bae, C. L., & DeBusk-Lane, M. (2019). Implicit Theories, Working Memory, and Cognitive Load: Impacts on Creative Thinking. SAGE Open, 9(1), 2158244019835919. https://doi.org/10.1177/2158244019835919

    Article  Google Scholar 

  • Renninger, L. W., Coughlan, J., Verghese, P., & Malik, J. (2005). An Information Maximization Model of Eye Movements. Advances in Neural Information Processing Systems, 17(4), 1121–1128.

    Google Scholar 

  • Renninger, L. W., Verghese, P., & Coughlan, J. (2007). Where to Look next? Eye Movements Reduce Local Uncertainty. Journal of Vision, 7(3), 6. https://doi.org/10.1167/7.3.6

    Article  Google Scholar 

  • Senbel, M. (2012). Experiential Learning and the Co-Creation of Design Artifacts: A Hybrid Urban Design Studio for Planners. Journal of Planning Education and Research, 32(4), 449–464. https://doi.org/10.1177/0739456X12455065

    Article  Google Scholar 

  • Siemens, George. 2004. “Connectivism: A Learning Theory for the Digital Age.” International Journal of Instructional Technology and Distance Learning. https://www.semanticscholar.org/paper/Connectivism%3A-A-Learning-Theory-for-the-Digital-Age-Siemens/f87c61b964e32786e06c969fd24f5a7d9426f3b4. Accessed 24 Jan 2023.

  • Smart Education of China. 2023. “Summary of Professional Interpretations.” Yangguang Gaokao. 2023. https://gaokao.chsi.com.cn/zyk/zybk/zyjd/listPage. Accessed 12 Mar 2023.

  • Spendlove, David. 2017. “The Identification and Location of Critical Thinking and Critiquing in Design and Technology Education.” In Critique in Design and Technology Education, edited by P John Williams and Kay Stables, 71–86. Contemporary Issues in Technology Education. Singapore: Springer. https://doi.org/10.1007/978-981-10-3106-9_5.

  • Stables, Kay. 2017. “Critiquing Design: Perspectives and World Views on Design and Design and Technology Education, for the Common Good.” In Critique in Design and Technology Education, edited by P John Williams and Kay Stables, 51–70. Contemporary Issues in Technology Education. Singapore: Springer. https://doi.org/10.1007/978-981-10-3106-9_4.

  • Strømsø, H. I., Bråten, I., & Stenseth, T. (2017). The Role of Students’ Prior Topic Beliefs in Recall and Evaluation of Information from Texts on Socio-Scientific Issues. Nordic Psychology, 69(3), 127–142. https://doi.org/10.1080/19012276.2016.1198270

    Article  Google Scholar 

  • Toh, Christine A., and Scarlett R. Miller. 2016. “The Preferences for Creativity Scale (Pcs): Identifying the Underlying Constructs of Creative Concept Selection.” In Proceedings of the Asme International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2016, Vol 7, UNSP V007T06A013. New York: Amer Soc Mechanical Engineers. https://www.webofscience.com/wos/woscc/full-record/WOS:000393001500013. Accessed 20 Dec 2022.

  • Tsai, MJ, AH Wu, I Braten, and CY Wang. 2022. “What Do Critical Reading Strategies Look like? Eye-Tracking and Lag Sequential Analysis Reveal Attention to Data and Reasoning When Reading Conflicting Information.” COMPUTERS & EDUCATION 187 (October). https://doi.org/10.1016/j.compedu.2022.104544.

  • Veneri, G., Pretegiani, E., Rosini, F., Federighi, P., Federico, A., & Rufa, A. (2012). Evaluating the Human Ongoing Visual Search Performance by Eye Tracking Application and Sequencing Tests. Computer Methods and Programs in Biomedicine, 107(3), 468–477. https://doi.org/10.1016/j.cmpb.2011.02.006

    Article  Google Scholar 

  • Wang, D., Cui, Z., Ge, L., & Li, Y. (2014). Study on the Difference between Chinese and English Horizontal and Vertical Typesetting Methods. Chinese Journal of Ergonomics, 20(5), 13–17.

    Google Scholar 

  • Wang, Zhenya, Heshan Liu, Huihui Shi, and Hua Liu. 2011. “The Research of Automobile Design Evaluation Method Based on the Eye Tracking System Technology.” In Frontiers of Manufacturing Science and Measuring Technology, Pts 1–3, edited by R. Chen and W. L. Yao, 230–232:654–58. Stafa-Zurich: Trans Tech Publications Ltd. https://doi.org/10.4028/www.scientific.net/AMR.230-232.654.

  • Williams, P John, and Kay Stables, eds. 2017.Critique in Design and Technology Education. Contemporary Issues in Technology Education. Singapore: Springerhttps://doi.org/10.1007/978-981-10-3106-9

  • Xu, Y., & Shao, X. (2015). The Cultivation of Creative Talents Is the Key to the Cultural and Creative Industry: Taking Art and Design Education in Colleges and Universities as an Example. Fujian Forum: Humanities and Social Sciences Edition, 0(6), 130–33.

    Google Scholar 

  • Yang, F.-Y. (2017). Examining the Reasoning of Conflicting Science Information from the Information Processing Perspective—an Eye Movement Analysis. Journal of Research in Science Teaching, 54(10), 1347–1372. https://doi.org/10.1002/tea.21408

    Article  Google Scholar 

  • Yang, F.-Y., Tsai, M.-J., Chiou, G.-L., Lee, S.W.-Y., Chang, C.-C., & Chen, L.-L. (2018). Instructional Suggestions Supporting Science Learning in Digital Environments Based on a Review of Eye Tracking Studies. Educational Technology and Society, 21(2), 28–45.

    Google Scholar 

  • Yangyang, L. (2012). International Note: Between-Domain Relations of Chinese High School Students’ Academic Achievements. Journal of Adolescence, 35(4), 1097–1098. https://doi.org/10.1016/j.adolescence.2012.02.004

    Article  Google Scholar 

  • Yuan, Ju-I. 2015. Art Transforms Destiny: The Unified Examination and Fine Art Education. Edited by S. Hsu and Y. Y. Wu. Education as Cultivation in Chinese Culture. Vol. 26. Dordrecht: Springer. https://doi.org/10.1007/978-981-287-224-1_8.

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. School of Arts and Design, Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250353, China

    Yongchun Mao

  2. School of Distance Education, Universiti Sains Malaysia, 11800, Penang, Malaysia

    Yongchun Mao

  3. Faculty of Education, Universiti Kebangsaan Malaysia, 43600, Bangi, Malaysia

    Shuo Ban

  4. College of Architecture and Landscape, Peking University, Beijing, 100080, China

    Guolin Zhang

Authors
  1. Yongchun Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shuo Ban
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guolin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YM, SB, and GZ contributed to conception and design of the study. YM and SB collected the data. YM performed the statistical analysis and wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.

Corresponding author

Correspondence to Yongchun Mao.

Ethics declarations

Ethics approval

The studies involving human participants were reviewed and approved by Biomedical Research Ethics Committee of Shandong Provincial Hospital. The participants provided their written informed consent to participate in this study.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

Table 7

Table 7 The text of the design proposal for a conceptual medical transportation vehicle in English
Full size table

Appendix 2

Table 8

Table 8 The text of the design proposal for a temporary shelter for stray animals in English
Full size table

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mao, Y., Ban, S. & Zhang, G. Design criticism and eye movement strategy in reading: a comparative study of design and non-design students. Int J Technol Des Educ (2024). https://doi.org/10.1007/s10798-024-09893-7

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10798-024-09893-7

Keywords

Search

Navigation