Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
Journal of Educational Evaluation for Health Professions Pub Date : 2023-01-11 , DOI: 10.3352/jeehp.2023.20.1
Sun Huh 1
Affiliation  

This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.

中文翻译:

ChatGPT 的知识和解释能力是否与韩国医学生参加寄生虫学考试的知识和解释能力相当?:一项描述性研究

本研究旨在通过对 ChatGPT 和医学生进行寄生虫学检查,比较人工智能语言模型 ChatGPT 与韩国医学生的知识和解释能力。考试由 79 个项目组成,于 2023 年 1 月 1 日对 ChatGPT 进行。考试结果根据 ChatGPT 的整体性能得分、项目知识水平的正确答案率以及对项目解释的可接受性进行分析. ChatGPT 的表现低于医学生,ChatGPT 的正确回答率与项目的知识水平无关。但是,可接受的解释与正确答案之间存在关联。综上所述,
更新日期:2023-01-11
down
wechat
bug