当前位置: X-MOL 学术ReCALL › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Quantitative experimental L2 acquisition MALL studies: A critical evaluation of research quality
ReCALL ( IF 4.235 ) Pub Date : 2023-06-20 , DOI: 10.1017/s0958344023000149
Jack Burston , Androulla Athanasiou , Konstantinos Giannakou

With more than 1,200 publications over the past two decades, experimental mobile-assisted language learning (MALL) studies targeting second/foreign language (L2) acquisition outcomes are certainly not lacking in quantity. Their research quality, on the other hand, has often been brought into question, most notably with regard to the adequacy of their assessment instruments and statistical analyses. Yet limiting the determination of research quality to the evaluation of testing procedures, and the statistical analysis of the results they produce, ignores the critical relevance of the underlying research parameters that generate the results in the first place. A comprehensive evaluation of quantitative experimental L2 acquisition MALL research quality, encompassing design as well as assessment instruments and statistical analysis, thus remains to be undertaken. The present investigation endeavors to do so based on an extensive compilation of 737 MALL studies published between 2000 and 2021. The research quality of these publications is evaluated according to four main parameters: language acquisition moderators, treatment intervention conditions, assessment instruments, and statistical analysis. These are applied according to a modified version of the Checklist for the Rigor of Education-Experiment Designs (CREED), which classifies research design quality into five levels: low, medium-low, medium, medium-high, high. With over three quarters of all studies falling within the low category, the result leaves much to be desired. Since the modified CREED algorithm developed here can equally be applied to studies from their inception, it offers a way forward to improve the research quality of future experimental MALL studies.



中文翻译:

定量实验 L2 习得 MALL 研究:研究质量的关键评估

过去 20 年来,针对第二语言/外语 (L2) 习得结果的实验​​性移动辅助语言学习 (MALL) 研究数量已超过 1,200 篇,数量当然不乏。另一方面,他们的研究质量经常受到质疑,尤其是在评估工具和统计分析的充分性方面。然而,将研究质量的确定仅限于测试程序的评估以及对其产生的结果的统计分析,忽略了首先生成结果的基础研究参数的关键相关性。因此,对定量实验 L2 采集 MALL 研究质量的全面评估,包括设计、评估工具和统计分析,仍有待进行。本次调查基于 2000 年至 2021 年间发表的 737 项 MALL 研究的广泛汇编。这些出版物的研究质量根据四个主要参数进行评估:语言习得调节因素、治疗干预条件、评估工具和统计分析。这些是根据教育实验设计严格性清单(CREED)的修改版本应用的,该清单将研究设计质量分为五个级别:低、中低、中、中高、高。由于超过四分之三的研究都属于低水平,因此结果还有很多不足之处。由于这里开发的改进的 CREED 算法同样可以应用于从一开始的研究,它为提高未来实验性 MALL 研究的研究质量提供了一条前进的道路。

更新日期:2023-06-20
down
wechat
bug