Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Practical validation framework for competence measurement in VET: a validation study of an instrument for measuring basic commercial knowledge and skills in Switzerland
Empirical Research in Vocational Education and Training Pub Date : 2021-08-12 , DOI: 10.1186/s40461-021-00122-2
Silja Rohr-Mentele 1 , Sarah Forster-Heinzer 2
Affiliation  

Competence development and measurement are of great interest to vocational education and training (VET). Although there are many instruments available for measuring competence in diverse settings, in many cases, the completed steps of validation are neither documented nor made transparent in a comprehensible manner. Understanding what an instrument actually measures is extremely important, inter alia, for evaluating test results, for conducting replication studies and for enforcing adaptation intentions. Therefore, more thorough and qualitative validation studies are required. This paper presents an approach to facilitate validation studies using the example of the simuLINCA test. The approach to validation applied in this study was developed in the field of medicine; nevertheless, it provides a promising means of assessing the validity of (computer-based) instruments in VET. We present the approach in detail along a newly developed computer-based simulation (simuLINCA) that measures basic commercial knowledge and skills of apprentices in Switzerland. The strength of the presented approach is that it provides practical guidelines that help perform the measurement process and support an increase in transparency. Still, it is flexible enough to allow different concepts to test development and validity. The approach applied proved to be practicable for VET and the measurement of occupational competence. After extending and slightly modifying the approach, a practical validation framework, including the description of each step and questions to support the application of it, is available for the VET context. The computer-based test instrument, simuLINCA, provides insights into how a computer-based test for measuring competence in various occupational fields can be developed and validated. SimuLINCA showed satisfying evidence for a valid measurement instrument. It could, however, be further developed, revised and extended.



中文翻译:

职业教育与培训能力测量的实用验证框架:瑞士基本商业知识和技能测量工具的验证研究

职业教育和培训 (VET) 对能力发展和衡量非常感兴趣。尽管有许多工具可用于衡量不同环境中的能力,但在许多情况下,已完成的验证步骤既没有记录也没有以易于理解的方式透明化。了解仪器实际测量的内容对于评估测试结果、进行复制研究和执行适应意图尤其重要。因此,需要进行更彻底和定性的验证研究。本文介绍了一种使用simuLINCA的示例来促进验证研究的方法测试。本研究中应用的验证方法是在医学领域开发的;尽管如此,它为评估职业教育与培训中(基于计算机的)工具的有效性提供了一种很有前景的方法。我们根据新开发的基于计算机的模拟 ( simuLINCA)详细介绍了该方法) 衡量瑞士学徒的基本商业知识和技能。所提出方法的优势在于它提供了实用的指导方针,有助于执行测量过程并支持提高透明度。尽管如此,它仍然足够灵活,可以允许不同的概念来测试开发和有效性。所采用的方法被证明适用于职业教育与培训和职业能力的测量。在扩展并稍微修改该方法之后,一个实用的验证框架,包括每个步骤的描述和支持它应用的问题,可用于 VET 上下文。基于计算机的测试仪器,simuLINCA,提供有关如何开发和验证用于衡量各种职业领域能力的基于计算机的测试的见解。SimuLINCA为有效的测量仪器提供了令人满意的证据。然而,它可以进一步发展、修订和扩展。

更新日期:2021-08-12
down
wechat
bug