We report on the development of a rubric to reliably qualify and score responses to the Views of Nature of Science Questionnaire (VNOS): The VNOS Analysis and Scoring Rubric (VAScoR). The VAScoR is designed to (a) provide systematic guidance for the qualitative analysis, and score assignment to nuanced categories, of VNOS responses, (b) explicitly scaffold qualitative inferencing and standardize score assignment to substantially lessen the burden of, and variance in, analyzing and scoring the VNOS, and (c) improve the viability and meaningfulness of cross-study comparisons drawing on VNOS data. The rubric adopted the VNOS's consensus NOS framework and further delineated core and related elements across 10 target NOS aspects. The VAScoR's reliability was examined in two studies that drew on VNOS questionnaires completed by 185 preservice secondary science teachers (58% female; 126 undergraduate and 59 graduate students) enrolled over several years in a combined undergraduate and graduate licensure program in a large U.S. Midwestern university. In Study I, VAScoR analyses of 86 VNOS questionnaires undertaken by a single author were used to examine the rubric's intra-rater reliability, which resulted in a robust Cronbach's alpha value of 0.81. In Study II, analyses by four authors of a randomly generated, overlapping set of 18 questionnaires were used to examine inter-rater reliability, which was supported with substantial consensus among raters as indicated by a Cohen's kappa of 0.71. Further evidence for the VAScoR's inter-rater reliability was indicated by moderate to strong consistency among four raters with an overall Pearson's correlation coefficient of 0.82, and coefficient values ranging from 0.77 to 0.89 for six possible rater pairings.

中文翻译：

---

VAScR 的开发：对科学本质观点 (VNOS) 调查问卷的答复进行资格和评分的评分标准

我们报告了一个评估细则的开发情况，以可靠地对科学本质观点问卷(VNOS) 的回答进行资格评定和评分：VNOS 分析和评分细则(VAScoR)。VAScoR旨在 (a) 为VNOS响应的定性分析和细微类别的评分分配提供系统指导，(b) 明确支持定性推理并标准化评分分配，以大幅减轻分析的负担和差异对VNOS进行评分，以及 (c) 提高基于VNOS数据的交叉研究比较的可行性和意义。该标题采用了VNOS 的共识 NOS 框架，并进一步界定了 10 个目标 NOS 方面的核心和相关要素。两项研究对VAScR的可靠性进行了检验，这些研究采用了由 185 名职前中学科学教师（58% 为女性；126 名本科生和 59 名研究生）完成的VNOS问卷调查，这些教师在美国中西部一所大型大学的本科和研究生联合许可项目中注册了数年。 。在研究 I 中，由一位作者对 86 份VNOS问卷进行了VAScoR分析，用于检查该量规的评估者内部可靠性，得出稳健的 Cronbach's alpha 值为 0.81。在研究 II 中，四位作者对随机生成的、重叠的 18 份问卷进行了分析，用于检查评估者间的可靠性，这得到了评估者之间的实质性共识的支持，科恩卡帕值为 0.71。VAScoR 评估者间可靠性的进一步证据是四位评估者之间的中等到强一致性，总体皮尔逊相关系数为 0.82，六种可能的评估者配对的系数值范围为 0.77 至 0.89 。