The present study compared the diagnostic accuracy of a single computer adaptive test (CAT), Star Reading or Star Math, and a combination of the two in a gated screening framework to predict end-of-year proficiency in reading and math. Participants included 13,009 students in Grades 3–8 who had at least one fall screening score and end-of-year state test score in reading and math. First, diagnostic accuracy statistics were evaluated for a single screening measure to predict proficiency on end-of-year tests. Second, a gated screening framework was simulated to examine the diagnostic accuracy of a combination of screening measures (i.e., scores from the CATs and the end-of-year test). The diagnostic accuracy of each screening method was compared. Results suggest that diagnostic accuracy did not improve for the gated screening method when compared to the single screening method. The gated screening method tended to yield low sensitivity values (M = 0.42, range = 0.35–0.48) and high specificity values (M = 0.97, range = 0.95–0.99). The only condition to reach acceptable sensitivity and specificity (>0.70) was a single reading screener predicting reading outcomes. Sample specific cut-scores from receiver operating curve (ROC) analyses led to improved diagnostic accuracy outcomes relative to all other methods.

中文翻译：

---

预测阅读和数学成绩的计算机自适应测试筛选方法的比较

本研究比较了单一计算机自适应测试（CAT）、明星阅读或明星数学的诊断准确性，以及门控筛选框架中两者的组合，以预测年终阅读和数学的熟练程度。参与者包括 13,009 名 3 至 8 年级的学生，他们至少有一项秋季筛选成绩以及年终州阅读和数学考试成绩。首先，对单一筛查措施的诊断准确性统计数据进行评估，以预测年终测试的熟练程度。其次，模拟了门控筛查框架，以检查筛查措施组合（即 CAT 分数和年终测试）的诊断准确性。比较了每种筛查方法的诊断准确性。结果表明，与单一筛查方法相比，门控筛查方法的诊断准确性并未提高。门控筛选方法往往会产生低敏感性值（M  = 0.42，范围 = 0.35–0.48）和高特异性值（M  = 0.97，范围 = 0.95–0.99）。达到可接受的灵敏度和特异性 (>0.70) 的唯一条件是预测阅读结果的单个阅读筛选器。相对于所有其他方法，来自受试者工作曲线 (ROC) 分析的样本特定切分可以提高诊断准确性结果。