Research on computerized adaptive testing (CAT) has provided evidence of the psychometric advantages of CAT over traditional fixed-item tests (FIT). However, evidence on test-taking experience is limited. This study investigated the psychometric and psychological impacts of CAT in the context of a multidimensional fluid reasoning test. In an online experimental study, we tested 286 participants, randomly assigning them to either the CAT or FIT conditions. We used two types of measures to assess participants' experience: self-report and time-based measures. The results showed that CAT outperforms FIT in terms of measurement precision but had a minimal impact on the test-taking experience. At the same time, FIT resulted in a more optimistic evaluation: when completing FIT, participants believed they had answered more items correctly than when completing CAT. Yet response time analysis indicates that participants invested more effort when working in CAT. Rapid guessing increased as the test progressed in both CAT and FIT, particularly in the FIT condition with the most difficult items. Providing information about how CAT works or starting the test with easier items may potentially enhance test-takers' experiences.

中文翻译：

---

自适应与非自适应心理测试的测量精度和用户体验

计算机自适应测试 (CAT) 的研究证明了 CAT 相对于传统固定项目测试 (FIT) 的心理测量优势。然而，关于应试经验的证据有限。本研究调查了多维流体推理测试中 CAT 的心理测量和心理影响。在一项在线实验研究中，我们测试了 286 名参与者，随机将他们分配到 CAT 或 FIT 条件。我们使用两种类型的衡量标准来评估参与者的体验：自我报告和基于时间的衡量标准。结果表明，CAT 在测量精度方面优于 FIT，但对考试体验的影响却很小。同时，FIT 也带来了更为乐观的评价：在完成 FIT 时，参与者认为自己比完成 CAT 时正确回答了更多的项目。然而响应时间分析表明参与者在 CAT 工作时投入了更多的精力。随着 CAT 和 FIT 测试的进行，快速猜测的次数不断增加，尤其是在 FIT 条件下，题目难度最高。提供有关 CAT 如何工作的信息或从更简单的项目开始测试可能会增强考生的体验。