Purpose

This article describes the development processes, sampling and analysis practices and the assessment of reliability and validity of a new 0survey that sought to evaluate undergraduate students' perceptions and expectations related to privacy and library participation in learning analytics studies. This article provides other researchers with information required to independently evaluate the survey's efficacy, as well as guidance for designing other surveys.

Design/methodology/approach

Following question development, pre-survey validity assessments were made using subject matter expert panel review and cognitive interviews. Post-hoc analysis of survey construct reliability was evaluated using the Omega coefficient, while exploratory factor analysis was utilized to assess construct validity. Survey design limitations and potential bias effects are also examined.

Findings

The survey exhibited a high level of reliability among research constructs, while the exploratory factor analysis results suggested that survey constructs contained multiple conceptual elements that should be measured separately for more nuanced analysis.

Practical implications

This article provides a model for other researchers wishing to re-use the survey described or develop similar surveys.

Social implications

As learning analytics interest continues to expand, engaging with the subjects, in this case students, of analysis is critical. Researchers need to ensure that captured measurements are appropriately valid in order to accurately represent the findings.

Originality/value

This survey is one of very few addressing library learning analytics that has undergone extensive validity analysis of the conceptual constructs.

中文翻译：

---

有效问题：新的图书馆学习分析调查的开发和评估

目的

本文介绍了一项新的 0 调查的开发过程、抽样和分析实践以及可靠性和有效性的评估，该调查旨在评估本科生对学习分析研究中的隐私和图书馆参与相关的看法和期望。本文为其他研究人员提供了独立评估调查有效性所需的信息，以及设计其他调查的指导。

设计/方法论/途径

问题制定后，通过主题专家小组审查和认知访谈进行预调查有效性评估。使用欧米茄系数评估调查构建可靠性的事后分析，同时利用探索性因素分析来评估构建有效性。还检查了调查设计的局限性和潜在的偏差影响。

发现

该调查在研究结构中表现出高度的可靠性，而探索性因素分析结果表明，调查结构包含多个概念元素，应单独测量这些概念元素以进行更细致的分析。

实际影响

本文为其他希望重复使用所描述的调查或开发类似调查的研究人员提供了一个模型。

社会影响

随着学习分析的兴趣不断扩大，与分析科目（在本例中为学生）的互动至关重要。研究人员需要确保捕获的测量结果适当有效，以便准确地表示研究结果。

原创性/价值

这项调查是极少数针对图书馆学习分析进行的调查之一，该调查对概念结构进行了广泛的有效性分析。