当前位置: X-MOL 学术arXiv.cs.IR › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Decoy Effect In Search Interaction: Understanding User Behavior and Measuring System Vulnerability
arXiv - CS - Information Retrieval Pub Date : 2024-03-27 , DOI: arxiv-2403.18462
Nuo Chen, Jiqun Liu, Hanpei Fang, Yuankai Luo, Tetsuya Sakai, Xiao-Ming Wu

This study examines the decoy effect's underexplored influence on user search interactions and methods for measuring information retrieval (IR) systems' vulnerability to this effect. It explores how decoy results alter users' interactions on search engine result pages, focusing on metrics like click-through likelihood, browsing time, and perceived document usefulness. By analyzing user interaction logs from multiple datasets, the study demonstrates that decoy results significantly affect users' behavior and perceptions. Furthermore, it investigates how different levels of task difficulty and user knowledge modify the decoy effect's impact, finding that easier tasks and lower knowledge levels lead to higher engagement with target documents. In terms of IR system evaluation, the study introduces the DEJA-VU metric to assess systems' susceptibility to the decoy effect, testing it on specific retrieval tasks. The results show differences in systems' effectiveness and vulnerability, contributing to our understanding of cognitive biases in search behavior and suggesting pathways for creating more balanced and bias-aware IR evaluations.

中文翻译:

搜索交互中的诱饵效应:了解用户行为和测量系统漏洞

本研究探讨了诱饵效应对用户搜索交互的影响,以及测量信息检索 (IR) 系统易受此效应影响的方法。它探讨了诱饵结果如何改变用户在搜索引擎结果页面上的交互,重点关注点击可能性、浏览时间和感知文档有用性等指标。通过分析多个数据集的用户交互日志,该研究表明诱饵结果会显着影响用户的行为和感知。此外,它还研究了不同级别的任务难度和用户知识如何改变诱饵效应的影响,发现更简单的任务和较低的知识水平会导致对目标文档的更高参与度。在IR系统评估方面,该研究引入了DEJA-VU指标来评估系统对诱饵效应的敏感性,并在特定的检索任务上进行测试。结果显示了系统有效性和脆弱性的差异,有助于我们理解搜索行为中的认知偏差,并提出创建更加平衡和具有偏见意识的 IR 评估的途径。
更新日期:2024-03-28
down
wechat
bug