Giovanni Maria Biancofiore
Yashar Deldjoo
Fedelucio Narducci
Skip Abstract Section
Abstract
Question-answering systems are recognized as popular and frequently effective means of information seeking on the web. In such systems, information seekers can receive a concise response to their queries by presenting their questions in natural language. Interactive question answering is a recently proposed and increasingly popular solution that resides at the intersection of question answering and dialogue systems. On the one hand, the user can ask questions in normal language and locate the actual response to her inquiry; on the other hand, the system can prolong the question-answering session into a dialogue if there are multiple probable replies, very few, or ambiguities in the initial request. By permitting the user to ask more questions, interactive question answering enables users to interact with the system and receive more precise results dynamically.
This survey offers a detailed overview of the interactive question-answering methods that are prevalent in current literature. It begins by explaining the foundational principles of question-answering systems, hence defining new notations and taxonomies to combine all identified works inside a unified framework. The reviewed published work on interactive question-answering systems is then presented and examined in terms of its proposed methodology, evaluation approaches, and dataset/application domain. We also describe trends surrounding specific tasks and issues raised by the community, so shedding light on the future interests of scholars. Our work is further supported by a GitHub page synthesising all the major topics covered in this literature study. https://sisinflab.github.io/interactive-question-answering-systems-survey/
- Huda Alamri, Vincent Cartillier, Abhishek Das, Jue Wang, Anoop Cherian, Irfan Essa, Dhruv Batra, Tim K Marks, Chiori Hori, Peter Anderson, et al. 2019. Audio visual scene-aware dialog. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7558–7567.Google Scholar
Cross Ref
- Kamran Alipour, Jürgen P. Schulze, Yi Yao, Avi Ziskind, and Giedrius Burachas. 2020. A Study on Multimodal and Interactive Explanations for Visual Question Answering. In SafeAI@AAAI(CEUR Workshop Proceedings, Vol. 2560). CEUR-WS.org, 54–62.Google Scholar
- Francesca Alloatti, Luigi Di Caro, and Gianpiero Sportelli. 2019. Real Life Application of a Question Answering System Using BERT Language Model. In SIGdial. Association for Computational Linguistics, 250–253.Google Scholar
- Ashton Anderson, Daniel Huttenlocher, Jon Kleinberg, and Jure Leskovec. 2012. Discovering value from community activity on focused question answering sites: a case study of stack overflow. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. 850–858.Google ScholarDigital Library
- Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C Lawrence Zitnick, and Devi Parikh. 2015. Vqa: Visual question answering. In Proceedings of the IEEE international conference on computer vision. 2425–2433.Google ScholarDigital Library
- Ashutosh Baheti, Alan Ritter, and Kevin Small. 2020. Fluent Response Generation for Conversational Question Answering. In ACL. Association for Computational Linguistics, 191–207.Google Scholar
- Kinjal Basu. 2019. Conversational AI : Open Domain Question Answering and Commonsense Reasoning. In ICLP Technical Communications(EPTCS, Vol. 306). 396–402.Google Scholar
- Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic parsing on freebase from question-answer pairs. In Proceedings of the 2013 conference on empirical methods in natural language processing. 1533–1544.Google Scholar
- Ana Berdasco, Gustavo López, Ignacio Díaz-Oreiro, Luis Quesada, and Luis A. Guerrero. 2019. User Experience Comparison of Intelligent Personal Assistants: Alexa, Google Assistant, Siri and Cortana. In UCAmI(MDPI Proceedings, Vol. 31). MDPI, 51.Google ScholarCross Ref
- Guillaume Le Berre and Philippe Langlais. 2020. Attending Knowledge Facts with BERT-like Models in Question-Answering: Disappointing Results and Some Explanations. In Canadian Conference on AI(Lecture Notes in Computer Science, Vol. 12109). Springer, 356–367.Google Scholar
- Santanu Bhattacharjee, Rejwanul Haque, Gideon Maillette de Buy Wenniger, and Andy Way. 2020. Investigating Query Expansion and Coreference Resolution in Question Answering on BERT. In NLDB(Lecture Notes in Computer Science, Vol. 12089). Springer, 47–59.Google Scholar
- Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008. Freebase: a collaboratively created graph database for structuring human knowledge. In Proceedings of the 2008 ACM SIGMOD international conference on Management of data. 1247–1250.Google ScholarDigital Library
- Antoine Bordes, Nicolas Usunier, Sumit Chopra, and Jason Weston. 2015. Large-scale Simple Question Answering with Memory Networks. CoRR abs/1506.02075(2015).Google Scholar
- Rakesh Chada. 2019. Gendered Pronoun Resolution using BERT and an extractive question answering formulation. CoRR abs/1906.03695(2019).Google Scholar
- Adriane Chapman and H. V. Jagadish. 2009. Why not?. In SIGMOD Conference. ACM, 523–534.Google ScholarDigital Library
- David L. Chen and William B. Dolan. 2011. Collecting Highly Parallel Data for Paraphrase Evaluation. In ACL. The Association for Computer Linguistics, 190–200.Google Scholar
- Wenhu Chen, Ming-Wei Chang, Eva Schlinger, William Wang, and William W Cohen. 2020. Open question answering over tables and text. arXiv preprint arXiv:2010.10439(2020).Google Scholar
- Ting-Rui Chiang, Hao-Tong Ye, and Yun-Nung Chen. 2020. An Empirical Study of Content Understanding in Conversational Question Answering. In AAAI. AAAI Press, 7578–7585.Google Scholar
- Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023. Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality. https://lmsys.org/blog/2023-03-30-vicuna/Google Scholar
- Eunsol Choi, He He, Mohit Iyyer, Mark Yatskar, Wen-tau Yih, Yejin Choi, Percy Liang, and Luke Zettlemoyer. 2018. QuAC: Question answering in context. arXiv preprint arXiv:1808.07036(2018).Google Scholar
- Philipp Christmann, Rishiraj Saha Roy, Abdalghani Abujabal, Jyotsna Singh, and Gerhard Weikum. 2019. Look before you Hop: Conversational Question Answering over Knowledge Graphs Using Judicious Context Expansion. In CIKM. ACM, 729–738.Google Scholar
- Kevin Clark and Christopher D. Manning. 2016. Improving Coreference Resolution by Learning Entity-Level Distributed Representations. In Association for Computational Linguistics (ACL).Google Scholar
- Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018. Think you have solved question answering? try arc, the ai2 reasoning challenge. arXiv preprint arXiv:1803.05457(2018).Google Scholar
- Daniel Cohen, Liu Yang, and W Bruce Croft. 2018. WikiPassageQA: A benchmark collection for research on non-factoid answer passage retrieval. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 1165–1168.Google ScholarDigital Library
- Sérgio Curto, Ana Cristina Mendes, Pedro Curto, Luísa Coheur, and Ângela Costa. 2014. JUST.ASK, a QA system that learns to answer new questions from previous interactions. In LREC. European Language Resources Association (ELRA), 2603–2607.Google Scholar
- Danica Damljanovic, Milan Agatonovic, and Hamish Cunningham. 2010. Natural Language Interfaces to Ontologies: Combining Syntactic Analysis and Ontology-Based Lookup through the User Interaction. In ESWC (1)(Lecture Notes in Computer Science, Vol. 6088). Springer, 106–120.Google Scholar
- Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, José MF Moura, Devi Parikh, and Dhruv Batra. 2017. Visual dialog. In Proceedings of the IEEE conference on computer vision and pattern recognition. 326–335.Google ScholarCross Ref
- Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, and Andrew McCallum. 2019. Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering. In ICLR (Poster). OpenReview.net.Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).Google Scholar
- Bhuwan Dhingra, Kathryn Mazaitis, and William W Cohen. 2017. Quasar: Datasets for question answering by search and reading. arXiv preprint arXiv:1707.03904(2017).Google Scholar
- Tuong Do, Huy Tran, Thanh-Toan Do, Erman Tjiputra, and Quang D. Tran. 2019. Compact Trilinear Interaction for Visual Question Answering. In ICCV. IEEE, 392–401.Google Scholar
- Matthew Dunn, Levent Sagun, Mike Higgins, V Ugur Guney, Volkan Cirik, and Kyunghyun Cho. 2017. Searchqa: A new q&a dataset augmented with context from a search engine. arXiv preprint arXiv:1704.05179(2017).Google Scholar
- Ronald Fagin, Amnon Lotem, and Moni Naor. 2003. Optimal aggregation algorithms for middleware. Journal of computer and system sciences 66, 4 (2003), 614–656.Google ScholarDigital Library
- Minwei Feng, Bing Xiang, Michael R Glass, Lidan Wang, and Bowen Zhou. 2015. Applying deep learning to answer selection: A study and an open task. In 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU). 813–820.Google ScholarCross Ref
- Antonio Ferrández and Jesús Peral. 2010. The benefits of the interaction between data warehouses and question answering. In EDBT/ICDT Workshops (ACM International Conference Proceeding Series). ACM.Google ScholarDigital Library
- Jun-ichi Fukumoto, Noriaki Aburai, and Ryosuke Yamanishi. 2013. Interactive Document Expansion for Answer Extraction of Question Answering System. In KES(Procedia Computer Science, Vol. 22). Elsevier, 991–1000.Google Scholar
- Peng Gao, Haoxuan You, Zhanpeng Zhang, Xiaogang Wang, and Hongsheng Li. 2019. Multi-Modality Latent Interaction Network for Visual Question Answering. In ICCV. IEEE, 5824–5834.Google Scholar
- Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, and Ali Farhadi. 2018. IQA: Visual Question Answering in Interactive Environments. In CVPR. Computer Vision Foundation / IEEE Computer Society, 4089–4098.Google Scholar
- Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. 2017. Making the v in vqa matter: Elevating the role of image understanding in visual question answering. In Proceedings of the IEEE conference on computer vision and pattern recognition. 6904–6913.Google ScholarCross Ref
- Daya Guo, Duyu Tang, Nan Duan, Ming Zhou, and Jian Yin. 2018. Dialog-to-Action: Conversational Question Answering Over a Large-Scale Knowledge Base. In NeurIPS 2018. 2946–2955.Google Scholar
- Wenya Guo, Ying Zhang, Jufeng Yang, and Xiaojie Yuan. 2021. Re-attention for visual question answering. IEEE Transactions on Image Processing 30 (2021), 6730–6743.Google ScholarDigital Library
- Maryam Habibi, Parvaz Mahdabi, and Andrei Popescu-Belis. 2016. Question answering in conversations: Query refinement using contextual and semantic information. Data Knowl. Eng. 106(2016), 38–51.Google ScholarDigital Library
- Hojae Han, Seungtaek Choi, Haeju Park, and Seung-won Hwang. 2019. MICRON: Multigranular Interaction for Contextualizing RepresentatiON in Non-factoid Question Answering. In EMNLP/IJCNLP (1). Association for Computational Linguistics, 5889–5894.Google Scholar
- Sofian Hazrina, Nurfadhlina Mohd Sharef, Hamidah Ibrahim, Masrah Azrifah Azmi Murad, and Shahrul Azman Mohd. Noah. 2017. Review on the advancements of disambiguation in semantic question answering system. Inf. Process. Manag. 53, 1 (2017), 52–69.Google ScholarCross Ref
- Shizhu He, Kang Liu, and Weiting An. 2019. Learning to Align Question and Answer Utterances in Customer Service Conversation with Recurrent Pointer Networks. In AAAI. AAAI Press, 134–141.Google Scholar
- Lynette Hirschman and Robert J. Gaizauskas. 2001. Natural language question answering: the view from here. Nat. Lang. Eng. 7, 4 (2001), 275–300.Google ScholarDigital Library
- Yining Hong, Jialu Wang, Yuting Jia, Weinan Zhang, and Xinbing Wang. 2019. Academic Reader: An Interactive Question Answering System on Academic Literatures. In AAAI. AAAI Press, 9855–9856.Google Scholar
- Jun Hu, Shengsheng Qian, Quan Fang, and Changsheng Xu. 2018. Attentive Interactive Convolutional Matching for Community Question Answering in Social Multimedia. In ACM Multimedia. ACM, 456–464.Google Scholar
- Hsin-Yuan Huang, Eunsol Choi, and Wen-tau Yih. 2018. Flowqa: Grasping flow in history for conversational machine comprehension. arXiv preprint arXiv:1810.06683(2018).Google Scholar
- Eric Hulburd. 2020. Exploring BERT Parameter Efficiency on the Stanford Question Answering Dataset v2.0. CoRR abs/2002.10670(2020).Google Scholar
- Yunseok Jang, Yale Song, Youngjae Yu, Youngjin Kim, and Gunhee Kim. 2017. TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering. In CVPR. IEEE Computer Society, 1359–1367.Google Scholar
- Zhen Jia, Soumajit Pramanik, Rishiraj Saha Roy, and Gerhard Weikum. 2021. Complex temporal question answering on knowledge graphs. In Proceedings of the 30th ACM international conference on information & knowledge management. 792–802.Google ScholarDigital Library
- Weike Jin, Zhou Zhao, Mao Gu, Jun Yu, Jun Xiao, and Yueting Zhuang. 2019. Multi-interaction Network with Object Relation for Video Question Answering. In ACM Multimedia. ACM, 1193–1201.Google Scholar
- Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017. Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension. arXiv preprint arXiv:1705.03551(2017).Google Scholar
- Ying Ju, Fubang Zhao, Shijie Chen, Bowen Zheng, Xuefeng Yang, and Yunfeng Liu. 2019. Technical report on Conversational Question Answering. CoRR abs/1909.10772(2019).Google Scholar
- Endri Kacupaj, Kuldeep Singh, Maria Maleshkova, and Jens Lehmann. 2022. Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 925–934.Google ScholarDigital Library
- Kushal Kafle and Christopher Kanan. 2017. An analysis of visual question answering algorithms. In Proceedings of the IEEE International Conference on Computer Vision. 1965–1973.Google ScholarCross Ref
- Magdalena Kaiser, Rishiraj Saha Roy, and Gerhard Weikum. 2020. Conversational Question Answering over Passages by Leveraging Word Proximity Networks. In SIGIR. ACM, 2129–2132.Google Scholar
- Tushar Khot, Peter Clark, Michal Guerquin, Peter Jansen, and Ashish Sabharwal. 2020. Qasc: A dataset for question answering via sentence composition. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 8082–8090.Google ScholarCross Ref
- Kyung-Min Kim, Min-Oh Heo, Seong-Ho Choi, and Byoung-Tak Zhang. 2017. Deepstory: Video story qa by deep embedded memory networks. arXiv preprint arXiv:1707.00836(2017).Google Scholar
- Natalia Konstantinova and Constantin Orasan. 2013. Interactive question answering. In Emerging applications of natural language processing: concepts and new research. IGI Global, 149–169.Google Scholar
- Satwik Kottur, José MF Moura, Devi Parikh, Dhruv Batra, and Marcus Rohrbach. 2018. Visual coreference resolution in visual dialog using neural module networks. In Proceedings of the European Conference on Computer Vision (ECCV). 153–169.Google ScholarDigital Library
- Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A Shamma, et al. 2017. Visual genome: Connecting language and vision using crowdsourced dense image annotations. International journal of computer vision 123, 1 (2017), 32–73.Google Scholar
- Mayank Kulkarni and Kristy Elizabeth Boyer. 2018. Toward Data-Driven Tutorial Question Answering with Deep Learning Conversational Models. In BEA@NAACL-HLT. Association for Computational Linguistics, 273–283.Google Scholar
- Girish Kumar, Matthew Henderson, Shannon Chan, Hoang Nguyen, and Lucas Ngoo. 2018. Question-Answer Selection in User to User Marketplace Conversations. In IWSDS(Lecture Notes in Electrical Engineering, Vol. 579). Springer, 397–403.Google Scholar
- Souvik Kundu, Qian Lin, and Hwee Tou Ng. 2020. Learning to Identify Follow-Up Questions in Conversational Question Answering. In ACL. Association for Computational Linguistics, 959–968.Google Scholar
- Chia-Chih Kuo, Shang-Bao Luo, and Kuan-Yu Chen. 2020. An Audio-Enriched BERT-Based Framework for Spoken Multiple-Choice Question Answering. In INTERSPEECH. ISCA, 4173–4177.Google Scholar
- Veronica Latcinnik and Jonathan Berant. 2020. Explaining Question Answering Models through Text Generation. CoRR abs/2004.05569(2020).Google Scholar
- Changyoon Lee, Donghoon Han, Hyoungwook Jin, and Alice Oh. 2019. automaTA: Human-Machine Interaction for Answering Context-Specific Questions. In L@S. ACM, 44:1–44:4.Google Scholar
- Jie Lei, Licheng Yu, Mohit Bansal, and Tamara L Berg. 2018. Tvqa: Localized, compositional video question answering. arXiv preprint arXiv:1809.01696(2018).Google Scholar
- Fei Li and H. V. Jagadish. 2014. Constructing an Interactive Natural Language Interface for Relational Databases. Proc. VLDB Endow. 8, 1 (2014), 73–84.Google ScholarDigital Library
- Huayu Li, Martin Renqiang Min, Yong Ge, and Asim Kadav. 2017. A Context-aware Attention Network for Interactive Question Answering. In KDD. ACM, 927–935.Google Scholar
- Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, and Jiebo Luo. 2018. Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions. In EMNLP. Association for Computational Linguistics, 1338–1346.Google Scholar
- Qian Li, Hui Su, Cheng Niu, Daling Wang, Zekang Li, Shi Feng, and Yifei Zhang. 2019. Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension. In MRQA@EMNLP. Association for Computational Linguistics, 38–47.Google Scholar
- Qing Li, Qingyi Tao, Shafiq R. Joty, Jianfei Cai, and Jiebo Luo. 2018. VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions. In ECCV (7)(Lecture Notes in Computer Science, Vol. 11211). Springer, 570–586.Google Scholar
- Ronghan Li, Zejun Jiang, Lifang Wang, Xinyu Lu, and Meng Zhao. 2020. Directional attention weaving for text-grounded conversational question answering. Neurocomputing 391(2020), 13–24.Google ScholarCross Ref
- Tianle Li, Xueguang Ma, Alex Zhuang, Yu Gu, Yu Su, and Wenhu Chen. 2023. Few-shot In-context Learning for Knowledge Base Question Answering. arXiv preprint arXiv:2305.01750(2023).Google Scholar
- Yuncheng Li, Yale Song, Liangliang Cao, Joel R. Tetreault, Larry Goldberg, Alejandro Jaimes, and Jiebo Luo. 2016. TGIF: A New Dataset and Benchmark on Animated GIF Description. In CVPR. IEEE Computer Society, 4641–4650.Google Scholar
- Aiting Liu, Ziqi Huang, Hengtong Lu, Xiaojie Wang, and Caixia Yuan. 2019. BB-KBQA: BERT-Based Knowledge Base Question Answering. In CCL(Lecture Notes in Computer Science, Vol. 11856). Springer, 81–92.Google Scholar
- Siyuan Liu, Sourav S. Bhowmick, Wanlu Zhang, Shu Wang, and Wanyi Huang. 2018. NEURON: An Interactive Natural Language Interface for Understanding Query Execution Plans in RDBMS. CoRR abs/1805.05670(2018).Google Scholar
- Song Liu, Yixin Zhong, and Fuji Ren. 2013. Interactive Question Answering Based on FAQ. In CCL(Lecture Notes in Computer Science, Vol. 8202). Springer, 73–84.Google Scholar
- Yuhang LIU, Wei WEI, and Feida ZHU. 2022. Declaration-based prompt tuning for visual question answering. International Joint Conferences on Artificial Intelligence.Google Scholar
- James Lockett, Sanith Wijesinghe, Jasper Phillips, Ian Gross, Michael Schoenfeld, Walter T. Hiranpat, Phillip J. Marlow, Matt Coarr, and Qian Hu. 2019. Intelligent Voice Agent and Service (iVAS) for Interactive and Multimodal Question and Answers. In FQAS(Lecture Notes in Computer Science, Vol. 11529). Springer, 396–402.Google Scholar
- Vanessa Lopez, Christina Unger, Philipp Cimiano, and Enrico Motta. 2013. Evaluating question answering over linked data. Journal of Web Semantics 21 (2013), 3–13.Google ScholarDigital Library
- Anutosh Maitra, Shivam Garg, and Shubhashis Sengupta. 2020. Enabling Interactive Answering of Procedural Questions. In NLDB(Lecture Notes in Computer Science, Vol. 12089). Springer, 73–81.Google Scholar
- Angrosh Mandya, Danushka Bollegala, and Frans Coenen. 2019. Evaluating Co-reference Chains Based Conversation History in Conversational Question Answering. In PACLING(Communications in Computer and Information Science, Vol. 1215). Springer, 280–292.Google Scholar
- Angrosh Mandya, James O’Neill, Danushka Bollegala, and Frans Coenen. 2020. Do not let the history haunt you: Mitigating Compounding Errors in Conversational Question Answering. In LREC. European Language Resources Association, 2017–2025.Google Scholar
- Kenneth Marino, Mohammad Rastegari, Ali Farhadi, and Roozbeh Mottaghi. 2019. Ok-vqa: A visual question answering benchmark requiring external knowledge. In Proceedings of the IEEE/cvf conference on computer vision and pattern recognition. 3195–3204.Google ScholarCross Ref
- Yosi Mass, Haggai Roitman, Shai Erera, Or Rivlin, Bar Weiner, and David Konopnicki. 2019. A Study of BERT for Non-Factoid Question-Answering under Passage Length Constraints. CoRR abs/1908.06780(2019).Google Scholar
- J. S. McCarley. 2019. Pruning a BERT-based Question Answering Model. CoRR abs/1910.06360(2019).Google Scholar
- Pablo N Mendes, Max Jakob, and Christian Bizer. 2012. DBpedia: A multilingual cross-domain knowledge base. European Language Resources Association (ELRA).Google Scholar
- Tamás Mészáros and Tadeusz P. Dobrowiecki. 2017. Agent-based Reconfigurable Natural Language Interface to Robots - Human-Agent Interaction using Task-specific Controlled Natural Languages. In ICAART (2). SciTePress, 632–639.Google Scholar
- Todor Mihaylov, Peter Clark, Tushar Khot, and Ashish Sabharwal. 2018. Can a suit of armor conduct electricity? a new dataset for open book question answering. arXiv preprint arXiv:1809.02789(2018).Google Scholar
- Seungwhan Moon, Pararth Shah, Anuj Kumar, and Rajen Subba. 2019. Memory Graph Networks for Explainable Memory-grounded Question Answering. In CoNLL. Association for Computational Linguistics, 728–736.Google Scholar
- Thomas Müller, Francesco Piccinno, Peter Shaw, Massimo Nicosia, and Yasemin Altun. 2019. Answering Conversational Questions on Structured Data without Logical Forms. In EMNLP/IJCNLP (1). Association for Computational Linguistics, 5901–5909.Google Scholar
- M. Asif Naeem, Saif Ullah, and Imran Sarwar Bajwa. 2012. Interacting with Data Warehouse by Using a Natural Language Interface. In NLDB(Lecture Notes in Computer Science, Vol. 7337). Springer, 372–377.Google Scholar
- Preslav Nakov, Lluís Màrquez, Walid Magdy, Alessandro Moschitti, James Glass, and Bilal Randeree. 2019. Semeval-2015 task 3: Answer selection in community question answering. arXiv preprint arXiv:1911.11403(2019).Google Scholar
- Allen Nie, Erin D. Bennett, and Noah D. Goodman. 2019. Learning to Explain: Answering Why-Questions via Rephrasing. CoRR abs/1906.01243(2019).Google Scholar
- Florian Nothdurft and Wolfgang Minker. 2016. Justification and transparency explanations in dialogue systems to maintain human-computer trust. In Situated Dialog in Speech-Based Human-Computer Interaction. Springer, 41–50.Google Scholar
- Reham A. Osama, Nagwa M. El-Makky, and Marwan Torki. 2019. Question Answering Using Hierarchical Attention on Top of BERT Features. In MRQA@EMNLP. Association for Computational Linguistics, 191–195.Google Scholar
- Arantxa Otegi, Aitor Gonzalez-Agirre, Jon Ander Campos, Aitor Soroa, and Eneko Agirre. 2020. Conversational Question Answering in Low Resource Scenarios: A Dataset and Case Study for Basque. In LREC. European Language Resources Association, 436–442.Google Scholar
- Jinyoung Park, Hyeong Kyu Choi, Juyeon Ko, Hyeonjin Park, Ji-Hoon Kim, Jisu Jeong, Kyungmin Kim, and Hyunwoo Kim. 2023. Relation-aware language-graph transformer for question answering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 13457–13464.Google ScholarDigital Library
- Jungin Park, Jiyoung Lee, and Kwanghoon Sohn. 2021. Bridge to answer: Structure-aware graph interaction network for video question answering. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 15526–15535.Google ScholarCross Ref
- Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.Google ScholarCross Ref
- Rivindu Perera and Parma Nand. 2014. Interaction History Based Answer Formulation for Question Answering. In KESW(Communications in Computer and Information Science, Vol. 468). Springer, 128–139.Google Scholar
- Volha Petukhova, Desmond Darma Putra, Alexandr Chernov, and Dietrich Klakow. 2015. Understanding Questions and Extracting Answers: Interactive Quiz Game Application Design. In LTC(Lecture Notes in Computer Science, Vol. 10930). Springer, 246–261.Google Scholar
- Akshit Pradhan, Pragya Shukla, Pallavi Patra, Rohit Pathak, and Ajay Kumar Jena. 2018. Enhancing Interaction with Social Networking Sites for Visually Impaired People by Using Textual and Visual Question Answering. In CICBA (2)(Communications in Computer and Information Science, Vol. 1031). Springer, 3–14.Google Scholar
- Zihao Qi, Dario Bertero, Ian D. Wood, and Pascale Fung. 2019. Incorporate User Representation for Personal Question Answer Selection Using Siamese Network. In ICASSP. IEEE, 7540–7544.Google Scholar
- Chen Qu, Liu Yang, Cen Chen, Minghui Qiu, W. Bruce Croft, and Mohit Iyyer. 2020. Open-Retrieval Conversational Question Answering. In SIGIR. ACM, 539–548.Google Scholar
- Chen Qu, Liu Yang, Minghui Qiu, W. Bruce Croft, Yongfeng Zhang, and Mohit Iyyer. 2019. BERT with History Answer Embedding for Conversational Question Answering. In SIGIR. ACM, 1133–1136.Google Scholar
- Chen Qu, Liu Yang, Minghui Qiu, Yongfeng Zhang, Cen Chen, W. Bruce Croft, and Mohit Iyyer. 2019. Attentive History Selection for Conversational Question Answering. In CIKM. ACM, 1391–1400.Google Scholar
- Pranav Rajpurkar, Robin Jia, and Percy Liang. 2018. Know What You Don’t Know: Unanswerable Questions for SQuAD. In ACL (2). Association for Computational Linguistics, 784–789.Google Scholar
- Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. SQuAD: 100, 000+ Questions for Machine Comprehension of Text. In EMNLP. The Association for Computational Linguistics, 2383–2392.Google Scholar
- Siva Reddy, Danqi Chen, and Christopher D. Manning. 2019. CoQA: A Conversational Question Answering Challenge. Trans. Assoc. Comput. Linguistics 7 (2019), 249–266.Google ScholarCross Ref
- Mengye Ren, Ryan Kiros, and Richard S. Zemel. 2015. Exploring Models and Data for Image Question Answering. In NIPS. 2953–2961.Google Scholar
- Heather Riley and Mohan Sridharan. 2019. Integrating Non-monotonic Logical Reasoning and Inductive Learning With Deep Learning for Explainable Visual Question Answering. Frontiers Robotics AI 6 (2019), 125.Google ScholarCross Ref
- Andreas Rücklé and Iryna Gurevych. 2017. End-to-End Non-Factoid Question Answering with an Interactive Visualization of Neural Attention Weights. In ACL (System Demonstrations). Association for Computational Linguistics, 19–24.Google Scholar
- Amrita Saha, Vardaan Pahuja, Mitesh M. Khapra, Karthik Sankaranarayanan, and Sarath Chandar. 2018. Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graph. arXiv:1801.10314 (2018).Google Scholar
- Wataru Sakata, Tomohide Shibata, Ribeka Tanaka, and Sadao Kurohashi. 2019. FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance. In SIGIR. ACM, 1113–1116.Google Scholar
- Apoorv Saxena, Adrian Kochsiek, and Rainer Gemulla. 2022. Sequence-to-Sequence Knowledge Graph Completion and Question Answering. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2814–2828.Google ScholarCross Ref
- Malte Schwarzer, Jonas Düver, Danuta Ploch, and Andreas Lommatzsch. 2016. An Interactive e-Government Question Answering System. In LWDA(CEUR Workshop Proceedings, Vol. 1670). CEUR-WS.org, 74–82.Google Scholar
- Bhaskar Sen, Nikhil Gopal, and Xinwei Xue. 2020. Support-BERT: Predicting Quality of Question-Answer Pairs in MSDN using Deep Bidirectional Transformer. CoRR abs/2005.08294(2020).Google Scholar
- Huan Shao, Yunlong Xu, Yi Ji, Jianyu Yang, and Chunping Liu. 2019. Intra-Modality Feature Interaction Using Self-attention for Visual Question Answering. In ICONIP (5)(Communications in Computer and Information Science, Vol. 1143). Springer, 215–222.Google Scholar
- Zhenwei Shao, Zhou Yu, Meng Wang, and Jun Yu. 2023. Prompting large language models with answer heuristics for knowledge-based visual question answering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 14974–14983.Google ScholarCross Ref
- Tao Shen, Xiubo Geng, Tao Qin, Daya Guo, Duyu Tang, Nan Duan, Guodong Long, and Daxin Jiang. 2019. Multi-Task Learning for Conversational Question Answering over a Large-Scale Knowledge Base. In EMNLP-IJCNLP (1). Association for Computational Linguistics, 2442–2451.Google Scholar
- Lei Shi, Shijie Geng, Kai Shuang, Chiori Hori, Songxiang Liu, Peng Gao, and Sen Su. 2020. Multi-Layer Content Interaction Through Quaternion Product for Visual Question Answering. In ICASSP. IEEE, 4412–4416.Google Scholar
- Andrew Shin, Yoshitaka Ushiku, and Tatsuya Harada. 2018. Customized Image Narrative Generation via Interactive Visual Question Generation and Answering. In CVPR. Computer Vision Foundation / IEEE Computer Society, 8925–8933.Google Scholar
- Wissam Siblini, Charlotte Pasqual, Axel Lavielle, and Cyril Cauchois. 2019. Multilingual Question Answering from Formatted Text applied to Conversational Agents. CoRR abs/1910.04659(2019).Google Scholar
- Daniil Sorokin and Iryna Gurevych. 2018. Interactive Instance-based Evaluation of Knowledge Base Question Answering. In EMNLP (Demonstration). Association for Computational Linguistics, 114–119.Google Scholar
- Lixin Su, Jiafeng Guo, Yixing Fan, Yanyan Lan, Ruqing Zhang, and Xueqi Cheng. 2019. An Adaptive Framework for Conversational Question Answering. In AAAI. AAAI Press, 10041–10042.Google Scholar
- Yu Su, Ahmed Hassan Awadallah, Miaosen Wang, and Ryen W. White. 2018. Natural Language Interfaces with Fine-Grained User Interaction: A Case Study on Web APIs. In SIGIR. ACM, 855–864.Google Scholar
- Yu Su, Huan Sun, Brian Sadler, Mudhakar Srivatsa, Izzeddin Gür, Zenghui Yan, and Xifeng Yan. 2016. On generating characteristic-rich question sets for qa evaluation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 562–572.Google ScholarCross Ref
- Hiroaki Sugiyama, Toyomi Meguro, and Ryuichiro Higashinaka. 2016. Evaluation of Question-Answering System About Conversational Agent’s Personality. In IWSDS(Lecture Notes in Electrical Engineering, Vol. 427). Springer, 183–194.Google Scholar
- Anirudh Sundar and Larry Heck. 2022. Multimodal conversational AI: A survey of datasets and approaches. arXiv preprint arXiv:2205.06907(2022).Google Scholar
- Oyvind Tafjord, Bhavana Dalvi, and Peter Clark. 2022. Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 2078–2093.Google ScholarCross Ref
- Yiming Tan, Dehai Min, Yu Li, Wenbo Li, Nan Hu, Yongrui Chen, and Guilin Qi. 2023. Can ChatGPT replace traditional KBQA models? An in-depth analysis of the question answering performance of the GPT LLM family. In International Semantic Web Conference. Springer, 348–367.Google ScholarDigital Library
- Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023. Stanford Alpaca: An Instruction-following LLaMA model. https://github.com/tatsu-lab/stanford_alpaca.Google Scholar
- Gemini Team, Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, et al. 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805(2023).Google Scholar
- Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, and Raviteja Anantha. 2021. Question Rewriting for Conversational Question Answering. In WSDM. ACM, 355–363.Google Scholar
- Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, and Raviteja Anantha. 2021. Question rewriting for conversational question answering. In Proceedings of the 14th ACM international conference on web search and data mining. 355–363.Google ScholarDigital Library
- Betty van Aken, Benjamin Winter, Alexander Löser, and Felix A. Gers. 2019. How Does BERT Answer Questions?: A Layer-Wise Analysis of Transformer Representations. In CIKM. ACM, 1823–1832.Google ScholarDigital Library
- Ulli Waltinger, Alexa Breuing, and Ipke Wachsmuth. 2012. Connecting Question Answering and Conversational Agents - Contextualizing German Questions for Interactive Question Answering Systems. Künstliche Intell. 26, 4 (2012), 381–390.Google ScholarCross Ref
- Mengqiu Wang, Noah A Smith, and Teruko Mitamura. 2007. What is the Jeopardy model? A quasi-synchronous grammar for QA. In Proceedings of the 2007 joint conference on empirical methods in natural language processing and computational natural language learning (EMNLP-CoNLL). 22–32.Google Scholar
- Zhiguo Wang, Patrick Ng, Xiaofei Ma, Ramesh Nallapati, and Bing Xiang. 2019. Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering. In EMNLP/IJCNLP (1). Association for Computational Linguistics, 5877–5881.Google Scholar
- Jason Weston, Antoine Bordes, Sumit Chopra, Alexander M Rush, Bart Van Merriënboer, Armand Joulin, and Tomas Mikolov. 2015. Towards ai-complete question answering: A set of prerequisite toy tasks. arXiv preprint arXiv:1502.05698(2015).Google Scholar
- Wilson Wong, Lawrence Cavedon, John Thangarajah, and Lin Padgham. 2012. Mixed-initiative conversational system using question-answer pairs mined from the web. In CIKM. ACM, 2707–2709.Google Scholar
- Wilson Wong, Lawrence Cavedon, John Thangarajah, and Lin Padgham. 2012. Strategies for Mixed-Initiative Conversation Management using Question-Answer Pairs. In COLING. Indian Institute of Technology Bombay, 2821–2834.Google Scholar
- Wilson Wong, John Thangarajah, and Lin Padgham. 2011. Health conversational system based on contextual matching of community-driven question-answer pairs. In CIKM. ACM, 2577–2580.Google Scholar
- Fei Wu, Xinyu Duan, Jun Xiao, Zhou Zhao, Siliang Tang, Yin Zhang, and Yueting Zhuang. 2017. Temporal Interaction and Causal Influence in Community-Based Question Answering. IEEE Trans. Knowl. Data Eng. 29, 10 (2017), 2304–2317.Google ScholarDigital Library
- Jinmeng Wu, Tingting Mu, Jeyarajan Thiyagalingam, and John Yannis Goulermas. 2020. Building interactive sentence-aware representation based on generative language model for community question answering. Neurocomputing 389(2020), 93–107.Google ScholarCross Ref
- Zhiyong Wu, Ben Kao, Tien-Hsuan Wu, Pengcheng Yin, and Qun Liu. 2020. PERQ: Predicting, Explaining, and Rectifying Failed Questions in KB-QA Systems. In WSDM. ACM, 663–671.Google ScholarDigital Library
- Zhipeng Xie. 2017. Enhancing Document-Based Question Answering via Interaction Between Question Words and POS Tags. In NLPCC(Lecture Notes in Computer Science, Vol. 10619). Springer, 136–147.Google Scholar
- Kun Xiong, Anqi Cui, Zefeng Zhang, and Ming Li. 2016. Neural Contextual Conversation Learning with Labeled Question-Answering Pairs. CoRR abs/1607.05809(2016).Google Scholar
- Jun Xu, Tao Mei, Ting Yao, and Yong Rui. 2016. MSR-VTT: A Large Video Description Dataset for Bridging Video and Language. In CVPR. IEEE Computer Society, 5288–5296.Google Scholar
- Jingjing Xu, Yuechen Wang, Duyu Tang, Nan Duan, Pengcheng Yang, Qi Zeng, Ming Zhou, and Xu Sun. 2019. Asking Clarification Questions in Knowledge-Based Question Answering. In EMNLP-IJCNLP (1). Association for Computational Linguistics, 1618–1629.Google Scholar
- Wei Yang, Yuqing Xie, Aileen Lin, Xingyu Li, Luchen Tan, Kun Xiong, Ming Li, and Jimmy Lin. 2019. End-to-End Open-Domain Question Answering with BERTserini. In NAACL-HLT (Demonstrations). Association for Computational Linguistics, 72–77.Google Scholar
- Wei Yang, Yuqing Xie, Luchen Tan, Kun Xiong, Ming Li, and Jimmy Lin. 2019. Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering. CoRR abs/1904.06652(2019).Google Scholar
- Yi Yang, Wen-tau Yih, and Christopher Meek. 2015. Wikiqa: A challenge dataset for open-domain question answering. In Proceedings of the 2015 conference on empirical methods in natural language processing. 2013–2018.Google ScholarCross Ref
- Zekun Yang, Noa Garcia, Chenhui Chu, Mayu Otani, Yuta Nakashima, and Haruo Takemura. 2020. BERT Representations for Video Question Answering. In WACV. IEEE, 1545–1554.Google Scholar
- Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018. HotpotQA: A dataset for diverse, explainable multi-hop question answering. arXiv preprint arXiv:1809.09600(2018).Google Scholar
- Wen-tau Yih, Matthew Richardson, Christopher Meek, Ming-Wei Chang, and Jina Suh. 2016. The value of semantic parse labeling for knowledge base question answering. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). 201–206.Google Scholar
- Xingdi Yuan, Marc-Alexandre Côté, Jie Fu, Zhouhan Lin, Chris Pal, Yoshua Bengio, and Adam Trischler. 2019. Interactive Language Learning by Question Answering. In EMNLP/IJCNLP (1). Association for Computational Linguistics, 2796–2813.Google Scholar
- Oksana Zdrok. 2023. The Rise of Generative Question Answering with LLMs. https://shelf.io/blog/the-rise-of-generative-question-answering-with-llms/ Accessed: 2024-03-06.Google Scholar
- Hongzhi Zhang, Guandong Xu, Xiao Liang, Tinglei Huang, and Kun Fu. 2018. An Attention-Based Word-Level Interaction Model: Relation Detection for Knowledge Base Question Answering. CoRR abs/1801.09893(2018).Google Scholar
- Sheng Zhang, Xin Zhang, Hui Wang, Jiajun Cheng, Pei Li, and Zhaoyun Ding. 2017. Chinese Medical Question Answer Matching Using End-to-End Character-Level Multi-Scale CNNs. Applied Sciences 7, 8 (2017), 767.Google ScholarCross Ref
- Sheng Zhang, Xin Zhang, Hui Wang, Lixiang Guo, and Shanshan Liu. 2018. Multi-Scale Attentive Interaction Networks for Chinese Medical Question Answer Selection. IEEE Access 6(2018), 74061–74071.Google ScholarCross Ref
- Xinbo Zhang, Lei Zou, and Sen Hu. 2019. An Interactive Mechanism to Improve Question Answering Systems via Feedback. In CIKM. ACM, 1381–1390.Google Scholar
- Yingying Zhang, Shengsheng Qian, Quan Fang, and Changsheng Xu. 2019. Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering. In ACM Multimedia. ACM, 1089–1097.Google Scholar
- Weiguo Zheng, Hong Cheng, Jeffrey Xu Yu, Lei Zou, and Kangfei Zhao. 2019. Interactive natural language question answering over knowledge graphs. Inf. Sci. 481(2019), 141–159.Google ScholarDigital Library
- Wanjun Zhong, Yifan Gao, Ning Ding, Yujia Qin, Zhiyuan Liu, Ming Zhou, Jiahai Wang, Jian Yin, and Nan Duan. 2022. ProQA: Structural Prompt-based Pre-training for Unified Question Answering. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 4230–4243.Google ScholarCross Ref
- Guangyou Zhou, Yin Zhou, Tingting He, and Wensheng Wu. 2016. Learning semantic representation with neural networks for community question answering retrieval. Knowledge-Based Systems 93 (2016), 75–83.Google ScholarDigital Library
- Zhiheng Zhou, Man Lan, Yuanbin Wu, and Jun Lang. 2017. Single turn Chinese emotional conversation generation based on information retrieval and question answering. In IALP. IEEE, 103–106.Google Scholar
- Chenguang Zhu, Michael Zeng, and Xuedong Huang. 2018. SDNet: Contextualized Attention-based Deep Network for Conversational Question Answering. CoRR abs/1812.03593(2018).Google Scholar
- Yuke Zhu, Oliver Groth, Michael Bernstein, and Li Fei-Fei. 2016. Visual7w: Grounded question answering in images. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4995–5004.Google ScholarCross Ref
Index Terms
- Interactive Question Answering Systems: Literature Review
Recommendations
Quality-aware collaborative question answering: methods and evaluation
WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data MiningCommunity Question Answering (QA) portals contain questions and answers contributed by hundreds of millions of users. These databases of questions and answers are of great value if they can be used directly to answer questions from any user. In this ...
Conversational question answering: a survey
AbstractQuestion answering (QA) systems provide a way of querying the information available in various formats including, but not limited to, unstructured and structured data in natural languages. It constitutes a considerable part of conversational ...
Towards Interactive Question Answering: An Ontology-Based Approach
ICSC '09: Proceedings of the 2009 IEEE International Conference on Semantic ComputingThe ability to provide both rich and natural answers with respect to a given question, and clear explanations for failures, is a crucial aspect for a future generation of Question Answering systems able to interact with a user. We argue that such ...
Comments