A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
Lei Huang Harbin Institute of Technology800 Dongchuan RoadHarbinHeilongjiangChina150001 , Weijiang Yu Huawei Inc.Bantian SubdistrictShenzhenGuangdongChina518129 , Weitao Ma , Weihong Zhong Harbin Institute of Technology800 Dongchuan RoadHarbinHeilongjiangChina150001 , Zhangyin Feng , Haotian Wang Harbin Institute of Technology800 Dongchuan RoadHarbinHeilongjiangChina150001 , Qianglong Chen , Weihua Peng Huawei Inc.Bantian SubdistrictShenzhenGuangdongChina518129 , Xiaocheng Feng , Bing Qin and Ting Liu Harbin Institute of Technology800 Dongchuan RoadHarbinHeilongjiangChina150001
Abstract
The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating plausible yet nonfactual content. This phenomenon raises significant concerns over the reliability of LLMs in real-world information retrieval (IR) systems and has attracted intensive research to detect and mitigate such hallucinations. Given the open-ended general-purpose attributes inherent to LLMs, LLM hallucinations present distinct challenges that diverge from prior task-specific models. This divergence highlights the urgency for a nuanced understanding and comprehensive overview of recent advances in LLM hallucinations. In this survey, we begin with an innovative taxonomy of hallucination in the era of LLM and then delve into the factors contributing to hallucinations. Subsequently, we present a thorough overview of hallucination detection methods and benchmarks. Our discussion then transfers to representative methodologies for mitigating LLM hallucinations. Additionally, we delve into the current limitations faced by retrieval-augmented LLMs in c
原文 arXiv:2311.05232;中英对照 + 大白话阅读 https://aha.fim.ai/paper/2311.05232v2