Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Unanswerable Questions and Ambiguous Prompts
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Unanswerable Questions and Ambiguous Prompts
Hazel Kim,Adel Bibi,Philip H. S. Torr,Yarin Gal
2024 · DOI: 10.48550/arXiv.2412.10246
arXiv.org · 10 Citations
TLDR
This work presents a novel approach to detecting model hallucination through systematic analysis of information flow across model layers when processing inputs with insufficient or ambiguous context, and demonstrates that tracking cross-layer information dynamics provides robust indicators of model reliability.
