Researchers develop cost-efficient method for detecting hallucinations in large language models

Researchers from Skoltech and Sberbank's Center for Practical Artificial Intelligence have proposed a new method, TOHA, for detecting hallucinations in large language models operating in retrieval-augmented generation (RAG) systems. The approach analyzes the topological structure of a model's attention maps and makes it possible to identify responses that are not supported by the provided context. The method does not require training additional models and uses only a small amount of annotated data for configuration.