In this work, we introduce CHAIR (Classifier of Hallucination As ImproveR), a supervised framework for detecting hallucinations by analyzing internal logits from each layer of every token. Our method extracts a compact set of features such as maximum, minimum, mean, standard deviation, and slope-from the token logits across all layers, enabling effective hallucination detection without overfitting. Experiments on TruthfulQA and MMLU datasets demonstrate that CHAIR significantly improves detection accuracy, particularly in zero-shot scenarios, showcasing its robustness and generalizability. Beyond hallucination detection, CHAIR highlights the potential of using internal representations for designing advanced decoding strategies. By leveraging patterns in logits, we suggest that more sophisticated models and adaptive decoding methods could further reduce hallucinations and enhance text completion quality. CHAIR not only offers a practical solution for detecting hallucinations but also lays the groundwork for exploring richer representations in LLMs to improve their factuality and coherence.


    Access

    Download


    Export, share and cite



    Title :

    CHAIR -- Classifier of Hallucination as Improver


    Contributors:
    Sun, Ao (author)

    Publication date :

    2025


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Facial Expression Hallucination

    Su, Congyong / Huang, Li | IEEE | 2005


    Face Hallucination: Theory and Practice

    Liu, C. / Shum, H. Y. / Freeman, W. T. | British Library Online Contents | 2007


    Airstream improver for vehicles

    LIU WEI | European Patent Office | 2024

    Free access

    Image hallucination with primal sketch priors

    Jian Sun, / Nan-Ning Zheng, / Hai Tao, et al. | IEEE | 2003


    Face Hallucination through Dual Associative Learning

    Liu, W. / Lin, D. / Tang, X. | British Library Conference Proceedings | 2005