Pedestrian detection is an important task in computer vision, which is also an important part of intelligent transportation systems. For privacy protection, thermal images are widely used in pedestrian detection problems. However, thermal pedestrian detection is challenging due to the significant effect of temperature variation on the illumination of images and that fine-grained illumination annotations are difficult to be acquired. The existing methods have attempted to exploit coarse-grained day/night labels, which however even hampers the model performance. In this work, we introduce a novel idea of regressing conditional thermal-visible feature distribution, dubbed as Illumination Distribution-Aware adaptation (IDA). The key idea is to predict the conditional visible feature distribution given a thermal image, subject to their pre-computed joint distribution. Specifically, we first estimate the thermal-visible feature joint distribution by constructing feature co-occurrence matrices, offering a conditional probability distribution for any given thermal image. With this pairing information, we then form a conditional probability distribution regression task for model optimization. Critically, as a model agnostic strategy, this allows the visible feature knowledge to be transferred to the thermal counterpart implicitly for learning more discriminating feature representation. Experiment results show that our method outperforms the prior art methods, which use extra illumination annotations. Besides, as a plug-in, our method can averagely reduce about 2% MR on KAIST dataset, and improve about 1% mAP on FLIR-aligned and Autonomous Vehicles datasets without extra calculation for test. Code is available at https://github.com/HaMeow-lst1/IDA.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Illumination Distribution-Aware Thermal Pedestrian Detection


    Contributors:
    Li, Songtao (author) / Ye, Mao (author) / Ji, Luping (author) / Tang, Song (author) / Gan, Yan (author) / Zhu, Xiatian (author)

    Published in:

    Publication date :

    2024-11-01


    Size :

    1748543 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Illumination-Aware Hallucination-Based Domain Adaptation for Thermal Pedestrian Detection

    Xie, Qian / Cheng, Ta-Ying / Dai, Zhuangzhuang et al. | IEEE | 2024


    Context-aware pedestrian detection using LIDAR

    Oliveira, L / Nunes, U | IEEE | 2010


    CONCEPT-AWARE ENSEMBLE SYSTEM FOR PEDESTRIAN DETECTION

    Lin, H. / Kim, K. / Choi, K. et al. | British Library Conference Proceedings | 2014


    Fixed Illumination for Pedestrian Protection

    M. Freedman / M. S. Janoff / B. W. Koth et al. | NTIS | 1975