Whether it’s a driver warning or an autonomous driving system, ADAS needs to decide when to alert the driver of danger or take over control. This research formulates the problem as an alert-scene categorization one and proposes a method using contrastive learning. Given a front-view video of a driving scene, a set of anchor points is marked by a human driver, where an anchor point indicates that the semantic attribute of the current scene is different from that of the previous one. The anchor frames are then used to generate contrastive image pairs to train a feature encoder and obtain a scene similarity measure, so as to expand the distance of the scenes of different categories in the feature space. Each scene category is explicitly modeled to capture the meta pattern on the distribution of scene similarity values, which is then used to infer scene categories. Experiments are conducted using front-view videos that were collected during driving at a cluttered dynamic campus. The scenes are categorized into no alert, longitudinal alert, and lateral alert. The results are studied at both feature encoding, category modeling, and reasoning aspects. By comparing precision with two full supervised end-to-end baseline models, the proposed method demonstrates competitive or superior performance. However, it remains still questions: how to generate ground truth data and how to evaluate performance in ambiguous situations, which leads to future works.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Contrastive-Learning-Based Method for Alert-Scene Categorization


    Contributors:
    Hu, Shaochi (author) / Fan, Hanwei (author) / Gao, Biao (author) / Zhao, Huijing (author)


    Publication date :

    2022-06-05


    Size :

    2261688 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Improve scene categorization via sub-scene recognition

    Zhu, S. s. / Yung, N. H. | British Library Online Contents | 2014


    Deep Fuzzy Multi-Object Categorization in Scene

    S.Kumaravel / S. Veni | BASE | 2020

    Free access

    Feature Selection for Scene Categorization Using Support Vector Machines

    V., Devendran / Thiagarajan, Hemalatha / Santra, A. K. et al. | IEEE | 2008



    ALERT DEVICE, ALERT METHOD, AND ALERT PROGRAM

    IMBE SATORU | European Patent Office | 2023

    Free access