Traffic accidents frequently lead to fatal injuries, contributing to over 50 million deaths until 2023. To mitigate driving hazards and ensure personal safety, it is crucial to assist vehicles in anticipating important objects during travel. Previous research on important object detection primarily assessed the importance of individual participants, treating them as independent entities and frequently overlooking the connections between these participants. Unfortunately, this approach has proven less effective in detecting important objects in complex scenarios. In response, we introduce Driving scene Relationship self-Understanding transformer (DRUformer), designed to enhance the important object detection task. The DRUformer is a transformer-based multi-modal important object detection model that takes into account the relationships between all the participants in the driving scenario. Recognizing that driving intention also significantly affects the detection of important objects during driving, we have incorporated a module for embedding driving intention. To assess the performance of our approach, we conducted a comparative experiment on the DRAMA dataset, pitting our model against other state-of-the-art (SOTA) models. The results demonstrated a noteworthy 16.2\% improvement in mIoU and a substantial 12.3\% boost in ACC compared to SOTA methods. Furthermore, we conducted a qualitative analysis of our model's ability to detect important objects across different road scenarios and classes, highlighting its effectiveness in diverse contexts. Finally, we conducted various ablation studies to assess the efficiency of the proposed modules in our DRUformer model.


    Access

    Download


    Export, share and cite



    Title :

    DRUformer: Enhancing the driving scene Important object detection with driving relationship self-understanding


    Contributors:

    Publication date :

    2023


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    DRIVING SCENE UNDERSTANDING

    DING SHUGUANG / JIN YUEXIANG / FAN MINGYU et al. | European Patent Office | 2021

    Free access

    Auditory Scene Understanding for Autonomous Driving

    Furletov, Yury / Willert, Volker / Adamy, Jurgen | IEEE | 2021



    Enhancing Scene Simulation for Autonomous Driving with Neural Point Rendering

    Yang, Junqing / Yan, Yuxi / Chen, Shitao et al. | IEEE | 2023


    ADS driving scene generation

    GILLENHAMMAR MAGNUS / LINDBERG CARL | European Patent Office | 2024

    Free access