Status quo autonomous driving mechanisms rely on fusing the multimodal sensing data to integrate the information from onboard units of a vehicle, e.g., lidar, camera, etc., and have yet to consider the information obtained via the inter-vehicle communication, such as the status of neighboring peers. In this paper, we consider to integrate not only the local onboard sensing data, but also the neighboring vehicle information from the vehicle-to-vehicle (V2V) data pipe, which is demonstrated to improve the autonomous driving performance significantly. Specifically, the opportunistic V2V messages are input to a transformer based fusing framework to improve the driving accuracy in both short and long routes in CARLA environment. Unlike previous rule-based mechanisms of dealing with the V2V messages, to the best of our knowledge, the proposed method is the first to integrate the V2V data to the neural network which implicitly induce the waypoints for accurate end-to-end autonomous driving. We conduct extensive experiments, whose results well demonstrate the utility of the V2V information, and can provide useful inspirations for future driving system design.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fusing Onboard Modalities with V2V Information for Autonomous Driving


    Contributors:
    Wan, Haodong (author) / Xu, Wenchao (author) / Cheng, Nan (author) / Yin, Zhisheng (author)


    Publication date :

    2022-06-01


    Size :

    2890366 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    ONBOARD INFORMATION PROCESSING DEVICE, AUTONOMOUS DRIVING SYSTEM, AND ONBOARD SYSTEM

    ANDO KOICHI / AMPO KEISUKE | European Patent Office | 2023

    Free access

    Autonomous onboard optical processor for driving aid [2344-27]

    Attia, M. / Servel, A. / Guibert, L. et al. | British Library Conference Proceedings | 1995


    Onboard autonomous science

    Ellery, Alex | Springer Verlag | 2015


    Onboard Autonomous Planning System

    Herz, Ella / George, Doug / Esposito, Timothy et al. | AIAA | 2014


    Onboard Autonomous Rover Science

    Castano, Rebecca / Estlin, Tara / Gaines, Dan et al. | IEEE | 2007