Autonomous driving requires a structured understanding of the surrounding road maps and networks to navigate. However, considering the flexibility of autonomous vehicles and the variations in lane curvature and shape, the online and accurate extraction of road maps with fine-grained boundaries and road networks with lane topology in a unified framework remains challenging. This paper proposes SRSU, an online road map detection and network estimation framework for structured bird's-eye view road scene understanding. Specifically, we introduce a hierarchical map representation, i.e., representing the road map as a set of ordered point sets with equivalent permutations and the road network as a directed graph, accurately describing the fine-grained map boundaries and lane topology in a unified framework. Building upon the above representation, we propose an online hierarchical map construction framework. It utilizes two sets of learnable hierarchical query embeddings to extract road maps with fine-grained boundaries and road networks with lane topologies, achieving a comprehensive understanding of the road scene. Furthermore, we introduce three empirical modules to enhance the accuracy of hierarchical map construction. These modules are termed auxiliary task prediction, multi-modal distillation, and higher-order interaction, responsible for enhancing the model's representational capabilities and providing valuable auxiliary information for subsequent tasks, generating robust features for final tasks, and learning the association information between different tasks, respectively. Finally, experiments on the nuScenes dataset demonstrate the proposed framework's effectiveness while highlighting the empirical module's superiority.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SRSU: An Online Road Map Detection and Network Estimation for Structured Bird's-Eye View Road Scene Understanding


    Contributors:
    Jia, Peng (author) / Jiang, Yahui (author) / Ju, Zhiyang (author) / Qi, Jianyong (author) / Zang, Zheng (author) / Wang, Yuchun (author) / Gong, Jianwei (author)

    Published in:

    Publication date :

    2024-12-01


    Size :

    16907659 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Structured Bird’s-Eye View Road Scene Understanding from Surround Video

    Jia, Peng / Gong, Jianwei / Jiang, Yahui et al. | IEEE | 2024


    Semantic Bird's-Eye View Road Line Mapping

    Bellusci, Matteo / Cudrano, Paolo / Mentasti, Simone et al. | IEEE | 2023


    RoadBEV: Road Surface Reconstruction in Bird’s Eye View

    Zhao, Tong / Yang, Lei / Xie, Yichen et al. | IEEE | 2024



    FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systems

    Song, Rui / Xu, Runsheng / Festag, Andreas et al. | IEEE | 2024

    Free access