This paper proposes a multi-task unified decoding framework for the panoptic driving perception, Sparse U-PDP. This framework’s primary objective is to combine vehicle object detection, lane detection and drivable area segmentation tasks. This paper mainly builds a multi-task unified decoder and further explores whether the potential connection between multi-tasks can improve the robustness of the model. Experiments demonstrate that the proposed Sparse U-PDP outperforms the present state-of-the-art multi-task model in terms of accuracy. The primary contributions of this work are as follows: First, we present the approach to unified multi-task representation. We abstract the multi-task into the “dynamic convolution kernels” representation form to build a highly unified multi-task decoder. Second, we use the proposed dynamic interaction module to establish different feature sampling pipelines for various task features. Lastly, our model is verified on the BDD100K dataset, where we achieve an AP50 of 84.1 in the “vehicle” category, 32.0 IoU in the lane detection, and 93.0 mIoU in the drivable area segmentation with the helper of CSP-Darknet. That is to say; Sparse U-PDP verifies that a more unified task representation form can implicitly increase the mutual help between different task branches.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Sparse U-PDP: A Unified Multi-Task Framework for Panoptic Driving Perception


    Contributors:
    Wang, Hai (author) / Qiu, Meng (author) / Cai, Yingfeng (author) / Chen, Long (author) / Li, Yicheng (author)

    Published in:

    Publication date :

    2023-10-01


    Size :

    2220129 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    MtpNet: Multi-Task Panoptic Driving Perception Network

    Li, Zheng / Yuan, Xiaohui / Sun, Bifan et al. | IEEE | 2025


    Multi-task Network for Panoptic Segmentation in Automated Driving

    Petrovai, Andra / Nedevschi, Sergiu | IEEE | 2019


    LiDAR-PDP: A LiDAR-Based Panoptic Dynamic Driving Environment Perception Algorithm

    Wang, Hai / Li, Jianguo / Cai, Yingfeng et al. | IEEE | 2025



    Depth-Aware Panoptic Segmentation with Mask Transformers and Panoptic Bins for Autonomous Driving

    Petrovai, Andra / Miclea, Vlad-Cristian / Nedevschi, Sergiu | IEEE | 2024