In the autonomous driving environment, Vulnerable Road Users (VRUs), including pedestrians and various types of riders with diverse visual attributes and unpredictable movements, necessitate prompt and precise motion intention to ensure their safety. However, detection methods tend to misidentify VRUs, while tracking methods struggle with maintaining fast-moving objects, and prediction methods overly depend on map topological data, which leads to unsatisfactory accuracy and reliability in VRU prediction. This paper introduces a DTP-M3Net for VRU-oriented monocular multiclass multistage detection, tracking and prediction. DTP-M3Net makes use of the basic location and classification information, as well as historical trajectories and coarse-to-fine semantic features to achieve comprehensive perception. Key innovations encompass a faster multi-object detection via deep neural network, an online multi-object tracking with ego-motion compensation, and a joint trajectory prediction based on a sequence-to-sequence network and spatial-temporal predicted cues. Excellently, deep convolutional features generated by detection are shared among downstream tracking and prediction modules. The effectiveness of proposed DTP-M3Net is validated on the public MOT challenge and VRU-Track dataset, demonstrating improvements in VRU perception.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    DTP-M3Net: Monocular Multiclass Multistage Vulnerable Road User Detection, Tracking and Prediction for Autonomous Driving


    Contributors:
    Xiong, Hui (author) / Zhang, Fang (author) / Fang, Xuzhi (author) / Huang, Heye (author) / Yuan, Quan (author) / Pan, Qinggui (author) / Zhang, Dezhao (author)


    Publication date :

    2024-09-24


    Size :

    2536759 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    MultiXNet: Multiclass Multistage Multimodal Motion Prediction

    Djuric, Nemanja / Cui, Henggang / Su, Zhaoen et al. | IEEE | 2021


    MULTIXNET: MULTICLASS MULTISTAGE MULTIMODAL MOTION PREDICTION

    Djuric, Nemanja / Cui, Henggang / Su, Zhaoen et al. | British Library Conference Proceedings | 2021


    Rapid tracking for autonomous driving with monocular video

    Wang, Patrick / Torrione, Peter / Collins, Leslie et al. | IEEE | 2013