Camera-based Bird'View (BEV) 3D object detection is thoroughly challenging and essential in autonomous driving perception system for alleviating the impression caused by object overlap and occlusion effectively. 3D multi-object tracking is one of the most important perception tasks in autonomous driving system, which suffers from the narrow view provided by only one single camera. In this paper, we present a novel framework called BEVMOT, which combines multi-object detection and tracking task in a unified framework in a considerable inference speed. The encoder of our framework generates the 360 degree panoramic image around the ego-car in the bird's eyes view utilizing the multiple cameras equipped on the car to broaden the perception field. An efficient decoder composes of multi-head attention and deformable attention following by a multi-object detection and tracking head, which learn the object center point and tracking embedding for acquiring object boxes and tracking id directly without the NMS post-processing. Meanwhile, tracking branch utilize tracking embedding to initialize new trajectories, update existing trajectories and achieve data association frame-by-frame. Extensive experiments show that our approach represents wonderful performance on NuScenes datasets, which exceeds many classic methods in term of AMOTA and AMOTP metrics.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    BEVMOT: A Multi-Object Detection and Tracking Method in Bird's-Eye-View via Spatiotemporal Transformers


    Contributors:
    Cui, Chenglin (author) / Song, Ruiqi (author) / Li, XinQing (author) / Ai, Yunfeng (author)


    Publication date :

    2023-09-24


    Size :

    8149511 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Real-Time Bird’s Eye View Multi-Object Tracking system based on Fast Encoders for Object Detection

    Gomez-Huelamo, Carlos / Del Egido, Javier / Bergasa, Luis M. et al. | IEEE | 2020


    BIRD'S EYE VIEW

    Online Contents | 1998


    BIRD'S EYE VIEW

    Online Contents | 1998


    BIRD'S EYE VIEW

    Online Contents | 1998


    BIRD'S EYE VIEW

    Online Contents | 1997