We propose an effective vehicle tracker and speed estimation method from Unmanned Aerial Vehicles (UAVs) videos that can be deployed on UAV-embedded edge devices. Our tracker uses segmentation-derived vehicle regions to initialise a MOSSE tracker. This enables road operators to make multipurpose use of segmentation outputs while still being able to track the vehicles across frames. The vehicle speed is estimated using flight parameters derived from the UAV's flight computer and the vehicle displacement across frames. We trained CABiNet on the UAVid urban segmentation benchmark dataset and finetuned it on a dataset collected at our study site. A mean Intersection over Union (mIoU) of 0.73 was obtained for the vehicle class. Our segmentation-initialised MOSSE tracker was evaluated on the VisDrone Multi-Object Tracking (MOT) benchmark dataset and compared against traditional methods that utilise object regions for tracker initialisation. Our approach yielded a Multi-Object Tracking Precision (MOTP) of 0.872 compared to 0.830 when using YOLOv4. Our vehicle speed estimations approach was evaluated using a privately collected ground truth vehicle speed dataset. Our approach yielded a Root Mean Square Error (RMSE) between 3.42 and 16.12 km/hr across different flight configurations. Finally, our approach was deployed on an NVIDIA Jetson Xavier NX edge device and could be executed at 8 Frames Per Second (FPS). The results indicate that our approach is a simple yet fast alternative to traditional tracking methods while producing multipurpose segmentation information.


    Access

    Download


    Export, share and cite



    Title :

    VEHICLE TRACKING AND SPEED ESTIMATION FROM UNMANNED AERIAL VEHICLES USING SEGMENTATION-INITIALISED TRACKERS


    Contributors:
    S. M. Tilon (author) / F. Nex (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Tracking from Unmanned Aerial Vehicles

    Meng, Channa ;Morris, John ;Sombattheera, Chattraku | Trans Tech Publications | 2015


    Vehicle Position Estimation with Aerial Imagery from Unmanned Aerial Vehicles

    Kruber, Friedrich / Morales, Eduardo Sanchez / Chakraborty, Samarjit et al. | IEEE | 2020


    Tracking from Unmanned Aerial Vehicles

    Meng, C. / Morris, J. / Sombattheera, C. | British Library Conference Proceedings | 2015


    VEHICLE POSITION ESTIMATION WITH AERIAL IMAGERY FROM UNMANNED AERIAL VEHICLES

    Kruber, Friedrich / Morales, Eduardo Sánchez / Chakraborty, Samarjit et al. | British Library Conference Proceedings | 2020


    Tracking unmanned aerial vehicles using reflected light

    BECKMAN BRIAN C / HASKIN MENASHE / PARENT GERSHON et al. | European Patent Office | 2017

    Free access