To ensure the safe and efficient navigation of autonomous vehicles and advanced driving assistance systems in complex traffic scenarios, predicting the future bounding boxes of surrounding traffic agents is crucial. However, simultaneously predicting the future location and scale of target traffic agents from the egocentric view poses challenges because the vehicles’ egomotion causes considerable field-of-view changes. Moreover, in anomalous or risky situations, tracking loss or abrupt motion changes limit the available observation time, requiring learning of cues within a short time window. Existing methods typically use a simple concatenation operation to combine different cues, overlooking their dynamics over time. To address this, this paper introduces the Fusion-Gated Recurrent Unit (Fusion-GRU) network, a novel encoder-decoder architecture for future bounding box localization. Unlike traditional gated recurrent units (GRUs), Fusion-GRU accounts for mutual and complex interactions among input features. Moreover, an intermediary estimator coupled with a self-attention aggregation layer is also introduced to learn sequential dependencies for long-range prediction. Finally, a GRU decoder is employed to predict the future bounding boxes. The proposed method is evaluated on two publicly available datasets, Risky Object Localization and Honda Egocentric Vehicle Intersection. The experimental results showcase the promising performance of the Fusion-GRU, demonstrating its effectiveness in predicting future bounding boxes of traffic agents.


    Access

    Download

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fusion-GRU: A Deep Learning Model for Future Bounding Box Prediction of Traffic Agents in Risky Driving Videos


    Additional title:

    Transportation Research Record: Journal of the Transportation Research Board


    Contributors:


    Publication date :

    2024-02-02




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    RISKY DRIVING DETECTION DEVICE, RISKY DRIVING DETECTION SYSTEM, AND RISKY DRIVING DETECTION PROGRAM

    UEDA KENKI / TACHIBANA RYOSUKE / KAWABATA SHINICHIRO et al. | European Patent Office | 2022

    Free access

    Traffic Analysis on Videos Using Deep Learning Techniques

    Telanakula, Srihasa / Kalluri, Hemantha Kumar | Springer Verlag | 2023


    Risky Driving or Risky Drivers?

    Leal, Nerida / Watson, Barry / Armstrong, Kerry | Transportation Research Record | 2010