We propose an image-based collision risk prediction model and a training strategy that allows training on simulated video data and successfully generalizes to real data. By doing so, we solve the data scarcity problem of collecting and labeling real (near) collisions, which are exceptionally rare events. Domain generalization from simulated to real data is taken into account by design by decoupling the learning strategy, and using task-specific, domain-resilient intermediate representations. Specifically, we use optical flow and vehicle bounding boxes, since they are instinctively related to the task of collision risk prediction and because their simulated-to-real domain gap is significantly lower than that of camera video data, i.e., they are more domain resilient. To demonstrate our approach, we present RiskNet, a novel neural network for image-based collision risk prediction, which classifies individual frames of a video sequence of a front-facing camera as safe or unsafe. Additionally, we present two novel datasets: the simulated Prescan dataset (which we intend to make publicly available) for training and the YouTube Driving Incidents Database (YDID) for real-world testing. The performance of RiskNet, trained solely on simulated data and tested on the real-world YDID, is comparable to that of a human driver, both in accuracy (91.8% vs. 93.6%) and F1-score (0.92 vs 0.94).


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Learning to Predict Collision Risk from Simulated Video Data


    Beteiligte:


    Erscheinungsdatum :

    2022-06-05


    Format / Umfang :

    3143958 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Predict Vehicle Collision by TTC From Motion Using a Single Video Camera

    Kilicarslan, Mehmet / Zheng, Jiang Yu | IEEE | 2019



    COLLISION RISK CALCULATION PROGRAM, COLLISION RISK CALCULATION METHOD, AND COLLISION RISK CALCULATION DEVICE

    SUZUKI HIROKO / SAITO TAKAHIRO / WATANABE ISAMU | Europäisches Patentamt | 2023

    Freier Zugriff

    COLLISION RISK CALCULATION PROGRAM, COLLISION RISK CALCULATION METHOD, AND COLLISION RISK CALCULATION DEVICE

    SUZUKI HIROKO / SAITO TAKAHIRO / WATANABE ISAMU | Europäisches Patentamt | 2018

    Freier Zugriff

    COLLISION RISK CALCULATION PROGRAM, COLLISION RISK CALCULATION METHOD, AND COLLISION RISK CALCULATION APPARATUS

    SUZUKI HIROKO / SAITO TAKAHIRO | Europäisches Patentamt | 2017

    Freier Zugriff