Video captioning aims to generate textual descriptions according to the video contents. The risk assessment of autonomous driving vehicles has become essential for an insurance company for providing adequate insurance coverage, in particular, for emerging MaaS business. The insurers need to assess the risk of autonomous driving business plans with a fixed route by analyzing a large number of driving data, including videos recorded by dash cameras and sensor signals. To make the process more efficient, generating captions for driving videos can provide insurers concise information to understand the video contents quickly. A natural problem with driving video captioning is, since the absence of egovehicles in these egocentric videos, descriptions of latent driving behaviors are difficult to be grounded in specific visual cues. To address this issue, we focus on generating driving video captions with accurate behavior descriptions, and propose to incorporate in-vehicle sensors which encapsulate the driving behavior information to assist the caption generation. We evaluate our method on the Japanese driving video captioning dataset called City Traffic, where the results demonstrate the effectiveness of in-vehicle sensors on improving the overall performance of generated captions, especially on generating more accurate descriptions for the driving behaviors.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Driving Behavior Aware Caption Generation for Egocentric Driving Videos Using In-Vehicle Sensors*


    Beteiligte:
    Zhang, Hongkuan (Autor:in) / Takeda, Koichi (Autor:in) / Sasano, Ryohei (Autor:in) / Adachi, Yusuke (Autor:in) / Ohtani, Kento (Autor:in)


    Erscheinungsdatum :

    11.07.2021


    Format / Umfang :

    3992274 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systems

    Yao, Yu / Xu, Mingze / Choi, Chiho et al. | ArXiv | 2018

    Freier Zugriff

    DRIVING BEHAVIOR-AWARE ADVANCED DRIVING ASSISTANCE SYSTEM

    UCAR SEYHAN / SISBOT EMRAH AKIN / ZEIYNALI FARID YASHAR et al. | Europäisches Patentamt | 2024

    Freier Zugriff


    Detecting Vehicle Interactions in Driving Videos via Motion Profiles

    Wang, Zheyuan / Zheng, Jiang Yu / Gao, Zhen | IEEE | 2020