Video captioning aims to generate textual descriptions according to the video contents. The risk assessment of autonomous driving vehicles has become essential for an insurance company for providing adequate insurance coverage, in particular, for emerging MaaS business. The insurers need to assess the risk of autonomous driving business plans with a fixed route by analyzing a large number of driving data, including videos recorded by dash cameras and sensor signals. To make the process more efficient, generating captions for driving videos can provide insurers concise information to understand the video contents quickly. A natural problem with driving video captioning is, since the absence of egovehicles in these egocentric videos, descriptions of latent driving behaviors are difficult to be grounded in specific visual cues. To address this issue, we focus on generating driving video captions with accurate behavior descriptions, and propose to incorporate in-vehicle sensors which encapsulate the driving behavior information to assist the caption generation. We evaluate our method on the Japanese driving video captioning dataset called City Traffic, where the results demonstrate the effectiveness of in-vehicle sensors on improving the overall performance of generated captions, especially on generating more accurate descriptions for the driving behaviors.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Driving Behavior Aware Caption Generation for Egocentric Driving Videos Using In-Vehicle Sensors*


    Contributors:


    Publication date :

    2021-07-11


    Size :

    3992274 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Egocentric Vision-based Future Vehicle Localization for Intelligent Driving Assistance Systems

    Yao, Yu / Xu, Mingze / Choi, Chiho et al. | ArXiv | 2018

    Free access

    DRIVING BEHAVIOR-AWARE ADVANCED DRIVING ASSISTANCE SYSTEM

    UCAR SEYHAN / SISBOT EMRAH AKIN / ZEIYNALI FARID YASHAR et al. | European Patent Office | 2024

    Free access


    Detecting Vehicle Interactions in Driving Videos via Motion Profiles

    Wang, Zheyuan / Zheng, Jiang Yu / Gao, Zhen | IEEE | 2020