Driving has various risk factors, including the possibility of traffic accidents involving pedestrians and/or oncoming vehicles. A driver assistance system that can prevent traffic accidents must be able to get the driver ' s attention. A practical solution for attention attraction should involve caption generation from in-vehicle images. Although a number of approaches for caption generation with deep neural networks have been proposed, they are inadequate for the specific risk factors while driving. The reason is that conventional captioning methods focus on not these factors but the entirety of an image. To tackle this problem, we first created a dataset to attract attention, one that considers risk factors during driving. Furthermore, we propose an image captioning method for the assistance system. Our method is based on neural baby talk and introduces an attention mask focusing on risk factors in an image. The mask enables our model to generate captions on each factor. Experimental results with our created dataset show that our method can generate captions for ideal attention attraction.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Attention Neural Baby Talk: Captioning of Risk Factors while Driving


    Contributors:


    Publication date :

    2019-10-01


    Size :

    2582598 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Traffic Scenario Understanding and Video Captioning via Guidance Attention Captioning Network

    Liu, Chunsheng / Zhang, Xiao / Chang, Faliang et al. | IEEE | 2024


    Visual Attention While Performing Driving and Driving-Related Tasks

    Underwood, G. / Crundall, D. / Chapman, P. | British Library Conference Proceedings | 1997


    VISUAL ATTENTION WHILE PERFORMING DRIVING AND DRIVING-RELATED TASKS

    Underwood, G. / Crundall, D. / Chapman, P. | British Library Conference Proceedings | 1997


    SYSTEM AND METHOD FOR ASSESSING USER ATTENTION WHILE DRIVING

    ZILBERMAN BOAZ / VAKULENKO MICHAEL / SANDLERMAN NIMROD et al. | European Patent Office | 2017

    Free access

    SYSTEM AND METHOD FOR ASSESSING USER ATTENTION WHILE DRIVING

    ZILBERMAN BOAZ / VAKULENKO MICHAEL / SANDLERMAN NIMROD et al. | European Patent Office | 2016

    Free access