Intelligent vehicle driving systems aim to control the driving behavior of a vehicle in real time without human intervention by perceiving and monitoring the surrounding environment. Describing images of traffic scenes automatically, which is one of the key problems of intelligent vehicle driving technology, has drawn attention since its inception. In recent years, a variety of automatic image description technologies have been proposed, among which the attention-based encoder-decoder framework achieved good results. In this paper we will discuss the fusing of a variety of information from multiple aspects of the images of traffic scenes. First, we will introduce visual attention, text attention and image topics attention which generates the weighted visual features, the attentive text information and the global image topics information respectively. We will then propose an adaptive two-stage merging network based on an encoder-decoder framework, which can fully integrate the three kinds of information in two stages, while automatically calculating the proportions of the information at each time step. Numerous experiments conducted on COCO2014 and Flickr30K datasets have demonstrated the effectiveness and advantages of the proposed method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Two-Stage Merging Network for Describing Traffic Scenes in Intelligent Vehicle Driving System


    Contributors:
    Song, Heng (author) / Zhu, Junwu (author) / Jiang, Yi (author)

    Published in:

    Publication date :

    2022-12-01


    Size :

    2716906 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Network traffic instability with automated driving and cooperative merging

    Gu, Ziyuan / Wang, Zelin / Liu, Zhiyuan et al. | Elsevier | 2022


    Research on Intelligent Vehicle Traffic Scenes Mapping Algorithm Considering Dynamic Objects

    Liu, Tongtong / Dong, Honghui / Zhou, Yue et al. | IEEE | 2023


    Road intelligent traffic system for vehicle automatic driving

    YANG HUAJIE / LI YINDONG | European Patent Office | 2022

    Free access

    Describing Visual Scenes Using Transformed Objects and Parts

    Sudderth, E. B. / Torralba, A. / Freeman, W. T. et al. | British Library Online Contents | 2008


    Estimating relative vehicle motions in traffic scenes

    Duric, Z. / Goldenberg, R. / Rivlin, E. et al. | Tema Archive | 2002