In this traffic-scene-modeling study, we propose an image-captioning network which incorporates element attention into an encoder-decoder mechanism to generate more reasonable scene captions. A visual-relationship-detecting network is also developed to detect the relative positions of object pairs. Firstly, the traffic scene elements are detected and segmented according to their clustered locations. Then, the image-captioning network is applied to generate the corresponding description of each traffic scene element. The visual-relationship-detecting network is utilized to detect the position relations of all object pairs in the subregion. The static and dynamic traffic elements are appropriately selected and organized to construct a 3D model according to the captions and the position relations. The reconstructed 3D traffic scenes can be utilized for the offline test of unmanned vehicles. The evaluations and comparisons based on the TSD-max, KITTI and Microsoft’s COCO datasets demonstrate the effectiveness of the proposed framework.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Caption Generation From Road Images for Traffic Scene Modeling


    Beteiligte:
    Li, Yaochen (Autor:in) / Wu, Chuan (Autor:in) / Li, Ling (Autor:in) / Liu, Yuehu (Autor:in) / Zhu, Jihua (Autor:in)


    Erscheinungsdatum :

    2022-07-01


    Format / Umfang :

    16594524 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Caption Generation from Road Images for Traffic Scene Construction

    Wu, Chuan / Li, Yaochen / Li, Ling et al. | IEEE | 2020


    CAPTION GENERATION FROM ROAD IMAGES FOR TRAFFIC SCENE CONSTRUCTION

    Wu, Chuan / Li, Yaochen / Li, Ling et al. | British Library Conference Proceedings | 2020


    Road Traffic Scene Acquisition

    Celinski, Ireneusz / Lukasik, Jerzy / Surma, Szymon et al. | TIBKAT | 2019


    Caption Generation for Traffic Signs Using a Deep Neural Scheme

    Sarkar, Janarddan / Ramachandran, Radhika / Kizhiyedath, Sreejith | British Library Conference Proceedings | 2022


    Road Traffic Scene Acquisition

    Celiński, Ireneusz / Łukasik, Jerzy / Surma, Szymon et al. | Springer Verlag | 2018