Deriving a meaningful caption for a Traffic Sign image is a challenging topic which is never addressed in prior literature. It is gaining a lot of traction with the introduction of tools and technologies in the fields of Natural Language Processing and Computer Vision. We discuss several concepts in this article, ranging from utilizing y, u, v color-space images to construct an artificial neural network to a single-mode neural architecture that functionally integrates image feature information with textual knowledge. We believe we are the first in the field to apply image captioning to traffic signs. Our model has been tested on GTSRB dataset and obtained a BLEU-1 score of 0.91. While many image captioning methods achieve good results by stacking one feature model on top of the sequential model, our traffic sign captioning work achieved better results by defining two concurrent models, one for feature extraction and one for sequence processing, and fusing them into a single architecture. Our architecture is quicker and capable of learning lengthy dependencies because of the usage of pre-trained models and an LSTM-based network.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Caption Generation for Traffic Signs Using a Deep Neural Scheme


    Weitere Titelangaben:

    Sae Int. J. Adv. and Curr. Prac. in Mobility


    Beteiligte:

    Kongress:

    10TH SAE India International Mobility Conference ; 2022



    Erscheinungsdatum :

    2022-10-05


    Format / Umfang :

    7 pages




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Caption Generation for Traffic Signs Using a Deep Neural Scheme

    Sarkar, Janarddan / Ramachandran, Radhika / Kizhiyedath, Sreejith | British Library Conference Proceedings | 2022


    CAPTION GENERATION FROM ROAD IMAGES FOR TRAFFIC SCENE CONSTRUCTION

    Wu, Chuan / Li, Yaochen / Li, Ling et al. | British Library Conference Proceedings | 2020


    Caption Generation from Road Images for Traffic Scene Construction

    Wu, Chuan / Li, Yaochen / Li, Ling et al. | IEEE | 2020


    Caption Generation From Road Images for Traffic Scene Modeling

    Li, Yaochen / Wu, Chuan / Li, Ling et al. | IEEE | 2022