Deriving a meaningful caption for a Traffic Sign image is a challenging topic which is never addressed in prior literature. It is gaining a lot of traction with the introduction of tools and technologies in the fields of Natural Language Processing and Computer Vision. We discuss several concepts in this article, ranging from utilizing y, u, v color-space images to construct an artificial neural network to a single-mode neural architecture that functionally integrates image feature information with textual knowledge. We believe we are the first in the field to apply image captioning to traffic signs. Our model has been tested on GTSRB dataset and obtained a BLEU-1 score of 0.91. While many image captioning methods achieve good results by stacking one feature model on top of the sequential model, our traffic sign captioning work achieved better results by defining two concurrent models, one for feature extraction and one for sequence processing, and fusing them into a single architecture. Our architecture is quicker and capable of learning lengthy dependencies because of the usage of pre-trained models and an LSTM-based network.
Caption Generation for Traffic Signs Using a Deep Neural Scheme
Sae Int. J. Adv. and Curr. Prac. in Mobility
10TH SAE India International Mobility Conference ; 2022
Sae International Journal of Advances and Current Practices in Mobility ; 5 , 4 ; 1483-1489
2022-10-05
7 pages
Aufsatz (Konferenz)
Englisch
Caption Generation for Traffic Signs Using a Deep Neural Scheme
British Library Conference Proceedings | 2022
|CAPTION GENERATION FROM ROAD IMAGES FOR TRAFFIC SCENE CONSTRUCTION
British Library Conference Proceedings | 2020
|