The paper introduces a pioneering work that explores the fusion of computer vision and natural language processing for narrative generation. We propose an innovative methodology that combines the GRiT model for dense captioning with the GPT model for story generation. GRiT extracts detailed object descriptions from images, while GPT constructs cohesive storylines based on these descriptions. The integrated approach aims to generate narratives with visual and textual information. Through experimental validation and qualitative analysis, we demonstrate the effectiveness of our method in creating engaging stories from visual content. Our paper advances AI-driven narrative generation and opens avenues for applications in digital storytelling, content creation, and creative AI.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Enhanced Dense Image Captioning Based On Transformers




    Publication date :

    2024-11-06


    Size :

    940648 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Remote Sensing Image Captioning Using Transformer

    Wang, Binze / Xi, Jiangbo / Wang, Xingrun et al. | British Library Conference Proceedings | 2022


    Remote Sensing Image Captioning Using Transformer

    Wang, Binze / Xi, Jiangbo / Wang, Xingrun et al. | Springer Verlag | 2022


    Multimodal Sentiment Analysis Based on Image Captioning and Attention Mechanism

    Sun, Ye / Jin, Guozhe / Zhao, Yahui et al. | IEEE | 2023


    Traffic Scenario Understanding and Video Captioning via Guidance Attention Captioning Network

    Liu, Chunsheng / Zhang, Xiao / Chang, Faliang et al. | IEEE | 2024


    A Comparative Study on Optimizers for Automatic Image Captioning

    Thavaraj A, Eliyah Immanuel / Juliet, Sujitha / J, Anila Sharon | IEEE | 2022