Unmanned Aerial Vehicles (UAVs) are able to provide instantaneous visual cues and a high-level data throughput that could be further leveraged to address complex tasks, such as semantically rich scene understanding. In this work, we built on the use of Large Language Models (LLMs) and Visual Language Models (VLMs), together with a state-of-the-art detection pipeline, to provide thorough zero-shot UAV scene literary text descriptions. The generated texts achieve a GUNNING Fog median grade level in the range of 7–12. Applications of this framework could be found in the filming industry and could enhance user experience in theme parks or in the advertisement sector. We demonstrate a low-cost highly efficient state-of-the-art practical implementation of microdrones in a well-controlled and challenging setting, in addition to proposing the use of standardized readability metrics to assess LLM-enhanced descriptions.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Semantic Scene Understanding with Large Language Models on Unmanned Aerial Vehicles


    Beteiligte:
    J. de Curtò (Autor:in) / I. de Zarzà (Autor:in) / Carlos T. Calafate (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    UNMANNED AERIAL VEHICLES

    NUÑEZ FERNANDEZ ALBERTO / HILARIO SERRANO EDUARDO / SERRANO MONTERO CESAR | Europäisches Patentamt | 2024

    Freier Zugriff

    UNMANNED AERIAL VEHICLES

    NUÑEZ FERNANDEZ ALBERTO / HILARIO SERRANO EDUARDO / SERRANO MONTERO CESAR | Europäisches Patentamt | 2024

    Freier Zugriff

    Unmanned Aerial Vehicles

    IAIN MATTHEW RUSSELL | Europäisches Patentamt | 2023

    Freier Zugriff

    UNMANNED AERIAL VEHICLES

    QIU LI | Europäisches Patentamt | 2021

    Freier Zugriff

    Unmanned aerial vehicles

    IAIN MATTHEW RUSSELL | Europäisches Patentamt | 2020

    Freier Zugriff