Unmanned Aerial Vehicle (UAV) Vision-and-Language Navigation (VLN) is vital for applications such as disaster response, logistics delivery, and urban inspection. However, existing methods often struggle with insufficient multimodal fusion, weak generalization, and poor interpretability. To address these challenges, we propose FlightGPT, a novel UAV VLN framework built upon Vision-Language Models (VLMs) with powerful multimodal perception capabilities. We design a two-stage training pipeline: first, Supervised Fine-Tuning (SFT) using high-quality demonstrations to improve initialization and structured reasoning; then, Group Relative Policy Optimization (GRPO) algorithm, guided by a composite reward that considers goal accuracy, reasoning quality, and format compliance, to enhance generalization and adaptability. Furthermore, FlightGPT introduces a Chain-of-Thought (CoT)-based reasoning mechanism to improve decision interpretability. Extensive experiments on the city-scale dataset CityNav demonstrate that FlightGPT achieves state-of-the-art performance across all scenarios, with a 9.22\% higher success rate than the strongest baseline in unseen environments. Our implementation is publicly available.


    Access

    Download


    Export, share and cite



    Title :

    FlightGPT: Towards Generalizable and Interpretable UAV Vision-and-Language Navigation with Vision-Language Models


    Contributors:
    Cai, Hengxing (author) / Dong, Jinhan (author) / Tan, Jingjun (author) / Deng, Jingcheng (author) / Li, Sihang (author) / Gao, Zhifeng (author) / Wang, Haidong (author) / Su, Zicheng (author) / Sumalee, Agachai (author) / Zhong, Renxin (author)

    Publication date :

    2025


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English





    Embodied Vision-and-Language Navigation with Dynamic Convolutional Filters

    LANDI, FEDERICO / Baraldi, Lorenzo / CORSINI, Massimiliano et al. | BASE | 2019

    Free access

    Counterfactual Vision-and-Language Navigation via Adversarial Path Sampling

    Fu, Tsu-Jui / Wang, Xin Eric / Peterson, Matthew et al. | ArXiv | 2019

    Free access

    Multimodal Attention Networks for Low-Level Vision-and-Language Navigation

    Federico Landi / Lorenzo Baraldi / Marcella Cornia et al. | BASE | 2021

    Free access

    Guest Editorial: Language in Vision

    Yan, Yan / Lu, Jiwen / Mian, Ajmal et al. | British Library Online Contents | 2017