Object detection in drone-captured imagery has attracted significant attention due to its wide range of real-world applications, including surveillance, disaster response, and environmental monitoring. Although the majority of existing methods are developed under closed-set assumptions, and some recent studies have begun to explore open-vocabulary or open-world detection, their application to UAV imagery remains limited and underexplored. In this paper, we address this limitation by exploring the relationship between images and textual semantics to extend object detection in UAV imagery to an open-vocabulary setting. We propose a novel and efficient detector named Unmanned Aerial Vehicle Open-Vocabulary Detector (UAV-OVD), specifically designed for drone-captured scenes. To facilitate open-vocabulary object detection, we propose improvements from three complementary perspectives. First, at the training level, we design a region–text contrastive loss to replace conventional classification loss, allowing the model to align visual regions with textual descriptions beyond fixed category sets. Structurally, building on this, we introduce a multi-level text-guided fusion decoder that integrates visual features across multiple spatial scales under language guidance, thereby improving overall detection performance and enhancing the representation and perception of small objects. Finally, from the data perspective, we enrich the original dataset with synonym-augmented category labels, enabling more flexible and semantically expressive supervision. Experiments conducted on two widely used benchmark datasets demonstrate that our approach achieves significant improvements in both mean mAP and Recall. For instance, for Zero-Shot Detection on xView, UAV-OVD achieves 9.9 mAP and 67.3 Recall, 1.1 and 25.6 higher than that of YOLO-World. In terms of speed, UAV-OVD achieves 53.8 FPS, nearly twice as fast as YOLO-World and five times faster than DetrReg, demonstrating its strong potential for real-time open-vocabulary detection in UAV imagery.


    Access

    Download


    Export, share and cite



    Title :

    UAV-OVD: Open-Vocabulary Object Detection in UAV Imagery via Multi-Level Text-Guided Decoding


    Contributors:
    Lijie Tao (author) / Guoting Wei (author) / Zhuo Wang (author) / Zhaoshuai Qi (author) / Ying Li (author) / Haokui Zhang (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Toward High-Resolution UAV Imagery Open-Vocabulary Semantic Segmentation

    Zimo Chen / Yuxiang Xie / Yingmei Wei | DOAJ | 2025

    Free access

    Highway Abandoned Objects Recognition Based on Open Vocabulary Object Detection Approach

    Liu, Siwen / Zhuang, Yifan / Zheng, Nanfang et al. | ASCE | 2024



    Text recognition on traffic panels from street-level imagery

    Gonzalez, A. / Bergasa, L. M. / Yebes, J. Javier et al. | IEEE | 2012


    Homerobot: Open-vocabulary mobile manipulation

    Yenamandra, S. | DataCite | 2024