In this study, we introduce an Unmanned Aerial Vehicle (UAV) centric visual semantic simultaneous localization and mapping (SLAM) framework that integrates RGB–D cameras, inertial measurement units (IMUs), and a 5G–enabled remote interaction module. Our system addresses three critical limitations in existing approaches: (1) Distance constraints in remote operations; (2) Static map assumptions in dynamic environments; and (3) High–dimensional perception requirements for UAV–based applications. By combining YOLO–based object detection with epipolar–constraint-based dynamic feature removal, our method achieves real-time semantic mapping while rejecting motion artifacts. The framework further incorporates a dual–channel communication architecture to enable seamless human–in–the–loop control over UAV–Unmanned Ground Vehicle (UGV) teams in large–scale scenarios. Experimental validation across indoor and outdoor environments indicates that the system can achieve a detection rate of up to 75 frames per second (FPS) on an NVIDIA Jetson AGX Xavier using YOLO–FASTEST, ensuring the rapid identification of dynamic objects. In dynamic scenarios, the localization accuracy attains an average absolute pose error (APE) of 0.1275 m. This outperforms state–of–the–art methods like Dynamic–VINS (0.211 m) and ORB–SLAM3 (0.148 m) on the EuRoC MAV Dataset. The dual-channel communication architecture (Web Real–Time Communication (WebRTC) for video and Message Queuing Telemetry Transport (MQTT) for telemetry) reduces bandwidth consumption by 65% compared to traditional TCP–based protocols. Moreover, our hybrid dynamic feature filtering can reject 89% of dynamic features in occluded scenarios, guaranteeing accurate mapping in complex environments. Our framework represents a significant advancement in enabling intelligent UAVs/UGVs to navigate and interact in complex, dynamic environments, offering real-time semantic understanding and accurate localization.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Unmanned Aerial Vehicle–Unmanned Ground Vehicle Centric Visual Semantic Simultaneous Localization and Mapping Framework with Remote Interaction for Dynamic Scenarios


    Beteiligte:
    Chang Liu (Autor:in) / Yang Zhang (Autor:in) / Liqun Ma (Autor:in) / Yong Huang (Autor:in) / Keyan Liu (Autor:in) / Guangwei Wang (Autor:in)


    Erscheinungsdatum :

    2025




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    Dynamic mapping method based on visual SLAM (Simultaneous Localization and Mapping) of unmanned aerial vehicle

    YAO LINA / WANG YAOZHENG / ZHANG SHUYUAN et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Unmanned aerial vehicle framework and unmanned aerial vehicle

    XU DUO | Europäisches Patentamt | 2023

    Freier Zugriff

    UNMANNED AERIAL VEHICLE AND LOCALIZATION METHOD FOR UNMANNED AERIAL VEHICLE

    XIE LIHUA / NGUYEN PHAM NHAT THIEN MINH / CAO MUQING et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    UNMANNED AERIAL VEHICLE AND LOCALIZATION METHOD FOR UNMANNED AERIAL VEHICLE

    XIE LIHUA / NGUYEN PHAM NHAT THIEN MINH / CAO MUQING et al. | Europäisches Patentamt | 2022

    Freier Zugriff