Multi-robot cooperative navigation is an important task, which has been widely studied in many fields like logistics, transportation, and disaster rescue. However, most of the existing methods either require some strong assumptions or are validated in simple scenarios, which greatly hinders their implementation in the real world. In this paper, more complex environments are considered in which robots can only acquire local observations from their own sensors and have only limited communication capabilities for mapless collaborative navigation. To address this challenging task, we propose a hierarchical framework, by fusing both Sensor-wise and Agent-wise features for Perception-Improving (SAPI), which can adaptively integrate features from different information sources to improve perception capabilities. Specifically, to facilitate scene understanding, we assign prior knowledge to the visual coder to generate efficient embeddings. For effective feature representation, an attention-based sensor fusion network is designed to fuse sensor-level information of visual and LiDAR sensors, while graph convolution with multi-head attention mechanism is applied to aggregate agent-level information from an arbitrary number of neighbors. In addition, reinforcement learning is used to optimize the policy, where a novel compound reward function is introduced to guide training. Extensive experiments demonstrate that our method has excellent generalization ability in different scenarios and scalability for large-scale systems.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Hierarchical Perception-Improving for Decentralized Multi-Robot Motion Planning in Complex Scenarios


    Contributors:
    Jia, Yunjie (author) / Song, Yong (author) / Xiong, Bo (author) / Cheng, Jiyu (author) / Zhang, Wei (author) / Yang, Simon X. (author) / Kwong, Sam (author)


    Publication date :

    2024-07-01


    Size :

    5096376 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Hierarchical Motion Planning for Autonomous Driving in Large-Scale Complex Scenarios

    Zhang, Songyi / Jian, Zhiqiang / Deng, Xiaodong et al. | IEEE | 2022


    DECENTRALIZED MULTI-ROBOT PLANNING TO EXPLORE AND PERCEIVE

    Matignon, Laetitia / Jeanpierre, Laurent / Mouaddib, Abdel-Illah | BASE | 2015

    Free access