In this paper, a deep reinforcement learning (DRL) method for the global path planning of the water-air amphibious unmanned vehicle (WAAUV) is proposed. Firstly, the mathematical model of the WAAUV is constructed in line with the characteristics of an unmanned surface vehicle (USV) and a quadrotor unmanned aerial vehicle (UAV). Secondly, a Markov decision process (MDP) framework of the deep deterministic policy gradient (DDPG) algorithm is established to plan the path during navigation and flight, including the state space, the action space, and reward functions. In particular, the novel reward functions which overcome the sparse reward problem, are designed by fully considering the multiple constraints, such as reaching the goal point, energy consumption, obstacle avoidance, and so on. The control policy is trained with repeated trials by adjusting relevant parameters. Finally, through the simulations of the WAAUV in two modes, the feasibility and effectiveness of the proposed method is demonstrated.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Global path planning for amphibious unmanned vehicles with multiple constraints via deep reinforcement learning


    Beteiligte:
    Wu, Ting (Autor:in) / Wang, Ronghao (Autor:in) / Zhang, Yan (Autor:in) / Meng, Yuhang (Autor:in) / Xiang, Yuzhu (Autor:in) / Xiang, Zhengrong (Autor:in)


    Erscheinungsdatum :

    05.07.2024


    Format / Umfang :

    250181 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Unmanned Aerial Vehicles Path Planning Based on Deep Reinforcement Learning

    Wang, Guoqiu / Zheng, Xuanyu / Zhao, Haitong et al. | Springer Verlag | 2019


    Coverage Path Planning With Budget Constraints for Multiple Unmanned Ground Vehicles

    Tran, Vu Phi / Perera, Asanka / Garratt, Matthew A. et al. | IEEE | 2023



    UAV path planning with kinematic constraints based on deep reinforcement learning

    Gao, Mingsheng / Zhang, Xiaoxuan | British Library Conference Proceedings | 2022