Unmanned surface vehicle (USV) has witnessed a rapid growth in the recent decade and has been applied in various practical applications in both military and civilian domains. USVs can either be deployed as a single unit or multiple vehicles in a fleet to conduct ocean missions. Central to the control of USV and USV formations, path planning is the key technology that ensures the navigation safety by generating collision free trajectories. Compared with conventional path planning algorithms, the deep reinforcement learning (RL) based planning algorithms provides a new resolution by integrating a high-level artificial intelligence. This work investigates the application of deep reinforcement learning algorithms for USV and USV formation path planning with specific focus on a reliable obstacle avoidance in constrained maritime environments. For single USV planning, with the primary aim being to calculate a shortest collision avoiding path, the designed RL path planning algorithm is able to solve other complex issues such as the compliance with vehicle motion constraints. The USV formation maintenance algorithm is capable of calculating suitable paths for the formation and retain the formation shape robustly or vary shapes where necessary, which is promising to assist with the navigation in environments with cluttered obstacles. The developed three sets of algorithms are validated and tested in computer-based simulations and practical maritime environments extracted from real harbour areas in the UK.


    Access

    Download


    Export, share and cite



    Title :

    Learn to navigate: cooperative path planning for unmanned surface vehicles using deep reinforcement learning


    Contributors:
    Zhou, X (author) / Wu, P (author) / Zhang, H (author) / Guo, W (author) / Liu, Y (author)

    Publication date :

    2019-11-13


    Remarks:

    IEEE Access , 7 pp. 165262-165278. (2019)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Cooperative path planning of unmanned aerial vehicles

    Tsourdos, Antonios / White, Brian / Shanmugavel, Madhavan | TIBKAT | 2011


    Cooperative path planning of unmanned aerial vehicles

    Tsourdos, Antonios ;White, Brian ;Shanmugavel, Madhavan | SLUB | 2011


    Cooperative path planning of unmanned aerial vehicles

    Tsourdos, Antonios / White, Brian / Shanmugavel, Madhavan | TIBKAT | 2011