Autonomous unmanned aerial vehicles are able to sense their surrounding environments, and fly safely with little or no human intervention. Autonomous unmanned aerial vehicles are characterized by their ability to make decisions based on predicting future possible situations and learning from previous experiences. In this paper, we aim at developing algorithms that enable unmanned aerial vehicles to monitor and detect a dynamic uncertain target autonomously. This work considers a real monitoring system consists of a mission area, an autonomous unmanned aerial vehicle, a charging station, and a dynamic uncertain target. The mission area consists of two main areas, which are the area where the charging station is placed and the area where the target moves. The target area is divided to a number of subareas. We also adopt a time slotted system that has M equal-duration slots. The unmanned aerial vehicle is equipped with a battery of finite energy that can be recharged from the charging station. It can fly from one subarea to another during one time slot. The target moves from one subarea to another according to an unknown Markov process. In this context, we propose to using reinforcement learning algorithms that enables autonomous unmanned aerial vehicles to learn the movement of a dynamic uncertain target autonomously. Simulation results show that reinforcement learning algorithms outperform the performance of random and circular algorithms.11This work was supported by the ASPIRE Award for Research Excellence Program 2020 (Abu Dhabi, UAE) under grant AARE20-161.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning Method for Autonomous UAVs Monitoring an Uncertain Target


    Contributors:


    Publication date :

    2021-12-06


    Size :

    540050 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    A new deep reinforcement learning architecture for autonomous UAVs

    Muñoz Ferran, Guillem | BASE | 2018

    Free access


    Autonomous Ground Target Tracking by Multiple Cooperative UAVs

    Sinha, A. / Kirubarajan, T. / Bar-Shalom, Y. et al. | British Library Conference Proceedings | 2005


    Autonomous Ground Target Tracking by Multiple Cooperative UAVs

    Sinha, A. / Kirubarajan, T. / Bar-Shalom, Y. | IEEE | 2005