In this paper, we propose a dynamic responsive policy for a quadrotor to traverse through narrow gaps based on deep reinforcement learning (RL). The policy provides agile and dynamically adjusted gap-traversing actions for the quadrotor in real-time by directly mapping the observed states of the quadrotor and gaps to motor thrusts. In contrast to existing optimization-based methods, our RL-based policy couples trajectory planning and control modules, which are strictly independent and computationally complex in previous works. Moreover, a safety-aware exploration is presented to reduce the collision risk and improve the safety of the policy, which also facilitates the transfer of the policy to real-world environments. Specifically, we formulate a safety reward on the state spaces of both position and orientation to inspire the quadrotor to traverse through the narrow gap at an appropriate attitude closer to the center of the gap. With the learned gap-traversing policy, we implement extensive simulations and real-world experiments to evaluate its performance and compare it with the related approaches. Our implementation includes several gap-traversing tasks with random positions and orientations, even if never trained specially before. All the performances indicate that our RL-based gap-traversing policy is transferable and more efficient in terms of real-time dynamic response, agility, time-consuming, and generalization.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Learning Real-Time Dynamic Responsive Gap-Traversing Policy for Quadrotors With Safety-Aware Exploration


    Beteiligte:
    Chen, Shiyu (Autor:in) / Li, Yanjie (Autor:in) / Lou, Yunjiang (Autor:in) / Lin, Ke (Autor:in) / Wu, Xinyu (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-03-01


    Format / Umfang :

    6031481 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    PAMPC: Perception-Aware Model Predictive Control for Quadrotors

    Falanga, Davide / Foehn, Philipp / Lu, Peng et al. | BASE | 2018

    Freier Zugriff

    Real-time implementation of a decoupled and robust velocity controller for quadrotors

    Liu, Hao / Hou, Xiaolei / Kim, Jonghyuk et al. | IEEE | 2013


    Decentralized real time implementation of a leader-follower coordination strategy for quadrotors

    Corona-Sanchez, Jose J. / Vargas-Jacob, Juan A. / Rodriguez-Cortes, H. | IEEE | 2014


    Nonlinear MPC for Multiple Quadrotors in Dynamic Environments

    Recalde, Luis F. / Guevara, Bryan S. / Andaluz, Victor et al. | IEEE | 2022


    Controlled Manipulation with Multiple Quadrotors

    Srikanth, Manohar / Soto, Albert / Annaswamy, Anuradha et al. | AIAA | 2011