Inspired by hummingbirds and certain insects, flapping wing micro aerial vehicles (FWMAVs) exhibit potential energy efficiency and maneuverability advantages. Among them, the bi-directional motor-driven tailless FWMAV with simple structure prevails in research, but it requires active pose control for hovering. In this paper, we employ deep reinforcement learning to train a low-level hovering strategy that directly maps the drone’s state to motor voltage outputs. To our knowledge, other FWMAVs in both reality and simulations still rely on classical proportional-derivative controllers for pose control. Our learning-based approach enhances strategy robustness through domain randomization, eliminating the need for manually fine-tuning gain parameters. The effectiveness of the strategy is validated in a high-fidelity simulation environment, showing that for an FWMAV with a wingspan of approximately 200 mm, the center of mass is maintained within a 20 mm radius during hovering. Furthermore, the strategy is utilized to demonstrate point-to-point flight, trajectory tracking, and controlled flight of multiple drones.


    Access

    Download


    Export, share and cite



    Title :

    Hovering of Bi-Directional Motor Driven Flapping Wing Micro Aerial Vehicle Based on Deep Reinforcement Learning


    Contributors:
    Haitian Hu (author) / Zhiyuan Zhang (author) / Zhaoguo Wang (author) / Xuan Wang (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Hovering and gliding multi-wing flapping micro aerial vehicle

    RATTI JAYANT / JONES EMANUEL / VACHTSEVANOS GEORGE | European Patent Office | 2016

    Free access

    Wing kinematics and aerodynamics of a hovering flapping Micro Aerial Vehicle

    Prosser, D / Basrai, T / Dickert, J et al. | IEEE | 2011


    Hovering flapping wing aircraft and hovering flapping wing flight method

    WANG JUN / LI FUQIANG / WU BAOLEI | European Patent Office | 2023

    Free access

    OPTIMAL HOVERING WING KINEMATICS OF FLAPPING-WING MODEL USING REINFORCEMENT LEARNING

    Yang, H.-H. / Lee, S.-G. / Han, Y.-J. et al. | British Library Conference Proceedings | 2022


    Design and Implementation of Hovering Flapping Wing Micro Air Vehicle

    Li, Jiaxiang / Wang, Chao / Liu, Jin et al. | British Library Conference Proceedings | 2019