With the increasing penetration of inverter-based renewable energy resources, deep reinforcement learning (DRL) has been proposed as one of the most promising solutions to realize real-time and autonomous control for future carbon-neutral power systems. In particular, DRL-based frequency control approaches have been extensively investigated to overcome the limitations of model-based approaches, such as the computational cost and scalability for large-scale systems. Nevertheless, the real-world implementation of DRLbased frequency control methods is facing the following fundamental challenges: 1) safety guarantee during the learning and decision-making processes; 2) adaptability against the dynamic system operating conditions. To this end, this is the first work that proposes an Adaptive and Safe-Certified DRL (AdapSafe) algorithm for frequency control to simultaneously address the aforementioned challenges. In particular, a novel self-tuning control barrier function is designed to actively compensate the unsafe frequency control strategies under variational safety constraints and thus achieve guaranteed safety. Furthermore, the concept of meta-reinforcement learning is integrated to significantly enhance its adaptiveness in non-stationary power system environments without sacrificing the safety cost. Experiments are conducted based on GB 2030 power system, and the results demonstrate that the proposed AdapSafe exhibits superior performance in terms of its guaranteed safety in both training and test phases, as well as its considerable adaptability against the dynamics changes of system parameters.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    AdapSafe: Adaptive and Safe-Certified Deep Reinforcement Learning-Based Frequency Control for Carbon-Neutral Power Systems


    Beteiligte:

    Erscheinungsdatum :

    2023-06-26


    Anmerkungen:

    In: Williams, Brian and Chen, Yiling and Neville, Jennifer, (eds.) Proceedings of the AAAI Conference on Artificial Intelligence. (pp. pp. 5294-5302). AAAI: Washington, D.C., USA. (2023)


    Medientyp :

    Paper


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    CERTIFIED ADVERSARIAL ROBUSTNESS FOR DEEP REINFORCEMENT LEARNING

    LUETJENS BJOERN MALTE / EVERETT MICHAEL F / HOW JONATHAN P et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Safe Deep Reinforcement Learning for Adaptive Cruise Control by Imposing State-Specific Safe Sets

    Brosowsky, Mathis / Keck, Florian / Ketterer, Jakob et al. | IEEE | 2021


    Towards Safe Deep Reinforcement Learning for Autonomous Airborne Collision Avoidance Systems

    Panoutsakopoulos, Christos / Yuksek, Burak / Inalhan, Gokhan et al. | AIAA | 2022


    Novel adaptive stability enhancement strategy for power systems based on deep reinforcement learning

    Zhao, Yincheng / Hu, Weihao / Zhang, Guozhou et al. | BASE | 2023

    Freier Zugriff