A reinforcement learning system includes a plurality of agents, each agent having an individual reward function and one or more safety constraints that involve joint actions of the agents, wherein each agent maximizes a team-average long-term return in performing the joint actions, subject to the safety constraints, and participates in operating a physical system. A peer-to-peer communication network is configured to connect the plurality of agents. A distributed constrained Markov decision process (D-CMDP) model is implemented over the peer-to-peer communication network and is configured to perform policy optimization using a decentralized policy gradient (PG) method, wherein the participation of each agent in operating the physical system is based on the D-CMDP model.


    Access

    Download


    Export, share and cite



    Title :

    DECENTRALIZED POLICY GRADIENT DESCENT AND ASCENT FOR SAFE MULTI-AGENT REINFORCEMENT LEARNING


    Contributors:
    LU SONGTAO (author) / HORESH LIOR (author) / CHEN PIN-YU (author) / LIU SIJIA (author) / CHEN TIANYI (author)

    Publication date :

    2023-04-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05B Steuer- oder Regelsysteme allgemein , CONTROL OR REGULATING SYSTEMS IN GENERAL



    Ascent/Descent Software

    Brown, Charles / Andrew, Robert / Roe, Scott et al. | NTRS | 2012


    STEP ASCENT/DESCENT VEHICLE

    YONEDA KAN / URA HIROYUKI | European Patent Office | 2015

    Free access

    STEP FOR ASCENT/DESCENT

    TSUKAMOTO NORIHISA | European Patent Office | 2016

    Free access

    Lunar descent and ascent trajectories

    Bennett, F. V. | NTRS | 1970


    Apollo lunar ascent and descent.

    Kayton, M. | NTRS | 1967