Methods, systems, and computer-readable media for using inverse reinforcement learning to learn constraints from expert demonstrations are disclosed. The constraints may be learned as a constraint function in two alternating procedures, namely policy optimization and constraint function optimization. Neural network constraint functions may be learned which can represent arbitrary constraints. Embodiments are disclosed that work in all types of environments, with either discrete or continuous state and action spaces. Embodiments are disclosed that may scale to a large set of demonstrations. Embodiments are disclosed that work with any forward CRL technique when finding the optimal policy.


    Access

    Download


    Export, share and cite



    Title :

    SYSTEMS AND METHODS TO LEARN CONSTRAINTS FROM EXPERT DEMONSTRATIONS


    Contributors:

    Publication date :

    2023-11-23


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Safety Aware Reinforcement Learning by Identifying Comprehensible Constraints in Expert Demonstrations

    Müller, Leopold / Böcking, Lars / Färber, Michael | TIBKAT | 2022

    Free access

    Airship Control using Expert Demonstrations

    Daskiran, Onur / Dogan, Atilla | AIAA | 2016


    Distributional expert demonstrations for autonomous driving

    WU SZU-HAO / JIANG SHU / CAO YU et al. | European Patent Office | 2025

    Free access

    DISTRIBUTIONAL EXPERT DEMONSTRATIONS FOR AUTONOMOUS DRIVING

    WU SZU-HAO / JIANG SHU / CAO YU et al. | European Patent Office | 2023

    Free access

    Prediction from expert demonstrations for safe tele-surgery

    Chowriappa, A. / Wirz, R. / Ashammagari, A. R. et al. | British Library Online Contents | 2013