Reinforcement Learning (RL) has emerged as an effective approach to address a variety of complex control tasks. In a typical RL problem, an agent interacts with the environment by perceiving observations and performing actions, with the ultimate goal of maximizing the cumulative reward. In the traditional formulation, the environment is assumed to be a fixed entity that cannot be externally controlled. However, there exist several real-world scenarios in which the environment offers the opportunity to configure some of its parameters, with diverse effects on the agent’s learning process. In this contribution, we provide an overview of the main aspects of environment configurability. We start by introducing the formalism of the Configurable Markov Decision Processes (Conf-MDPs) and we illustrate the solutions concepts. Then, we revise the algorithms for solving the learning problem in Conf-MDPs. Finally, we present two applications of Conf-MDPs: policy space identification and control frequency adaptation.


    Access

    Download


    Export, share and cite



    Title :

    Configurable Environments in Reinforcement Learning: An Overview



    Publication date :

    2022-01-01



    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Automatic configuration of self-configurable environments

    LOWRY THOMAS ETHAN | European Patent Office | 2021

    Free access

    Automatic Configuration of Self-Configurable Environments

    LOWRY THOMAS ETHAN | European Patent Office | 2019

    Free access

    Automatic configuration of self-configurable environments

    LOWRY THOMAS ETHAN | European Patent Office | 2018

    Free access