In this paper, we propose a new method for solving the reinforcement learning problem in a dynamically changing environment, as in vehicle navigation, in which the Markov Decision Process used in traditional reinforcement learning is modified so that the response of the environment is taken into consideration for determining the agent's next state. This is achieved by changing the action-value function to handle three parameters at a time, namely, the current state, action taken by the agent, and action taken by the environment. As it considers the actions by the agent and environment, it is termed "Double Action". Based on the Q-learning method, the proposed method is implemented and the update rule is modified to handle all of the three parameters. Preliminary results show that the proposed method has the sum of rewards (negative) 89.5% less than that of the traditional method. Apart form that, our new method also has the total number of collisions and mean steps used in one episode 89.5% and 15.5% lower than that of the traditional method respectively. © 2005 IEEE. ; published_or_final_version


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Double action Q-learning for obstacle avoidance in a dynamically changing environment


    Beteiligte:
    Ngai, DCK (Autor:in) / Yung, NHC (Autor:in)

    Erscheinungsdatum :

    2005-01-01



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Double Action Q-learning for obstacle avoidance in a dynamically changing environment

    Ngai, D. C. K. / Yung, N. H. C. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2005



    OBSTACLE AVOIDANCE ACTION

    GIER MAX / SILVA WILLIAM ANTHONY | Europäisches Patentamt | 2021

    Freier Zugriff

    Obstacle avoidance action

    GIER MAX / SILVA WILLIAM ANTHONY | Europäisches Patentamt | 2022

    Freier Zugriff

    Dynamically Sized Occupancy Grids for Obstacle Avoidance

    Marlow, Sean / Langelaan, Jack | AIAA | 2010