In this paper, we propose a new method for solving the reinforcement learning problem in a dynamically changing environment, as in vehicle navigation, in which the Markov Decision Process used in traditional reinforcement learning is modified so that the response of the environment is taken into consideration for determining the agent's next state. This is achieved by changing the action-value function to handle three parameters at a time, namely, the current state, action taken by the agent, and action taken by the environment. As it considers the actions by the agent and environment, it is termed "Double Action". Based on the Q-learning method, the proposed method is implemented and the update rule is modified to handle all of the three parameters. Preliminary results show that the proposed method has the sum of rewards (negative) 89.5% less than that of the traditional method. Apart form that, our new method also has the total number of collisions and mean steps used in one episode 89.5% and 15.5% lower than that of the traditional method respectively. © 2005 IEEE. ; published_or_final_version


    Access

    Download


    Export, share and cite



    Title :

    Double action Q-learning for obstacle avoidance in a dynamically changing environment


    Contributors:
    Ngai, DCK (author) / Yung, NHC (author)

    Publication date :

    2005-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Double Action Q-learning for obstacle avoidance in a dynamically changing environment

    Ngai, D. C. K. / Yung, N. H. C. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2005


    Obstacle avoidance action

    GIER MAX / SILVA WILLIAM ANTHONY | European Patent Office | 2022

    Free access

    OBSTACLE AVOIDANCE ACTION

    GIER MAX / SILVA WILLIAM ANTHONY | European Patent Office | 2021

    Free access

    Dynamically Sized Occupancy Grids for Obstacle Avoidance

    Marlow, Sean / Langelaan, Jack | AIAA | 2010