Abstract The required learning time and curse of dimensionality restrict the applicability of Reinforcement Learning(RL) on real robots. Difficulty in inclusion of initial knowledge and understanding the learned rules must be added to the mentioned problems. In this paper we address automatic state abstraction and creation of hierarchies in RL agent’s mind, as two major approaches for reducing the number of learning trials, simplifying inclusion of prior knowledge, and making the learned rules more abstract and understandable. We formalize automatic state abstraction and hierarchy creation as an optimization problem and derive a new algorithm that adapts decision tree learning techniques to state abstraction. The proof of performance is supported by strong evidences from simulation results in nondeterministic environments. Simulation results show encouraging enhancements in the required number of learning trials, agent’s performance, size of the learned trees, and computation time of the algorithm. Keywords: State Abstraction, Hierarchical Reinforcement Learning


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reduction of Learning Time for Robots Using Automatic State Abstraction


    Beteiligte:


    Erscheinungsdatum :

    01.01.2006


    Format / Umfang :

    14 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Efficient Failure Detection for Mobile Robots Using Mixed-Abstraction Particle Filters

    Plagemann, Christian / Stachniss, Cyrill / Burgard, Wolfram | Springer Verlag | 2006


    Automatic home video abstraction using audio contents [4925-52]

    Zhao, M. / Chen, C. F. / Chen, C. et al. | British Library Conference Proceedings | 2002


    An Abstraction

    Emerald Group Publishing | 1951


    Domain-Abstraction-Based Approach for Learning Multidomain Planning

    Chae, Hyeok-Joo / Choi, Han-Lim | AIAA | 2021