This work addresses the problem of retrieving a target object from cluttered environment using a robot manipulator. In the details, the proposed solution relies on a Task and Motion Planning approach based on a two-level architecture: the high-level is a Task Planner aimed at finding the optimal objects sequence to relocate, according to a metric based on the objects weight; the low-level is a Motion Planner in charge of planning the end-effector path for reaching the specific objects taking into account the robot physical constraints. The high-level task planner is a Reinforcement Learning agent, trained using the information coming from the low-level Motion Planner. In this work we consider the Q-Tree algorithm, which is based on a dynamic tree structure inspired by the Q-learning technique. Three different RL-policies with two kinds of tree exploration techniques (Breadth and Depth) are compared in simulation scenarios with different complexity. Moreover, the proposed learning methods are experimentally validated in a real scenario by adopting a KINOVA Jaco2 7-DoFs robot manipulator.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Objects Relocation in Clutter with Robot Manipulators via Tree-based Q-Learning Algorithm: Analysis and Experiments



    Erscheinungsdatum :

    2022-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Robot Manipulators

    Y. P. Popov | NTIS | 1975


    Robot Manipulators

    Bräunl, Thomas | Springer Verlag | 2022



    An Efficient algorithm for robot manipulators dynamic computation

    Tenreiro Machado, J. A. / Matos, J. S. / Carvalho, J. M. et al. | BASE | 1988

    Freier Zugriff

    Learning Sliding Policy of Flat Multi-target Objects in Clutter Scenes

    Wu, Liangdong / Wu, Jiaxi / Li, Zhengwei et al. | BASE | 2024

    Freier Zugriff