Forestry machines are heavy vehicles performing complex manipulation tasks in unstructured production forest environments. Together with the complex dynamics of the on-board hydraulically actuated cranes, the rough forest terrains have posed a particular challenge in forestry automation. In this study, the feasibility of applying reinforcement learning control to forestry crane manipulators is investigated in a simulated environment. Our results show that it is possible to learn successful actuator-space control policies for energy efficient log grasping by invoking a simple curriculum in a deep reinforcement learning setup. Given the pose of the selected logs, our best control policy reaches a grasping success rate of 97%. Including an energy-optimization goal in the reward function, the energy consumption is significantly reduced compared to control policies learned without incentive for energy optimization, while the increase in cycle time is marginal. The energy-optimization effects can be observed in the overall smoother motion and acceleration profiles during crane manipulation.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning Control of a Forestry Crane Manipulator


    Beteiligte:
    Andersson, Jennifer (Autor:in) / Bodin, Kenneth (Autor:in) / Lindmark, Daniel (Autor:in) / Servin, Martin (Autor:in) / Wallin, Erik (Autor:in)

    Erscheinungsdatum :

    2021-01-01



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    MANIPULATOR CRANE

    BABOCHENKO NATALYA VLADIMIROVNA | Europäisches Patentamt | 2020

    Freier Zugriff

    Gantry crane manipulator

    SONG FENG / JIANG SHAN / LI CHAO et al. | Europäisches Patentamt | 2015

    Freier Zugriff

    Intelligent Control of Manipulator Based on Deep Reinforcement Learning

    Zhou, Jiangtao / Zheng, Hua / Zhao, Dongzhu et al. | IEEE | 2021


    A TELESCOPIC ARM FOR A FORESTRY CRANE

    PISEK FRANC | Europäisches Patentamt | 2020

    Freier Zugriff