A method for the creation of a liquid pouring controller is proposed, based on experimental data gathered from a small number of experiments. In a laboratory configuration, a UR5 robot arm equipped with a camera near the end effector holds a container. The camera captures the liquid pouring from the container as the robot adjusts its turning angles to achieve a specific pouring target volume. The proposed controller applies image analysis in a preprocessing stage to determine the liquid volume pouring from the container at each frame. This calculated volume, in conjunction with an estimated target volume in the receiving container, serves as input for a policy that computes the necessary turning angles for precise liquid pouring. The data received on the physical system is used as Monte-Carlo episodes for training an artificial neural network using a policy gradient method. Experiments with the proposed method are conducted using a simple simulation. Convergence proves to be fast and the achieved policy is independent of initial and goal volumes. ; PeerReviewed


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Offline feature-based reinforcement learning with preprocessed image inputs for liquid pouring control



    Erscheinungsdatum :

    2023-11-14


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    004 / 629




    Runway Configuration Management with Offline Reinforcement Learning

    Milad Memarzadeh / Tejas Puranik / Jarrett Battistini et al. | NTRS


    Ramp control method based on offline reinforcement learning and macroscopic model

    HAN YU / LI LINGHUI / GAO JINDA et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Adaptive traffic signal control method based on CQL offline reinforcement learning

    PI JIATIAN / YANG XINMIN / WU CHANGZHI | Europäisches Patentamt | 2023

    Freier Zugriff

    Signal lamp and route cooperative control method based on offline reinforcement learning

    OUYANG YAJIE / ZHAO KUO | Europäisches Patentamt | 2024

    Freier Zugriff

    Data-Driven Offline Reinforcement Learning for HVAC-Systems

    Blad, Christian / Bøgh, Simon / Kallesøe, Carsten | BASE | 2022

    Freier Zugriff