The fourth industrial (I4.0) revolution encourages automatic online monitoring of all products to achieve zero-defect and high-quality production. In this scenario, collaborative robots, in which humans and robots share the same workspace, are a suitable solution that integrates the precision of a robot with the ability and flexibility of a human. To improve human-robot collaboration, human changeable choices or even non-significant mistakes should be allowed or corrected during work. This paper proposes a robust online optimization of the Dassembly sequence through Robust Adversaria lReinforcement Learning (RARL), where an artificial agent is deliberately trying to boycott the assembly completion. To demonstrate the applicability of robust human-robot collaborative assembly using adversarial RL, an environment composed of Markov Decision Process (MDP) like grid world is developed and a multi-agent RL approach is integrated. The results of the framework are promising: the robot observation on human activities has been successfully achieved thanks to a penalty-reward system adopted and the alternation of human to robot actions for the wrong terminal state is the one pursued by the human, but due to robot blockage wrong actions, the right terminal state is followed by human, which is the same as the robot target.


    Access

    Download


    Export, share and cite



    Title :

    Robust Adversarial Reinforcement Learning for Optimal Assembly Sequence Definition in a Cobot Workcell



    Publication date :

    2022-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    An REU Experience With Micro Assembly Workcell Research

    Stapleton, William / Asiabanpour, Bahram / Jimenez, Jesus et al. | BASE | 2010

    Free access


    3D Printing with a Cobot Arm

    Trtnik, Ales | BASE | 2022

    Free access

    Adversarial Proximal Policy Optimisation for Robust Reinforcement Learning

    Ince, Bilkan / Shin, Hyo-Sang / Tsourdos, Antonios | AIAA | 2024