In modern industrial environments, human-robot collaboration is a trend in automation to improve performance and productivity. Instead of isolating robot from human to guarantee safety, collaborative robotics allows human and robot working in the same area at the same time. New hazards and risks, such as the collision between robot and human, arise in this situation. Safety analysis is necessary to protect both human and robot when using a collaborative robot.To perform safety analysis, robots need to perceive the surrounding environment in realtime. This surrounding environment is perceived and stored in the form of scene graph, which is a direct graph with semantic representation of the environment, the relationship between the detected objects and properties of these objects. In order to generate the scene graph, a simulated warehouse is used: robots and humans work in a common area for transferring products between shelves and conveyor belts. Each robot generates its own scene graph from the attached camera sensor. In the graph, each detected object is represented by a node and edges are used to denote the relationship among the identified objects. The graph node includes values like velocity, bounding box sizes, orientation, distance and directions between the object and the robot.We generate scene graph in a simulated warehouse scenario with the frequency of 7 Hz and present a study of Mask R-CNN based on the qualitative comparison. Mask R-CNN is a method for object instance segmentation to get the properties of the objects. It uses ResNetFPN for feature extraction and adds a branch to Faster R-CNN for predicting segmentation mask for each object. And its results outperform almost all existing, single-model entries on instance segmentation and bounding-box object detection. With the help of this method, the boundaries of the detected object are extracted from the camera images. We initialize Mask R-CNN model using three different types of weights: COCO pre-trained weight, ImageNet pre-trained weight and ...


    Access

    Download


    Export, share and cite



    Title :

    Scene Recognition for Safety Analysis in Collaborative Robotics


    Contributors:

    Publication date :

    2018-01-01


    Type of media :

    Theses


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Formal model of human erroneous behavior for safety analysis in collaborative robotics

    Askarpour M. / Mandrioli D. / Rossi M. et al. | BASE | 2019

    Free access

    Possibilities of Collaborative Robotics

    Tölli, Arttu | BASE | 2019

    Free access

    Collision avoidance for collaborative robotics

    Safeea, Mohammad | BASE | 2016

    Free access

    US-Japan Collaborative Robotics Research Program

    P. S. Schenker / S. Hirai | NTIS | 1994


    InHARD - Industrial Human Action Recognition Dataset in the Context of Industrial Collaborative Robotics

    DALLEL, Mejdi / HAVARD, Vincent / BAUDRY, David et al. | BASE | 2020

    Free access