A novel framework for joint segmentation and tracking in depth videos of object surfaces is presented. Initially, the 3D colored point cloud obtained using the Kinect camera is used to segment the scene into surface patches, defined by quadratic functions. The computed segments together with their functional descriptions are then used to partition the depth image of the subsequent frame in a consistent manner with respect to the precedent frame. This way, solutions established in previous frames can be reused which improves the efficiency of the algorithm and the coherency of the segmentations along the movie. The algorithm is tested for scenes showing human and robot manipulations of objects. We demonstrate that the method can successfully segment and track the human/robot arm and object surfaces along the manipulations. The performance is evaluated quantitatively by measuring the temporal coherency of the segmentations and the segmentation covering using ground truth. The method provides a visual front-end designed for robotic applications, and can potentially be used in the context of manipulation recognition, visual servoing, and robot-grasping tasks ; Peer Reviewed ; Postprint (author’s final draft)


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Joint segmentation and tracking of object surfaces in depth movies along human/robot manipulations



    Erscheinungsdatum :

    2013-01-01


    Medientyp :

    Sonstige


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    Joint segmentation and tracking of object surfaces in depth movies along human/robot manipulations

    Dellen, Babette / Husain, Farzad / Torras, Carme | BASE | 2013

    Freier Zugriff


    Mobile robot capable of moving forward along brick joint in tracking mode and tracking method of mobile robot

    FANG QIU / HE ZHIHAO / GUO XINGHAO et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Road Movies

    Weingroff, Richard F. | Online Contents | 1996


    Integrating tracking with fine object segmentation

    Papoutsakis, K. E. / Argyros, A. A. | British Library Online Contents | 2013