This paper presents an artificial cognitive system tightly integrating object perception and manipulation for assistive robotics. This is necessary for assistive robots, not only to perform manipulation tasks in a reasonable amount of time and in an appropriate manner, but also to robustly adapt to new environments by handling new objects. In particular, this system includes perception capabilities that allow robots to incrementally learn object categories from the set of accumulated experiences and reason about how to perform complex tasks. To achieve these goals, it is critical to detect, track and recognize objects in the environment as well as to conceptualize experiences and learn novel object categories in an open-ended manner, based on human–robot interaction. Interaction capabilities were developed to enable human users to teach new object categories and instruct the robot to perform complex tasks. A naive Bayes learning approach with a Bag-of-Words object representation are used to acquire and refine object category models. Perceptual memory is used to store object experiences, feature dictionary and object category models. Working memory is employed to support communication purposes between the different modules of the architecture. A reactive planning approach is used to carry out complex tasks. To examine the performance of the proposed architecture, a quantitative evaluation and a qualitative analysis are carried out. Experimental results show that the proposed system is able to interact with human users, learn new object categories over time, as well as perform complex tasks. ; published


    Access

    Download


    Export, share and cite



    Title :

    Towards lifelong assistive robotics: a tight coupling between object perception and manipulation


    Contributors:

    Publication date :

    2018-05-24


    Remarks:

    1872-8286



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    004 / 629




    The State of Lifelong Learning in Service Robots:Current Bottlenecks in Object Perception and Manipulation

    Kasaei, S. Hamidreza / Melsen, Jorik / Beers, Floris van et al. | BASE | 2021

    Free access

    Shared Control Templates for Assistive Robotics

    Quere, Gabriel / Hagengruber, Annette / Iskandar, Maged Samuel Zakri et al. | German Aerospace Center (DLR) | 2020

    Free access

    Ethically Aligned Design for Assistive Robotics

    Weng, Yueh-Hsuan / Hirata, Yasuhisa | IEEE | 2018


    Employing Whole-Body Control in Assistive Robotics

    Iskandar, Maged / Quere, Gabriel / Hagengruber, Annette et al. | German Aerospace Center (DLR) | 2019

    Free access

    Feel-good robotics: requirements on touch for embodiment in assistive robotics

    Beckerle, Philipp / Kõiva, Risto / Kirchner, Elsa Andrea et al. | BASE | 2018

    Free access