In order for robots to interact with humans on real-world scenarios or objects, these robots need to construct a representa- tion (‘state of mind’) of these scenarios that a) are grounded in the robots’ perception and b) ideally should match human understand- ing and concepts. Using table-top settings as scenario, we propose a framework that generates a robot’s ’‘state of mind’ by extracting the objects on the table along with their properties (color, shape and texture) and spatial relations to each other. The scene as perceived by the robot is represented in a dynamic graph in which object at- tributes are encoded as fuzzy linguistic variables that match human spatial concepts. In particular, this paper details the construction of such graph representations by combining low-level neural network- based feature recognition and a high-level fuzzy inference system. Using fuzzy representations allows for easily adapting the robot’s original scene representation to deviations in properties or relations that emerge in language descriptions given by humans viewing the same scene. The framework is implemented on a Pepper humanoid robot and has been evaluated using a data set collected in-house. ; https://www.umu.se/en/research/projects/autonomous-systems-ability-to-understand-their-own-limitations/


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Fuzzy Inference System for a Visually Grounded Robot State of Mind


    Beteiligte:

    Erscheinungsdatum :

    2020-01-01



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    004 / 629



    Multiobjective Navigation of a Guide Mobile Robot for the Visually Impaired Based on Intention Inference of Obstacles

    Kang, D.-O. / Kim, S.-H. / Lee, H. et al. | British Library Online Contents | 2001


    COLLABORATIVE ROBOT FOR VISUALLY INSPECTING AN AIRCRAFT

    COLIN NICOLAS / GUIBERT FRANK | Europäisches Patentamt | 2016

    Freier Zugriff

    Collaborative robot for visually inspecting an aircraft

    COLIN NICOLAS / GUIBERT FRANK | Europäisches Patentamt | 2018

    Freier Zugriff

    Robot Assisted Routing and Navigation System for Visually Impaired People

    Vishnu Prasad S / T. Shanmuganantham | BASE | 2020

    Freier Zugriff

    Natural landmark detection for visually-guided robot navigation

    Celaya, Enric / Albarral García, José Luís / Jiménez Schlegl, Pablo et al. | BASE | 2007

    Freier Zugriff