Several simulation theories have been proposed as an explanation for how humans and other agents internalize an “inner world” that allows them to simulate interactions with the external real world – prospectively and retrospectively. Such internal simulation of interaction with the environment has been argued to be a key mechanism behind mentalizing and planning. In the present work, we study internal simulations in a robot acting in a simulated human environment. A model of sensory–motor interactions with the environment is generated from human demonstrations and tested on a Robosoft Kompaï robot. The model is used as a controller for the robot, reproducing the demonstrated behavior. Information from several different demonstrations is mixed, allowing the robot to produce novel paths through the environment, toward a goal specified by top-down contextual information. The robot model is also used in a covert mode, where the execution of actions is inhibited and perceptions are generated by a forward model. As a result, the robot generates an internal simulation of the sensory–motor interactions with the environment. Similar to the overt mode, the model is able to reproduce the demonstrated behavior as internal simulations. When experiences from several demonstrations are combined with a top-down goal signal, the system produces internal simulations of novel paths through the environment. These results can be understood as the robot imagining an “inner world” generated from previous experience, allowing it to try out different possible futures without executing actions overtly. We found that the success rate in terms of reaching the specified goal was higher during internal simulation, compared to overt action. These results are linked to a reduction in prediction errors generated during covert action. Despite the fact that the model is quite successful in terms of generating covert behavior toward specified goals, internal simulations display different temporal distributions compared to their overt counterparts. Links to human cognition and specifically mental imagery are discussed.


    Access

    Download


    Export, share and cite



    Title :

    Finding Your Way from the Bed to the Kitchen : Reenacting and Recombining Sensorimotor Episodes Learned from Human Demonstration


    Contributors:

    Publication date :

    2016-01-01


    Remarks:

    doi:10.3389/frobt.2016.00009



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Reenacting the History of the U.S. Air Transportation Network Evolution

    Song, Kisun / Lewe, Jung-Ho / Mavris, Dimitri N. | AIAA | 2018


    Nonequilibrium radiation from a recombining nitrogen plasma

    Tibère-Inglesse, Augustin C. / McGuire, Sean / Laux, Christophe O. | AIAA | 2018


    Which Way is Up? Lessons Learned from Space Shuttle Sensorimotor Research

    Wood, S. J. / Reschke, M. F. / Harm, D. L. et al. | NTRS | 2011


    Reenacting the History of the U.S. Air Transportation Network Evolution (AIAA 2018-4240)

    Song, Kisun / Lewe, Jung-Ho / Mavris, Dimitri N. | British Library Conference Proceedings | 2018


    Nonequilibrium Radiation from a Recombining Nitrogen Plasma (AIAA 2018-0241)

    Tibère-Inglesse, Augustin C. / McGuire, Sean / Laux, Christophe O. | British Library Conference Proceedings | 2018