In a multirobot system, using shared symbols for objects in the environment is a prerequisite for collaboration. Sharing symbols requires that each agent has anchored a symbol with an internal, sensor level representation, as well as that these symbols match between the agents. The problem can be solved easily when the internal representations can be communicated between the agents. However, with heterogeneous embodiments the available sensors are likely to differ, making it impossible to share the internal representations directly. We propose the use of pointing gestures to align symbols between a heterogeneous group of robots. We describe a planning framework that minimizes the required effort for anchoring representations across robots. The framework allows planning for both the gesturing and observing agents in a decentralized fashion. It considers both implicit sources of failure, such as ambiguous pointing, as well as costs required by actions. Simulation experiments demonstrate that the resulting planning problem has a complex solution structure with multiple local minima. Demonstration with a heterogeneous two-robot system shows the practical viability of this approach.


    Access

    Download


    Export, share and cite



    Title :

    Robot-Robot Gesturing for Anchoring Representations


    Contributors:
    Kondaxakis, P (author) / Gulzar, K (author) / Kinauer, S (author) / Kokkinos, I (author) / Kyrki, V (author)

    Publication date :

    2019-02-01


    Remarks:

    IEEE Transactions on Robotics , 35 (1) pp. 216-230. (2019)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Gesturing test:a model of qualitative ergonomics

    Buscema,M. / Massini,G. / SEMEION,Rom,IT | Automotive engineering | 1992


    GESTURING FOR CONTROL INPUT FOR A VEHICLE

    BENDA NELS E / ERVA AUSTIN K / ERKKILA ZACHARY R | European Patent Office | 2019

    Free access

    GESTURING FOR CONTROL INPUT FOR A VEHICLE

    BENDA NELS / ERVA AUSTIN / ERKKILA ZACHARY | European Patent Office | 2019

    Free access

    Gesturing for control input for a vehicle

    BENDA NELS E / ERVA AUSTIN K / ERKKILA ZACHARY R | European Patent Office | 2021

    Free access

    Anchoring robot based on iris mechanism

    XU LINSEN / ZHANG ZHUANGZHUANG / LIU JINFU et al. | European Patent Office | 2024

    Free access