Hand guidance of robots has proven to be a useful tool both for programming trajectories and in kinesthetic teaching. However hand guidance is usually relegated to robots possessing joint-torque sensors (JTS). Here we propose to extend hand guidance to robots lacking those sensors through the use of an Augmented Reality (AR) device, namely Microsoft’s Hololens. Augmented reality devices have been envisioned as a helpful addition to ease both robot programming and increase situational awareness of humans working in close proximity to robots. We reference the robot by using a registration algorithm to match a robot model to the spatial mesh. The in-built hand tracking capabilities are then used to calculate the position of the hands relative to the robot. By decomposing the hand movements into orthogonal rotations we achieve a completely sensorless hand guidance without any need to build a dynamic model of the robot itself. We did the first tests our approach on a commonly used industrial manipulator, the KUKA KR-5.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Sensorless hand guidance using microsoft hololens


    Beteiligte:
    Puljiz, David (Autor:in) / Stöhr, Erik (Autor:in) / Riesterer, Katharina S. (Autor:in) / Hein, Björn (Autor:in) / Kröger, Torsten (Autor:in)

    Erscheinungsdatum :

    2019-03-11



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    General Hand Guidance Framework using Microsoft HoloLens

    Puljiz, David / Stöhr, Erik / Riesterer, Katharina S. et al. | BASE | 2019

    Freier Zugriff

    Single Pilot Operations with AR-Glasses using Microsoft HoloLens

    Tran, The Huy / Behrend, Ferdinand / Funning, Niels et al. | IEEE | 2018


    Real-time object detection and tracking in mixed reality using Microsoft HoloLens

    Farasin A. / Peciarolo F. / Grangetto M. et al. | BASE | 2020

    Freier Zugriff

    Evaluating the Microsoft HoloLens through an augmented reality assembly application

    Evans, Gabriel / Miller, Jack / Iglesias Pena, Mariangely et al. | SPIE | 2017