Hand guidance emerged from the safety requirements for collaborative robots, namely possessing joint-torque sensors. Since then it has proven to be a powerful tool for easy trajectory programming, allowing lay-users to reprogram robots intuitively. Going beyond, a robot can learn tasks by user demonstrations through kinesthetic teaching, enabling robots to generalise tasks and further reducing the need for reprogramming. However, hand guidance is still mostly relegated to collaborative robots. Here we propose a method that doesn't require any sensors on the robot or in the robot cell, by using a Microsoft HoloLens augmented reality head mounted display. We reference the robot using a registration algorithm to match the robot model to the spatial mesh. The in-built hand tracking and localisation capabilities are then used to calculate the position of the hands relative to the robot. By decomposing the hand movements into orthogonal rotations and propagating it down through the kinematic chain, we achieve a generalised hand guidance without the need to build a dynamic model of the robot itself. We tested our approach on a commonly used industrial manipulator, the KUKA KR-5.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    General Hand Guidance Framework using Microsoft HoloLens


    Beteiligte:
    Puljiz, David (Autor:in) / Stöhr, Erik (Autor:in) / Riesterer, Katharina S. (Autor:in) / Hein, Björn (Autor:in) / Kröger, Torsten (Autor:in)

    Erscheinungsdatum :

    2019-11-03



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629




    Sensorless hand guidance using microsoft hololens

    Puljiz, David / Stöhr, Erik / Riesterer, Katharina S. et al. | BASE | 2019

    Freier Zugriff

    Single Pilot Operations with AR-Glasses using Microsoft HoloLens

    Tran, The Huy / Behrend, Ferdinand / Funning, Niels et al. | IEEE | 2018


    Real-time object detection and tracking in mixed reality using Microsoft HoloLens

    Farasin A. / Peciarolo F. / Grangetto M. et al. | BASE | 2020

    Freier Zugriff

    Evaluating the Microsoft HoloLens through an augmented reality assembly application

    Evans, Gabriel / Miller, Jack / Iglesias Pena, Mariangely et al. | SPIE | 2017