One goal of the project described in this paper is to create learning algorithms for machines and robots that lack a precise virtual controller for correct simulations. Using a digital twin approach, the developed mixed reality application aims for an overlay of a virtual robot model with the real world counterpart using Microsoft HoloLens 2 smart glasses. The application should help users to have an inside look into the results of the learning algorithm and therefore supervise and improve those results. The main focus of this paper is the visual representation of the digital twin on the smart glasses. One of the challenges is the level of abstraction and specific use of shaders (program code defining material attributes) to help the user differentiating between virtual and real objects. Therefore different presentation methods are described and evaluated. Study results with 48 persons show that the most abstract representation (wireframe) scores lowest, whereas a half-transparent model works best.


    Access

    Download


    Export, share and cite



    Title :

    Improving MR visualization of digital twins using HoloLens 2


    Contributors:

    Publication date :

    2021-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Keywords :

    Classification :

    DDC:    629




    Sensorless hand guidance using microsoft hololens

    Puljiz, David / Stöhr, Erik / Riesterer, Katharina S. et al. | BASE | 2019

    Free access


    General Hand Guidance Framework using Microsoft HoloLens

    Puljiz, David / Stöhr, Erik / Riesterer, Katharina S. et al. | BASE | 2019

    Free access

    Go-Kart Simulation in HoloLens

    Paridhi, K. / Olabisi, Shola / Srinivasa Murthy, Y. V. et al. | Springer Verlag | 2023


    Single Pilot Operations with AR-Glasses using Microsoft HoloLens

    Tran, The Huy / Behrend, Ferdinand / Funning, Niels et al. | IEEE | 2018