Exploring of software architectures with software visualization in Augmented Reality (AR) is possible with different interaction methods, such gesture, gaze, and speech. For interaction with speech (i.e., natural language), we present an architecture and an implementation of conversational interfaces for the Microsoft HoloLens device. We aim to remedy some peculiarities of AR devices, but also enhancing the exploration task at hand. To implement the conversational interface different natural language processing (NLP) components such as natural language generation and intent recognition are typically required. Our proposed architecture integrates conversational components with the AR-based software visualization. We describe its implementation based on different user utterances, where the system provides information about the to-be-explored component-based software architecture in the form of adjusted visualizations and speech-based results. We apply out tool to explore OSGi-based software architectures.


    Access

    Download


    Export, share and cite



    Title :

    Speak to your Software Visualization - Exploring Component-Based Software Architectures in Augmented Reality with a Conversational Interface




    Publication date :

    2019-11-14



    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Adopting Conversational Interfaces for Exploring OSGi-based Software Architectures in Augmented Reality

    Seipel, Peter / Stock, Adrian / Santhanam, Sivasurya et al. | German Aerospace Center (DLR) | 2019

    Free access

    Visualization of OSGi Based Software Architectures in Virtual Reality

    Nafeie, Lisa | German Aerospace Center (DLR) | 2018

    Free access

    Evaluating the Navigation in Software Visualization in Augmented Reality with Speech Processing

    Stock, Adrian | German Aerospace Center (DLR) | 2019

    Free access


    A Performance Framework for Component-Based Software Architectures

    Smarkusky, D. L. / Smith, H. H. / Vandivort, A. M. | British Library Online Contents | 2005