The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface


    Contributors:

    Conference:

    AIAA SciTech Forum ; 2021 ; Virtual, US


    Type of media :

    Miscellaneous


    Type of material :

    No indication


    Language :

    English




    EXPLORING MULTIMODAL INTERACTIONS IN HUMAN-AUTONOMY TEAMING USING A NATURAL USER INTERFACE

    Vie, Lisa Le / Barrows, Bryan A. / Allen, B. D. et al. | TIBKAT | 2021


    Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

    Le Vie, Lisa / Barrows, Bryan A. / Allen, B. D. et al. | AIAA | 2021


    Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

    Lisa R Le Vie / Bryan A Barrows / B Danette Allen et al. | NTRS


    Human-Autonomy Teaming

    Meghan Saephan | NTRS


    Human-Autonomy Teaming

    M. Saephan | NTIS | 2023