Abstract Contemporary organizations increasingly adopt conversational agents (CAs) as intelligent and natural language-based solutions for providing services and information. CAs offer new forms of personalization, speed, (cost-)effectiveness, and automation. However, despite their hype in research and practice, many organizations still fail to seize CAs’ potential because they lack knowledge of how to evaluate and improve the quality of CAs to sustain them in organizational operations. We aim to fill this knowledge gap by conducting a design science research project in which we aggregate insights from the literature and practice to derive an applicable set of quality criteria for CAs. Our article contributes to CA research and guides practitioners by providing a blueprint to structure the evaluation of CAs and to discover areas for systematic improvement.


    Access

    Download


    Export, share and cite



    Title :

    Enhancing conversational agents for successful operation: A multi-perspective evaluation approach for continuous improvement


    Contributors:

    Published in:

    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    BKL:    85.40 Marketing / 83.72 Verkehrswirtschaft



    Emotional Capabilities of Conversational Agents: A Review

    Jahn, Katharina / Rehren, Oliver / Schneider, Sascha et al. | DataCite | 2022


    Immunizing with information – Inoculation messages against conversational agents’ response failures

    Weiler, Severin / Matt, Christian / Hess, Thomas | Online Contents | 2021

    Free access

    A Review of Dialogue Intent Identification Methods for Closed Domain Conversational Agents

    Papalkar, Sahil / Nagmal, Arati / Karve, Shreya et al. | IEEE | 2018