This paper presents a multimodal corpus of 209 spoken game dialogues between a human and a remote-controlled artificial agent. The interactions involve people collaborating with the agent to identify countries on the world map as quickly as possible, which allows studying rapid and spontaneous dialogue with complex anaphoras, disfluent utterances and incorrect descriptions. The corpus consists of two parts: 8 hours of game interactions have been collected with a virtual unembodied agent online and 26.8 hours have been recorded with a physically embodied robot in a research lab. In addition to spoken audio recordings available for both parts, camera recordings and skeleton-, facial expression- and eye-gaze tracking data have been collected for the lab-based part of the corpus. In this paper, we introduce the pedagogical reference resolution game (RDG-Map) and the characteristics of the corpus collected. We also present an annotation scheme we developed in order to study the dialogue strategies utilized by the players. Based on a subset of 330 minutes of interactions annotated so far, we discuss initial insights into these strategies as well as the potential of the corpus for future research.
RDG-Map : A Multimodal Corpus of Pedagogical Human-Agent Spoken Interactions
2020-01-01
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
DDC: | 629 |
A Spoken Dialog Corpus for Car Telematics Services
Springer Verlag | 2005
|Construction and Analysis of a Multi-Layered In-car Spoken Dialogue Corpus
Springer Verlag | 2005
|ALAT's Soft-Spoken, Out-Spoken Commander
Online Contents | 1994
Multimodal Human-Human-Robot Interactions (MHHRI) Dataset for Studying Personality and Engagement
BASE | 2017
|