DFKI-LT - Studying Mutual Phonetic Influence With a Web-Based Spoken Dialogue System

Eran Raveh, Ingmar Steiner, Iona Gessinger, Bernd Möbius
Studying Mutual Phonetic Influence With a Web-Based Spoken Dialogue System
in: Alexey Karpov, Oliver Jokisch, Rodmonga Potapova (eds.):
1 20th International Conference on Speech and Computer (SPECOM) volume 11096,
Lecture Notes in Artificial Intelligence, Pages 552-562, Springer, 9/2018

 
This paper presents a study on mutual speech variation influences in a human-computer setting. The study highlights behavioral patterns in data collected as part of a shadowing experiment, and is performed using a novel end-to-end platform for studying phonetic variation in dialogue. It includes a spoken dialogue system capable of detecting and tracking the state of phonetic features in the user's speech and adapting accordingly. It provides visual and numeric representations of the changes in real time, offering a high degree of customization, and can be used for simulating or reproducing speech variation scenarios. The replicated experiment presented in this paper along with the analysis of the relationship between the human and non-human interlocutors lays the groundwork for a spoken dialogue system with personalized speaking style, which we expect will improve the naturalness and efficiency of human-computer interaction.
 
Files: BibTeX, 1809.04945, web.pdf, 978-3-319-99579-3_57