Investigating the prosody and voice quality of social signals in scenario meetings

Marcela Charfuelan Oliva; Marc Schröder

In: Proceedings Affective Computing and Intelligent Interaction. Affective Computing and Intelligent Interaction (ACII-2011), 4th, October 9-12, Memphis, TN, USA, Springer, 2011.


In this study we propose a methodology to investigate possible prosody and voice quality correlates of social signals, and test-run it on annotated naturalistic recordings of scenario meetings. The core method consists of computing a set of prosody and voice quality measures, followed by a Principal Components Analysis (PCA) and Support Vector Machine (SVM) classification to identify the core factors predicting the associated social signal or related annotation. We apply the methodology to controlled data and two types of annotations in the AMI meeting corpus that are relevant for social signalling: dialogue acts and speaker roles.


prosody_vq_ami_corpus.pdf (pdf, 189 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence