Investigating the prosody and voice quality of social signals in scenario meetings

Marcela Charfuelan Oliva, Marc Schröder

In: Proceedings Affective Computing and Intelligent Interaction. Affective Computing and Intelligent Interaction (ACII-2011) 4th October 9-12 Memphis TN United States Springer 2011.


In this study we propose a methodology to investigate possible prosody and voice quality correlates of social signals, and test-run it on annotated naturalistic recordings of scenario meetings. The core method consists of computing a set of prosody and voice quality measures, followed by a Principal Components Analysis (PCA) and Support Vector Machine (SVM) classification to identify the core factors predicting the associated social signal or related annotation. We apply the methodology to controlled data and two types of annotations in the AMI meeting corpus that are relevant for social signalling: dialogue acts and speaker roles.


prosody_vq_ami_corpus.pdf (pdf, 189 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz