Marc Schröder

person software quality research teaching publications

Publications

2011

Schröder, M. (2011). The SEMAINE API: A component integration framework for a naturally interacting and emotionally competent Embodied Conversational Agent. PhD thesis in Computer Science, Saarland University, December 2011.
Schröder, M., Bevacqua, E., Cowie, R., Eyben, F., Gunes, H., Heylen, D., ter Maat, M., McKeown, G., Pammi, S., Pantic, M., Pelachaud, C., Schuller, B., de Sevin, E., Valstar, M. & Wöllmer, M. (2011). Building Autonomous Sensitive Artificial Listeners. IEEE Transactions on Affective Computing, Preprint available October 2011.
McKeown, G., Valstar, M., Cowie, R., Pantic, M., & Schröder, M. (2011). The SEMAINE Database: Annotated Multimodal Records of Emotionally Coloured Conversations between a Person and a Limited Agent. IEEE Transactions on Affective Computing, Preprint available July 2011.
Charfuelan, M., & Schröder, M. (2011). Investigating the prosody and voice quality of social signals in scenario meetings. Proc. Affective Computing and Intelligent Interaction. Memphis, TN, USA.
Charfuelan, M., & Schröder, M. (2011a). The vocal effort of dominance in scenario meetings. Proc. Interspeech. Florence, Italy.
Charfuelan, M., Schröder, M., & Pammi, S. (2011). Classification of listener linguistic vocalisations in interactive meetings. Proc. Eusipco. Barcelona, Spain.
Kruijff-Korbayova, I., Athanasopoulos, G., Beck, A., Cosi, P., Cuayáhuitl, H., Dekens, T., Enescu, V., et al. (2011). An event-based conversational system for the Nao robot. Proc. IWSDS 2011: Workshop on Paralinguistic Information and its Integration in Spoken Dialogue Systems. Granada, Spain.
Pammi, S., & Schröder, M. (2011). Evaluating the meaning of synthesized listener vocalizations. Proc. Interspeech. Florence, Italy.
Pammi, S., Schröder, M., & Charfuelan, M. (2011). Multidimensional meaning annotation of listener vocalizations for synthesis. Proc. Workshop Emotion and Computing. Berlin, Germany.
Schröder, M., Baggia, P., Burkhardt, F., Pelachaud, C., Peter, C., & Zovato, E. (2011). EmotionML - an upcoming standard for representing emotions and related states. Proc. Affective Computing and Intelligent Interaction. Memphis, TN, USA.
Schröder, M., Charfuelan, M., Pammi, S., & Steiner, I. (2011). Open source voice creation toolkit for the MARY TTS Platform. Proc. Interspeech. Florence, Italy.
Schröder, M., Pirker, H., Lamolle, M., Burkhardt, F., Peter, C., & Zovato, E. (2011). Representing emotions and related states in technological systems. In P. Petta, R. Cowie, & C. Pelachaud (Eds.), Emotion-Oriented Systems -- The Humaine Handbook (pp. 367-386). Springer.

2010

Schröder, M., Burkhardt, F. and Krstulovic, S. (2010). Synthesis of emotional speech. In Scherer, K. R., Bänziger, T. and Roesch, E. (Eds.). Blueprint for Affective Computing, pp. 222-231. Oxford, UK: Oxford University Press.
Steiner, I., Schröder, M., Charfuelan, M., & Klepp, A. (2010). Symbolic vs. acoustics-based style control for expressive unit selection. In Proc. Seventh ISCA Tutorial and Research Workshop on Speech Synthesis. Kyoto, Japan.
Pammi, S., Schröder, M., Charfuelan, M., Türk, O., & Steiner, I. (2010). Synthesis of listener vocalisations with imposed intonation contours. In Proc. Seventh ISCA Tutorial and Research Workshop on Speech Synthesis. Kyoto, Japan.
Brunet, P. M., Charfuelan, M., Cowie, R., Schröder, M., Donnan, H., & Douglas-Cowie, E. (2010). Detecting politeness and efficiency in a cooperative social interaction. In Proc. Interspeech. Makuhari, Japan.
Charfuelan, M., Schröder, M., & Steiner, I. (2010). Prosody and voice quality of vocal social signals: the case of dominance in scenario meetings. In Proc. Interspeech. Makuhari, Japan.
Bevacqua, E., Pammi, S., Hyniewska, S., Schröder, M., & Pelachaud, C. (2010). Multimodal Backchannels for Embodied Conversational Agents. In Proc. Intelligent Virtual Agents (pp. 194–200). Philadelphia, USA: Springer. doi:10.1007/978-3-642-15892-6_21
Kipp, M., Heloir, A., Schröder, M., & Gebhard, P. (2010). Realizing Multimodal Behavior. In Proc. Intelligent Virtual Agents (pp. 57–63). Philadelphia, USA. doi:10.1007/978-3-642-15892-6_7
de Sevin, E., Bevacqua, E., Pammi, S., Pelachaud, C., Schröder, M., & Schuller, B. (2010). A Multimodal Listener Behaviour Driven by Audio Input. In Proc. International Workshop on Interacting with ECAs as Virtual Characters at AAMAS'10. Toronto, Canada.
Türk, O. and Schröder, M. (2010). Evaluation of Expressive Speech Synthesis with Voice Conversion and Copy Re-synthesis Techniques. IEEE Transactions on Audio, Speech and Language Processing, 18(5), pp. 965-973. doi:10.1109/TASL.2010.2041113
Pammi, S., Charfuelan, M., & Schröder, M. (2010). Multilingual Voice Creation Toolkit for the MARY TTS Platform. In Proc. LREC 2010. Valettea, Malta.
Schröder, M., & McKeown, G. (2010). Considering Social and Emotional Artificial Intelligence. Proc. AISB 2010 Symposium "Towards a Comprehensive Intelligence Test", Leicester, UK.
Schröder, M., Pammi, S, Cowie, R., McKeown, G., Gunes, H., Pantic, M., Valstar, M., Heylen, D., ter Maat, M., Eyben, F., Schuller, B., Wöllmer, M., Bevacqua, E., Pelachaud, C. and de Sevin, E. (2010). Demo: Have a Chat with Sensitive Artificial Listeners. Proc. AISB'2010 Symposium "Towards a Comprehensive Turing Test", Leicester, UK.
Schröder, M. (2010). The SEMAINE API: Towards a standards-based framework for building emotion-oriented systems. Advances in Human-Machine Interaction, Volume 2010, Article ID 319406. doi:10.1155/2010/319406. [preprint]

2009

Schröder, M., Bevacqua, E., Eyben, F., Gunes, H., Heylen, D., ter Maat, M., Pammi, S., Pantic, M., Pelachaud, C., Schuller, B., de Sevin, E., Valstar, M., and Wöllmer, M. (2009). A Demonstration of Audiovisual Sensitive Artificial Listeners. In Proc. International Conference on Affective Computing & Intelligent Interaction. Amsterdam, The Netherlands: IEEE.
Pammi, S., & Schröder, M. (2009). Annotating meaning of listener vocalizations for speech synthesis. In Proc. International Conference on Affective Computing & Intelligent Interaction. Amsterdam, The Netherlands: IEEE.
Schröder, M., Pammi, S., & Türk, O. (2009). Multilingual MARY TTS participation in the Blizzard Challenge 2009. In Blizzard Challenge 2009. Edinburgh, UK.
Schröder, M. (2009). Vocal synthesis. In D. Sander & K. R. Scherer (Eds.), The Oxford Companion to Emotion and the Affective Sciences (pp. 406-407). Oxford University Press.
Pammi, S., Charfuelan, M., & Schröder, M. (2009). Quality control of automatic labelling using HMM-based synthesis. Proc. ICASSP 2009, Taipei, Taiwan.
Pammi, S., & Schröder, M. (2009). A corpus based analysis of back­channel vocalizations. Presented at the Interdisciplinary Workshop on Laughter and other Interactional Vocalisations in Speech, Berlin, Germany.
Schröder, M. (2009). Expressive Speech Synthesis: Past, Present, and Possible Futures, Affective Information Processing (Tao, J., Tan, T., eds.), pp. 111-126. London: Springer.

2008

Schröder, M. (2008). Approaches to emotional expressivity in synthetic speech, The Emotion in the Human Voice (Izdebski, K., ed.), pp. 307-321. San Diego, CA: Plural.
van Deemter, K., Krenn, B., Piwek, P., Klesen, M., Schröder, M. and Baumann, S. (2008). Fully Generated Scripted Dialogue for Embodied Agents. Artificial Intelligence, Vol. 172, Issue 10, pp. 1219-1244.
Burkhardt, F. & Schröder, M. (2008). Emotion Markup Language: Requirements with Priorities. W3C Incubator Group Report.
Türk, O. and Schröder, M. (2008). A comparison of voice conversion methods for transforming voice quality in emotional speech synthesis. Proc. Interspeech 2008, Brisbane, Australia.
Schröder, M., Charfuelan, M., Pammi, S., & Türk, O. (2008). The MARY TTS entry in the Blizzard Challenge 2008. Proc. Blizzard Challenge 2008, Brisbane, Australia.
Schröder, M., Wilson, I., Jarrold, W., Evans, D., Pelachaud, C., Zovato, E. and Karpouzis, K. (2008). What is most important for an Emotion Markup Language? Proc. Third Workshop Emotion and Computing, KI 2008, Kaiserslautern, Germany.
Schröder, M., Gebhard, P., Charfuelan, M., Endres, C., Kipp, M., Pammi, S., Rumpler, M. & Türk, O. (2008). Enhancing Animated Agents in an Instrumented Poker Game. In Proc. KI 2008 (LNAI 5243, pp. 316-323). Kaiserslautern, Germany: Springer.
Gebhard, P., Schröder, M., Charfuelan, M., Endres, C., Kipp, M., Pammi, S., Rumpler, M. & Türk, 0. (2008). IDEAS4Games: Building Expressive Virtual Characters for Computer Games. In Proc. IVA (Vol. 5208, pp. 426-440). Tokyo, Japan: Springer.
Schröder, M., Cowie, R., Heylen, D., Pantic, M., Pelachaud, C., & Schuller, B. (2008). Towards responsive Sensitive Artificial Listeners. Fourth International Workshop on Human-Computer Conversation. Bellagio, Italy.
Schröder, M. (ed.), Baggia, P., Burkhardt, F., Martin, J., Pelachaud, C., Peter, C., Schuller, B., Wilson, I. & Zovato, E. (2008). Elements of an EmotionML 1.0. W3C Final Incubator Group Report, World Wide Web Consortium, November 2008.

2007

Krstulovic, S., Hunecke, A. & Schröder, M. (2007). Investigating HMMs as a parametric model for expressive speech synthesis in German. Proc. ICPhS, Saarbrücken, Germany.
Download: PDF

Krstulovic, S., Hunecke, A. & Schröder, M. (2007). An HMM-Based Speech Synthesis System applied to German and its Adaptation to a Limited Set of Expressive Football Announcements. Proc. Interspeech Antwerp, Belgium.
Download: PDF

Schröder, M. (2007). Interpolating expressions in unit selection. Proc. 2nd International Conference on Affective Computing and Intelligent Interaction (ACII'2007), Lisbon, Portugal.
Download: PDF

Schröder, M., Batliner, A. & d'Alessandro, C. (2007). Proceedings of the International Workshop on Paralinguistic Speech - between Models and Data. Saarbrücken, Germany. DFKI Document D-07-02.
Online: http://www.dfki.de/paraling07/programme

Schröder, M., Devillers, L., Karpouzis, K., Martin, J.-C., Pelachaud, C., Peter, C., Pirker, H., Schuller, B., Tao, J. & Wilson, I. (2007). What should a generic emotion markup language be able to represent? Proc. 2nd International Conference on Affective Computing and Intelligent Interaction (ACII'2007), Lisbon, Portugal.
Download: PDF

Schröder, M. & Hunecke, A. (2007). MARY TTS participation in the Blizzard Challenge 2007. Proc. Blizzard Challenge 2007, Bonn, Germany.
Download: PDF

Schröder, M. & Hunecke, A. (2007). Creating German Unit Selection Voices for the MARY TTS Platform from the BITS Corpora. Proc. SSW6, Bonn, Germany.
Download: PDF

Schröder, M., Zovato, E., Pirker, H., Peter, C. & Burkhardt, F. (2007). W3C Emotion Incubator Group Final Report. Published online: http://www.w3.org/2005/Incubator/emotion/XGR-emotion-20070710

Steigner, J. & Schröder, M. (2007). Cross-Language Phonemisation In German Text-To-Speech Synthesis. Proc. Interspeech Antwerp, Belgium.
Download: PDF

2006

Schröder, M., Hunecke, A. & Krstulovic, S. (2006). OpenMary - open source unit selection as the basis for research on expressive synthesis, Blizzard Challenge Workshop 2006, Pittsburgh, PA, USA.
Download: PDF

Schröder, M. (2006). Expressing degree of activation in synthetic speech. IEEE Transactions on Audio, Speech and Language Processing, 14 (4), pp. 1128-1136.
Online at IEEE

Schröder, M. & Cowie, R. (2006). Issues in emotion-oriented computing - towards a shared understanding, Workshop on Emotion and Computing at KI 2006, Bremen, Germany.
Download: PDF

Schröder, M., Pirker, H. & Lamolle, M. (2006). First suggestions for an Emotion Annotation and Representation Language, LREC 2006 workshop on Emotion: Corpora for Research on Emotion and Affect, Genoa, Italy.
Download: PDF

Schröder, M., Heylen, D. & Poggi, I. (2006). Perception of non-verbal emotional listener feedback. Proc. Speech Prosody 2006, Dresden, Germany.
Download: PDF

Becker, S., Schröder, M.& Barry, W.J. (2006). Rule-based prosody prediction for German text-to-speech synthesis. Proc. Speech Prosody 2006, Dresden, Germany.
Download: PDF

Trouvain, J., Schmidt, S., Schröder, M., Schmitz, M. & Barry, W. J. (2006). Modelling personality features by changing prosody in synthetic speech. Proc. Speech Prosody 2006, Dresden, Germany.
Download: PDF

Schröder, M. & Cowie, R. (2006). Developing a consistent view on emotion-oriented computing. In: Machine Learning for Multimodal Interaction (S. Renals and S. Bengio, eds.), Springer LNCS 3869, pp. 194-205.
Download: PDF

2005

Turk, O., Schröder, M., Bozkurt, B. & Arslan, L. (2005). Voice Quality Interpolation for Emotional Text-to-Speech Synthesis Proc. Interspeech 2005, Lisbon, Portugal, pp. 797-800.
Download: PDF

Albrecht, I., Schröder, M., Haber, J. & Seidel, H.-P. (2005). Mixed feelings: Expression of non-basic emotions in a muscle-based talking head. Virtual Reality, 8(4), pp. 201-212.
Download: PDF (color, 5MB) / PDF (b/w, 0.5MB) Online: Springer online

Cowie, R. & Schröder, M. (2005). Piecing together the emotion jigsaw. In: Machine Learning for Multimodal Interaction, First International Workshop, MLMI 2004. Martigny, Switzerland, June 21-23, 2004, Revised Selected Papers. (Samy Bengio, Hervé Bourlard, Eds.) . Lecture Notes in Computer Science, vol. 3361, pp. 305-317. Berlin: Springer Verlag.
Download: PDF Online: Springer online

2004

Schröder, M. & Breuer, S. (2004). XML Representation Languages as a Way of Interconnecting TTS Modules. Proc. ICSLP'04 Jeju, Korea.
Download: PDF
See also this

page with additional information.

Schröder, M. (2004). Speech and Emotion Research: An overview of research frameworks and a dimensional approach to emotional speech synthesis. PhD thesis, PHONUS 7, Research Report of the Institute of Phonetics, Saarland University.
Download: PDF

Schröder, M. (2004). Dimensional emotion representation as a basis for speech synthesis with non-extreme emotions. Proc. Workshop on Affective Dialogue Systems Kloster Irsee, Germany, pp. 209-220.
Download: PDF

Trouvain, J. & Schröder, M. (2004). How (Not) to Add Laughter to Synthetic Speech Proc. Workshop on Affective Dialogue Systems Kloster Irsee, Germany, pp. 229-232.
Download: PDF

2003

Schröder, M. & Trouvain, J. (2003). The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching. International Journal of Speech Technology, 6, pp. 365-377.
Download (pre-print version): PDF

Schröder, M. & Grice, M. (2003). Expressing vocal effort in concatenative synthesis. Proc. 15th International Conference of Phonetic Sciences, Barcelona, Spain, pp. 2589-2592.
Download: PDF

Douglas-Cowie, E., Cowie, R. & Schröder, M. (2003). The description of naturally occurring emotional speech. 15th International Conference of Phonetic Sciences, Barcelona, Spain, pp. 2877-2880.
Download: PDF

Schröder, M. (2003). Emotional speech synthesis for emotionally-rich virtual worlds. Proc. of Workshop on emotionally rich virtual worlds with emotion synthesis at the 8th International Conference on 3D Web Technology (Web3D), 10. March 2003, St.Malo, France.
Download: PDF

Schröder, M. (2003). Experimental study of affect bursts. Speech Communication, 40 (1-2), Special Issue following the ISCA Workshop on Speech and Emotion, pp. 99-116.
Download (pre-print version): PDF

2002

Albrecht, I., Haber, J., Kähler, K., Schröder, M. & Seidel, H.-P. (2002). "May I talk to you? :-)" -- Facial Animation from Text, Proc. Pacific Graphics 2002.
Download: PDF

Krenn, B., Pirker, H., Grice, M., Piwek, P., van Deemter, K., Schröder, M., Klesen, M. & Gstrein, E. (2002). Generation of multimodal dialogue for net environments, Proceedings of Konvens 2002, Saarbrücken, Germany.
Download: PDF

Piwek, P., Krenn, B., Schröder, M., Grice, M., Baumann, S. & Pirker, H. (2002). RRL: A Rich Representation Language for the description of agent behaviour in NECA, Proceedings of the AAMAS Workshop Conversational Agents, Bologna, Italy.
Download: PDF

2001

Schröder, M. (2001). Emotional Speech Synthesis - A Review. Proc. Eurospeech 2001, Aalborg, Vol. 1, pp. 561-564.
Download: PDF

Schröder, M., Cowie, R., Douglas-Cowie, E., Westerdijk, M. & Gielen, S. (2001). Acoustic Correlates of Emotion Dimensions in View of Speech Synthesis. Proc. Eurospeech 2001, Aalborg, Vol. 1, pp. 87-90.
Download: PDF

Schröder, M. & Trouvain, J. (2001). The German Text-to-Speech Synthesis System MARY: A Tool for Research, Development and Teaching. 4th ISCA Workshop on Speech Synthesis, Blair Atholl, Scotland, pp. 131-136.
Download: PDF

2000

Cowie, R., Douglas-Cowie, E. & Schröder, M. (eds.). Proceedings of the ISCA Workshop on Speech and Emotion: A Conceptual Framework for Research, Northern Ireland 2000. Belfast, NI: Textflow.
Read Proceedings Online

Schröder, M. (2000). Experimental Study of Affect Bursts, ISCA Workshop on Speech and Emotion, Northern Ireland, p. 132-137.
Download: PDF

Douglas-Cowie, E., Cowie, R., & Schröder, M. (2000). A new emotion database: Considerations, sources and scope, ISCA Workshop on Speech and Emotion, Northern Ireland, p. 39-44.
Download: PDF

Cowie, R., Douglas-Cowie, E., Savvidou, S., McMahon, E., Sawey, M., & Schröder, M. (2000). 'FEELTRACE': An instrument for recording perceived emotion in real time, ISCA Workshop on Speech and Emotion, Northern Ireland , p. 19-24.
Download: PDF

1999

Schröder, M. (1999a). Zur Machbarkeit von Synthese emotionaler Sprache ohne Modellierung der Stimmqualität, Elektronische Sprachsignalverarbeitung 1999, Görlitz, p. 222-229.
Download: PDF

Schröder, M. (1999b). Can emotions be synthesized without controlling voice quality?, Phonus 4, Research Report of the Institute of Phonetics, Saarland University., p. 37-55.
Download: PDF

1998

Schröder, M. (1998). L'expression audiovisuelle de l'amusement - premières expériences audiovisuelles. Mémoire de Maîtrise, Université Stendhal, Grenoble 3.
Download: PDF

Schröder, M., Aubergé, V., & Cathiard, M.-A. (1998). Can we hear smiles?, ICSLP 98, Sydney.
Download: PDF


Program committee memberships and reviewing activities

Associate Editorship

IEEE Transactions on Affective Computing

Reviewing for Journals

Computer Speech and Language

Emotion

IEEE Transactions on Audio, Speech and Language Processing

Acta Acustica united with Acustica

Conferences and workshops - Program Committee / Scientific Committee Memberships

PC member, International Workshop on Human Behaviour Understanding, August 2010, Istanbul, Turkey.

Reviewer, International Conference on Kansei Engineering and Emotion Research (KEER 2010), March 2010, Paris, France.

Reviewer, International Conference on Intelligent Text Processing and Computational Linguistics (CICLing 2010), March 2010, Romania.

PC member and Co-Chair of the Demo session at the International Conference on Affective Computing and Intelligent Interfaces (ACII 2009), Amsterdam, The Netherlands, September 2009.

PC member, IEEE International Workshop on Social Signal Processing, Amsterdam, The Netherlands, September 2009.

Reviewer, Interspeech 2009, Brighton, UK, September 2009.

Reviewer, Annual Meeting of the Association for Computational Linguistics, Singapore, August 2009.

KI 2008 workshop on Emotion and Computing, Kaiserslautern, Germany, September 2008.

Interspeech 2008, Brisbane, Australia, September 2008.

8th International Conference on Intelligent Virtual Agents, Tokyo, Japan, September 2008.

Annual Meeting of the Association for Computational Linguistics, Columbus, Ohio, June 2008.

LREC workshop on Corpora for Research on Emotion and Affect, Marrakech, Morocco, May 2008.

International Conference on Intelligent Virtual Agents, Paris, France, September 2007.

International Conference on Affective Computing (ACII 2007), Lisbon, Portugal, September 2007.

International Conference of Phonetic Sciences (ICPhS), Saarbrücken, Germany, August 2007.

Workshop on the Phonetics of Laughter 2007, Saarbrücken, Germany, August 2007.

ParaLing'07 - International Workshop on Paralinguistic Speech, Chair, Saarbrücken, Germany, August 2007.

Interspeech 2006, Pittsburgh, PA, USA, September 2006.

AAAI Workshop on Computational Aesthetics, Boston, MA, July 2006.

ACL/Coling Workshop on Sentiment and Subjectivity in Text, Sydney, Australia, July 2006.

Workshop on Perception and Interactive Technologies, Kloster Irsee, Germany, June 2006.

LREC Workshop on Emotion: Corpora for Research on Emotion and Affect, Genoa, Italy, May 2006.

Interspeech 2005, Lisbon, Portugal, September 2005.

Affective Computing Session of the 1st Intl. Conference on Augmented Cognition, Las Vegas, July 2005.

Machine Learning for Multimodal Interaction (MLMI), Edinburgh, July 2005.

Invited talks

Manchester, 13 September 2011, Invited talk at Prosody and Discourse Conference 2011: Expressive prosody in speech and non-verbal vocalisations: Why is it so difficult to synthesise?

Amsterdam, 14-15 July 2010, Two plenary talks and tutorials given at eNTERFACE 2010:

Bielefeld, 19 October 2009. "Open-source research platforms for multimodal, emotion-oriented interactive systems: SEMAINE API and MARY TTS". Invited Talk at the Colloquium of the Sonderforschungsbereich SFB 673 Alignment in Communication, University of Bielefeld.

Edinburgh, 7 May 2009. "Building Sensitive Artificial Listeners and other emotion-oriented systems". Invited Talk at the Colloquium of the School of Informatics, Edinburgh.

Edinburgh, 24.07.2005. Invited speaker at the User Modelling 2005 Workshop on "Adapting the Interaction Style to Affective Factors". "Towards emotion-sensitive multimodal interfaces: The challenge of the European Network of Excellence HUMAINE"

Geneva, 31.01.2005. Talk at the Colloquium of the Geneva Emotion Research Group. "Emotional Speech Synthesis - Technologies and resulting research opportunities".

Leipzig, 04.06.2003. Talk at the Colloquium of the Max Planck Institute for Cognitive Neurosciences. "Experimental study of affect bursts"

Munich, 23.01.2003: Talk at the Colloquium of the Graduiertenkolleg Sprache, Mimik und Gestik im Kontext technischer Informationssysteme: "Emotionale Sprachsynthese: Überblick, Forschungsmethoden, Dimensionaler Ansatz"