Michael Kipp: Research

Dr. Michael Kipp, Senior Researcher

Michael Kipp

Michael Kipp is head of the EMBOTS (Embodied Agents) research group in the MMCI Cluster of Excellence, Saarbrücken. He is also senior researcher at the DFKI (German Research Center for Artificial Intelligence). His group is conducting research and teaching in the area of intelligent embodied agents, including human behavior analysis, automated character animation, intelligent interactive systems and formal evaluation.

Before joining the Cluster of Excellence, Michael Kipp was senior researcher in various DFKI projects like VirtualHuman, VirtualConstructor and Ligabot. He obtained his PhD in 2003 in the field of automated gesture synthesis at Saarland University on a scholarship by the DFG (German Research Foundation). Before his PhD he worked on dialogue systems and automatic summarization in the VERBMOBIL project and on linguistic annotation technology in the European NITE project. For his PhD research, he created the now internationally used video annotation tool Anvil. From 2003-05, as a "creative break" from academia, Michael Kipp worked full-time at the Saarländisches Staatstheater (National Theatre Saarland) as an assistant director, directing the play norway.today in 2005.

Michael Kipp's research activities include co-organizing the 2010 Workshop on Multimodal Corpora (at LREC-10), co-chairing the 9th International Conference on Intelligent Virtual Agents (IVA 2009) and being on the editorial board of the Journal on Multimodal User Interfaces (Springer). He is regularly serving as a programme committee member on various international conferences including IVA, IUI, AAMAS and ACM Multimedia.

Research Activities

Chairs, Committees

Programme committee member / Reviewer

Journal Reviewer

Invited Talks, Guest Lectures

Projects

Please visit the EMBOTS project pages for more information.

Publications

You can find most of my publications electronically here. Find the most current conference publications, ordered by year, some way below.

Books, Edited Volumes

Kipp, M., Martin, J.C., Paggio, P., Heylen, D. (Eds.). (2009) Multimodal Corpora: From Models of Natural Interaction to Systems and Applications, Lecture Notes on Aritificial Intelligence, LNAI 5509, Springer.
Link to Springer

Ruttkay, Z., Kipp, M., Nijholt, A. and Vilhjálmsson, H. (Eds.). (2009). Proceedings of the 9th International Conference on Intelligent Virtual Agents, Lecture Notes on Aritificial Intelligence, LNAI 5773, Springer.
Link to Springer

Kipp, M. (2004) Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. Boca Raton, Florida, Dissertation.com.

Book Chapters

Kipp, M. (2010) ANVIL: The Video Annotation Research Tool. In: Durand, J., Gut, U., Kristofferson, G. (eds.) Handbook of Corpus Phonology, Oxford University Press, to appear.

Kipp, M. (2010) Multimedia Annotation, Querying and Analysis in ANVIL.
In: M. Maybury (ed.) Multimedia Information Extraction, Chapter 19, MIT Press, in press.

Schmidt, T., Ehmer, O., Hoyt, J., Kipp, M., Loehr, D., Rose, T., Sloetjes, H., Duncan, S., Magnusson, M. (2009) An exchange format for multimodal annotations. In: Multimodal Corpora: From Models of Natural Interaction to Systems and Applications, LNAI 5509, Springer.

Bunt, H., Kipp, M., Maybury, M. and Wahlster, W. (2005) Fusion and Coordination for Multimodal Interactive Information Presentation. In: Stock, O., Zancanaro, M. (eds.): Multimodal Intelligent Information Presentation. Series Text, Speech and Language Technology, Vol 27, pp. 325-340, Kluwer Academic.

Kipp, M., Alexandersson, J., Engel, R. and Reithinger, N. (2000) Dialog Processing. In: W. Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, pp. 452-465, Springer.

Alexandersson, J., Engel, R., Kipp, M., Koch, S., Küssner, U., Reithinger, N. and Stede, M. (2000) Modeling Negotiation Dialogs. In: W. Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, pp. 441-451, Springer.

Journal Articles

Heloir, A., Kipp, M. (2010) Realtime Animation of Interactive Agents: Specification and Realization. In: Applied Artificial Intelligence, Taylor & Francis, to appear.
Download PDF (pre-print version)    |    Article on journal website

Neff, M., Kipp, M., Albrecht, I. and Seidel, H.-P. (2008) Gesture Modeling and Animation Based on a Probabilistic Recreation of Speaker Style. In: ACM Transactions on Graphics 27 (1), ACM Press, pp. 1-24.
Download PDF

Kipp, M., Neff, M. and Albrecht, I. (2007) An Annotation Scheme for Conversational Gestures : How to economically capture timing and form. In: Journal on Language Resources and Evaluation - Special Issue on Multimodal Corpora, Vol. 41, No. 3-4, Springer, pp. 325-339.
Download PDF (pre-print version)

Klesen, M., Kipp, M., Gebhard, P. and Rist, T. (2003) Staging Exhibitions: Methods and tools for modelling narrative structure to produce interactive performances with virtual actors. In: Virtual Reality. Special Issue on Storytelling in Virtual Environments 7 (1), pp. 17-29, Springer.
link to Springer   |    Draft version as PDF

Kipp, M., Alexandersson, J. and Reithinger, N. (1999) Understanding Spontaneous Negotiation Dialogue. In: Electronic Transactions on Artificial Intelligence (ETAI), Special Issue on Intelligent Dialogue Systems. Also in: Linköping Electronic Articles in Computer and Information Science, Vol.4, No. 027, ISSN 1401-9841. (Originally presented at the workshop on "Knowledge And Reasoning in Practical Dialogue Systems" at IJCAI-99.)
Download PDF

Conference Papers (by year)

2010

Kipp, M., Heloir, A., Gebhard, P., Schroeder, M. (2010) Realizing Multimodal Behavior: Closing the gap between behavior planning and embodied agent presentation. In: Proceedings of the 10th International Conference on Intelligent Virtual Agents (IVA-10), Springer.
Download PDF

Miksatko, J., Kipp, K.H., Kipp, M. (2010) The Persona Zero-Effect: Evaluating virtual character benefits on a learning task. In: Proceedings of the 10th International Conference on Intelligent Virtual Agents (IVA-10), Springer.
Download PDF

Nguyen, Q. and Kipp, M. (2010) Annotation of Human Gesture using 3D Skeleton Controls. In: Proceedings of 7th International Conference on Language Resources and Evaluation (LREC), ELDA.
Download PDF

Heloir, A., Neff, M. and Kipp, M. (2010) Exploiting Motion Capture for Virtual Human Animation: Data Collection and Annotation Visualization. In: Proc. of the LREC Workshop on "Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality", ELDA.
Download PDF

2009

Kipp, M., Martin, J.-C. (2009) Gesture and Emotion: Can basic gestural form features discriminate emotions? In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction (ACII-09), IEEE Press.
Nominated for Best Paper Award
Download PDF

Miksatko, J., Kipp, M. (2009) Hybrid Control for Embodied Agents Applications. In: Proc. of the 32nd Annual Conference on Artificial Intelligence (KI 2009), LNAI 5803, pp. 524-531, Springer.
Download PDF

Heloir, A., Kipp, M. (2009) EMBR - A Realtime Animation Engine for Interactive Embodied Agents. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09), LNAI 5773, pp. 393-404, Springer.
Download PDF

Luo, P., Kipp, M., Neff, M. (2009) Augmenting Gesture Animation with Motion Capture Data to Provide Full-Body Engagement. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09), LNAI 5773, Springer, pp. 405-417.
Download PDF

Nguyen, Q. and Kipp, M. (2009) A Gesture Analysis and Modeling Tool for Interactive Embodied Agents. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09), Springer, pp. 566-568.
GALA Student Award winner

Gregor, I., Kipp, M. and Miksatko, J. (2009) IVAN - Intelligent Interactive Virtual Agent Narrators. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09), Springer, pp. 560-561.

2008

Kipp, M., Gebhard, P. (2008) IGaze: Studying reactive gaze behavior in semi-immersive human-avatar interactions. In: Proceedings of the 8th International Conference on Intelligent Virtual Agents (IVA-08), LNAI 5208, Springer, pp. 191-199.
Download PDF

Gebhard, P., Schröder, M., Charfuelan, M., Endres, C., Kipp, M., Pammi, S., Rumpler, M., Türk, O. (2008) IDEAS4Games: Building Expressive Virtual Characters for Computer Games. In: Proceedings of the 8th International Conference on Intelligent Virtual Agents (IVA-08), LNAI 5208, Springer, pp. 426-440.
Download PDF

Heloir, A., Kipp, M., Gibet, S., Courty, N. (2008) Specifying and evaluating data-driven style transformation for gesturing embodied agents. In: Proceedings of the 8th International Conference on Intelligent Virtual Agents (IVA-08) , LNAI 5208, Springer, pp. 215-222.

Kipp, M. (2008) Spatiotemporal Coding in ANVIL. In: Proceedings of the 6th international conference on Language Resources and Evaluation (LREC-08)
Download PDF

Strauss, M., Kipp, M. (2008) ERIC: A Generic Rule-based Framework for an Affective Embodied Commentary Agent. In: Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS).
Download PDF

Schmidt, T., Ehmer, O., Hoyt, J., Kipp, M., Loehr, D., Rose, T., Sloetjes, H., Duncan, S., Magnusson, M. An exchange format for multimodal annotations.
In: Proceedings of the 6th international conference on Language Resources and Evaluation (LREC-08)
Download PDF

Schröder, Marc; Gebhard, Patrick; Charfuelan, Marcela; Endres, Christoph; Kipp, Michael; Pammi, Sathish Chandra; Rumpler, Martin; Türk, Oytun (2008) Enhancing Animated Agents in an Instrumented Poker Game. In: KI 2008: Advances in Artificial Intelligence Springer, 2008.
Download PDF

2007

Kipp, M., Neff, M., Kipp, K.H. und Albrecht, I. (2007) Toward Natural Gesture Synthesis: Evaluating gesture units in a data-driven approach. In: Pelachaud et al. (eds.) Proceedings of the 7th International Conference on Intelligent Virtual Agents, LNAI 4722, Springer, pp.15-28.
Winner of Best Paper Award
Download PDF

Vilhjalmsson, H., Cantelmo, N., Cassell, J., Chafai, N. E., Kipp, M., Kopp, S., Mancini, M., Marsella, S., Marshall, A. N., Pelachaud, C., Ruttkay, Z., Thórisson, K. R., van Welbergen, H. und van der Werf, R. J. (2007) The Behavior Markup Language: Recent Developments and Challenges. In: Pelachaud et al. (eds.) Proceedings of the 7th International Conference on Intelligent Virtual Agents, LNAI 4722, Springer, pp. 99-111.
Download PDF

2006

Kipp, M. (2006) Creativity meets Automation: Combining Nonverbal Action Authoring with Rules and Machine Learning. In: Proceedings of the 6th International Conference on Intelligent Virtual Agents (IVA 2006), pp. 230-242.
Download: PDF

Kipp, M., Kipp, K.H., Ndiaye, A. and Gebhard, P. (2006) Evaluating the Tangible Interface and Virtual Characters in the Interactive COHIBIT Exhibit. In: Proceedings of the 6th International Conference on Intelligent Virtual Agents (IVA 2006), pp. 434-444.
Download: PDF

Kipp, M., Neff, M. and Albrecht, I. (2006) An Annotation Scheme for Conversational Gestures : How to economically capture timing and form. In: Proceedings of the Workshop on "Multimodal Corpora" at LREC 2006, pp. 24-27.

Neff, M., Kipp, M., Albrecht, I. and Seidel, H.-P. (2006) Gesture Modeling and Animation by Imitation. Tech. Rep. MPI-I-2006-4-008, Max-Planck-Institut Informatik, Saabrücken, Germany.

Reithinger, N., Gebhard, P., Löckelt, M., Ndiaye, A., Pfleger, N., Rumpler, M., Kipp, M., Blocher, A., Wahlster, W. (2006) Dialogic and Affective Interaction with VirtualHuman. In: Proceedings of the 29th Annual German Conference on Artificial Intelligence (KI 2006), pp. 45-48.

2005

A. Ndiaye, P. Gebhard, M. Kipp, M. Klesen, M. Schneider and W. Wahlster (2005) Ambient Intelligence in Edutainment: Tangible Interaction with Life-Like Exhibit Guides. In: Proceedings of the INTETAIN 2005, Springer, pp. 104-113.
Download: PDF

2003

Kipp, M. (2003) Gesture Generation by Imitation - From Human Behavior to Computer Character Animation, PhD Thesis, Saarland University.

Patrick Gebhard, Michael Kipp, Martin Klesen, Thomas Rist (2003) Adding the Emotional Dimension to Scripting Character Dialogues. In: Proceedings of the 4th International Working Conference on Intelligent Virtual Agents (IVA'03), Kloster Irsee.
Download PDF

Gebhard, P., Kipp, M., Klesen, M. und Rist, T. (2003) What Are They Going to Talk About? Towards Life-Like Characters that Reflect on Interactions with Users. In: Proc. of the First International Conference on Technologies for Interactive Digital Storytelling and Entertainment (TIDSE'03), Fraunhofer IRB Verlag, pp. 380-387.
Download PDF

Patrick Gebhard, Michael Kipp, Martin Klesen and Thomas Rist (2003) Authoring Scenes for Adaptive, Interactive Performances. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS-03), ACM Press, New York, pp. 725-732.
Download PDF

Thomas Rist, Elisabeth André, Stephan Baldes, Patrick Gebhard, Martin Klesen, Michael Kipp, Peter Rist and Markus Schmitt (2003) A Review of the Development of Embodied Presentation Agents and Their Application Fields. In: Life-Like Characters - Tools, Affective Functions, and Applications, H. Prendinger and M. Ishizuka (eds.), Springer, pp. 377-404.

2002

Kipp, M., Reithinger, N., Bernsen, N.O., Dybkjaer, L., Wegener Knudsen, M., Machuca, M., Riera, M. (2002) Best practice gesture, facial expression, and cross-modality coding schemes for inclusion in the workbench, NITE Deliverable D2.3.
Download PDF

Stephan Baldes, Patrick Gebhard, Michael Kipp, Martin Klesen, Peter Rist, Thomas Rist and Markus Schmitt (2002) The Interactive CrossTalk Installation: Meta-Theater with Animated Presentation Agents. In: Proceedings of the Workshop on "Lifelike Animated Agents" held in conjunction with the Seventh Pacific Rim International Conference on Artificial Intelligence (PRICAI), pp. 9-15.
Download PDF

Jean-Claude Martin and Michael Kipp (2002) Annotating and Measuring Multimodal Behaviour - Tycoon Metrics in the Anvil Tool. In: Proceedings of the Third International Conference on Language Resources and Evaluation (LREC).
Download PDF

T. Rist, S. Baldes, P. Gebhard, M. Kipp, M. Klesen, P. Rist, M. Schmitt (2002) Crosstalk: An interactive installation with animated presentation agents. In: Proceedings of the Second Conf. on Computational Semiotics for Games and New Media, Augsburg, pp. 61-67.
Download PDF

2001

Kipp, M. (2001) Anvil - A Generic Annotation Tool for Multimodal Dialogue. In: Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech), pp. 1367-1370.
Download: gzipped postscript (300 KB) or PDF (244 KB), 4 pages

Kipp, M. (2001) From Human Gesture to Synthetic Action. In: Proceedings of the Workshop on "Multimodal Communication and Context in Embodied Agents" held in conjunction with the Fifth International Conference on Autonomous Agents (AGENTS), pp. 9-14, Montreal.
Download: gzipped postscript (343 KB) or PDF (225 KB), 6 pages

Vintar, S., Kipp, M. (2001) Multi-Track Annotation of Terminology Using Anvil. In: Proceedings of the Workshop on "Multi-layer Corpus-based Analysis" at Eurolan.
Download: gzipped postscript, 276 KB, 13 pages

Kipp, M. (2001) Analyzing Individual Nonverbal Behavior for Synthetic Character Animation. In: C. Cave, I. Guaitella, S. Santi (eds.) Oralite et Gestualite - Actes du colloque ORAGE 2001, Paris: L'Harmattan, pages 240-244.

Dybkjær, L., Berman, S., Kipp, M., Wegener Olsen, M., Pirrelli, V., Reithinger, N., Soria, C. (2001) Survey of Existing Tools, Standards and User Needs for Annotation of Natural Interaction and Multimodal Data. ISLE Natural Interactivity and Multimodality Working Group Deliverable D11.1.
Online version

Serenari, M., Dybkjær, L., Heid, U., Kipp, M., Reithinger, N. (2001) Survey of existing gesture, facial expression, and cross-modality coding schemes. NITE Deliverable D2.1.

2000

Reithinger, N., Kipp, M., Engel, R. and Alexandersson, J. (2000) Summarizing Multilingual Spoken Negotiation Dialogues. In: Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL-2000).
Download PDF

1998

Kipp, M. (1998) The Neural Path to Dialogue Acts. In: Proceedings of the 13th European Conference on Artificial Intelligence (ECAI).
Download: gzipped postscript, 41 KB, 5 pages
Download PDF (has some minor typesetting bugs from PS to PDF conversion)

Norbert Reithinger, Michael Kipp (1998) Large Scale Dialogue Annotation in Verbmobil. In: Proceedings of the Workshop on "Recent Advances in Corpus Annotation" at the 10th European Summer School in Logic, Language and Information (ESSLLI-98), Saarbrücken.
Download PDF

Jan Alexandersson, Bianka Buschbeck-Wolf, Tsutomu Fujinami, Michael Kipp,
Stefan Koch, Elisabeth Maier, Norbert Reithinger, Birte Schmitz, Melanie Siegel (1998) Dialogue Acts in Verbmobil-2. Second Edition. Verbmobil-Report Nr.226, DFKI GmbH, Saarbrücken.
Download PDF (106 pages)

Isard, A., McKelvie, D., Cappelli, B., Dybkjær, L., Evert, S., Fitschen, A., Heid, U., Kipp, M. Klein, M., Mengel, A., Baun Møller, M., Reithinger, N. (1998) Specification of Workbench Architecture. MATE Deliverable D3.1.

1997

Kipp, M. (1997) Dialogaktbestimmung mit Neuronalen Netzen, Diplom Thesis, Universität des Saarlandes, Lehrstuhl Prof. W. Wahlster.
Download PDF (120 pages, German)

1996

Reithinger, N., Engel, R., Kipp, M. and Klesen, M. (1996) Predicting Dialogue Acts for a Speech-To-Speech Translation System. In: Proceedings of the Fourth International Conference on Spoken Language Processing (ICSLP-96), pp. 654-657, Philadelphia.
Download PDF

Current Teaching

SS 2010

Lecture: Artificial Intelligence (Wahlster, Kipp)



Previous Teaching

WS 2009/10

Lecture: User Interface Design and Usability (Kipp)

Lecture: Character Animation (Heloir, Kipp)

SS 2009

Proseminar: Mensch-Computer Interaktion (Kipp, Heloir, Miksatko)

SS 2008

Seminar: Character Animation (Heloir, Kipp)

WS 2007/08

Seminar: Advances in Human-Computer Interaction (Gebhard, Kipp, Rumpler, Schmitz)

WS 2006/07

Seminar: AI Tools (Kipp, Ndiaye, Heckmann, Feld)

SS 2006

Seminar: Intelligent Virtual Characters (Kipp)

Contact

DFKI
Campus D3.2, Room 0.19
66123 Saarbrücken
Germany

Phone: +49 (0) 681 85775-5256 (office)

E-mail: kipp(at)dfki.de