Contents:

Dr. Norbert Reithinger

Principal Researcher and Research Fellow in the Intelligent User Interfaces department
Director of the Project Office Berlin

DFKI GmbH - German Research Center for Artificial Intelligence

Fon: +49 30 23895 1802
Fon: +49 30 23895 1800 (secretary)
Fon: +49 178 147 8467 (mobile)

and sometimes in Saarbrücken:
DFKI GmbH, Campus D3_2, D-66123 Saarbrücken, Germany
Fon: +49 681 85775 5346
Fax: +49 681 85775 5021

Email: (If you don't get an answer to an e-mail, it might be blocked by various spam filters.)

Research interests

• Innovative multimodal interfaces using speech, haptics etc.
• Anything that has to do with dialogue control and dialogue recovery, e.g. clarification dialogues
• Implemented multimodal systems
• Implementing multimodal systems
• Translation systems

Current (public) projects

• Voice2Social (2011-2013) Multimodale Interaktionstechnologie und Social Software für soziale Medien
• EIT ICT Labs (2010-) EIT's Knowledge and Innovation Community (KIC) for the Information Society
• SmartSenior (2009-2013) Intelligente Dienste und Dienstleistungen für Senioren
• Förderprogramm Theseus (2007-2011), Research program for a new Internet-based knowledge infrastructure
See also the CoMET- Demonstrator to get an idea of our work.

Past (public) projects

• DILIA (2008-2011) Der Digitale Bibliotheksassistent
• SpeechEval (2008-2010) Automatische Evaluierung interaktiver Sprachdienste auf Basis erlernter Benutzermodelle
• INSCAPE (2004-2008), interactive storytelling
• IDEX (2007), Interaktive dynamische Informationsextraktion
• SmartWeb (2004-2007), natural multimodal access to the Semantic Web
• VirtualHuman (2002-2006), anthropomorphic interaction agents.
• MIAMM (2001-2004), a multimodal access system that uses haptics.
• SmartKom (1999-2003), a multimodal access system to various applications in three scenarios.
• NITE (2001-2003), tools and techniques for multimodal annotations.
• Verbmobil (1993-2000), a speech-to-speech translation system.
• ISLE NIMM subgroup on Natural Interaction and MultiModality (2000-2001), standards for multimodal annotations.
• MATE (1998 -1999), multi-level annotation tools engineering.

Some Ressources

• ACL Special Interest Group on Discourse and Dialogue (SIGdial)
• Dan Bohu's list of spoken dialogue systems
• Staffan Larsson's discourse related links
• The Haptics Community Web Site

Current and (some) past conferences and workshops I was somehow involved with

• LREC 2012 8th ELRA Conference on Language Resources and Evaluation Istanbul, MAy, 23.-25., 2012 (Program Committee )
• 50th Annual Meeting of the Association for Computational Linguistics,J eju, Korea, July 8-14, 2012 (Program Committee )
• 13th International Conference on Multimodal Interaction ICMI 2011, Alicante, Spain, 14-18 November 2011 (Program Committee )
• IWSDS2011 - Workshop on Paralinguistic Information and its Integration in Spoken Dialogue Systems Granada, Spain, September 1-3, 2011 (Program Committee )
• Seventh IJCAI workshop on Knowledge and Reasoning in Practical Dialogue Systems, Barcelona, July, 17, 2011 (Program Committee )
• 22nd Joint International Conference on Artificial Intelligence (IJCAI-11), Barcelona, July, 16-22, 2011 (Program Committee )
• 12th International Conference on Multimodal Interfaces and 7th Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010)Beijing, November 8-12, 2010 (Technical Program Committee )
• INTERSPEECH 2010 Makuhari, Japan 26-30 September 2010 (Scientific Review Committee)
• SECOND INTERNATIONAL WORKSHOP ON SPOKEN DIALOGUE SYSTEMS TECHNOLOGY, Gotemba Kogen Resort, Japan, 1.-2.10. 2010. (Scientific Committee)
• ICMI-MLMI (International Conference on Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction) 2009, Cambridge, MA,ICMI-MLMI (International Conference on Multimodal Interfaces and Workshop on Machine Learning for Multimodal Interaction) 2009, Cambridge, MA, 2.-6. November 2009 (Technical Program Committee )
• INTERSPEECH 2009 Brighton, UK 6-10 September 2009 (Scientific Review Committee)
• 1st Europe-Asia spoken dialogue systems technology workshop (EASDS). Kloster Irsee, 9. - 11. Dezember 2009. (Scientific Committee)
• INTERSPEECH 2008 Brisbane, Australia 22-26 September 2008 (Scientific Review Committee)
• Perception and Interactive Technologies (PIT08), Kloster Irsee, June 16 - 18, 2008 (Scientific Committee)
• Interspeech 2007 - Eurospeech (Scientific Review Committee)
• 8th SIGdial Workshop on Discourse and Dialogue 2007 (program committee)
• 30th Annual German Conference on Artificial Intelligence (KI 07) (program committee)
• Third International Conference on Intelligent Environments (IE'07) (program committee)
• IUI 2007 - International Conference on Intelligent User Interfaces (program committee)
• 4th International Natural Language Generation Conference INLG2006, Sydney (program committee)
• 7th SIGdial Workshop on Discourse and Dialogue 2006 (program committee)
• AAAI-06 workshop on Statistical and Empirical Approaches for Spoken Dialogue Systems, Boston, 2006 (Technical Committee).
• IUI 2006 - International Conference on Intelligent User Interfaces (program committee)
• VNLSW2005 - Voice, Natural Language and Semantic Web Technologies (Workshop at ESWC 2005) (program committee)
• 4th Workshop on KNOWLEDGE AND REASONING IN PRACTICAL DIALOGUE SYSTEMS (Workshop at IJCAI 2005) (program committee)
• 6th SIGdial Workshop on Discourse and Dialogue 2005 (program committee)
• Advanced Topics in Modeling Natural Language Dialog (Workshop at KONVENS 2004) (program committee)
• FLAIRS 2004 Special Track on User Modeling and HCI Approaches in Natural Language Generation (program committee)
• ISCA Workshop on Error Handling in Spoken Dialogue Systems 2003 (scientific committee)
• 4th SIGdial Workshop on Discourse and Dialogue 2003 (program committee)
• 3rd Workshop on Knowledge and Reasoning in Practical Dialogue Systems 2003 (program committee)
• EACL-03 Workshop on Dialogue Systems: interaction, adaptation and styles of management (program committee)
• International Natural Language Generation Conference 2002 (program committee)
• ACL 2001 (PC co-chair)
• Workshop on Data-Driven Machine Translation 2001 (program committee)
• Eurospeech 2001 (scientific committee)
• ACL 2000 (demo chair)

Some recent talks (links lead to PDF-versions of the talk)

• Multimodal User Interfaces @DFKI Invited Talk at the German-Korean "Interdisciplinary Research Symposium on BioMEMS, BioMedical, Nano-, System Technology". Korea Institute of Science and Technology Europe, Saarbrücken, 10.09.2007
• SmartWeb - Mobiler Zugang zum Semantischen Web Eingeladener Hauptvortrag auf der 18. Konferenz Elektronische Sprachsignalverarbeitung ESSV 2007, BTU Cottbus, 10.09.2007
• DFKI-interner Workshop "Multi-Modalität und Dialogsteuerung" DFKI internal access only! DFKI, 25./26.05.2007
• "Das SmartWeb Orakel" at the the 54th International Wolfgang Wahlster Birthday Party Conference, DFKI, 2007
• "Multimodal Access to Context-Aware Navigation Services" IPQC Workshop Advanced Navigation, Berlin, 12.12.2006 (Together with Tim Schwartz)
• "Accessing the Semantic Web - The Mobile Multimodal Access System SmartWeb" IMIX project review. Amsterdam, 30.3.2006 (workshop pages)
• "SmartWeb - Mobiler Breitbandiger Zugang zum Semantischen Web" CeBIT - future talk. Hannover, 10.3.2006
• "A Look Under the Hood - Design and Development of the First SmartWeb System Demonstrator" Seventh International Conference on Multimodal Interfaces, Trento, 5.10.2005 (Zusammen mit Simon Bergweiler, Ralf Engel, Gerd Herzog, Norbert Pfleger, Massimo Romanelli, Daniel Sonntag)
• "Verteilte Multimodale Dialogkomponente für das Mobile Endgerät" Erste SmartWeb-Projektstandssitzung. München, 15.6.2005 (Zusammen mit Daniel Sonntag, Ralf Engel, Norbert Pfleger, Massimo Romanelli, David Gelbart)
• "VirtualHuman - Anthropomorphe Interaktionsagenten" CeBIT - future talk. Hannover, 20.3.2004 (Zusammen mit Dr.Alassane Ndiaye)
• "SmartKom: Hören, Sehen, Verstehen" CeBIT - future talk. Hannover, 19.3.2004
• "The MIAMM Software Architecture" MIAMM Final project review. Soesterberg, 25.2.2004 (Together with Ralf Engel, Dirk Fedeler, Christoph Lauer, Elsa Pecourt (DFKI), Robert Mencl, Silke Goronzy, Marta Tolos Rigueiro (Sony), Eric Kow, Frederic Landragin, David Langlois, Laurent Romary, Amalia Todirascou (LORIA))
• "Multimodal Information Access Using Speech and Gestures". Indo-German Workshop on Language Technology, Chennai (Madras), 17.2.2004.
• "SmartKom - Adaptive and Flexible Multimodal Access to Multiple Applications". ICMI, Vancouver, 6.11.2003 (Together with Jan Alexandersson, Tilman Becker, Anselm Blocher, Ralf Engel, Markus Löckelt, Jochen Müller, Norbert Pfleger, Peter Poller, Michael Streit, Valentin Tschernomas).
• "DFKI Approach to Dialogue Management". MITRE, Bedford, MA., 28.10.2003 (Together with Markus Löckelt, Elsa Pecourt).
• "MIAMMM - Multidimensional Information Access Using Multiple Modalities". DFKI, Saarbrücken, 23.10.2003 (Together with Ralf Engel, Dirk Fedeler, Christoph Lauer, Elsa Pecourt, Benjamin Peters).
• "Multimodal Dialogue Processing". IDEA-LAB, WHU Vallendar, 9.11.2001 (Together with Tilman Becker).
• "Media Coordination in SmartKom". Dagstuhl Workshop "Coordination and Fusion in Multimodal Interaction", Schloss Dagstuhl, 29.10.-2.11.2001. (See also All presentations of the workshop)
• "Summarizing Multilingual Spoken Negotiation Dialogues". ACL 2000, Hongkong, 4.10.2000 (Together with Jan Alexandersson, Ralf Engel and Michael Kipp).
• "Verbmobil: The Development and Integration of a Large Speech-To-Speech Translation System". Tutorial at COLING 2000, 29..7.2000 (Together with Andreas Klüter).
• "Experiences from Verbmobil". 3rd International Workshop on Human-Computer Conversation, Bellagio, 3.-5. July 2000.
• "Robust Information Extraction in a Speech Translation System". Eurospeech-99, Budapest, 9.9.1999.

Some recent papers (links lead to PDF-versions of the papers or to the publishers' web site)

• J. Frey; J. Alexandersson; E. Gholamsaghaee; N. Reithinger; C. Stahl SmartCase: A Smart Home Environment in a Suitcase. In: International Conference on Intelligent Environments. International Conference on Intelligent Environments (IE-11), 7th, July 25-28, Nottingham, United Kingdom, o.A. 2011.
• D. Sonntag; N. Reithinger; G. Herzog; T. Becker A Discourse and Dialogue Infrastructure for Industrial Dissemination. In: G. G. Lee; J. Mariani; W. Minker; S. Nakamura (Hrsg.). Spoken Dialogue Systems for Ambient Environments - IWSDS 2010: Proceedings of the Seond International Workshop on Spoken Dialogue Systems. International Workshop On Spoken Dialogue Systems Technology (IWSDS-2010), October 1-2, Gotemba, Shizuoka, Japan, Pages 132-143, Lecture Notes in Artificial Intelligence (LNAI), Vol. 6392, ISBN 3-642-16201-0, Springer, 2010.
• J. Götze; T. Scheffler; R. Roller; N. Reithinger User Simulation for the Evaluation of Bus Information Systems. In: Proceedings of 2010 IEEE Workshop on Spoken Language Technology. IEEE Workshop on Spoken Language Technology (SLT-2010), December 12-15, Berkeley, CA, United States, Pages 454-459, IEEE, 2010.
• Tatjana Scheffler, Roland Roller, Norbert Reithinger. SpeechEval - Evaluating Spoken Dialog Systems by User Simulation. In: Arne Jönsson, Jan Alexandersson, David Traum, Ingrid Zukerman (ed.) Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems. 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (KRPD-09), located at IJCAI 2009, July 12, Pasadena, CA, United States, pages 93-98, IJCAI 2009, 2009.
• Tatjana Scheffler, Roland Roller, Norbert Reithinger. Semi-Automatic Creation of Resources for Spoken Dialog Systems. In: B. Mertsching, M. Hund, Z. Aziz (ed.) KI 2009: Advances in Artificial Intelligence. KI (KI-2009), in Conjunction with 32nd Annual Conference on Artificial Intelligence, September 15-18, Paderborn, Germany, pages 209-216, Lecture Notes in Artificial Intelligence (LNAI), Vol. 5803, Springer, 2009.
• Inessa Seifert, Kathrin Eichler, Holmer Hemsen, Sven Schmeier, Michael Kruppa, Günter Neumann, Norbert Reithinger. DiLiA - A DIGITAL LIBRARY ASSISTANT - A new approach to information discovery through information extraction and Visualization. In: Joaquim Filipe, Kecheng Liu (ed.) International Conference on Knowledge Management and Information Sharing. International Conference on Knowledge Management and Information Sharing (KMIS-09), located at The International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, October 6-8, Madiera, Portugal, INSTICC Press, 2009.
• Kathrin Eichler, Holmer Hemsen, Markus Löckelt, Günter Neumann and Norbert Reithinger. Interactive Dynamic Information Extraction. In Proceedings of the 31st annual German conference on Advances in Artificial Intelligence (LNAI 5243), p. 54 - 61. Springer, 2008.
• Markus Löckelt, Norbert Pfleger and Norbert Reithinger. Multi-party Conversation for Mixed Reality. In INTERNATIONAL JOURNAL OF VIRTUAL REALITY, Volume 6, Number 4, p.31-42, December 2007.
• Norbert Reithinger. SmartWeb - Mobile Dialogic Access to the Semantic Web. In Klaus Fellbaum (Hrsg.): Elektronische Sprachsingalverarbeitung - Tagungsband der 18. Konferenz. TUDpress, Dresden. 2007, p. 11-18.
• Daniel Sonntag, Norbert Reithinger. SmartWeb Handheld Interaction: General Interactions and Result Display for User-System Multimodal Dialogue. SmartWeb Technical Report, DFKI, DFKI Technical Report, Vol. V 1.1, 2007.
• D. Oberle, A. Ankolekar, P. Hitzler, P. Cimiano, M. Sintek, M. Kiesel, B. Mougouie, S. Vembu, S. Baumann, M. Romanelli, P. Buitelaar, R. Engel, D. Sonntag, N. Reithinger, B. Loos, R. Porzel, H.-P. Zorn, V. Micelli, C. Schmidt, M. Weiten, F. Burkhardt, and J. Zhou. DOLCE ergo SUMO: On Foundational and Domain Models in SWIntO (SmartWeb Integrated Ontology). Journal of Web Semantics. 2007.
• Norbert Reithinger, Gerd Herzog, Anselm Blocher. SmartWeb - Mobile Broadband Access to the Semantic Web. In KI - Künstliche Intelligenz, 2/2007, p. 30-33.
• Daniel Sonntag, Ralf Engel, Gerd Herzog, Alexander Pfalzgraf, Norbert Pfleger, Massimo Romanelli and Norbert Reithinger. Smart Web Handheld - Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services. In Proc. International Workshop on AI for Human Computing (in conjunction with IJCAI), Hyderabad, India. 2007.
  Revised version in: Artifical Intelligence for Human Computing. ICMI 2006 and IJCAI 2007 International Workshops, Banff, Canada, November 3, 2006, Hyderabad, India, January 6, 2007, Revised Seleced and Invited Papers. Lecture Notes in Computer Science 4451, Springer Verlag 2007.
• Massimo Romanelli, Daniel Sonntag, Norbert Reithinger. Connecting Foundational Ontologies with MPEG-7 Ontologies for Multimodal QA. In Proc. First International Conference on Semantics and digital Media Technology (SAMT 2006), Athens, Greece. 2006.
• Norbert Reithinger, Patrick Gebhard, Markus Löckelt, Alassane Ndiaye, Norbert Pfleger, and Martin Klesen. VirtualHuman - Dialogic and Affective Interaction with Virtual Characters. In: Proc. ICMI 2006, Banff, 2006.
• Sebastian Möller, Roman Englert, Klaus Engelbrecht, Verena Hafner, Anthony Jameson, Antti Oulasvirta, Alexander Raake, Norbert Reithinger. MeMo: Towards Automatic Usability Evaluation of Spoken Dialogue Services by User Error Simulations. In: Proc. Interspeech 2006, Pittsburgh. 2006.
• Gerd Herzog and Norbert Reithinger. The SmartKom Architecture: A Framework for Multimodal Dialogue Systems. In: Wolfgang Wahlster (ed.): SmartKom - Foundations of Multimodal Dialogue Systems, Springer, 2006.
• Norbert Reithinger and Gerd Herzog. An Exemplary Interaction with SmartKom. In: Wolfgang Wahlster (ed.): SmartKom - Foundations of Multimodal Dialogue Systems, Springer, 2006.
• Norbert Reithinger, Elsa Pecourt, and Mina Nikolova. Meta-Data for Interactive Storytelling. International Conference on Virtual Storytelling (ICVS 2005), Strasbourg, Nov 30 - Dec 2, 2005. (Short poster presentation)
• Norbert Reithinger, Simon Bergweiler, Ralf Engel, Gerd Herzog, Norbert Pfleger, Massimo Romanelli, and Daniel Sonntag. A Look Under the Hood - Design and Development of the First SmartWeb System Demonstrator. In: Proc. ICMI 2005, Trento, 2005.
• Norbert Reithinger, Dirk Fedeler, Ashwani Kumar, Christoph Lauer, Elsa Pecourt, and Laurent Romary. MIAMM: A Multi-Modal Dialogue System Using Haptics. In: J. van Kuppevelt, L. Dybkjaer, and N.O.Bernsen (eds.): Advances in Natural Multimodal Dialogue Systems, pp 307 - 332, Springer, 2005.
• Norbert Reithinger and Daniel Sonntag: An Integration Framework for a Mobile Multimodal Dialogue System Accessing the Semantic Web. In: Proc. Interspeech 2005, Lisboa, 2005.
• Peter Poller and Norbert Reithinger: A State Model for the Realization of Visual Perceptive Feedback in SmartKom. In: Proc. ICSLP, Jeju, 2004.
• Elsa Pecourt and Norbert Reithinger: Multimodal Database Access on Handheld Devices. In: The Companion Volume to the Proceedings of 42st Annual Meeting of the Association for Computational Linguistics, Barcelona 2004.
• Jan Alexandersson, Tilman Becker, Ralf Engel, Markus Löckelt, Elsa Pecourt, Norbert Pfleger, Peter Poller, and Norbert Reithinger: Ends-based Dialogue Processing. In: HLT-NAACL 2004 Workshop: 2nd Workshop on Scalable Natural Language Understanding, Boston, 2004.
• Norbert Reithinger, Gerd Herzog, and Alassane Ndiaye. Situated Multimodal Interaction in SmartKom. In: Computers & Graphics, 27(6):899-903, 2003.
• Norbert Reithinger, Jan Alexandersson, Tilman Becker, Anselm Blocher, Ralf Engel, Markus Löckelt, Jochen Müller, Norbert Pfleger, Peter Poller, Michael Streit, Valentin Tschernomas: SmartKom - Adaptive and Flexible Multimodal Access to Multiple Applications. In Proc. ICMI, Vancouver, 2003.
• Norbert Reithinger, Anselm Blocher: SmartKom - Multimodal Human Computer Interaction. i-com 3(1): 4-10 (2003)
• Soria, C., Bernsen, N. O., Cadee, N., Carletta, J., Dybkjaer, L., Evert, S., Heid, U., Isard, A., Kolodnytsky, M., Lauer, C., Lezius, W., Noldus, L. P. J. J., Pirrelli, V., Reithinger, N. and Vogele, A.: Advanced Tools for the Study of Natural Interactivity. Proceedings of the Third International Conference on Language Resources and Evaluation (LREC'2002), Las Palmas, May 2002.
• Anselm Blocher, Reinhard Karger, Norbert Reithinger: Maschinelles Dolmetschen und Multimodale Interaktion. In: Mitteilungen für Dolmetscher und Übersetzer Mitteilungen für Dolmetscher und Übersetzer, Vol. 06/02, No. 6, pages 31-37, 2002.
• Wolfgang Wahlster, Norbert Reithinger, and Anselm Blocher: Smartkom: Multimodal Communication with a Life-Like Character. In Proceedings of EuroSpeech 2001, Aalborg, 2001.
• Wolfgang Wahlster, Norbert Reithinger, and Anselm Blocher: SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents. In: Gottfried Wolf, Gunther Klein (ed.) Proceedings of the International Status Conference "Human-Computer Interaction". International Status Conference "Human-Computer Interaction", Germany, Pages 23-34, o.A. 10/2001.
• Jan Alexandersson, Ralf Engel, Michael Kipp, Norbert Reithinger. Dialog Processing. In: Wolfgang Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, pages 454-467, Springer, Berlin/ Heidelberg/ New York, 2000.
• Jan Alexandersson, Ralf Engel, Michael Kipp, Norbert Reithinger, Stephan Koch, Uwe Küssner, Manfred Stede. Dialog Processing and Context Evaluation Modeling Negotiation Dialogs. In: Wolfgang Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, pages 443-453, Springer, Berlin/ Heidelberg/ New York, 2000.
• Norbert Reithinger, Michael Kipp, Ralf Engel, and Jan Alexanderson. Summarizing Mulitlingual Spoken Negotiation Dialogues. In Proceedings of ACL 2000, HongKong, 2000.
• Norbert Reithinger and Ralf Engel: Robust Content Extraction for Translation and Dialog Processing. Modeling Negotiation Dialogs In: W. Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, Springer, pages 430-439, 2000.
• Jan Alexandersson, Ralf Engel, Michael Kipp, Stephan Koch, Uwe Küssner, Norbert Reithinger and Manfred Stede: Modeling Negotiation Dialogs In: W. Wahlster (ed.) Verbmobil: Foundations of Speech-to-Speech Translation, Springer, pages 441-451, 2000.
• Norbert Reithinger: Leave One Out Experiments for Statistical Dialogue Act Recognition Verbmobil Technical Memo 146, 2000.
• Norbert Reithinger: Robust Information Extraction in a Speech Translation System. In Proceedings of EuroSpeech 99, Budapest, 1999.
• Michael Kipp, Norbert Reithinger, and Jan Alexandersson: Understanding Spontaneous Negotiation Dialogue. In Electronic Transactions on Artificial Intelligence Volume 3 - 1999 Section D: Special Section on Intelligent Dialogue Systems. Linköping, 1999.
• Older papers of the Verbmobil dialogue group at DFKI

Back to top

Miscellaneous

Interview with tagesschau.de (06.08.2007) (German, PDF)

Interview with POTATO (07.12.2007) (German, PDF)

You Can Own an Integer Too - Get Yours Here
This is mine: 7F 59 AE A9 64 DF CA 7A 80 E6 23 16 2C C1 D4 46

Back to top