Current projects


Fundamental Research Project Kognit (Start April 2014): Augmented Reality for Dementia Patients (BMBF) EIT Digital                     MEDICAL CPS
                                                                                              CPS for Smart Factories
Also see the SmartWeb-THESEUS book/monography.
 Hot topics for bachelor, master, or PhD students!    Finished projects
Organiser: ISMAR 2015 Tutorial on Intelligent User Interfaces New tutorial!
Co-organiser: AAAI 2014 Fall Symposium: Natural Language Access to Big Data (NLA2DB)  New symposium!
Current Course: Intelligent User Interfaces: Design and Implementation, WS 2013/14 2014/15 2015/16 New course!
Current Course: Advances in Information Extraction: From Text and Image to Knowledge, SS 2014 New course!
Ontology Lecture at CBMS 2011
SS 2010 at CS, Saarland University: Semantic Web Technologies (for intelligent HCI & DB access)
I won a German High Tech Award in 2011 for medical technology with a business case for RadSpeech, a semantic dialogue system for radiologists.
Award
  

Work in progress

A methodology for user-centred mixed reality in cyber-physical environments & cognitive assistance by cognitive computingMarch 2014; Nov 2014: NLP for BD; 2015, with IBM:  The Cognitive Era     
Ontologies and Adaptivity in Dialogue for Question Answering, January 2010
(This work has been adopted by the BMWi Research Programme THESEUS and the excellence cluster Multimodal Computing and Interaction (MMCI).)
A Methodology for Emergent Software, THESEUS, DFKI Technical Report, October 2010 [link]
Usability Guidelines for Use Case Applications,  April 2010 [link]
Handheld Interaction: General Interactions and Result Display for User-System Multimodal Dialogue, V1.1, December 2009           
Geometrodynamics of Information Retrieval Space,  Daniel Sonntag and Romàn Zapatrin, February 2009 [link]
On Introspection, Metacognitive Control and Augmented Data Mining Live Cycles, Daniel Sonntag, July 2008 [link]
Comments are welcome on older works:
Distributed text mining and NLP for DataMiningGrid (Draft), Daniel Sonntag, March 2004 [pdf]
Distributed NLP, Java Technologies for Distributed Computing, and ML for Question Answering, Daniel Sonntag, March 2004 [pdf]
Multimedia Databases State-of-the-Art Report Version 1.0, Daniel Sonntag, DC Research Ulm,  January 2004 [html]

Selected invited talks
KÜNSTLICHE INTELLIGENZ IN DER MEDIZIN: DAS KLINISCHE DATENINTELLIGENZ PROJEKT
(AI in Medicine--the clinical data intelligence project)
Big Data: Verfügbarkeit, Verknüpfbarkeit und Verwertbarkeit der Daten verbessern, conference (sponsored by BMBF / DFG) (November 13, 2016)
[link]
Machine Learning for Doctors in Healthcare
Innovators Summit - Digital Health, Technology Review 2016
Heise Events, Berlin, Germany (November 30, 2016)

Advances in MEDICAL Information Extraction
Siemens, Neuperlach, Munich, Germany  (February 15, 2016)
[link]
Intelligent User Interfaces and Mixed Reality Applications to Care for Older Adults
Cybermedia Center, Osaka University (October 5, 2015)
[link]
Kognit – Cognitive Assistants for Dementia Patients
IBM Cognitive Systems Institute Group Speaker Series  / Cognitive Computing (October 29, 2015)
[link]
Augmented and Mixed Reality - ERmed
Siemens Corporate Technologies (CT) Headquarters, Munich, Germany  (December 4, 2013)
[pdf]
Digital World and Digital Assistance 
Bitkom-Academy, Kaiserslautern, Germany (October 17, 2013)
[pdf]
Medical Imaging and User Interaction
Cebit 2012  Lab / Lounge Talks (in German),  Hannover, Germany (March 9, 2012)
[pdf]
[pdf]
Radspeech - A mobile dialogue system for radiologists, Business Case Presentation
RSNA 2011,  Chigaco, USA (December 2, 2011)
[pdf]
[video]
Mediation through Explanation and Multimodal Interaction
European Institute of Innovation and Technology (EIT), Technology Readmap, Berlin (December 15, 2010)
[pdf]
Automatic Spatial Plausibility Checks for Medical Object Recognition Results Using a Spatio-Anatomical Ontology.  KEOD Conference, Valencia, Spain (October 27, 2010) [link]
Theseus Medico Replenishments Semantic Heart and RadSpeech: Semantic Modelling of the Heart and Mobile Dialogue-based Image Annotation and Retrieval. Invited at acatech – DEUTSCHE AKADEMIE DER TECHNIKWISSENSCHAFTEN e.V, Berlin (September 14, 2010)  [pdf]
Explanations in Dialogue Systems through Uncertain RDF Knowledge Bases
International Workshop on Explanation-aware Computing at ECAI, Lisbon (August 16, 2010)
[link]
Usability in THESEUS-Prototyping Multimodal Dialogue Systems for Usecases
Invited at Deutsche Telekom Laboratories, Workshop ITG-Richtlinie "Usability", Berlin (August 3, 2010)
[pdf]
[THESEUS-
Report]
Semantic Dialogue and Semantic Search: Two sides of the same coin?
Invited at Digital Enterprise Research Institute (DERI), Ireland (November 13, 2009)  
[abstract]
Mutimodal Dialogue in Radiology and Semantic Interface Elements.
The Internet of the Future - International THESEUS Symposium 2009,  Semantic Image Annotation, German Federal Ministry of Economics and Technology (BMWi), Berlin (June 30, 2009)
[link]
[pdf]
On Intuitive Dialogue-Based Communication and Instinctive Dialogue Initiative.
International Workshop on Instinctive Computing, Carnegie Mellon University, Pittsburgh, PA, USA (June 16, 2009)
[link]
A Constraint-Based Graph Visualisation Architecture for Mobile Semantic Web Interfaces.
Second International Conference on Semantics and digital Media Technology (SAMT), Genova, Italy (December 7, 2007)
[pdf]
Context-Sensitive Multimodal Mobile Interfaces.
Invited by IBM, Second International SIMPE Workshop, 
Singapore (September 9, 2007)
[pdf]
SmartWeb Handheld - Multimodal Interaction with Ontological Knowledge Bases and Semantic Web Services.
International Workshop on AI for Human Computing (AI4HC) in conjunction with (IJCAI) 2007, Hyderabad, India (January 6, 2007)
[pdf]
SmartWeb Overview at IP Sekt (Semantically-Enabled Knowledge Technologies), Empolis, Kaiserslautern (January 19, 2006) [pdf]
Multimodal Dialogue for Multimedia Databases, CSLP workshop panel review, JHU, Baltimore (November 10, 2005) [pdf]
Linguistic Extensions for DB2, DARPA/IPTO/IBM Watson Research Laboratory, Unstructured Information Management Architecture (UIMA) (June 18 2004)
Assessing the Quality of Natural Language Text, GI workshop on data quality, Ulm (September 29, 2004) [pdf]
Profile: NLP and Information Retrieval, MPI Saarbrücken (May 28, 2004) [pdf]
State-of-the-Art in Multimedia Databases, DaimlerChrysler DBA symposium, Stuttgart (March 22, 2004) [pdf]



Selected review activities

Intelligent User Interfaces Conference, 2011/2012/2013/2014/2015/2016/2017
Computer-based Medical Systems Symposium, 2012/2013/2014/2015/2016/2017
Communications of the ACM, 2013/2014/2015
Elsevier Intelligent Systems Journal, 2014/2015
KI Conference (the German AI conference), 2013/2014/2015/2016
KI Journal, Kuenstliche Intelligenz, 2010/2011/2012/2013/2014/2015/2016/2017
ACM Transactions on Interactive Intelligent Systems (TiiS), 2013/2014
International Journal on Document Analysis and Recognition, 2010/2013/2014
Computers in Biology and Medicine Journal, 2016
IJCAI Conference, 2005/2009/2015/2016
PAIS Conference, 2012/2014/2016
ECAI Conference, 2012/2014
AAAI Conference, 2004/2012
ACL Conference, 2004/2011
ICMI Conference, 2009/2011
Connection Science Journal, UK, 2012
International Journal of Human-Computer Studies, 2010
International Journal of Engineering Applications of AI, 2010
The Computer Journal, Oxford, 2009
Data and Knowledge Engineering Journal (DKE), 2009
LREC Conference, 2006/2008
CHI conference, 2017
International Journal of Language Resources and Evaluation, 2006/2007
ECML Conference, 2003





Conferences and workshops

International Conference on Intelligent User Interfaces (IUI 2017), Limassol, Cyprus (programme committee)
The 39th German Conference on Artificial Intelligence (KI-2016), September 26-30, 2016, Klagenfurt, Austria (programme committee)
29th International Symposium on Computer-Based Medical Systems (CBMS 2016), Dublin/Belfast, June 20 – 23, 2016 (senior programme committee)
IJCAI 2016, Twenty-Fifth International Joint Conference on Artificial Intelligence Jul 9, 2016 - Jul 15, 2016, NYC (programme commitee)
9th Conference on Prestigious Applications of Intelligent Systems (ECAI/PAIS 2016) (programme committee)
International Conference on Intelligent User Interfaces (IUI), Sonoma, CA, USA, March 7-10, 2016
(programme committee)
ESWC 2016 1st International Workshop on Extraction and Processing of Rich Semantics from Medical Texts, May 29 2016, Crete (programme commiteem speaker)
AAAI 2015 Fall Symposium Series, Washington, DC, USA November 12–14, 2015 (programme committee, speaker)
The 14th IEEE International Symposium on Mixed and Augmented Reality FUKUOKA, JAPAN September 29 - October 3, 2015 (tutorial organiser, speaker)

The 38th German Conference on Artificial Intelligence (KI-2015), September 21-25, 2015, Dresden, Germany (programme committee, speaker)
International Conference on Human-Computer Interaction - INTERACT 2015, September 14-18, Bamberg, Germany (panelist)
LIDER Roadmapping Workshop on: Content Analytics and Linked Data in Healthcare and Medicine, July 13, Siemens, München (speaker)
ACM International Symposium on Pervasive Displays, DFKI, Saarbrücken, June 10-12, 2015 (presenter)
International Conference on Intelligent User Interfaces (IUI), Atlanta, USA, March 29 - April 1, 2015 (programme committee, presenter)
AAAI 2014 Fall Symposium Series, Washington, DC, USA November 13–15, 2014 (co-organiser, co-chair of symposium, presenter)
The 37th German Conference on Artificial Intelligence (KI-2014), September 22-26, 2014, Stuttgart, Germany (programme committee, participant)
21st European Conference on Artificial Intelligence (ECAI 2014)
August 18-22, Prague, Czech Republic (programme committee)
HCI International 2014, 22-27 June, 2014, Grete, Greece (speaker, panelist)
International Conference on Prestigious Applications of Intelligent Systems (PAIS’14), August 20-21, Prague, Czech Republic (programme committee)
27th IEEE International Symposium on Computer-Based Medical Systems, May 27-29, 2014, Mount Sinai Hospital, New York, USA (programme committee, track co-chair)
The 2014 International Conference on Collaboration Technologies and Systems (CTS), May 19-23, 2014 in Minneapolis, USA (tutorial chair)
International Conference on Intelligent User Interfaces (IUI), Haifa, Israel February 24-27, 2014 (senior programme committee, presenter)
36th German Conference on Artificial Intelligence September 16-20, 2013: Koblenz, Germany (programme committee)
The Twenty-Seventh AAAI Conference on Artificial Intelligence (AAAI-13), July 14–18, 2013 in Bellevue, Washington, USA (speaker)
HCI International 2013, 21-26 July 2013, Las Vegas, Nevada, USA (speaker)

The 2013 International Conference on Collaboration Technologies and Systems (CTS 2013) May 20-24, 2013 San Diego, California, USA (track, symposia, special session co-chair)
26th IEEE International Symposium on Computer-Based Medical Systems, University of Porto, Portugal, June 20-22, 2013 (programme committee)
International Conference on Intelligent User Interfaces (IUI), March 19-22, 2013, Los Angeles, USA (workshop and tutorial chair)
35th German Conference on Artificial Intelligence September 24-27, 2012: Saarbrücken, Germany (publicity chair, programme committee)
First Joint Conference on Lexical and Computational Semantics June 7-8, Montreal, Canada (programme committee)
The 25th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2012), June 20-22, Rome, Italy (programme committee)
9th Extended Semantic Web Conference, May 27-31, Heraklion, Crete, Greece (speaker)
The 5th International Conference on Integrated Systems, Design and Technology (ISDT),  May 12-15, Mallorca, Spain (invited speaker)
International Conference on Intelligent User Interfaces (IUI), February 14-17, 2012, Lisbon, Spain (presenter)
The 97th International Scientific Assembly and Annual Meeting of the Radiological Society of North America (RSNA 2011), Chicago, USA (speaker)
The 13th International Conference on Multimodal Interaction (ICMI), November 14-18, Alicante, Spain (presenter)
The 10th International Semantic Web Conference (ISWC), October 23-27, Bonn, Germany (speaker)
The Sixth International Workshop on Ontology Matching (OM-2011),  October 24, Germany (presenter)
International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES), September 12-14, Kaiserslautern, Germany (participant)
International Conference on MobileHCI, August 30-September 2, 2011, Stockholm, Sweden (speaker)
International Joint Conference on Artificial Intelligence (IJCAI-11), July 16-22, 2011,Barcelona, Spain (participant)
International Workshop on Explanation-aware Computing (Exact), July 16, 2011, Barcelona, Spain (speaker)
The 24th International Symposium on Computer-Based Medical Systems (CBMS), June 26-30, 2011, Bristol, UK (speaker)
The 93th German Radiology Congress, Mai 16 -19, Hamburg, Germany (presenter)
International Conference on Intelligent User Interfaces (IUI), February 13-16, 2011, Palo Alto, CA, USA (presenter)
International Conference on Semantic and Digital Media Technologies (SAMT), December 1-3, 2010, Saarbrücken, Germany (speaker)
International Conference on Interactive Tabletops and Surfaces, ACM, November 7-10, 2010,  Saarbrücken, Germany (participant)
International Conference on Knowledge Engineering and Ontology Development (KEOD), October 25-28, 2010, Valencia, Spain (speaker)
International Conference on Knowledge Discovery and Information Retrieval (KDIR), October 25-28, 2010, Valencia, Spain (speaker)
International Conference on Knowledge Management and Information Sharing (KMIS), October 25-28, 2010, Valencia, Spain (presenter)
International Workshop on Explanation-aware Computing (Exact), August 16, 2010, Lisbon, Portugal (speaker)
European Conference on Artificial Intelligence (ECAI), August 16-20, 2010, Lisbon, Portugal (participant)
The Sixth International Conference on Intelligent Environments (IE), July 19-21, Kuala Lumpur, Malaysia, (speaker)
Second STI Germany Industry Day on Linked Open Data, June 15, 2010, FZI Forschungszentrum Informatik, Karlsruhe, Germany (participant)
International Conference Language Resources and Evaluation (LREC), May 19-21, 2010, Valletta, Malta (speaker)
International AAAI Spring Symposium on Linked Data Meets Artificial Intelligence, March 22-24, 2010, Stanford, CA, USA (participant)
International Conference on Intelligent User Interfaces (IUI), February 7-10, 2010, Hong Kong, China (presenter)
International Workshop on Spoken Dialogue Systems (IWSDS), December 9-11, 2009, Kloster Irsee, Germany (speaker)
International Conference on Knowledge Management and Information Sharing (KMIS), IC3K, October 8-9, 2009, Madeira, Portugal (speaker)
International Workshop on Speech in Mobile and Pervasive Environments (at ACM MobileHCI '09), September 15, 2009, Bonn, Germany (speaker)
International Joint Conference on Artificial Intelligence (IJCAI-09), July 14-17, 2009 in Pasadena, CA, USA (speaker)
The 2009 International Conference on Artificial Intelligence (ICAI-09), July 13-16, 2009 in Las Vegas, Nevada, USA (speaker)
International Workshop on Intelligence and Interaction at IJCAI-09,  Monday, July 13, 2009 in Pasadena, CA, USA (participant)
International Workshop on Semantic Image Annotation, THESEUS-Symposium, German Federal Ministry of Economics and Technology (BMWi), June 30,  2009, Berlin, Germany (speaker)
International Workshop on Instictive Computing (IC-09), Carnegie Mellon University, June 15-16, 2009, Pittsburgh, USA (speaker)
Second International Computational Linguistics – Applications (CLA'09), IMCSIT conference Workshop, October 12-14, 2009, Mr?gowo, Poland (program committee)
Fifth International Conference on Formal Ontology in Information Systems (FOIS), Oct 31 - Nov 3, 2008, Saarbrücken, Germany (participant)
Seventh Internatinal Semantic Web Conference (ISWC), October 26-30, 2008, Karlsruhe, Germany (participant)
Second International Workshop on Ontology Dynamics (IWOD 2008), October 27, Karlsruhe, Germany (participant)
The Third International Workshop on Ontology Matching (OM-2008), October 26, Karlsruhe, Germany (participant)
Euler International Mathematical Institute, Scientific Collaboration Program (EIMI), August 6-14, 2008, St. Petersburg, Russia (invited participant)
International Conference on Language Resources and Evaluation (LREC), May 26-31, 2008, Marrakech, Morocco (scientific committee, participant)
Second International Conference on Semantics and Digital Media Technologies (SAMT), December 5-7, 2007, Genova, Italy (speaker)
Workshop NATO Advanced Study Institute on Mining Massive Data Sets for Security, September 10-21, 2007, Gazzada, Italy (participant)
30th German Conference on Artificial Intelligence (KI-2007), September 10-13, Osnabrück, Germany 2007 (participant)
International Conference MobileHCI, Singapore, September 9-12, 2007, Singapore (participant)
Second International Workshop on Speech in Mobile and Pervasive Environments (SiMPE 2007), September 9, 2007, Singapore (speaker)
Twelfth International Conference on Human-Computer Interaction (HCII), July 22-27, 2007, Beijing, P.R., China (speaker)
Twentieth International Joint Conference on Artificial Intelligence (IJCAI), January 6-12, 2007, Hyderabad, India (participant)
International Workshop on AI for Human Computing (AI4HC) January 6, 2007, Hyderabad, India (speaker)
First International Conference on Semantics and Digital Media Technology (SAMT), December 6-8, 2006, Athens, Greece (participant)
First International Workshop on Semantic-enhanced Multimedia Presentation Systems (SEMPS) 2006, December 6, Athens, Greece (participant)
Fifth Slovenian and First International Language Technologies (IS-LTC) Conference, October 9-10, Ljubliana, Slovenia 2006 (speaker)
International Workshop on Multilingual Semantic Annotation: Theory and Applications, SALSA/FRAMENET, June 26-27, 2006,  Saarbrücken, Germany (participant)
International Symposium on Intelligent Environments, Microsoft Research, April 5-7, 2006, Homerton College, Cambridge, UK (invited participant)
The Fifth International Conference on Language Resources and Evaluation (LREC) 2006, May 22-24, Genoa, Italy (scientific committee)
Workshop CLSP Fall Planning meeting for 2006 Summer Workshop, November 11-13, 2005, Johns Hopkins University, Baltimore, USA (panel reviewer, speaker)
The Seventh International Conference MobileHCI, September 19-22, 2005, Salzburg, Austria (participant)
International Workshop AI in Mobile Systems at MobileHCI, September 19, Salzburg, Austria (speaker)
International Conference Interspeech, September 4-8, 2005, Lisboa, Portugal (participant)
Intenational Workshop on Discourse and Dialogue (SIGDIAL) September 2-3, 2005, Lisboa, Portugal (participant)
Workshop DARPA/IPTO/IBM Watson Research Laboratory, Unstructured Information Management Architecture (UIMA), June 17-18 2004, Palisades, NY, USA (invited participant, reviewer, panelist)
Workshop on Data Quality at GI Jahrestagung, September 20, 2004, Ulm, Germany (speaker)
European Conference on AI (ECAI), August 23-27, 2004, Valencia, Spain (participant)
Workshop on Semantic Intelligent Middleware for the Web and the Grid collocated with ECAI 2004, August 23, 2004, Valencia, Spain (speaker)
Workshop on Ontologies and Data Mining, DaimlerChrysler Research & Technology, December 18, 2003, Ulm, Germany (participant)
European Conference on Machione Learning (ECML/PKDD), September 22-26, 2003, Dubrovnik, Croatia (participant)
International Workshop on Text Mining for Bioinformatics at ECML, September 22, 2003, Dubrovnik, Croatia 2003 (speaker)
International Workshop on Text Mining, DaimlerChrysler Research & Technology, April 26-27, 2002, Ulm, Germany (speaker)



Finished projects

Ermed
In ERmed, we entered the augmented and mixed reality realm, thereby combining multiple input and output modalities (2012-2014). We provided a new fundation for managing dynamic content by combining optical see-through head-mounted displays with eye trackers.
Ermed
THESEUS & MEDICO Radspeech        Radspeech
We implement a situation-aware dialogue shell for semantic access to media and services (2007-2012).  
Also see BMWi Research Programme THESEUS  or  Student Research Opportunities.
Radspeech's main contrubution: interactive knowledge discovery and acquisiton in medical data (images, texts). 
See the SmartWeb-THESEUS book/monography.
RadSpeech
SmartWeb                            no display for pics
Multimodal Dialogue-Based Access to the Semantic Web (2004-2007):
I was responsible for the dialogue reaction and presentation design/implementation, as well as SmartWeb's mobile interface design.

SMARTVIEW (internal)    no display for pics
SMARTVIEW - DaimlerChrysler Research / DaimlerChrysler Bank:
We developed this software to visualise data relations and background data in an interactive environment (Visual Data Mining). (2004)
GRAPA (internal)               no display for pics 
GRAPA - DaimlerChrysler Research (RIC/AM Information Mining):
The tool loads relations from databases and visualises their structure with a graphical interface and automatic graph layouts.
The tool I developed used an underlying graph visualisation platform. Graph algorithms are additionally used to highlight relationships. (2003)
no display for pics
MuchMore 
Information organisation and access for the medical domain:
I contributed to the combination of statistical and knowledge-based methods for information and knowledge extraction using MESH and ULMS concept hierarchies. (2002-2003)
no display for pics
Information Minder             no display for pics
I was working on language resources, FSA compression, multi-word unit extraction, and rule-based machine learners. (2000-2002)
Olive 
A Multilingual Indexing Tool for Broadcast Material Based on Speech Recognition
I ported, merged, and maintained the lexical and morphological resource databases (Mmorph and Sardic). (1998-2000)
no display for pics