Project

CAMELOT

Continuous Adaptive Machine-Learning of Transfer of Control Situations

Continuous Adaptive Machine-Learning of Transfer of Control Situations

A remaining major challenge with autonomous systems is the handling of situations that the system cannot handle on its own. Up to now, this transfer of control has been considered in isolation. An important step towards long-term autonomous systems and the aim of the project is to develop systems that can learn from past situations in order to improve their behaviour in future, similar situations. As a result, the transfer of control to humans can become more efficient, and in some cases even obsolete, which is also a core requirement of the industry.

CAMELOT is in this sense a follow-up project of TRACTAT and builds on its results by looking at the task from the perspective of self-learning systems and multimodal human-machine interaction. Machine learning models support the system to recognize and classify situations. The models are multiply adaptive; they can be improved by passive observation and by actively being teached by user to deal with new situations. Multimodality plays a role on the one hand as a source for the recognition of user behaviour in response to the system, and on the other hand for the natural communication between system and user in case of a transfer of control. By using new methods in combining symbolic and sub-symbolic learning, not only is explainability and extensibility ensured, but the overall recognition performance is also improved compared to the state of the art.

Sponsors

BMBF - Federal Ministry of Education and Research

01IW20008

BMBF - Federal Ministry of Education and Research

Share project:

Contact Person

Keyfacts

Publications about the project

Niko Kleer; Maurice Rekrut; Julian Wolter; Tim Schwartz; Michael Feld

In: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE International Conference on Human-Robot Interaction (HRI-2023), March 13-16, Stockholm, Sweden, Pages 81-85, ISBN 978-1-4503-9970-8, ACM, 2023.

To the publication

Amr Gomaa; Michael Feld

In: AI & HCI Workshop at the 40th International Conference on Machine Learning (ICML). AI&HCI Workshop @ ICML, located at icml, July 29, Honolulu, Hawaii, USA, PMLR, 2023.

To the publication

Amr Gomaa

In: ICMI '22: International Conference on Multimodal Interaction. ACM International Conference on Multimodal Interaction (ICMI-2022), located at 24rd ACM International Conference on Multimodal Interaction, November 7-11, Bangalore, India, ISBN 978-1-4503-9390-4, Association for Computing Machinery (ACM), 11/2022.

To the publication

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz