Improving Chatbots in Higher Education - Intent Recognition Evaluation

Hong Li, Tamar Arndt, Milos Kravcik

In: Heinz-Werner Wollersheim , Marios Karapanos , Norbert Pengel (editor). Bildung in der digitalen Transformation. Jahrestagung der Gesellschaft für Medien in der Wissenschaft October 21-22 Germany Pages 257-267 Medien in der Wissenschaft 78 ISBN 978-3-8309-4456-0 Waxmann 2021.


Intelligent assistants provide a lot of potential in development of scalable mentoring solutions for higher education. Chatbots became popular also in this field, but they may cause users’ frustration if they do not understand the user correctly. Therefore, it is crucial to evaluate their performance in recognizing user messages, in order to know their weak points and improve them accordingly. In our experiments we took one chatbot used by students of educational sciences and evaluated it from various perspectives. The results indicate that this kind of validation can help to improve the usability of chatbots in the learning domain.


36_GMW.pdf (pdf, 470 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz