Skip to main content Skip to main navigation


Improving Chatbots in Higher Education - Intent Recognition Evaluation

Hong Li; Tamar Arndt; Milos Kravcik
In: Heinz-Werner Wollersheim; Marios Karapanos; Norbert Pengel (Hrsg.). Bildung in der digitalen Transformation. Jahrestagung der Gesellschaft für Medien in der Wissenschaft, October 21-22, Germany, Pages 257-267, Medien in der Wissenschaft, Vol. 78, ISBN 978-3-8309-4456-0, Waxmann, 2021.


Intelligent assistants provide a lot of potential in development of scalable mentoring solutions for higher education. Chatbots became popular also in this field, but they may cause users’ frustration if they do not understand the user correctly. Therefore, it is crucial to evaluate their performance in recognizing user messages, in order to know their weak points and improve them accordingly. In our experiments we took one chatbot used by students of educational sciences and evaluated it from various perspectives. The results indicate that this kind of validation can help to improve the usability of chatbots in the learning domain.