Skip to main content Skip to main navigation

Innovative learning environment for psychomotor skills – Project MILKI-PSY

A scientific presentation on YouTube, TED Talks, digital lectures and seminars – learning even abstract knowledge and complex issues no longer requires a physical presence. Teaching psychomotor skills in a university education today, however, still does. The motion sequences for a sport, or a surgical operation, or manual dexterity in the arts and crafts – all depend on practical exercise, direct feedback, and reflection. Learning success relies on personal support and material input, which limits the scalability of such study courses.


[Translate to English:] Illustration© Adobe Stock / Tierney

This may change with current technological developments promising new opportunities to convey motor knowledge via distance learning. For example, immersive learning and practice rooms in mixed, augmented, and virtual reality settings or the latest sensor systems that can track and record movements at a highly detailed level already exist. Big Data and learning analytics now analyze and evaluate large volumes of data. Machine learning and generative AI models interpret this data, draw conclusions, and generate individual feedback. Each of these technologies has been treated separately – until now.

The aim of the MILKI-PSY (Multimodal Immersive Learning with Artificial Intelligence for Psychomotor Skills) research project is to integrate these technologies to create an independent, immersive learning environment for psychomotor skills using AI supported, data intensive, multimodal methods. This comprehensive approach will enable multimodal recordings of the activities of experts and the use of these recordings as blueprints for learners. On the basis of complex data analyses, AI-based analytics facilitate learning progress through automated error detection and personalized feedback.

MILKI-PSY is one of twelve new projects funded by German government research grants dedicated to innovation through artificial intelligence and big data in the field of "Digital Higher Education."