An Interactive Pedestrian Environment Simulator for Cognitive Monitoring and Evaluation

Jason Orlosky, Markus Weber, Yecheng Gu, Daniel Sonntag, Sergey Sosnovsky

In: Proceedings of the 20th International Conference on Intelligent User Interfaces Companion. International Conference on Intelligent User Interfaces (IUI) 20th March 29-April 1 Atlanta GA United States Seiten 57-60 ACM New York, NY, USA 2015.


Recent advances in virtual and augmented reality have led to the development of a number of simulations for different applications. In particular, simulations for monitoring, evaluation, training, and education have started to emerge for the consumer market due to the availability and affordability of immersive display technology. In this work, we introduce a virtual reality environment that provides an immersive traffic simulation designed to observe behavior and monitor relevant skills and abilities of pedestrians who may be at risk, such as elderly persons with cognitive impairments. The system provides basic reactive functionality, such as display of navigation instructions and notifications of dangerous obstacles during navigation tasks. Methods for interaction using hand and arm gestures are also implemented to allow users explore the environment in a more natural manner.


Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence