Visuo-haptic Illusions for Linear Translation and Stretching using Physical Proxies in Virtual Reality

Martin Feick, Niko Kleer, André Zenner, Anthony Tang, Antonio Krüger

In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM International Conference on Human Factors in Computing Systems (CHI-21) May 8-13 Yokohama/Virtual Japan ISBN 978-1-4503-8096-6/21/05 ACM 5/2021.


Providing haptic feedback when manipulating virtual objects is an essential part of immersive virtual reality experiences; however, it is challenging to replicate all of an object's properties and characteristics. We propose the use of visuo-haptic illusions alongside physical proxies to enhance the scope of proxy-based interactions with virtual objects. In this work, we focus on two manipulation techniques, linear translation and stretching across different distances, and investigate how much discrepancy between the physical proxy and the virtual object may be introduced without participants noticing. In a study with 24 participants, we found that manipulation technique and travel distance significantly affect the detection thresholds, and that visuo-haptic illusions impact performance and accuracy. We show that this technique can be used to enable functional proxy objects that act as stand-ins for multiple virtual objects, illustrating the technique through a showcase VR-DJ application.

Visuo-haptic_Illusions_for_Linear_Translation_and_Stretching_using_Physical_Proxies_in_Virtual_Reality.pdf (pdf, 4 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence