Augmented Things: Enhancing AR Applications leveraging the Internet of Things and Universal 3D Object Tracking

Jason Raphael Rambach; Alain Pagani; Didier Stricker

In: IEEE Adjunct Proceeding of. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-17), October 9-13, Nantes, France, IEEE, 2017.


With Augmented Reality (AR) reaching its technological maturity, there is a constantly increasing request for AR applications that address a broadened user base. Current AR applications still tend to be spatially and temporally confined either by applying to a single use case or by their tracking requirements. At the same time, with the rise of the Internet of Things (IoT), more and more everyday objects are fitted with wireless connection interfaces. In this work, we present the concept of Augmented Things, in which objects carry all the necessary tracking and augmentation information required for AR applications. This allows a user to connect to them, load this information on his personal device and have augmentations such as maintenance instructions or product origin and usage displayed. For this, we also present and evaluate a universally robust 3D object tracking framework based on high quality 3D scans of the objects.


AugmentedThings_CameraReady.pdf (pdf, 9 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence