Quan Nguyen, Research

About me

I'm a researcher and PhD candidate in the junior research group Embodied Agents (EMBOTS) since August 2009.

During my studie I gathered experience in multimodal dialog systems and designing of user interfaces as a research assistant at DFKI in the projects SMARTKOM, TALK and i2home. In 2008 I joined the EMBOTS research group and finished my master's thesis in 2009 with topic "Annotation of Human Gesture using 3D Skeleton Controls" (please visit this page for further informations).

Since I joined the EMBOTS group I am co-developer of the ANVIL Software.

Projects



Feasibility Study: Sign Language Avatars for The Web

We are currently conducting a feasibility study for the Bundesministerium für Arbeit und Soziales (German ministry for labour and social welfare) to explore the potential of avatars for (semi)automatic sign language translation. Apart from surveying existing work we will conduct structured expert interviews and empirical tests to find out the practical limits of avatar-based sign language communication.


Multitouch Puppetry: Creating coordinated 3D motion for an articulated arm

Controlling a high-dimensional structure like a 3D humanoid skeleton is a challenging task. Intuitive interfaces that allow non-experts to perform character animation with standard input devices would open up many possibilities. Therefore, we propose a novel multitouch interface for simultaneously controlling the many degrees of freedom of a human arm. We combine standard multitouch techniques and a morph map into a bimanual interface, and evaluate this interface in a three-layered user study with repeated interactions.

For further informations please visit the Multitouch Puppetry page on the EMBOTS Projects website.




Annotation of Human Gesture using 3D Skeleton Controls

The manual transcription of human gesture behavior from video for linguistic analysis is a work-intensive process that results in a rather coarse description of the original motion. We present a novel approach for transcribing gestural movements: by overlaying an articulated 3D skeleton onto the video frame(s) the human coder can replicate original motions on a pose-by-pose basis by manipulating the skeleton. Our tool is integrated in the ANVIL tool so that both symbolic interval data and 3D pose data can be entered in a single tool.

For further informations please visit the GAnTool page on the EMBOTS Projects website.


Publications

pdf icon

Kipp, M., Nguyen, Q. (2010) Multitouch Puppetry: Creating coordinated 3D motion for an articulated arm.
In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces 2010, ACM Press.


pdf icon

Nguyen, Q., Kipp, M. (2010) Annotation of Human Gesture using 3D Skeleton Controls.
In: Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC-2010) 2010, , ELDA, Paris.


pdf icon

Nguyen, Q. and Kipp, M. (2010) Poster presented at LREC 2010, Malta




Nguyen, Q. and Kipp, M. (2009) A Gesture Analysis and Modeling Tool for Interactive Embodied Agents.
In: Proceedings of the 9th International Conference on Intelligent Virtual Agents (IVA-09) 2009, Springer, pp. 566-568.