DFKI-LT - Optimizing Situated Dialogue Management in Unknown Environments

Heriberto Cuayahuitl, Nina Dethlefs
Optimizing Situated Dialogue Management in Unknown Environments
1 Proceedings of the Annual Conference of the International Speech Communication Association (INTERSPEECH), Pages 1009-1012, Florenz, Italy, ISCA, 8/2011
We present a conversational learning agent that helps users navigate through complex and challenging spatial environments. The agent exhibits adaptive behaviour by learning spatially-aware dialogue actions while the user carries out the navigation task. To this end, we use Hierarchical Reinforcement Learning with relational representations to efficiently optimize dialogue actions tightly-coupled with spatial ones, and Bayesian networks to model the user's beliefs of the navigation environment. Since these beliefs are continuously changing, we induce the agent's behaviour in real time. Experimental results, using simulation, are encouraging by showing efficient adaptation to the user's navigation knowledge, specifically to the generated route and the intermediate locations to negotiate with the user.
Files: BibTeX, hc-interspeech2011.PDF