Publication
A salience-driven approach to speech recognition for human-robot interaction
Pierre Lison
In: Thomas Icard; Reinhard Muskens. Interfaces: Explorations in Logic, Language and Computation: ESSLLI 2008 and ESSLLI 2009 Student Sessions, Selected Papers. Springer Verlag, 2010.
Abstract
We present an implemented model for speech recognition in natural environments
which relies on contextual information about salient entities to prime
utterance recognition. The hypothesis underlying our approach is that, in situated
human-robot interactions, the speech recognition performance can be significantly enhanced by exploiting knowledge about the immediate physical environment and the dialogue history. To this end, visual salience (objects perceived in the physical scene) and linguistic salience (previously referred expressions within the current dialogue) are integrated into a single cross-modal salience model. The model is dynamically updated as the environment evolves, and is used to establish expectations about uttered words which are most likely to be heard given the context. The update is realised by continously adapting the word-class probabilities specified in the statistical language model. The present article discusses the motivations behind our approach, describes our implementation as part of a distributed, cognitive architecture for mobile robots, and reports the evaluation results on a test suite.