Recognizing time pressure and cognitive load on the basis of speech: An experimental study.

Anthony Jameson; Christian Müller; B. Großmann-Hutter; R. Rummer; Frank Wittig

In: M. Bauer; P. Gmytrasiewicz; J. Vassileva (Hrsg.). Proceedings of the Eighth International Conference on User Modeling. International Conference on User Modeling (UM-2001), Pages 24-33, 2001.


In an experimental environment, we simulated the situation of a user who gives speech input to a system while walking through an airport. The time pressure on the subjects and the requirement to navigate while speaking were manipulated orthogonally. Each of the 32 subjects generated 80 utterances, which were coded semi-automatically with respect to a wide range of features, such as filled pauses. The experiment yielded new results concerning the effects of time pressure and cognitive load on speech. To see whether a system can automatically identify these conditions on the basis of speech input, we had this task performed for each subject by a Bayesian network that had been learned on the basis of the experimental data for the other subjects. The results shed light on the conditions that determine the accuracy of such recognition.

muellerEtAl2001.pdf (pdf, 523 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz