Multimedia Interface

The interactive FLUIDS demonstrator provides a multimedia interface which allows the user to play the role of an operator and to interact with the real-time control system, a simulated traffic management application.  

Your browser does not understand the <APPLET> tag. You must be using a Java-compatible browser to run this embedded program.

The multimedia interface of the FLUIDS demonstrator supports multimodal input by combining (1) menu-based natural language for the formulation of questions, and (2) deictic pointing gestures to select potential problem areas as optional arguments for ``What happens?'' queries. On the output side, various media combinations are employed for the intelligent presentation of information. The different output modes include:

• Natural language text
• Speech
• Graphical representations
  • Information graphics
  • Maps
• Animation

The figure below shows a screen hardcopy of the multimedia interface of the FLUIDS demonstrator. The presentation sub-window on the right displays information related to the previous question (``What may happen?'' ) of the operator. The context-sensitive input menu now offers decision support for the determination of possible corrective actions to handle the current problem situation.

  
  

  
Note: Clicking on the image will display it in full resolution.