The MIAMM Device
Overview:
When browsing through online music collections on a future handheld device, it is possible that a user will have to deal with large search results on a scressn of limited size, especially if the entered characteristics are not well defined. It could be difficult to overview and handle the outcome of query or navigate through songs when there interface insufficiently assists these kinds of operations. It must be assured that the interaction with the interface might improve in terms of easy-of-use, by utilizing the combination of different communication senses making the interaction multi modal.
Overall Architecture:
DFKI software parts:
The Action Planer - Ap
We look at task oriented cooperative dialogues where both partners collaborate to achieve a common goal. This dialogues can be viewed as a coherent sequence of utterances asking for actions to be performed or introducing new information to the dialogue context. The task of the action planer is to recognize the user’s goal, and to trigger the necessary actions for the achievement of this goal. The triggered actions can be internal, such as database queries or the updating of the internal state of the system, or external, like communication with the user. In other words, the action planer is responsible for the control of both the task structure and the interaction structure of the dialogue.
The Speech Interpretation - Spin
The Visual Haptic Interaction Planer - VisHapTac
The Visualization of the Simulated Handheld Device - Vis
Exploring of multidimensional music databases need visualization metaphors that support multidimensional information presentation. The main goal of the visualization module is the intuitive presentation and navigation of large music data sets for different dimensions like genre, mood, time, rating, speed or title name. The visualizations are embedded into an simulated three dimensional virtual handheld device rendered with Open GL.
Name |
Implemented |
Figure No. |
Description |
Ordered List | yes |
2 |
List in form of a wheel. |
Timeline | yes |
3 |
Time scale based arrangement of the titles. |
Landscape | yes |
4 |
Music map ordered by genres. |
Galaxy | planed |
Titles as stars in an solar system. | |
Feel circle | planed |
8 |
Titles are placed in feel circles. |
Parametric Ball | planed |
9 |
All dimensions can be changed by one ball. |
Conic Tree | could be |
7 |
All Dimensions can be explored in one globe. |
Lexicon | yes |
5 |
Alphabetical ordered list. |
Figure 1, The handheld device.
Figure 2, The wheel visualization Metaphor.
Figure 3, The timeline visualization metaphor
Figure 4, The whole landscape visualization metaphor
Figure 5, The lexicon visualization metaphor
Figure 6: The implementd landscape visualisation metaphor
Figure 7, Outlook - The CAIDA walrus visualization
Figure 8, Moods can be expressed in Feel circles
Figure 9, Parametric Ball
Christoph Lauer 2.2003