Knowledge-Assisted Cross-Media Analysis of Audio-Visual Content in the News Domain

Vasileios Mezaris, Spyros Gidaros, Georgios Th. Papadopoulos, Walter Kasper, Roeland Ordelman, Franciska de Jong, Yiannis Kompatsiaris

In: Proceedings of the Sixth International Workshop on Content-Based Multimedia Indexing (CBMI-2008). International Workshop on Content-Based Multimedia Indexing (CBMI) London 6/2008.


In this paper, a complete architecture for knowledge-assisted cross-media analysis of News-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text) separately, and proposes a fusion technique based on the particular characteristics of News-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic video annotations.

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence