DFKI-LT - Knowledge-Assisted Cross-Media Analysis of Audio-Visual Content in the News Domain
Knowledge-Assisted Cross-Media Analysis of Audio-Visual Content in the News Domain
1 Proceedings of the Sixth International Workshop on Content-Based Multimedia Indexing (CBMI-2008), London, o.A., Queen Mary University, 6/2008
In this paper, a complete architecture for knowledge-assisted cross-media analysis of News-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text) separately, and proposes a fusion technique based on the particular characteristics of News-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic video annotations.