DFKI and University of Kaiserslautern Participation at TRECVID 2010 - Semantic Indexing Task

Damian Borth, Adrian Ulges, Markus Koch, Thomas Breuel

In: Proceedings of the TREC Video Retrieval Evaluation Workshop 2010. TRECVID Workshop (Trecvid-2010) TREC Workshop 2010 on Video Retrieval Evaluation (TRECVID-2010) NIST 11/2010.


This paper describes the TRECVID 2010 participation of the DFKI-MADM team in the semantic indexing task. This years participation was dominated by two aspects, a new dataset and a large-sized vocabulary of 130 concepts. For the annual TRECVID benchmark this means to scale label annotation efforts to significant larger concept vocabularies and datasets. Aiming to reduce this effort, our intention is to automatically acquire training data from online video portals like YouTube and to use tags, associated with each video, as concept labels. Results for the evaluated subset of concepts show similarly to last year’s participation, that effects like label noise and domain change lead to a performance loss (infMAP 2.1% and 1.3%) as compared to purely TRECVID trained concept detectors (infMAP 5.0% and 4.4%). Nevertheless, for individual concepts like “demonstration or protest” or “bus” automatic learning from online video portals is a valid alternative to expected labeled training datasets. Furthermore, the results also indicate that fusion of multiple features helps to improves detection precision.


trecvid-2010.pdf (pdf, 434 KB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence