Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation

Publikation

Christian Bailer; Bertram Taetz; Didier Stricker

In: Proceedings - 2015 IEEE International Conference on Computer Vision. International Conference on Computer Vision (ICCV-15), December 13-16, Santiago, Chile, IEEE, 2015.

Zusammenfassung

Modern large displacement optical flow algorithms usually use an initialization by either sparse descriptor matching techniques or dense approximate nearest neighbor fields. While the latter have the advantage of being dense, they have the major disadvantage of being very outlier prone as they are not designed to find the optical flow, but the visually most similar correspondence. In this paper we present a dense correspondence field approach that is much less outlier prone and thus much better suited for optical flow estimation than approximate nearest neighbor fields. Our approach is conceptually novel as it does not require explicit regularization, smoothing (like median filtering) or a new data term, but solely our novel purely data based search strategy that finds most inliers (even for small objects), while it effectively avoids finding outliers. Moreover, we present novel enhancements for outlier filtering. We show that our approach is better suited for large displacement optical flow estimation than state-of-the-art descriptor matching techniques. We do so by initializing EpicFlow (so far the best method on MPI-Sintel) with our Flow Fields instead of their originally used state-of-the-art descriptor matching technique. We significantly outperform the original EpicFlow on MPI-Sintel, KITTI and Middlebury.

Projekte

AlterEgo - Enhancing social interactions using information technology,
DYNAMICS - Konsistente Rekonstruktion von dynamischen Szenen und Eigenschaftstransfer mit Hilfe von Zwangsbedingungen und erlerntem Vorwissen

FlowFields.pdf (pdf, 9 MB ) FlowFields_Supplementary_Material.zip (zip, 16 MB ) Supplementary_Material.pdf (pdf, 532 KB ) FlowFieldsLibrary1.0.1.zip (zip, 377 KB )

Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation

Zusammenfassung

Projekte

Folgen Sie uns auf:

Herausgeber

Newsletter

Standorte