SceneFlowFields: Dense Interpolation of Sparse Scene Flow Correspondences

René Schuster, Oliver Wasenmüller, Georg Kuschk, Christian Bailer, Didier Stricker

In: Proceedings of IEEE Winter Conference on Applications of Computer Vision (WACV) |. IEEE Winter Conference on Applications of Computer Vision (WACV-18) March 12-14 Lake Tahoe NV/CA United States IEEE 2018.


While most scene flow methods use either variational optimization or a strong rigid motion assumption, we show for the first time that scene flow can also be estimated by dense interpolation of sparse matches. To this end, we find sparse matches across two stereo image pairs that are detected without any prior regularization and perform dense interpolation preserving geometric and motion boundaries by using edge information. A few iterations of variational energy minimization are performed to refine our results, which are thoroughly evaluated on the KITTI benchmark and additionally compared to state-of-the-art on MPI Sintel. For application in an automotive context, we further show that an optional ego-motion model helps to boost performance and blends smoothly into our approach to produce a segmentation of the scene into static and dynamic parts.

schuster2018sceneflowfields.pdf (pdf, 6 MB)

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz