Multi3-Net: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery

Jakub Fil, Marc Rußwurm, Tim G. J. Rudner, Ramona Pelich, Benjamin Bischke, Veronika Kopacková, Piotr Bilinski

In: NIPS 2018 Workshop Spatiotemporal. Neural Information Processing Systems (NIPS-2018) December 2-8 Montreal Quebec Canada Curran Associates, Inc 2018.


We present a novel approach to performing rapid segmentation of flooded buildings by fusing multiresolution, multisensor, and multitemporal satellite imagery in a convolutional neural network. Our method significantly expedites the generation of satellite imagery-based flood maps, which are crucial for first responders and local authorities in the early stages of flood events. By incorporating multitemporal satellite imagery, our approach allows for a rapid and accurate post-disaster damage assessment, helping governments to better coordinate medium- and long-term financial assistance programs for affected areas. Our model consists of multiple streams of encoder-decoder architectures that extract temporal information from mediumresolution images and spatial information from high-resolution images before fusing the resulting representations into a single medium resolution segmentation map of flooded buildings. We demonstrate that our model produces highly accurate segmentation of flooded buildings using only freely available medium-resolution imagery and can be improved through very high-resolution (VHR) data.

5e7751974c5d0bffe7955795fa261a31e3d63f1d.pdf (pdf, 9 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence