Segmentation of Imbalanced Classes in Satellite Imagery Using Adaptive Uncertainty Weighted Class Loss

Benjamin Bischke, Patrick Helber, Damian Borth, Andreas Dengel

In: 2018 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE International Geoscience and Remote Sensing Symposium (IGARSS-2018) Tutorial TH3.R7: Segmentation July 22-27 Valencia Spain Seiten 6191-6194 ISBN 978-1-5386-7150-4 IEEE 2018.


We propose a novel loss function for the training of deep Convolutional Neural Networks (CNNs) focusing on land use and land cover classification in remote sensed data. In satellite imagery, object classes are often highly imbalanced leading to poor pixel-wise classification results when using standard training methods only. In this work, we introduce a loss function which leverages the per class uncertainty of the model during training together with median frequency balancing of the class pixels. We evaluate our result on aerial images of the state-of-the-art dataset Vaihingen. We obtain a significant improvement of the F1-Score and pixel accuracy against the standard cross entropy loss on the small car class. The overall F1-Score using a single CNN achieves 89.35%, resulting in an error reduction of 21.22% against the baseline.

IGARSS_2018_bischke__uncertainty_loss.pdf (pdf, 16 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence