Contextual Enrichment of Remote-Sensed Events with Social Media Streams

Benjamin Bischke, Damian Borth, Christian Schulze, Andreas Dengel

In: MM '16: 2016 ACM Multimedia Conference Proceedings. ACM International Conference on Multimedia (ACM MM-16) befindet sich ACM Multimedia 16 October 15-19 Amsterdam Netherlands ISBN 978-1-4503-3603-1/16/10 ACM 2016.


The availability of satellite images for academic or commer- cial purpose is increasing rapidly due to efforts made by governmental agencies (NASA, ESA) to publish such data openly or commercial startups (PlanetLabs) to provide real- time satellite data. Beyond many commercial application, satellite data is helpful to create situation awareness in dis- aster recovery and emergency situations such as wildfires, earthquakes, or flooding. To fully utilize such data sources, we present a scalable system for the contextual enrichment of satellite images by crawling and analyzing multimedia content from social media. This information stream can provide vital information from the ground and help to com- plement remote sensing in situations. We use Twitter as main data source and analyze its textual, visual, temporal, geographical and social dimensions. Visualizations show dif- ferent aspects of the event allowing high-level comprehension and provide deeper insights into the event as complemented by social media.


2964284.2984063_socialsatellite_cameraready.pdf (pdf, 8 MB )

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence