Publikation
Generating Custom Code for Efficient Query Execution on Heterogeneous Processors
Sebastian Breß; Bastian Köcher; Henning Funke; Steffen Zeuch; Tilmann Rabl; Volker Markl
DFKI, Technical Report, Vol. abs/1709.00700, arXiv, 2017.
Zusammenfassung
Processor manufacturers build increasingly specialized processors to mitigate the effects of the power wall to deliver improved performance. Currently, database engines are manually optimized for each processor: A costly and error prone process. In this paper, we propose concepts to enable the database engine to perform per-processor optimization automatically. Our core idea is to create variants of generated code and to learn a fast variant for each processor. We create variants by modifying parallelization strategies, specializing data structures, and applying different code transformations. Our experimental results show that the performance of variants may diverge up to two orders of magnitude. Therefore, we need to generate custom code for each processor to achieve peak performance. We show that our approach finds a fast custom variant for multi-core CPUs, GPUs, and MICs.
Projekte
- E2Data - European Extreme Performing Big Data Stacks
- SAGE - Percipient Storage für Exascale Data-Centric Computing