Adaptive Fragment Assignment for Processing File Data in a Database

Andrey Balmin, Romulo Antonio Pereira Goncalves, Fatma Ozcan, Jonas Traub



Scheduling mechanisms for assigning data in a distributed file system to database workers are provided. In one embodiment, a method of and computer program product for assignment of data blocks to database workers are provided. A request for table data is received. Metadata for a plurality of blocks in a file system is retrieved from a metadata store. Each of the plurality of blocks contains a subset of the table data. A request for work is received from a requestor. An assignment of one or more of the plurality of blocks is provided to the requestor.

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence