Logo des Repositoriums
 
Konferenzbeitrag

Communication-Optimal Parallel Reservoir Sampling

Vorschaubild nicht verfügbar

Volltext URI

Dokumententyp

Text/Conference Paper

Zusatzinformation

Datum

2023

Zeitschriftentitel

ISSN der Zeitschrift

Bandtitel

Quelle

Verlag

Gesellschaft für Informatik e.V.

Zusammenfassung

When evaluating complex analytical queries on high-velocity data streams, many systems cannot run those queries on all elements of a stream. Sampling is a widely used method to reduce the system load by replacing the input with a representative yet manageable subset. For unbounded data, reservoir sampling generates a fixed-size uniform sample independent of the input cardinality. However, the collection of reservoir samples itself can already be a bottleneck for high-velocity data.In this paper, we introduce a technique that allows fully parallelizing reservoir sampling for many-core architectures. Our approach relies on the efficient combination of thread-local samples taken over chunks of the input without necessitating communication during the sampling phase and with minimal communication when merging. We show how our efficient merge guarantees uniform random samples while allowing data to be distributed over worker threads arbitrarily. Our analysis of this approach within the Umbra database system demonstrates linear scaling along the available threads and the ability to sustain high-velocity workloads.

Beschreibung

Winter, Christian; Sichert, Moritz; Birler, Altan; Neumann, Thomas; Kemper, Alfons (2023): Communication-Optimal Parallel Reservoir Sampling. BTW 2023. DOI: 10.18420/BTW2023-27. Bonn: Gesellschaft für Informatik e.V.. ISBN: 978-3-88579-725-8. pp. 567-578. Dresden, Germany. 06.-10. März 2023

Zitierform

Tags