Loading [a11y]/accessibility-menu.js
Fast and Accurate Cardinality Estimation by Self-Morphing Bitmaps | IEEE Journals & Magazine | IEEE Xplore

Fast and Accurate Cardinality Estimation by Self-Morphing Bitmaps


Abstract:

Estimating the cardinality of a data stream is a fundamental problem underlying numerous applications such as traffic monitoring in a network or a datacenter and query op...Show More

Abstract:

Estimating the cardinality of a data stream is a fundamental problem underlying numerous applications such as traffic monitoring in a network or a datacenter and query optimization of Internet-scale P2P data networks. Existing solutions suffer from high processing/query overhead or memory in-efficiency, which prevents them from operating online for data streams with very high arrival rates. This paper takes a new solution path different from the prior art and proposes a self-morphing bitmap, which combines operational simplicity with structural dynamics, allowing the bitmap to be morphed in a series of steps with an evolving sampling probability that automatically adapts to different stream sizes. We further generalize the design of self-morphing bitmap. We evaluate the self-morphing bitmap theoretically and experimentally. The results demonstrate that it significantly outperforms the prior art.
Published in: IEEE/ACM Transactions on Networking ( Volume: 30, Issue: 4, August 2022)
Page(s): 1674 - 1688
Date of Publication: 10 February 2022

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.