Xianzhi Zeng
Shuhao Zhang
ABSTRACT
Data stream compression has attracted vast interest in emerging IoT (Internet of Things) applications. However, adopting stream compression on IoT applications is non-trivial due to the divergent demands, i.e., low energy consumption, high throughput, low latency, high compressibility, and tolerable information loss, which sometimes conflict with each other. This is particularly challenging when adopting stateful stream compression algorithms, which rely on states, e.g., a dictionary or model. This paper presents our vision of CStream, a hardware-conscious stateful stream compression framework for IoT applications. Through careful hardware-conscious optimizations, CStream will minimize energy consumption while striving to satisfy the divergent performance demands for parallelizing complex stateful stream compression algorithms for IoT applications.
- Davis Blalock et al. 2018. Sprintz: Time series compression for the internet of things. In ACM IMWUT (2018).Google Scholar
- Bansal et al. 2020. A Survey on IoT Big Data: Current Status, 13 V's Challenges, and Future Directions. CSUR (2020).Google Scholar
- Cardellini et al. 2022. Runtime Adaptation of Data Stream Processing Systems: The State of the Art. CSUR (2022).Google Scholar
- Duvignau et al. 2019. Streaming piecewise linear approximation for efficient data management in edge computing. In SIGAPP.Google Scholar
- Gennady Pekhimenko et al. 2018. TerseCades: Efficient Data Compression in Stream Processing. In USENIX ATC 18. Boston, MA.Google Scholar
- Havers et al. 2019. Driven: a framework for efficient data retrieval and clustering in vehicular networks. In ICDE. IEEE.Google Scholar
- Li et al. 2022. Camel: Managing Data for Efficient Stream Learning. In SIGMOD 2022.Google Scholar
- Prajith Ramakrishnan Geethakumari et al. 2021. Streamzip: Compressed sliding-windows for stream aggregation. In ICFPT. IEEE.Google Scholar
- Khurram Iqbal et al. 2020. Performance comparison of lossless compression strategies for dynamic vision sensor data. In ICASSP. IEEE.Google Scholar
- Søren Kejser Jensen et al. 2018. Modelardb: Modular model-based time series management with spark and cassandra. VLDB (2018).Google ScholarDigital Library
- Yiming Li et al. 2022. Camel: Managing Data for Efficient Stream Learning. In SIGMOD.Google Scholar
- Yancan Mao and et al. 2023. MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores. In SIGMOD.Google Scholar
- Sparsh Mittal. 2016. A survey of techniques for architecting and managing asymmetric multicore processors. CSUR (2016).Google Scholar
- Muhammad Anis Uddin Nasir et al. 2015. The power of both choices: Practical load balancing for distributed stream processing engines. In ICDE. IEEE.Google Scholar
- Adnan Ozsoy et al. 2011. CULZSS: LZSS lossless data compression on CUDA. In ICCC. IEEE.Google Scholar
- John Paparrizos et al. 2021. VergeDB: A Database for IoT Analytics on Edge Devices.. In CIDR.Google Scholar
- Julian Shun et al. 2013. Practical parallel lempel-ziv factorization. In 2013 Data Compression Conference. IEEE.Google Scholar
- Jianguo Wang et al. 2017. An experimental study of bitmap compression vs. inverted list compression. In SIGMOD.Google Scholar
- Manni Wang et al. 2021. AsyMo: scalable and efficient deep-learning inference on asymmetric mobile CPUs. In MobiCom.Google Scholar
- Qunsong Zeng et al. 2021. Energy-efficient resource management for federated edge learning with CPU-GPU heterogeneous computing. IEEE TWC (2021).Google Scholar
- Xianzhi Zeng and et al. 2023. Parallelizing Stream Compression for IoT Applications on Asymmetric Multicores. In ICDE. IEEE.Google Scholar
- Steffen Zeuch and et al. 2020. NebulaStream: Complex analytics beyond the cloud. VLIoT 2020 (2020).Google Scholar
- Shuhao Zhang et al. 2019. Briskstream: Scaling data stream processing on shared-memory multicore architectures. In SIGMOD.Google Scholar
- Shuhao Zhang et al. 2021. Parallelizing Intra-Window Join on Multicores: An Experimental Study. In SIGMOD.Google Scholar
- Yu Zhang and et al. 2023. CompressStreamDB: Fine-Grained Adaptive Stream Processing without Decompression. In ICDE.Google Scholar
Index Terms
- A Hardware-Conscious Stateful Stream Compression Framework for IoT Applications (Vision)
Recommendations
Hardware-Conscious Stream Processing: A Survey
Data stream processing systems (DSPSs) enable users to express and run stream applications to continuously process data streams. To achieve realtime data analytics, recent researches keep focusing on optimizing the system latency and throughput. ...
Sub-millisecond Stateful Stream Querying over Fast-evolving Linked Data
SOSP '17: Proceedings of the 26th Symposium on Operating Systems PrinciplesApplications like social networking, urban monitoring and market feed processing require stateful stream query: a query consults not only streaming data but also stored data to extract timely information; useful information from streaming data also ...
Comments