skip to main content
10.1145/3583678.3596885acmconferencesArticle/Chapter ViewAbstractPublication PagesdebsConference Proceedingsconference-collections
short-paper

A Hardware-Conscious Stateful Stream Compression Framework for IoT Applications (Vision)

Published: 27 June 2023 Publication History

Abstract

Data stream compression has attracted vast interest in emerging IoT (Internet of Things) applications. However, adopting stream compression on IoT applications is non-trivial due to the divergent demands, i.e., low energy consumption, high throughput, low latency, high compressibility, and tolerable information loss, which sometimes conflict with each other. This is particularly challenging when adopting stateful stream compression algorithms, which rely on states, e.g., a dictionary or model. This paper presents our vision of CStream, a hardware-conscious stateful stream compression framework for IoT applications. Through careful hardware-conscious optimizations, CStream will minimize energy consumption while striving to satisfy the divergent performance demands for parallelizing complex stateful stream compression algorithms for IoT applications.

References

[1]
Davis Blalock et al. 2018. Sprintz: Time series compression for the internet of things. In ACM IMWUT (2018).
[2]
Bansal et al. 2020. A Survey on IoT Big Data: Current Status, 13 V's Challenges, and Future Directions. CSUR (2020).
[3]
Cardellini et al. 2022. Runtime Adaptation of Data Stream Processing Systems: The State of the Art. CSUR (2022).
[4]
Duvignau et al. 2019. Streaming piecewise linear approximation for efficient data management in edge computing. In SIGAPP.
[5]
Gennady Pekhimenko et al. 2018. TerseCades: Efficient Data Compression in Stream Processing. In USENIX ATC 18. Boston, MA.
[6]
Havers et al. 2019. Driven: a framework for efficient data retrieval and clustering in vehicular networks. In ICDE. IEEE.
[7]
Li et al. 2022. Camel: Managing Data for Efficient Stream Learning. In SIGMOD 2022.
[8]
Prajith Ramakrishnan Geethakumari et al. 2021. Streamzip: Compressed sliding-windows for stream aggregation. In ICFPT. IEEE.
[9]
Khurram Iqbal et al. 2020. Performance comparison of lossless compression strategies for dynamic vision sensor data. In ICASSP. IEEE.
[10]
Søren Kejser Jensen et al. 2018. Modelardb: Modular model-based time series management with spark and cassandra. VLDB (2018).
[11]
Yiming Li et al. 2022. Camel: Managing Data for Efficient Stream Learning. In SIGMOD.
[12]
Yancan Mao and et al. 2023. MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores. In SIGMOD.
[13]
Sparsh Mittal. 2016. A survey of techniques for architecting and managing asymmetric multicore processors. CSUR (2016).
[14]
Muhammad Anis Uddin Nasir et al. 2015. The power of both choices: Practical load balancing for distributed stream processing engines. In ICDE. IEEE.
[15]
Adnan Ozsoy et al. 2011. CULZSS: LZSS lossless data compression on CUDA. In ICCC. IEEE.
[16]
John Paparrizos et al. 2021. VergeDB: A Database for IoT Analytics on Edge Devices. In CIDR.
[17]
Julian Shun et al. 2013. Practical parallel lempel-ziv factorization. In 2013 Data Compression Conference. IEEE.
[18]
Jianguo Wang et al. 2017. An experimental study of bitmap compression vs. inverted list compression. In SIGMOD.
[19]
Manni Wang et al. 2021. AsyMo: scalable and efficient deep-learning inference on asymmetric mobile CPUs. In MobiCom.
[20]
Qunsong Zeng et al. 2021. Energy-efficient resource management for federated edge learning with CPU-GPU heterogeneous computing. IEEE TWC (2021).
[21]
Xianzhi Zeng and et al. 2023. Parallelizing Stream Compression for IoT Applications on Asymmetric Multicores. In ICDE. IEEE.
[22]
Steffen Zeuch and et al. 2020. NebulaStream: Complex analytics beyond the cloud. VLIoT 2020 (2020).
[23]
Shuhao Zhang et al. 2019. Briskstream: Scaling data stream processing on shared-memory multicore architectures. In SIGMOD.
[24]
Shuhao Zhang et al. 2021. Parallelizing Intra-Window Join on Multicores: An Experimental Study. In SIGMOD.
[25]
Yu Zhang and et al. 2023. CompressStreamDB: Fine-Grained Adaptive Stream Processing without Decompression. In ICDE.

Cited By

View all

Index Terms

  1. A Hardware-Conscious Stateful Stream Compression Framework for IoT Applications (Vision)
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        DEBS '23: Proceedings of the 17th ACM International Conference on Distributed and Event-based Systems
        June 2023
        221 pages
        ISBN:9798400701221
        DOI:10.1145/3583678
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 27 June 2023

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. stream compression
        2. IoT and edge computing
        3. asymmetric and heterogeneous hardware

        Qualifiers

        • Short-paper

        Funding Sources

        • National Research Foundation, Singapore and Infocomm Media Development Authority under its Future Communications Research & Development Programme

        Conference

        DEBS '23

        Acceptance Rates

        Overall Acceptance Rate 145 of 583 submissions, 25%

        Upcoming Conference

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 59
          Total Downloads
        • Downloads (Last 12 months)24
        • Downloads (Last 6 weeks)4
        Reflects downloads up to 10 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media