skip to main content
10.1145/3533737.3535097acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
short-paper

Result-Set Management for NDP Operations on Smart Storage

Published:13 June 2022Publication History

ABSTRACT

Current data-intensive systems suffer from scalability as they transfer massive amounts of data to the host DBMS to process it there. Novel near-data processing (NDP) DBMS architectures and smart storage can provably reduce the impact of raw data movement. However, transferring the result-set of an NDP operation may increase the data movement, and thus, the performance overhead. In this paper, we introduce a set of in-situ NDP result-set management techniques, such as spilling, materialization, and reuse. Our evaluation indicates a performance improvement of 1.13 × to 400 ×.

References

  1. Timothy G. Armstrong, Vamsi Ponnekanti, Dhruba Borthakur, and Mark Callaghan. 2013. LinkBench: A Database Benchmark Based on the Facebook Social Graph. In Proc. SIGMOD. 12 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Antonio Barbalace, Martin Decky, Javier Picorel, and Pramod Bhatotia. 2020. BlockNDP: Block-storage near data processing. In Proc. Middlew.8–15. https://doi.org/10.1145/3429357.3430519Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Antonio Barbalace and Jaeyoung Do. 2021. Computational Storage: Where Are We Today?. In 11th Conference on Innovative Data Systems Research, CIDR 2021, Virtual Event, January 11-15, 2021, Online Proceedings. http://www.cidrdb.orgGoogle ScholarGoogle Scholar
  4. Wei Cao, Yang Liu, Zhushi Cheng, Ning Zheng, Wei Li, Wenjie Wu, Linqiang Ouyang, Peng Wang, Yijing Wang, Ray Kuan, Zhenjun Liu, Feng Zhu, and Tong Zhang. 2020. POLARDB meets computational storage: Efficiently support analytical workloads in cloud-native relational database. In Proc. FAST. 29–41.Google ScholarGoogle Scholar
  5. OpenSSD Project 2019. COSMOS Project Documentation. OpenSSD Project. http://www.openssd-project.org/wiki/Cosmos_OpenSSD_Technical_ResourcesGoogle ScholarGoogle Scholar
  6. Ilia Petrov, Andreas Koch, Sergey Hardock, Tobias Vincon, and Christian Riegger. 2019. Native Storage Techniques for Data Management. Proc. ICDE (2019).Google ScholarGoogle ScholarCross RefCross Ref
  7. Tobias Vincon, Lukas Weber, Arthur Bernhardt, Andreas Koch, and Ilia Petrov. 2020. nKV: Near-Data Processing with KV-Stores on Native Computational Storage. In Proc. DaMoN.Google ScholarGoogle Scholar
  8. Tobias Vincon, Lukas Weber, Arthur Bernhardt, Christian Riegger, Sergey Hardock, Christian Knoedler, Florian Stock, Leonardo Solis-Vasquez, Sajjad Tamimi, Andreas Koch, and Ilia Petrov. 2020. nKV in Action: Accelerating KV-Stores on Native Computational Storage with Near-Data Processing. PVLDB 12(2020).Google ScholarGoogle Scholar
  9. Lukas Weber, Tobias Vinçon, Christian Knödler, Leonardo Solis-Vasquez, Arthur Bernhardt, Ilia Petrov, and Andreas Koch. 2021. On the necessity of explicit cross-layer data formats in near-data processing systems. Distributed and Parallel Databases(2021).Google ScholarGoogle Scholar
  10. Louis Woods, Zsolt István, and Gustavo Alonso. 2014. Ibex: An Intelligent Storage Engine with Support for Advanced SQL Offloading. Proc. VLDB (2014).Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Louis Woods, J. Teubner, and G. Alonso. 2013. Less Watts, More Performance: An Intelligent Storage Engine for Data Appliances. In Proc. SIGMOD.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    DaMoN '22: Proceedings of the 18th International Workshop on Data Management on New Hardware
    June 2022
    83 pages
    ISBN:9781450393782
    DOI:10.1145/3533737

    Copyright © 2022 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 13 June 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • short-paper
    • Research
    • Refereed limited

    Acceptance Rates

    DaMoN '22 Paper Acceptance Rate12of18submissions,67%Overall Acceptance Rate80of102submissions,78%
  • Article Metrics

    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)0

    Other Metrics

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format