skip to main content
10.1145/3555776.3577733acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

NF-Log: Revisiting Log Writes in Relational Database for Efficient Persistent Memory Utilization

Published: 07 June 2023 Publication History

Abstract

Non-volatile memory (NVM) is a promising storage technology that combines not only high performance and byte-addressability (like DRAM) but also durability (like SSD). However, as existing relational database management systems (RDBMS) are originally designed based on the assumption that all the data and log are stored on high latency block based devices, they are not able to take full advantage of this new technology yet. Consequently, write operations will under-utilize the device(NVM) and eventually downgrade the performance. In this work, we analyzed the redo-log mechanism in InnoDB and after discovering its severe impact on the overall performance, we decided to perform optimizations that will match with NVM features. We started by re-designing the log write path within InnoDB. After that, we worked on improving the log data access locality and finally, we optimized the write ahead mechanism. NF-log (Non Flushing Log) utilizes the NVM byte addressability and its persistence feature to reduce the write size by 30% and boost up the performance to up to 38% for sysbench write_intensive workloads and up to 16% for TPC-C.

References

[1]
Mittal, et al. "A Survey of Software Techniques for Using Non-Volatile Memories for Storage and Main Memory Systems," in IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 5, pp. 1537--1550, 1 May 2016
[2]
Joseph Izraelevitz, et al. "Basic Performance Measurements of the Intel optane DC Persistent Memory Module," arXiv, 2019, 1903.05714.
[3]
P. Frühwirt, et al. "InnoDB Database Forensics: Reconstructing Data Manipulation Queries from Redo Logs" 2012 Seventh International Conference on Availability, Reliability and Security, 2012, pp. 625--633
[4]
Joy Arulraj, et al. 2016. Write-behind logging. Proc. VLDB Endow. 10, 4 (November 2016), 337--348.
[5]
Hyungsoo Jung, et al. Scalable database logging for multicores. Proc. VLDB Endow. 11, 2 (October 2017), 135--148.
[6]
Nachshon Cohen, et al 2019. Fine-Grain Checkpointing with In-Cache-Line Logging. In Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS '19). Association for Computing Machinery, New York, NY, USA, 441--454.
[7]
M. A. Ogleari, et al "Steal but No Force: Efficient Hardware Undo+Redo Logging for Persistent Memory Systems," 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA), 2018, pp. 336--349
[8]
J. Jeong, et al "Efficient Hardware-Assisted Logging with Asynchronous and Direct-Update for Persistent Memory," 2018 51st Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), 2018, pp. 520--532
[9]
arXiv:1903.05714 [cs.DC]
[10]
DeBrabant, et al. "A Prolegomenon on OLTP Database Systems for Non-Volatile Memory." ADMS@VLDB (2014).
[11]
Steven Pelley, et al. 2013. Storage management in the NVRAM era. Proc. VLDB Endow. 7, 2 (October 2013), 121--132.
[12]
Ismail Oukid, et al. 2014. SOFORT: a hybrid SCM-DRAM storage engine for fast data recovery. In Proceedings of the Tenth International Workshop on Data Management on New Hardware (DaMoN '14). Association for Computing Machinery, New York, NY, USA, Article 8, 1--7.
[13]
Nguyen, et al. (2019). Revisiting Write-Ahead logging with NVDIMM. KDBC(Korean Database Conference) (2019)
[14]
arXiv:2112.00425v1
[15]
AVNI, et al. 2021. Extending In-Memory OLTP with Persistent Memory. ADMS@VLDB (2021)
[16]
Jihang Liu, et al. 2020. LB+Trees: optimizing persistent index performance on 3DXPoint memory. Proc. VLDB Endow. 13, 7 (March 2020), 1078--1090.
[17]
Wenhui Zhang, et al. 2021. ChameleonDB: a key-value store for optane persistent memory. In Proceedings of the Sixteenth European Conference on Computer Systems (EuroSys '21). Association for Computing Machinery, New York, NY, USA, 194--209.
[18]
Gang Liu, et al. 2021. Zen: a high-throughput log-free OLTP engine for non-volatile main memory. Proc. VLDB Endow. 14, 5 (January 2021), 835--848.
[19]
https://pmem.io/pmdk/
[20]
https://dev.mysql.com/doc/dev/mysql-server/latest/
[21]
https://www.tpc.org/tpcc/
[22]
https://azure.microsoft.com/en-us/products/azure-sql/database/overview
[23]
https://www.oracle.com/cloud/
[24]
https://www.sap.com/products/hana/cloud.html
[25]
https://www.intel.com/content/dam/support/us/en/documents/memory-and-storage/data-center-persistent-mem/Intel-optane-DC-Persistent-Memory-Quick-Start-Guide.pdf
[26]
https://github.com/opcm/pcm

Index Terms

  1. NF-Log: Revisiting Log Writes in Relational Database for Efficient Persistent Memory Utilization
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          SAC '23: Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing
          March 2023
          1932 pages
          ISBN:9781450395175
          DOI:10.1145/3555776
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 07 June 2023

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. storage systems
          2. database systems
          3. relational database
          4. log optimization
          5. non volatile memory

          Qualifiers

          • Research-article

          Funding Sources

          • National Research Foundation of Korea(NRF)
          • SNU-SK Hynix Solu?tion Research Center

          Conference

          SAC '23
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

          Upcoming Conference

          SAC '25
          The 40th ACM/SIGAPP Symposium on Applied Computing
          March 31 - April 4, 2025
          Catania , Italy

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 100
            Total Downloads
          • Downloads (Last 12 months)29
          • Downloads (Last 6 weeks)1
          Reflects downloads up to 16 Feb 2025

          Other Metrics

          Citations

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media