Chun-Yuan Huang
ABSTRACT
Memory deduplication, which detects and removes redundant memory pages, can efficiently increase the efficiency of memory usage. It is often used with virtualization technologies, such as virtual machines (VMs), to improve their memory utilization. However, current memory deduplication systems, such as KSM (Kernel Samepage Merging), suffer the problem of either slow convergence or high CPU usage. In this paper, we proposed an algorithm, called hotscan, to accelerate the convergence of KSM for VM consolidation. We have observed that the pages have higher chance to be merged among different VMs are clustered in certain memory regions, called memory hot-zone. Based on this observation, hot-scan changes the scanning rule of KSM to check the pages in hot-zones of all VMs first. A novel data structure, called transpose list, is proposed to efficiently carry out the new scanning pattern. Experiments show that our method can accelerate the speed of deduplication 20% to 30% faster than the vanilla KSM without consuming too much additional CPU resource.
- Andrea Arcangeli, IzikEidus, and Chris Wright. 2009. Increasing memory density by using KSM. In In OLS.Google Scholar
- Sean Barker, Timothy Wood, Prashant Shenoy, and Ramesh Sitaraman. 2012. An Empirical Study of Memory Sharing in Virtual Machines. In Presented as part of the 2012 USENIX Annual Technical Conference (USENIX ATC 12). USENIX, Boston, MA, 273--284.Google Scholar
- C. R. Chang, J. J. Wu, and P. Liu. 2011. An Empirical Study on Memory Sharing of Virtual Machines for Server Consolidation. In 2011 IEEE Ninth International Symposium on Parallel and Distributed Processing with Applications. 244--249.Google Scholar
- Licheng Chen, Zhipeng Wei, Zehan Cui, Mingyu Chen, Haiyang Pan, and Yungang Bao. 2014. CMD: classification-based memory deduplication through page access characteristics. In ACM SIGPLAN Notices, Vol. 49. ACM, 65--76.Google ScholarDigital Library
- Yan Deng, Chunming Hu, Tianyu Wo, Bo Li, and Lei Cui. 2013. A memory deduplication approach based on group in virtualized environments. In Service Oriented System Engineering (SOSE), 2013 IEEE 7th International Symposium on. IEEE, 367--372.Google ScholarDigital Library
- Djellel Eddine Difallah, Andrew Pavlo, Carlo Curino, and Philippe Cudre-Mauroux. 2013. OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases. Proc. VLDB Endow. 7, 4 (Dec. 2013), 277--288. Google ScholarDigital Library
- Konrad Miller, Fabian Franz, Marc Rittinghaus, Marius Hillenbrand, and Frank Bellosa. 2013. XLH: More Effective Memory Deduplication Scanners Through Cross-layer Hints.. In USENIX Annual Technical Conference. 279--290.Google Scholar
- Yeji Nam, Dongwoo Lee, and Young Ik Eom. 2015. SELF: Improving the Memory-Sharing Opportunity using Virtual-Machine Self-Hints in Virtualized Systems. In Proceedings of the 6th Asia-Pacific Workshop on Systems. ACM, 10.Google ScholarDigital Library
- T Veni and S Bhanu. 2016. MDedup++: Exploiting Temporal and Spatial Page-Sharing Behaviors for Memory Deduplication Enhancement. Comput. J. 59, 3 (2016), 353--370.Google ScholarCross Ref
- Nai Xia, Chen Tian, Yan Luo, Hang Liu, and Xiaoliang Wang. 2018. UKSM: Swift Memory Deduplication via Hierarchical and Adaptive Memory Region Distilling. In 16th USENIX Conference on File and Storage Technologies (FAST 18). USENIX Association, Oakland, CA, 325--340.Google Scholar
Index Terms
- Memory hot-zone and its application to accelerate the convergence of KSM for VM consolidation
Recommendations
Exploiting Memory Page Management in KSM for Remote Memory Deduplication Attack
Information Security ApplicationsAbstractIn virtualized environments, modern operating systems take advantage of memory deduplication feature to efficiently manage physical memory. However, the adoption of this technique has given rise to memory deduplication attacks that disclose memory ...
Towards Efficient Hugepage-aware Memory Deduplication
WORDS '23: Proceedings of the 4th Workshop on Resource Disaggregation and ServerlessMemory deduplication techniques aim to reduce memory consumption by sharing redundant memory pages. Additionally, hugepages are commonly employed to optimize performance by minimizing TLB misses. However, the simultaneous use of memory deduplication ...
Introspection-Based Memory Pruning for Live VM Migration
Virtual Machine (VM) migration is an appealing technique on nowadays cloud platforms to achieve high availability, load balancing and power saving. Unfortunately, migration of VM involves transferring a large amount of data, thereby imposing high ...
Comments