Abstract
Co-locating and running multiple applications on a multicore system is inevitable for data centers to achieve high resource efficiency. However, it causes performance degradation due to the contention for shared resources, such as cache and memory bandwidth. Several approaches use software or hardware isolation techniques to mitigate resource contentions. Nevertheless, the existing approaches have not fully exploited differences in isolation techniques by the characteristics of applications to maximize the performance. Software techniques bring more flexibility than hardware ones in terms of performance while sacrificing strictness and responsiveness. In contrast, hardware techniques provide more strict and faster isolations compared to software ones. In this paper, we illustrate the trade-offs between software and hardware isolation techniques and also show the benefit of coordinated enforcement of multiple isolation techniques. Also, we propose HIS, a hybrid isolation system that dynamically uses either the software or hardware isolation technique. Our preliminary results show that HIS can improve the performance of foreground applications by from 1.7–2.14\(\times \) compared with static isolations for the selected benchmarks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bailey, D.H., et al.: The NAS parallel benchmarks. Int. J. Supercomput. Appl. 5(3), 63–73 (1991)
Bienia, C., Kumar, S., Singh, J.P., Li, K.: The parsec benchmark suite: characterization and architectural implications. In: Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques, pp. 72–81. ACM (2008)
Che, S., Boyer, M., Meng, J., Tarjan, D., Sheaffer, J.W., Lee, S.H., Skadron, K.: Rodinia: a benchmark suite for heterogeneous computing. In: 2009 IEEE International Symposium on Workload Characterization, IISWC 2009, pp. 44–54. IEEE (2009)
Chen, S., Delimitrou, C., Martínez, J.F.: Parties: Qos-aware resource partitioning for multiple interactive services. In: Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 107–120 (2019)
David, H., Gorbatov, E., Hanebutte, U.R., Khanna, R., Le, C.: RAPL: memory power estimation and capping. In: Proceedings of the 16th ACM/IEEE International Symposium on Low Power Electronics and Design, pp. 189–194. ACM (2010)
Delimitrou, C., Kozyrakis, C.: Quasar: resource-efficient and QoS-aware cluster management. ACM SIGPLAN Not. 49(4), 127–144 (2014)
Derr, S.: Control Group Cpusets. BULL SA (2004). https://www.kernel.org/doc/Documentation/cgroup-v1/cpusets.txt
Elnikety, S., et al.Perfiso: Performance isolation for commercial latency-sensitive services
Hsu, C.H., et al.: Adrenaline: pinpointing and reining in tail queries with quick voltage boosting. In: 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA), pp. 271–282. IEEE (2015)
Intel, C.: Improving real-time performance by utilizing cache allocation technology. Intel Corporation, April 2015
Kim, S., Eom, H., Yeom, H.Y.: Virtual machine consolidation based on interference modeling. J. Supercomput. 66(3), 1489–1506 (2013). https://doi.org/10.1007/s11227-013-0939-2
Lepers, B., Quéma, V., Fedorova, A.: Thread and memory placement on numa systems: asymmetry matters. In: USENIX Annual Technical Conference, pp. 277–289 (2015)
Leverich, J., Kozyrakis, C.: Reconciling high server utilization and sub-millisecond quality-of-service. In: Proceedings of the Ninth European Conference on Computer Systems, p. 4. ACM (2014)
Linden, G.: Make data useful (2006)
Lo, D., Cheng, L., Govindaraju, R., Ranganathan, P., Kozyrakis, C.: Heracles: improving resource efficiency at scale. ACM SIGARCH Comput. Architect. News 43, 450–462 (2015)
Seo, D., Eom, H., Yeom, H.Y.: MLB: a memory-aware load balancing method for mitigating memory contention. In: Conference on Timely Results in Operating Systems (TRIOS 2014) (2014)
Teabe, B., Tchana, A., Hagimont, D.: Application-specific quantum for multi-core platform scheduler. In: Proceedings of the Eleventh European Conference on Computer Systems, p. 3. ACM (2016)
Turner, P., Rao, B.B., Rao, N.: CPU bandwidth control for CFS. In: Linux Symposium, vol. 10, pp. 245–254. Citeseer (2010)
Wysocki, R.J.: CPU Performance Scaling. Intel Corporation (2017). https://www.kernel.org/doc/html/v4.12/_sources/admin-guide/pm/cpufreq.rst.txt
Yun, H., Yao, G., Pellizzoni, R., Caccamo, M., Sha, L.: MemGuard: memory bandwidth reservation system for efficient performance isolation in multi-core platforms. In: 2013 IEEE 19th Real-Time and Embedded Technology and Applications Symposium (RTAS), pp. 55–64. IEEE (2013)
Zhang, X., Tune, E., Hagmann, R., Jnagal, R., Gokhale, V., Wilkes, J.: CPI 2: CPU performance isolation for shared compute clusters. In: Proceedings of the 8th ACM European Conference on Computer Systems, pp. 379–391. ACM (2013)
Zhao, Y., Rao, J., Yi, Q.: Characterizing and optimizing the performance of multithreaded programs under interference. In: 2016 International Conference on Parallel Architecture and Compilation Techniques (PACT), pp. 287–297. IEEE (2016)
Zhu, H., Erez, M.: DIRIGENT: enforcing QoS for latency-critical tasks on shared multicore systems. ACM SIGARCH Comput. Architect. News 44(2), 33–47 (2016)
Zhuravlev, S., Blagodurov, S., Fedorova, A.: Addressing shared resource contention in multicore processors via scheduling. ACM Sigplan Not. 45, 129–142 (2010)
Acknowledgments
This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. 2017R1A2B4004513, 2016M3C4A7952587, 2018R1C1B5085640), the Institute for the Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIP) (No. R0190-16-2012), and BK21 Plus for Pioneers in Innovative Computing (Dept. of Computer Science and Engineering, SNU) funded by National Research Foundation of Korea(NRF) (21A20151113068).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Nam, Y., Yoo, B., Choi, Y., Son, Y., Eom, H. (2020). Towards Hybrid Isolation for Shared Multicore Systems. In: Klusáček, D., Cirne, W., Desai, N. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP 2020. Lecture Notes in Computer Science(), vol 12326. Springer, Cham. https://doi.org/10.1007/978-3-030-63171-0_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-63171-0_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63170-3
Online ISBN: 978-3-030-63171-0
eBook Packages: Computer ScienceComputer Science (R0)