Skip to main content
SpringerLink
Log in

A novel index system describing program runtime characteristics for workload consolidation

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Workload consolidation is a common method to improve the resource utilization in clusters or data centers. In order to achieve efficient workload consolidation, the runtime characteristics of a program should be taken into consideration in scheduling. In this paper, we propose a novel index system for efficiently describing the program runtime characteristics. With the help of this index system, programs can be classified by the following runtime characteristics: 1) dependence to multi-dimensional resources including CPU, disk I/O, memory and network I/O; and 2) impact and vulnerability to resource sharing embodied by resource usage and resource sensitivity. In order to verify the effectiveness of this novel index system in workload consolidation, a scheduling strategy, Sche-index, using the new index system for workload consolidation is proposed. Experiment results show that compared with traditional least-loaded scheduling strategy, Sche-index can improve both program performance and system resource utilization significantly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Gmach D, Rolia J, Cherkasova L. Resource and virtualization costs up in the cloud: models and design choices. In: Proceedings of the 41st IEEE/IFIP International Conference on Dependable Systems & Networks. 2011, 395–402

    Google Scholar 

  2. Ahmad R W, Gani A, Hamid S H A, Shiraz M, Yousafzai A, Xia F. A survey on virtual machine migration and server consolidation frameworks for cloud data centers. Journal of Network and Computer Applications, 2015, 52: 11–25

    Article  Google Scholar 

  3. Li X, Wang R, Luan Z, Liu Y, Qian D. Coordinating workload balancing and power switching in renewable energy powered data center. Frontiers of Computer Science, 2016, 10(3): 574–587

    Article  Google Scholar 

  4. Stansberry M, Kudritzki J. Uptime institute 2012 data center industry survey. Uptime Institute, 2012

    Google Scholar 

  5. Zhuravlev S, Blagodurov S, Fedorova A. Addressing shared resource contention in multicore processors via scheduling. In: Proceedings of the 15th International Conference on Architectural Support for Programming Languages and Operating Systems. 2010, 129–141

    Google Scholar 

  6. Moreto M, Cazorla F J, Ramirez A, Sakellariou R, Valero M. FlexDCP: a QoS framework for CMP architectures. ACM SIGOPS Operating Systems Review, 2009, 43(2): 86–96

    Article  Google Scholar 

  7. Dwyer T, Fedorova A, Blagodurov S, Roth M, Gaud F, Pei J. A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. 2012, 83–94

    Google Scholar 

  8. Pacheco–Sanchez S, Casale G, Scotney B, McClean S, Parr G, Dawson S. Markovian workload characterization for QoS prediction in the cloud. In: Proceedings of the IEEE International Conference on Cloud Computing. 2011, 147–154

    Google Scholar 

  9. Blagodurov S, Gmach D, Arlitt M, Chen Y, Hyser C, Fedorova A. Maximizing server utilization while meeting critical SLAs via weight–based collocation management. In: Proceedings of the 2013 IFIP/IEEE International Symposium on Integrated Network Management. 2013, 277–285

    Google Scholar 

  10. Beloglazov A, Buyya R. Adaptive threshold–based approach for energy–efficient consolidation of virtual machines in cloud data centers. In: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e–Science. 2010, 1–4

    Google Scholar 

  11. Chen Q, Yang H, Mars J, Tang L. Baymax: QoS awareness and increased utilization for non–preemptive accelerators in warehouse scale computers. In: Proceedings of the 21st International Conference on Architectural Support for Programming Languages and Operating Systems. 2016, 681–696

    Google Scholar 

  12. Liu M, Li T. Optimizing virtual machine consolidation performance on NUMA server architecture for cloud workloads. In: Proceedings of the 41st International Symposium on Computer Architecture. 2014, 325–336

    Google Scholar 

  13. Mayer–Schönberger V, Cukier K. Big Data: A Revolution That will Transform How We Live, Work, and Think. Boston: Houghton Mifflin Harcourt, 2013

    Google Scholar 

  14. Di S, Kondo D, Cappello F. Characterizing cloud applications on a Google data center. In: Proceedings of the 42nd International Conference on Parallel Processing. 2013, 468–473

    Google Scholar 

  15. Schwarzkopf M, Konwinski A, Abd–El–Malek M, Wilkes J. Omega: flexible, scalable schedulers for large compute clusters. In: Proceedings of the 8th ACM European Conference on Computer Systems. 2013, 351–364

    Google Scholar 

  16. Wang J, Wen J, Han Y, Zhang J, Li C, Xiong Z. Achieving high throughput and TCP Reno fairness in delay–based TCP over large networks. Frontiers of Computer Science, 2014, 8(3): 426–439

    Article  MathSciNet  MATH  Google Scholar 

  17. Henning J L. SPEC CPU2006 benchmark descriptions. ACM SIGARCH Computer Architecture News, 2006, 34(4): 1–17

    Article  Google Scholar 

  18. Bienia C, Kumar S, Singh J P, Li K. The PARSEC benchmark suite: characterization and architectural implications. In: Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques. 2008, 72–81

    Chapter  Google Scholar 

  19. Ferdman M, Adileh A, Kocberber O. Clearing the clouds: a study of emerging scale–out workloads on modern hardware. ACM SIGPLAN Notices, 2012, 47(4): 37–48

    Article  Google Scholar 

  20. Mars J, Tang L. Whare–map: heterogeneity in homogeneous warehouse–scale computers. ACM SIGARCH Computer Architecture News, 2013, 41(3): 619–630

    Article  Google Scholar 

  21. Bailey D H, Barszcz E, Barton J T. The NAS parallel benchmarks. The International Journal of Supercomputing Applications, 1991, 5(3): 63–73

    Article  Google Scholar 

  22. Kopytov A. SysBench manual. MySQL AB, 2012, 2–3

    Google Scholar 

  23. Delimitrou C, Kozyrakis C. Paragon: QoS–aware scheduling for heterogeneous datacenters. ACM SIGPLAN Notices, 2013, 48(4): 77–88

    Article  Google Scholar 

  24. Mars J, Tang L, Hundt R, Skadron K, Soffa M L. Bubble–up: increasing utilization in modern warehouse scale computers via sensible colocations. In: Proceedings of the 44th Annual IEEE/ACMInternational Symposium on Microarchitecture. 2011, 248–259

    Google Scholar 

  25. Delimitrou C, Kozyrakis C. Quasar: resource efficient and QoS–aware cluster management. ACM SIGPLAN Notices, 2014, 49(4): 127–144

    Google Scholar 

  26. Delimitrou C, Sanchez D, Kozyrakis C. Tarcil: reconciling scheduling speed and quality in large shared clusters. In: Proceedings of the 6th ACM Symposium on Cloud Computing. 2015, 97–110

    Chapter  Google Scholar 

  27. Lo D, Cheng L, Govindaraju R, Ranganathan P, Kozyrakis C. Heracles: improving resource efficiency at scale. ACM SIGARCH Computer Architecture News, 2015, 43(3): 450–462

    Article  Google Scholar 

  28. Han J, Jeon S, Choi Y, Huh J. Interference management for distributed parallel applications in consolidated clusters. In: Proceedings of the 21st International Conference on Architectural Support for Programming Languages and Operating Systems. 2016, 443–456

    Google Scholar 

  29. Mars J, Vachharajani N, Hundt R, Soffa M L. Contention aware execution: online contention detection and response. In: Proceedings of the 8th Annual IEEE/ACM International Symposium on Code Generation and Optimization. 2010, 257–265

    Google Scholar 

  30. Tang L, Mars J, Soffa M L. Contentiousness vs. sensitivity: improving contention aware runtime systems on multicore architectures. In: Proceedings of the 1st International Workshop on Adaptive Self–Tuning Computing Systems for the Exaflop Era. 2011, 12–21

    Chapter  Google Scholar 

Download references

Acknowledgement

This work was funded by National Key Research and Development Program of China (2016YFB1000503), the National Natural Science Foundation of China (Grant Nos. 61133004, 61361126011, 61502019, 61732002, 61373081, 61772322), China Postdoctoral Science Foundation (2017M622263) and Natural Science Foundation of Shandong Province (ZR2015PF006).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Shandong Normal University, Jinan, 250014, China

    Lin Wang & Huaxiang Zhang

  2. School of Computer Science and Engineering, Beihang University, Beijing, 100191, China

    Lin Wang, Depei Qian, Rui Wang, Zhongzhi Luan & Hailong Yang

  3. School of Data and Computer Science, Sun Yat-sen University, Guangzhou, 510275, China

    Depei Qian

  4. Institute of Data Science and Technology, Shandong Normal University, Jinan, 250014, China

    Huaxiang Zhang

Authors
  1. Lin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Depei Qian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rui Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongzhi Luan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hailong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Huaxiang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rui Wang.

Additional information

Lin Wang is a lecturer in School of Information Science and Engineering, Shandong Normal University, China. She received her BS degree from School of Information Science and Engineering, Ji’nan University, received her MS degree from School of Computer Science and Technology, Shandong University, and received her Ph.D degree from the School of Computer Science and Engineering, Beihang University, China. Her research interests include computer architecture, distributed system and operating systems.

Depei Qian is a professor at the Department of Computer Science and Engineering, Beihang University, China. He received his master degree from University of North Texas in 1984. He is currently serving as the chief scientist of China National High Technology Program (863 Program) on high productivity computer and service environment. He is also a fellow of China Computer Federation (CCF). His research interests include innovative technologies in distributed computing, high performance computing and computer architecture.

Rui Wang is an assistant professor of School of Computer Science and Engineering, Beihang University, China. He received his BS and MS degree in computer science from Xi’an Jiaotong University in 2000 and 2003, respectively; and his PhD in computer science from Beihang University in 2009. His research interests include computer architecture and computer networks. He is a member of IEEE and China Computer Federation(CCF).

Zhongzhi Luan is an Associate Professor of School of Computer Science and Engineering, and Assistant Director of the Sino-German Joint Software Institute (JSI) at Beihang University, China. He completed PhD in Department of Computer Science of Xi’an Jiaotong University in 2003. He has been involved into more than 15 scientific projects mostly as project leader or the backbone of the researchers. He is now in charge of the international data placement testbed project which is funded by international cooperation program of National Science Foundation of China. His research interests include distributed computing, parallel computing, grid computing, HPC and new generation of network technology.

Hailong Yang is an assistant professor in School of Computer Science and Engineering, Beihang University, China. He received the PhD degree in the School of Computer Science and Engineering, Beihang University in 2014. He has been involved in several scientific projects such as performance analysis for big data systems and peformance optimization for large scale applications. His research interests include parallel and distributed computing, HPC, performance optimization and energy efficiency. He is also a member of IEEE and China Computer Federation (CCF).

Huaxiang Zhang is currently a professor with the School of Information Science and Engineering & the Institute of Data Science and Technology, Shandong Normal University, China. He received his PhD from Shanghai Jiaotong University in 2004, and worked as an associated professor with the Department of Computer Science, Shandong Normal University from 2004 to 2005. He has authored over 170 journal and conference papers and has been granted 11 invention patents. His current research interests include machine learning, pattern recognition, evolutionary computation, cross-media retrieval, Web information processing, data analysis, etc.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Qian, D., Wang, R. et al. A novel index system describing program runtime characteristics for workload consolidation. Front. Comput. Sci. 13, 489–499 (2019). https://doi.org/10.1007/s11704-018-6614-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-018-6614-2

Keywords

Search

Navigation