Skip to main content

Energy-Efficient and High-Performance Processing of Large-Scale Parallel Applications in Data Centers

  • Chapter
  • First Online:
Handbook on Data Centers

Abstract

Next generation supercomputers require drastically better energy efficiency to allow these systems to scale to exaflop computing levels. Virtually all major processor vendors and companies such as AMD, Intel, and IBM are developing high-performance and highly energy-efficient multicore processors and dedicating their current and future development and manufacturing to multicore products. It is conceivable that future multicore architectures can hold dozens or even hundreds of cores on a single die [3].

The author can be reached at phone: (845) 257-3534, fax: (845) 257-3996.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. http://en.wikipedia.org/wiki/Adapteva

  2. http://en.wikipedia.org/wiki/Dynamic_voltage_scaling

  3. http://www.intel.com/multicore/

  4. http://www.multicoreinfo.com/2011/10/adapteva-2/

  5. S. Albers, “Energy-efficient algorithms,” Communications of the ACM, vol. 53, no. 5, pp. 86–96, 2010.

    Article  MathSciNet  Google Scholar 

  6. H. Aydin, R. Melhem, D. Moss\` e, and P. Mej\` ia-Alvarez, “Power-aware scheduling for periodic real-time tasks,” IEEE Transactions on Computers, vol. 53, no. 5, pp. 584–600, 2004.

    Article  Google Scholar 

  7. N. Bansal, T. Kimbrel, and K. Pruhs, “Dynamic speed scaling to manage energy and temperature,” Proceedings of the 45th IEEE Symposium on Foundation of Computer Science, pp. 520–529, 2004.

    Google Scholar 

  8. J. A. Barnett, “Dynamic task-level voltage scheduling optimizations,” IEEE Transactions on Computers, vol. 54, no. 5, pp. 508–520, 2005.

    Article  Google Scholar 

  9. L. Benini, A. Bogliolo, and G. De Micheli, “A survey of design techniques for system-level dynamic power management,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, vol. 8, no. 3, pp. 299–316, 2000.

    Google Scholar 

  10. A. Berl, E. Gelenbe, M. Di Girolamo, G. Giuliani, H. De Meer, M. Q. Dang, and K. Pentikousis, “Energy-efficient cloud computing,” The Computer Journal, vol. 53, no. 7, pp. 1045–1051, 2010.

    Article  Google Scholar 

  11. D. P. Bunde, “Power-aware scheduling for makespan and flow,” Proceedings of the 18th ACM Symposium on Parallelism in Algorithms and Architectures, pp. 190–196, 2006.

    Google Scholar 

  12. H.-L. Chan, W.-T. Chan, T.-W. Lam, L.-K. Lee, K.-S. Mak, and P. W. H. Wong, “Energy efficient online deadline scheduling,” Proceedings of the 18th ACM-SIAM Symposium on Discrete Algorithms, pp. 795–804, 2007.

    Google Scholar 

  13. A. P. Chandrakasan, S. Sheng, and R. W. Brodersen, “Low-power CMOS digital design,” IEEE Journal on Solid-State Circuits, vol. 27, no. 4, pp. 473–484, 1992.

    Article  Google Scholar 

  14. S. Cho and R. G. Melhem, “On the interplay of parallelization, program performance, and energy consumption,” IEEE Transactions on Parallel and Distributed Systems, vol. 21, no. 3, pp. 342–353, 2010.

    Article  Google Scholar 

  15. D. Donofrio, L. Oliker, J. Shalf, M. F. Wehner, C. Rowen, J. Krueger, S. Kamil, and M. Mohiyuddin, “Energy-efficient computing for extreme-scale science,” Computer, vol. 42, no. 11, pp. 62–71, 2009.

    Article  Google Scholar 

  16. W.-c. Feng and K. W. Cameron, “The green500 list: encouraging sustainable supercomputing,” Computer, vol. 40, no. 12, pp. 50–55, 2007.

    Article  Google Scholar 

  17. V. W. Freeh, D. K. Lowenthal, F. Pan, N. Kappiah, R. Springer, B. L. Rountree, and M. E. Femal, “Analyzing the energy-time trade-off in high-performance computing applications,” IEEE Transactions on Parallel and Distributed Systems, vol. 18, no. 6, pp. 835–848, 2007.

    Article  Google Scholar 

  18. S. K. Garg, C. S. Yeo, A. Anandasivam, and R. Buyya, “Environment-conscious scheduling of HPC applications on distributed cloud-oriented data centers," Journal of Parallel Distributed Computing, vol. 71, no. 6, pp. 732–749, 2011.

    Article  MATH  Google Scholar 

  19. R. L. Graham, “Bounds on multiprocessing timing anomalies,” SIAM J. Appl. Math., vol. 2, pp. 416–429, 1969.

    Article  Google Scholar 

  20. I. Hong, D. Kirovski, G. Qu, M. Potkonjak, and M. B. Srivastava, “Power optimization of variable-voltage core-based systems,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 18, no. 12, pp. 1702–1714, 1999.

    Article  Google Scholar 

  21. C. Im, S. Ha, and H. Kim, “Dynamic voltage scheduling with buffers in low-power multimedia applications," ACM Transactions on Embedded Computing Systems, vol. 3, no. 4, pp. 686–705, 2004.

    Article  Google Scholar 

  22. Intel, Enhanced Intel SpeedStep Technology for the Intel Pentium M Processor – White Paper, March 2004.

    Google Scholar 

  23. S. U. Khan and I. Ahmad, “A cooperative game theoretical technique for joint optimization of energy consumption and response time in computational grids,” IEEE Transactions on Parallel and Distributed Systems, vol. 20, no. 3, pp. 346–360, 2009.

    Google Scholar 

  24. C. M. Krishna and Y.-H. Lee, “Voltage-clock-scaling adaptive scheduling techniques for low power in hard real-time systems,” IEEE Transactions on Computers, vol. 52, no. 12, pp. 1586–1593, 2003.

    Google Scholar 

  25. W.-C. Kwon and T. Kim, “Optimal voltage allocation techniques for dynamically variable voltage processors,” ACM Transactions on Embedded Computing Systems, vol. 4, no. 1, pp. 211–230, 2005.

    Google Scholar 

  26. Y. C. Lee and A. Y. Zomaya, “Energy conscious scheduling for distributed computing systems under different operating conditions,” IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 8, pp. 1374–1381, 2011.

    Google Scholar 

  27. Y.-H. Lee and C. M. Krishna, “Voltage-clock scaling for low energy consumption in fixed-priority real-time systems,” Real-Time Systems, vol. 24, no. 3, pp. 303–317, 2003.

    Google Scholar 

  28. K. Li, “Performance analysis of power-aware task scheduling algorithms on multiprocessor computers with dynamic voltage and speed,” IEEE Transactions on Parallel and Distributed Systems, vol. 19, no. 11, pp. 1484–1497, 2008.

    Google Scholar 

  29. K. Li, “Energy efficient scheduling of parallel tasks on multiprocessor computers,” Journal of Supercomputing, vol. 60, no. 2, pp. 223–247, 2012.

    Google Scholar 

  30. K. Li, “Scheduling precedence constrained tasks with reduced processor energy on multiprocessor computers,” IEEE Transactions on Computers, vol. 61, no. 12, pp. 1668–1681, 2012.

    Google Scholar 

  31. K. Li, “Power allocation and task scheduling on multiprocessor computers with energy and time constraints,” Energy-Efficient Distributed Computing Systems, A. Y. Zomaya and Y. C. Lee, eds., Chapter 1, pp. 1–37, John Wiley & Sons, 2012.

    Google Scholar 

  32. K. Li, “Algorithms and analysis of energy-efficient scheduling of parallel tasks,” Handbook of Energy-Aware and Green Computing, Vol. 1 (Chapter 15), I. Ahmad and S. Ranka, eds., pp. 331–360, CRC Press/Taylor & Francis Group, 2012.

    Google Scholar 

  33. M. Li, B. J. Liu, and F. F. Yao, “Min-energy voltage allocation for tree-structured tasks,” Journal of Combinatorial Optimization, vol. 11, pp. 305–319, 2006.

    Article  MATH  MathSciNet  Google Scholar 

  34. M. Li, A. C. Yao, and F. F. Yao, “Discrete and continuous min-energy schedules for variable voltage processors,” Proceedings of the National Academy of Sciences USA, vol. 103, no. 11, pp. 3983–3987, 2006.

    Google Scholar 

  35. M. Li and F. F. Yao, “An efficient algorithm for computing optimal discrete voltage schedules,” SIAM Journal on Computing, vol. 35, no. 3, pp. 658–671, 2006.

    Google Scholar 

  36. J. R. Lorch and A. J. Smith, “PACE: a new approach to dynamic voltage scaling," IEEE Transactions on Computers, vol. 53, no. 7, pp. 856–869, 2004.

    Google Scholar 

  37. R. N. Mahapatra and W. Zhao, “An energy-efficient slack distribution technique for multimode distributed real-time embedded systems,” IEEE Transactions on Parallel and Distributed Systems, vol. 16, no. 7, pp. 650–662, 2005.

    Google Scholar 

  38. B. C. Mochocki, X. S. Hu, and G. Quan, “A unified approach to variable voltage scheduling for nonideal DVS processors,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 23, no. 9, pp. 1370–1377, 2004.

    Google Scholar 

  39. G. Quan and X. S. Hu, “Energy efficient DVS schedule for fixed-priority real-time systems,” ACM Transactions on Embedded Computing Systems, vol. 6, no. 4, Article no. 29, 200–7.

    Google Scholar 

  40. N. B. Rizvandi, J. Taheri, and A. Y. Zomaya, “Some observations on optimal frequency selection in DVFS-based energy consumption minimization,” Journal of Parallel Distributed Computing, vol. 71, no. 8, pp. 1154–1164, 2011.

    Google Scholar 

  41. C. Rusu, R. Melhem, D. Moss\` e, “Maximizing the system value while satisfying time and energy constraints,” Proceedings of the 23rd IEEE Real-Time Systems Symposium, pp. 256–265, 2002.

    Google Scholar 

  42. D. Shin and J. Kim, “Power-aware scheduling of conditional task graphs in real-time multiprocessor systems,” Proceedings of the International Symposium on Low Power Electronics and Design, pp. 408–413, 2003.

    Google Scholar 

  43. D. Shin, J. Kim, and S. Lee, “Intra-task voltage scheduling for low-energy hard real-time applications,” IEEE Design & Test of Computers, vol. 18, no. 2, pp. 20–30, 2001.

    Google Scholar 

  44. M. R. Stan and K. Skadron, “Guest editors` introduction: power-aware computing,” IEEE Computer, vol. 36, no. 12, pp. 35–38, 2003.

    Google Scholar 

  45. O. S. Unsal and I. Koren, “System-level power-aware design techniques in real-time systems,” Proceedings of the IEEE, vol. 91, no. 7, pp. 1055–1069, 2003.

    Google Scholar 

  46. V. Venkatachalam and M. Franz, “Power reduction techniques for microprocessor systems,” ACM Computing Surveys, vol. 37, no. 3, pp. 195–237, 2005.

    Google Scholar 

  47. M. Weiser, B. Welch, A. Demers, and S. Shenker, “Scheduling for reduced CPU energy,” Proceedings of the 1st USENIX Symposium on Operating Systems Design and Implementation, pp. 13–23, 1994.

    Google Scholar 

  48. P. Yang, C. Wong, P. Marchal, F. Catthoor, D. Desmet, D. Verkest, and R. Lauwereins, “Energy-aware runtime scheduling for embedded-multiprocessor SOCs,” IEEE Design & Test of Computers, vol. 18, no. 5, pp. 46–58, 2001.

    Google Scholar 

  49. F. Yao, A. Demers, and S. Shenker, “A scheduling model for reduced CPU energy,” Proceedings of the 36th IEEE Symposium on Foundations of Computer Science, pp. 374–382, 1995.

    Google Scholar 

  50. H.-S. Yun and J. Kim, “On energy-optimal voltage scheduling for fixed-priority hard real-time systems,” ACM Transactions on Embedded Computing Systems, vol. 2, no. 3, pp. 393–430, 2003.

    Google Scholar 

  51. B. Zhai, D. Blaauw, D. Sylvester, and K. Flautner, “Theoretical and practical limits of dynamic voltage scaling,” Proceedings of the 41st Design Automation Conference, pp. 868–873, 2004.

    Google Scholar 

  52. X. Zhong and C.-Z. Xu, “Energy-aware modeling and scheduling for dynamic voltage scaling with statistical real-time guarantee,” IEEE Transactions on Computers, vol. 56, no. 3, pp. 358–372, 2007.

    Google Scholar 

  53. D. Zhu, R. Melhem, and B. R. Childers, “Scheduling with dynamic voltage/speed adjustment using slack reclamation in multiprocessor real-time systems,” IEEE Transactions on Parallel and Distributed Systems, vol. 14, no. 7, pp. 686–700, 2003.

    Google Scholar 

  54. D. Zhu, D. Moss\` e, and R. Melhem, “Power-aware scheduling for AND/OR graphs in real-time systems,” IEEE Transactions on Parallel and Distributed Systems, vol. 15, no. 9, pp. 849–864, 2004.

    Google Scholar 

  55. J. Zhuo and C. Chakrabarti, “Energy-efficient dynamic task scheduling algorithms for DVS systems,” ACM Transactions on Embedded Computing Systems, vol. 7, no. 2, Article no. 17, 200–8.

    Google Scholar 

  56. Z. Zong, A. Manzanares, X. Ruan, and X. Qin, “EAD and PEBD: two energy-aware duplication scheduling algorithms for parallel tasks on homogeneous clusters,” IEEE Transactions on Computers, vol. 60, no. 3, pp. 360–374, 2011.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Keqin Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media New York

About this chapter

Cite this chapter

Li, K. (2015). Energy-Efficient and High-Performance Processing of Large-Scale Parallel Applications in Data Centers. In: Khan, S., Zomaya, A. (eds) Handbook on Data Centers. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-2092-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4939-2092-1_1

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4939-2091-4

  • Online ISBN: 978-1-4939-2092-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics