Skip to main content
Log in

Compiler-directed power optimization of high-performance interconnection networks for load-balancing MPI applications

  • Research Article
  • Published:
Frontiers of Computer Science in China Aims and scope Submit manuscript

Abstract

Energy consumption of parallel computers has been becoming the obstruction to higher-performance systems. In this paper, we focus on power optimization of high-performance interconnection networks for MPI applications in high-performance parallel computers. Compared with the past history-based work, we propose the idea of compiler-directed power-aware on/off network links. There are some idle intervals for network links during the execution of parallel applications, at which the links still consume large amounts of energy. Using on/off network links, compiler first divides load-balancing MPI applications into the communication intervals and the computation intervals, and then inserts the on/off instruction into the applications to switch the link state. To avoid the time overhead of state switching, we use a time estimation technique to analyze the computation time, and insert the on instruction before reaching the communication intervals. Results from simulations and experiments show that the proposed compiler-directed method can reduce energy consumption of interconnection networks by 20∼70%, at a loss of less than 1% network latency and performance degradation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Mukherjee S S, Bannon P, Lang S., et al. The Alpha 21364 network architecture, IEEE Micro, 2002, 22(1): 26–35

    Article  Google Scholar 

  2. Steinmacher-Burow B. The Blue Gene/L Supercomputer. (presentation). IBM Bolingen, DESY-Hamburg, Feb 21, 2005

  3. Wang H S, Zhu X P, Li-Shiuan Peh, et al. Orion: A Power-Performance Simulator for Interconnection Networks. In: Proceedings of MICRO’02, Turkey, November 2002, 294–305

  4. Sidiropoulos S. High Performance Inter-Chip Signalling. Technical Report: CSL-TR-98-760, Computer Systems Laboratory, Stanford University. April 1998

  5. Shang L, Peh L S, Jha N K. Dynamic Voltage Scaling with Links for Power Optimization of Interconnection Networks. In: Proceedings of HPCA’03, Anaheim, CA. 2003, 91–102

  6. Soteriou V, Peh L S. Design-Space Exploration of Power-Aware On/Off Interconnection Networks. In:Proceedings of ICCD’04, San Jose, 2004, 510–517

  7. Soteriou V, Eisley N, Peh L S. Software-Directed Power-Aware Interconnection Networks. In:Proceedings of CASES’05, California, USA. 2005, 274–285

  8. Chen G Y, Li F H, Kandemir M. Compiler-Directed Channel Allocation for Saving Power in On-Chip Networks. In:Proceedings of POPL’06, South Carolina, USA. 2006, 194–205

  9. Kim E J, Yum K H, Link G M, et al. Energy Optimization Techniques in Cluster Interconnects. In: Proceedings of ISLPED’03, Seoul, Korea. 2003, 459–464

  10. Te T T, Benini L, De Micheli G. Analysis of Power Consumption on Switch Fabrics in Network Routers. In: Proceedings of DAC 2002, New Orleans, Louisiana, USA. 2002, 524–529

  11. Chen X N, Peh L S, Wei G Y, et al. Exploring the Design Space of Power-Aware Opto-Electronic Networked Systems. In: Proceedings of HPCA’05, San Francisco, CA.2005, 120–131

  12. Lefurgy C, Rajamani K, Rawson F, et al. Energy Management for Commercial Servers. IEEE computer, 2003, 36(12): 39–48

    Google Scholar 

  13. Bianchini R, Rajamony R. Power and Energy Management for Server Systems. IEEE Computer, 2004, 37(11): 68–74

    Google Scholar 

  14. Freeh V W, Pan F, Kappiah N, et al. Exploring the Energy-Time Tradeoff in MPI Programs on a Power-Scalable Cluster. In: Proceedings of IPDPS’05, 2005

  15. Kappiah N, Freeh V W, Lowenthal D K. Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs. In:Proceedings of SC’05, Seattle, Washington, USA. 2005, 611–614

  16. Springer R, Lowenthal D K, Rountree B, et al. Minimizing Execution Time in MPI Programs on an Energy-Constrained, Power-Scalable Cluster. In:Proceedings of PPoPP’06, New York, USA. 2006, 230–238

  17. Scott S L. Synchronization and Communication in the T3E Multi-processor. In: Proceedings of ASPLOS VII, MA, USA. 2006, 26–36

  18. Blumrich M, Chen D, Coteus P, et al. Design and Analysis of the BlueGene/L Torus Interconnection Network. IBM Research Report, RC23025 (W0312-022), December 3, 2003 Computer Science

  19. Luo Y, Yu J, Yang J, et al. Low Power Network Processor Design Using Clock Gating. DAC 2005, Anaheim, California, USA. 2005, 712–715

  20. Saavedra-Barrera R H. Machine Characterization and Benchmark Performance Prediction. [Technical Report: CSD-88-437], Berkeley, California. June 30, 1988

  21. Stallman R M, the GCC Developer Community. Using the GNU Compiler Collection. GCC Version 4.0.2, 2005

  22. Aho A V, Sethi R, Ullman J D. Compilers: Principles, Techniques, and Tools. Addison Welsley, Pearson Education, Inc, 1986

    Google Scholar 

  23. Wakabayashi M, Amano H. Environment for Multiprocessor Simulator Development. In:Proceedings of Fifth International Symposium on Parallel Architectures, Algorithms, and Networks. 2000, 64–71

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yi Huizhan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yang, X., Yi, H., Qu, X. et al. Compiler-directed power optimization of high-performance interconnection networks for load-balancing MPI applications. Front. Comput. Sc. China 1, 94–105 (2007). https://doi.org/10.1007/s11704-007-0008-1

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-007-0008-1

Keywords

Navigation