Abstract
Energy consumption of parallel computers has been becoming the obstruction to higher-performance systems. In this paper, we focus on power optimization of high-performance interconnection networks for MPI applications in high-performance parallel computers. Compared with the past history-based work, we propose the idea of compiler-directed power-aware on/off network links. There are some idle intervals for network links during the execution of parallel applications, at which the links still consume large amounts of energy. Using on/off network links, compiler first divides load-balancing MPI applications into the communication intervals and the computation intervals, and then inserts the on/off instruction into the applications to switch the link state. To avoid the time overhead of state switching, we use a time estimation technique to analyze the computation time, and insert the on instruction before reaching the communication intervals. Results from simulations and experiments show that the proposed compiler-directed method can reduce energy consumption of interconnection networks by 20∼70%, at a loss of less than 1% network latency and performance degradation.
Similar content being viewed by others
References
Mukherjee S S, Bannon P, Lang S., et al. The Alpha 21364 network architecture, IEEE Micro, 2002, 22(1): 26–35
Steinmacher-Burow B. The Blue Gene/L Supercomputer. (presentation). IBM Bolingen, DESY-Hamburg, Feb 21, 2005
Wang H S, Zhu X P, Li-Shiuan Peh, et al. Orion: A Power-Performance Simulator for Interconnection Networks. In: Proceedings of MICRO’02, Turkey, November 2002, 294–305
Sidiropoulos S. High Performance Inter-Chip Signalling. Technical Report: CSL-TR-98-760, Computer Systems Laboratory, Stanford University. April 1998
Shang L, Peh L S, Jha N K. Dynamic Voltage Scaling with Links for Power Optimization of Interconnection Networks. In: Proceedings of HPCA’03, Anaheim, CA. 2003, 91–102
Soteriou V, Peh L S. Design-Space Exploration of Power-Aware On/Off Interconnection Networks. In:Proceedings of ICCD’04, San Jose, 2004, 510–517
Soteriou V, Eisley N, Peh L S. Software-Directed Power-Aware Interconnection Networks. In:Proceedings of CASES’05, California, USA. 2005, 274–285
Chen G Y, Li F H, Kandemir M. Compiler-Directed Channel Allocation for Saving Power in On-Chip Networks. In:Proceedings of POPL’06, South Carolina, USA. 2006, 194–205
Kim E J, Yum K H, Link G M, et al. Energy Optimization Techniques in Cluster Interconnects. In: Proceedings of ISLPED’03, Seoul, Korea. 2003, 459–464
Te T T, Benini L, De Micheli G. Analysis of Power Consumption on Switch Fabrics in Network Routers. In: Proceedings of DAC 2002, New Orleans, Louisiana, USA. 2002, 524–529
Chen X N, Peh L S, Wei G Y, et al. Exploring the Design Space of Power-Aware Opto-Electronic Networked Systems. In: Proceedings of HPCA’05, San Francisco, CA.2005, 120–131
Lefurgy C, Rajamani K, Rawson F, et al. Energy Management for Commercial Servers. IEEE computer, 2003, 36(12): 39–48
Bianchini R, Rajamony R. Power and Energy Management for Server Systems. IEEE Computer, 2004, 37(11): 68–74
Freeh V W, Pan F, Kappiah N, et al. Exploring the Energy-Time Tradeoff in MPI Programs on a Power-Scalable Cluster. In: Proceedings of IPDPS’05, 2005
Kappiah N, Freeh V W, Lowenthal D K. Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs. In:Proceedings of SC’05, Seattle, Washington, USA. 2005, 611–614
Springer R, Lowenthal D K, Rountree B, et al. Minimizing Execution Time in MPI Programs on an Energy-Constrained, Power-Scalable Cluster. In:Proceedings of PPoPP’06, New York, USA. 2006, 230–238
Scott S L. Synchronization and Communication in the T3E Multi-processor. In: Proceedings of ASPLOS VII, MA, USA. 2006, 26–36
Blumrich M, Chen D, Coteus P, et al. Design and Analysis of the BlueGene/L Torus Interconnection Network. IBM Research Report, RC23025 (W0312-022), December 3, 2003 Computer Science
Luo Y, Yu J, Yang J, et al. Low Power Network Processor Design Using Clock Gating. DAC 2005, Anaheim, California, USA. 2005, 712–715
Saavedra-Barrera R H. Machine Characterization and Benchmark Performance Prediction. [Technical Report: CSD-88-437], Berkeley, California. June 30, 1988
Stallman R M, the GCC Developer Community. Using the GNU Compiler Collection. GCC Version 4.0.2, 2005
Aho A V, Sethi R, Ullman J D. Compilers: Principles, Techniques, and Tools. Addison Welsley, Pearson Education, Inc, 1986
Wakabayashi M, Amano H. Environment for Multiprocessor Simulator Development. In:Proceedings of Fifth International Symposium on Parallel Architectures, Algorithms, and Networks. 2000, 64–71
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, X., Yi, H., Qu, X. et al. Compiler-directed power optimization of high-performance interconnection networks for load-balancing MPI applications. Front. Comput. Sc. China 1, 94–105 (2007). https://doi.org/10.1007/s11704-007-0008-1
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11704-007-0008-1