Skip to main content
SpringerLink
Log in

Interpolation oriented parallel communication to optimize coupling in earth system modeling

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Complicated global climate problems trigger researchers from different scientific disciplines to link multiphysics simulations called models for integrated modeling of climate changes by using a software framework called earth system modeling (ESM). As its critical component, coupler is in charge of connections and interactions among models. With the advance of next-generation models, greater data transfer volume and higher coupling frequency are expected to put heavy performance burden on coupler. High efficient coupling techniques are required. In this paper, we propose the sub-domain mapping method to improve the parallel coupling consisted of data transfer and data transformation. By using one specific interpolation oriented communication routing, the communication operations that are originally decentralized in various steps can be combined together for execution. This can reduce the redundant communications and the entailed synchronization costs. The tests on the Tianhe-1A (TH-1A) supercomputer show that our method can achieve 1.1 to 4.9 fold performance improvements. We also present further optimization solution for the multi-interpolation cases. The test results show that our method can achieve up to 3.4 fold speedup over the original coupling execution of the current climate system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Dunlap R, Rugaber S, Mark L. A feature model of coupling technologies for earth system models. Computers & Geosciences, 2013, 53: 13–20

    Article  Google Scholar 

  2. Valcke S, Balaji V, Craig A, Deluca C, Dunlap R, Ford R W, Jacob R, Larson J, O’Kuinghttons R, Riley G D, Vertenstein M. Coupling technologies for earth system modelling. Geoscientific Model Development Discussions, 2012, 5(3): 1987–2006

    Article  Google Scholar 

  3. Bao Q, Lin P, Zhou T, Liu Y, Yu Y, Wu G, He B, He J, Li L, Li J, Li Y, Liu H, Qiao F, Song Z, Wang B, Wang J, Wang P, Wang X, Wang Z, Wu B, Wu T, Xu Y, Yu H, Zhao W, Zheng W, Zhou L. The flexible global ocean-atmosphere-land system model, spectral version 2: FGOALS-s2. Advances in Atmospheric Sciences, 2013, 30: 561–576

    Article  Google Scholar 

  4. Craig A P, Jacob R, Kauffman B, Bettge T, Larson J, Ong E, Ding C, He Y. CPL6: the new extensible, high performance parallel coupler for the community climate system model. International Journal of High Performance Computing Applications, 2005, 19(3): 309–327

    Article  Google Scholar 

  5. Redler R, Valcke S, Ritzdorf H. OASIS4-a coupling software for next generation earth system modelling. Geoscientific Model Development, 2010, 3(1): 87–104

    Article  Google Scholar 

  6. Jacob R, Larson J, Ong E. M × N communication and parallel interpolation in community climate system model version 3 using the model coupling toolkit. International Journal of High Performance Computing Applications, 2005, 19(3): 293–307

    Article  Google Scholar 

  7. Collins W D, Bitz C M, Blackmon M L, Bonan G B, Bretherton C S, Carton J A, Chang P, Doney S C, Hack J J, Henderson T B, Kiehl J T, Large W G, McKenna D S, Santer B D, Smith R D. The community climate system model version 3. Journal of Climate, 2006, 19(11): 2122–2143

    Article  Google Scholar 

  8. Yang X J, Liao X K, Lu K, Hu Q F, Song J Q, Su J S. The TianHe-1A supercomputer: its hardware and software. Journal of Computer Science and Technology, 2011, 26(3): 344–351

    Article  Google Scholar 

  9. Gent P R, Danabasoglu G, Donner L J, Holland M M, Hunke M M, Hunke E C, Jayne S R, Lawrence D M, Neale R B, Rasch P J, Vertenstein M, Worley P H, Yang Z L, Zhang M. The community climate system model version 4. Journal of Climate, 2011, 24(19): 4973–4991

    Article  Google Scholar 

  10. Dennis J M, Vertenstein M, Worley P H, Mirin A A, Craig A P, Jacob R, Mickelson S. Computational performance of ultra-high-resolution capability in the community earth system model. International Journal of High Performance Computing Applications, 2012, 26(1): 5–16

    Article  Google Scholar 

  11. Vertenstein M, Craig T, Middleton A, Feddema D, Fischer C. Community earth system model 1.0.4 User’s Guide. 2011, 1–145

    Google Scholar 

  12. Craig A P, Vertenstein M, Jacob R. A new flexible coupler for earth system modeling developed for community climate system model 4 and community earth system model 1. International Journal of High Performance Computing Applications, 2012, 26(1): 31–42

    Article  Google Scholar 

  13. Valcke S. The OASIS3 coupler: a European climate modelling community software, Geosci. Model Dev. Discuss, 5: 2139–2178

  14. Hinton A, Kwiatkowska M, Norman G, Parker D. PRISM: a tool for automatic verification of probabilistic systems. Tools and Algorithms for the Construction and Analysis of Systems. Springer Berlin Heidelberg, 2006: 441–444

    Google Scholar 

  15. Larson J, Jacob R, Ong E. Themodel coupling toolkit: a new Fortran90 toolkit for building multiphysics parallel coupled models. International Journal of High Performance Computing Applications, 2005, 19(3): 277–292

    Article  Google Scholar 

  16. Balaji V. The FMS manual: a developer’s guide to the GFDL flexible modeling system. 2002

    Google Scholar 

  17. Balaji V, Anderson J, Held I, Winton M, Malyshev S, Stouffer R. The exchange grid: a mechanism for data exchange between earth system components on independent grids. In: Proceedings of the 2005 International Conference on Parallel Computational Fluid Dynamics. 2006, 1–18

    Google Scholar 

  18. Hill C, DeLuca C, Suarez M, Silva A D. The architecture of the earth system modeling framework. Computing in Science & Engineering, 2004, 6(1): 18–28

    Article  Google Scholar 

  19. Collins N, Theurich G, Deluca C, Suarez M, Trayanov A, Balaji V, Li P, Yang W, Hill C, Silva A D. Design and implementation of components in the earth system modeling framework. International Journal of High Performance Computing Applications, 2005, 19(3): 341–350

    Article  Google Scholar 

  20. Yoshimura H, Yukimoto S. Development of a simple coupler (Scup) for earth system modeling. Pap Meteor Geophys, 2008, 59: 19–29

    Article  Google Scholar 

  21. Arakawa T, Yoshimura H, Saito F, Ogochi K. Data exchange algorithm and software design of KAKUSHIN coupler Jcup. Procedia Computer Science, 2011, 4: 1516–1525

    Article  Google Scholar 

  22. Ford R W, Riley G D, Bane M K, Armstrong C W, Freeman T L. GCF: a general coupling framework. Concurrency and Computation: Practice and Experience, 2006, 18(2): 163–181

    Article  Google Scholar 

  23. Armstrong C W, Ford R W, Riley G D. Coupling integrated earth system model components with bfg2. Concurrency and Computation: Practice and Experience, 2009, 21(6): 767–791

    Article  Google Scholar 

  24. Balaji V, Boville B, Cheung S, Clune T, Collins N, Craig T, Cruz C, Silva A D, Deluca C, Fainchtein R D, Eaton B, Hallberg B, Handerson T, Hill C, Iredell M, Jacob R, Jones P, Kluzek E, Kauffman B, Larson J, Li P, Liu F, Michalakes J, Murphy S, Neckels D, Kuinghttons R O, Oehmke B, Panaccione C, Rosinski J, Sawyer W, Sch wab E, Smithline S, Spector W, Stark D, Suarez M, Swift S, Theurich G, Trayanoy A, Vasquez S, Wolfe J, Yang W, Young M, Zaslavsky L. ESMF User Guide Version 3.1. Earth System Modeling Framework, 2009

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Ministry of Education Key Laboratory for Earth System Modeling, Center for Earth System Science, Institute for Global Change Studies, Tsinghua University, Beijing, 100084, China

    Yingsheng Ji & Guangwen Yang

  2. Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China

    Yingsheng Ji & Guangwen Yang

  3. Department of Mathematics and Computer Science, Emory University, Atlanta, GA, 30322, USA

    Yingzhuo Zhang

Authors
  1. Yingsheng Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yingzhuo Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guangwen Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yingsheng Ji.

Additional information

This paper is a revised and extended version of our paper that was presented at Workshop PCO 2013 in conjunction with IEEE IPDPS 2013 held in Boston USA.

Yingsheng Ji received the bachelor degree from Harbin Institute of Technology, China in 2006 and the master degree from Xi’an Jiaotong University, China in 2009. He is currently a PhD student at Tsinghua University, China under the supervision of Prof. Guangwen Yang. His research interests in clude system architecture, algorithm design and communication optimization. Now he is focused on the application and improvement of coupling algorithms.

Yingzhuo Zhang is a senior undergraduate student at Emory University, USA majoring in computer science and applied mathematics. She shows interests in high performance algorithm design, primarily such as large-scale applications and machine learning algorithms. She is willing to continue with her research in these areas after receiving her bachelor degree.

Professor Guangwen Yang is Director of the Institute of High Performance Computing, Department of Computer Science and Technology, Tsinghua University, China. He is expert group member of the National Hightech R&D Programme of China (863 Programme). His primary researches involve grid computing, parallel computing, distributed systems and algorithm design. He has published more than 100 papers.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, Y., Zhang, Y. & Yang, G. Interpolation oriented parallel communication to optimize coupling in earth system modeling. Front. Comput. Sci. 8, 693–708 (2014). https://doi.org/10.1007/s11704-014-3408-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-014-3408-z

Keywords

Search

Navigation