Skip to main content
Log in

Cosmological Simulations and Data Exploration: a Testcase on the Usage of Grid Infrastructure

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

While new infrastructures for large computational challenges begin to be widely accessible to researchers, computational codes need to be re-designed to exploit new facilities. The Grid and the cloud computing concepts are changing the computational resource distribution and availability, and much effort start to be made to develop new codes for a better exploitation of new resources. This paper presents an example of the use of Grid resources, based on gLite middleware, to run cosmological simulations, that, up to now, are normally executed on Supercomputers. We have also used the Grid to explore and visualize the dataset. We discuss non particular the performance of FLY a parallel code implementing the octal-tree algorithm introduced by J. Barnes and P. Hut to compute the gravitational field efficiently. It simulates the evolution of the collisionless component of the material content of our Universe. FLY was originally developed to run on mainframe systems using the one-side communication paradigm, but we are now presenting a modified version of the computational algorithm to exploit the Grid environment. We also integrated the data exploration and visualization process on the Grid, to obtain preliminary results using the distributed facilities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Antonuccio-Delogu, V., Dobrotka, A., Becciani, U., Cielo, S., Giocoli, C., Macci, A.V., Romeo-Velon, A.: Dissecting the spin distribution of dark matter haloes. Mon. Not. R. Astron. Soc. 407, 1338 (2010)

    Article  Google Scholar 

  2. Antonuccio, V., Becciani, U., Ferro, D.: FLY. A parallel tree N-body code for cosmological simulations. Reference guide. Comput. Phys. Commun. 155, 159 (2003)

    Article  MATH  Google Scholar 

  3. Barnes, J., Hut, P.: A hierarchical O(N log N) force-calculation algorithm. Nature 324, 446 (1986)

    Article  Google Scholar 

  4. Becciani, U., Costa, A., Antonuccio-Delogu, V., Caniglia, G., Comparato, M., Gheller, C., Jin, Z., Krokos, M., Massimino, P.: VisIVO-integrated tools and services for large-scale astrophysical visualization. Publ. Astron. Soc. Pac. 122, 119 (2010)

    Article  Google Scholar 

  5. Becciani, U., Comparato, M., Antonuccio Delogu, V.: FLY: MPI-2 high resolution code for LSS cosmological simulations. Comput. Phys. Commun. 176, 211 (2007)

    Article  MATH  Google Scholar 

  6. Becciani, U.: The cometa consortium and the PI2S2 project. Mem. S.A. It. Supp. 13, 10 (2009)

    Google Scholar 

  7. Becciani, U., Antonuccio-Delogu, V., Gambera, M.: A modified parallel treecode for N-body simulation of the large-scale structure of the universe. J. Comput. Phys. 163, 118 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  8. Berger, M.J., Colella, P.: Local adaptive mesh refinement for shock hydrodynamics. J. Comput. Phys. 82, 64 (1989)

    Article  MATH  Google Scholar 

  9. Bryan, G.L., Norman, M.L.: A hybrid AMR application for cosmology and astrophysics. IMA Vol. Math. 117, 165 (1999)

    Article  Google Scholar 

  10. Camarasu-Pop, S., Glatard, T., Mocicki, J.T., Benoit-Cattin, H., Sarrut, D.: Dynamic partitioning of GATE Monte-Carlo simulations on EGEE. J. Grid Computing 8, 241 (2008)

    Article  Google Scholar 

  11. Comparato, M., Becciani, U., Costa, A., Larsson, B., Garilli, B., Gheller, C., Taylor, J.: Visualization, exploration, and data analysis of complex astrophysical data. Publ. Astron. Soc. Pac. 119, 898 (2007)

    Article  Google Scholar 

  12. Dunkley, J., Komatsu, E., Nolta, M.R.: Five-year Wilkinson microwave anisotropy probe observations: likelihoods and parameters from the WMAP data. Astrophys. J. Suppl. 180, 306 (2009)

    Article  Google Scholar 

  13. gLite: Lightweight middleware for Grid computing. http://www.glite.org

  14. Germain Renaud, C., Loomis, C., Moscicki, J., Texier, R.: Scheduling for responsive Grids. J. Grid. Computing 6, 15 (2008)

    Article  Google Scholar 

  15. Hernquist, L., Bouchet, F.R., Suto, Y.: Application of the Ewald method to cosmological N-body simulations. Astrophys. J. Suppl. 75, 231 (1991)

    Article  Google Scholar 

  16. Hernquist, L.: Performance characteristics of tree codes. Astrophys. J. Suppl. 64, 715 (1987)

    Article  Google Scholar 

  17. Hockney, R.W., Eastwood, J.W.: Computer simulation using particles (1988)

  18. Lingrand, D., Montagnat, J., Martyniak, J., Colling, D.: Optimization of jobs submission on the EGEE production Grid: modeling faults using workload. J. Grid Computing 6, 305 (2008)

    Google Scholar 

  19. Merz, U., Pen, U., Trac, H.: Towards optimal parallel PM N-body codes: PMFAST. New Astron. 10, 393 (2005)

    Article  Google Scholar 

  20. Rainer, K., Edgar, G., Krammer, B., Mller, M.S., Resch, M.M.: Towards efficient execution of MPI applications on the Grid: porting and optimization issues. J. Grid Computing 2, 133 (2003)

    Google Scholar 

  21. Reed, D., Gardner, J., Quinn, T., Stadel, J., Fardal, M., Lake, G., Governato, F.: Evolution of the mass function of dark matter haloes. Mon. Not. R. Astron. Soc. 364, 565 (2003)

    Article  Google Scholar 

  22. Sirko, E.: Initial conditions to cosmological N-body simulations, or, how to run an ensemble of simulations. Astrophys. J. Suppl. 64, 728 (2005)

    Google Scholar 

  23. Sheth, R., Tormen, B.: Large-scale bias and the peak background split. Mon. Not. R. Astron. Soc. 308, 119 (1999)

    Article  Google Scholar 

  24. Springel, V., Yoshida, N., White, S.: GADGET: a code for collisionless and gasdynamical cosmological simulations. New Astron. 6, 79 (2001)

    Article  Google Scholar 

  25. The VOTECH Project: Virtual Observatory Technology. http://eurovotech.org

  26. The Cometa Consortium: http://www.consorzio-cometa.it/

  27. Distributed European Infrastructure for Supercomputing Applications: http://www.deisa.eu

  28. OpenMP: an API for multi-platform shared-memory parallel programming. http://www.openmp.org/

  29. The Mandelbrot Set: http://mathworld.wolfram.com/MandelbrotSet.html

  30. Message Passing Interface: http://www.mpi-forum.org/

  31. The PI2S2 Project: http://www.pi2s2.it/

  32. Testing MPI Support: http://wiki.egee-see.org/index.php/Testing_MPI_support

  33. VisIVO Server Web Site: http://visivoserver.oact.inaf.it

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ugo Becciani.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Becciani, U., Antonuccio-Delogu, V., Costa, A. et al. Cosmological Simulations and Data Exploration: a Testcase on the Usage of Grid Infrastructure. J Grid Computing 10, 265–277 (2012). https://doi.org/10.1007/s10723-011-9199-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-011-9199-7

Keywords

Navigation