Skip to main content

A Dynamic Load Balancing Technique for Parallel Execution of Structured Grid Models

  • Conference paper
  • First Online:
Numerical Computations: Theory and Algorithms (NUMTA 2019)

Abstract

Partitioning computational load over different processing elements is a crucial issue in parallel computing. This is particularly relevant in the case of parallel execution of structured grid computational models, such as Cellular Automata (CA), where the domain space is partitioned in regions assigned to the parallel computing nodes. In this work, we present a dynamic load balancing technique that provides for performance improvements in structured grid model execution on distributed memory architectures. First tests implemented using the MPI technology have shown the goodness of the proposed technique in sensibly reducing execution times with respect to not-balanced parallel versions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For the sake of simplicity, in this first implementation of the LB procedure the exchange of columns is not toroidal, i.e. it is not possible to exchange columns between the rightmost node and the leftmost node.

References

  1. Abraham, M.J., et al.: GROMACS: high performance molecular simulations through multi-level parallelism from laptops to supercomputers. SoftwareX 1, 19–25 (2015)

    Article  Google Scholar 

  2. Aidun, C., Clausen, J.: Lattice-Boltzmann method for complex flows. Annu. Rev. Fluid Mech. 42, 439–472 (2010)

    Article  MathSciNet  Google Scholar 

  3. Amritkar, A., Deb, S., Tafti, D.: Efficient parallel CFD-DEM simulations using OpenMP. J. Comput. Phys. 256, 501–519 (2014)

    Article  MathSciNet  Google Scholar 

  4. Andersson, B., Andersson, R., Håkansson, L., Mortensen, M., Sudiyo, R., van Wachem, B.: Computational Fluid Dynamics for Engineers. Cambridge University Press (2011). https://doi.org/10.1017/CBO9781139093590

  5. Avolio, M., et al.: Simulation of the 1992 Tessina landslide by a cellular automata model and future hazard scenarios. Int. J. Appl. Earth Obs. Geoinf. 2(1), 41–50 (2000)

    Article  Google Scholar 

  6. Cannataro, M., Di Gregorio, S., Rongo, R., Spataro, W., Spezzano, G., Talia, D.: A parallel cellular automata environment on multicomputers for computational science. Parallel Comput. 21(5), 803–823 (1995)

    Article  Google Scholar 

  7. Cervarolo, G., Mendicino, G., Senatore, A.: A coupled ecohydrological-three-dimensional unsaturated flow model describing energy, H\(_2\)O and CO\(_2\) fluxes. Ecohydrology 3(2), 205–225 (2010)

    Google Scholar 

  8. Cicirelli, F., Forestiero, A., Giordano, A., Mastroianni, C.: Parallelization of space-aware applications: modeling and performance analysis. J. Netw. Comput. Appl. 122, 115–127 (2018)

    Article  Google Scholar 

  9. D’Ambrosio, D., et al.: The open computing abstraction layer for parallel complex systems modeling on many-core systems. J. Parallel Distrib. Comput. 121, 53–70 (2018). https://doi.org/10.1016/j.jpdc.2018.07.005

    Article  Google Scholar 

  10. Di Gregorio, S., Filippone, G., Spataro, W., Trunfio, G.: Accelerating wildfire susceptibility mapping through GPGPU. J. Parallel Distrib. Comput. 73(8), 1183–1194 (2013)

    Article  Google Scholar 

  11. Di Gregorio, S., Rongo, R., Spataro, W., Spezzano, G., Talia, D.: High performance scientific computing by a parallel cellular environment. Future Gener. Comput. Syst. 12(5), 357–369 (1997)

    Article  Google Scholar 

  12. Duchateau, J., Rousselle, F., Maquignon, N., Roussel, G., Renaud, C.: An out-of-core method for physical simulations on a multi-GPU architecture using lattice Boltzmann method. In: 2016 International IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress, pp. 581–588. IEEE (2016)

    Google Scholar 

  13. Filippone, G., D’ambrosio, D., Marocco, D., Spataro, W.: Morphological coevolution for fluid dynamical-related risk mitigation. ACM Trans. Model. Comput. Simul. (ToMACS) 26(3), 18 (2016)

    Article  MathSciNet  Google Scholar 

  14. Folino, G., Mendicino, G., Senatore, A., Spezzano, G., Straface, S.: A model based on cellular automata for the parallel simulation of 3D unsaturated flow. Parallel Comput. 32(5), 357–376 (2006)

    Article  MathSciNet  Google Scholar 

  15. Frish, U., Hasslacher, B., Pomeau, Y.: Lattice gas automata for the Navier-Stokes equation. Phys. Rev. Lett. 56(14), 1505–1508 (1986)

    Article  Google Scholar 

  16. Cervarolo, G., Mendicino, G., Senatore, A.: Coupled vegetation and soil moisture dynamics modeling in heterogeneous and sloping terrains. Vadose Zone J. 10, 206–225 (2011)

    Article  Google Scholar 

  17. Gasior, J., Seredynski, F.: A cellular automata-like scheduler and load balancer. In: El Yacoubi, S., Wąs, J., Bandini, S. (eds.) ACRI 2016. LNCS, vol. 9863, pp. 238–247. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44365-2_24

    Chapter  Google Scholar 

  18. Gerakakis, I., Gavriilidis, P., Dourvas, N.I., Georgoudas, I.G., Trunfio, G.A., Sirakoulis, G.C.: Accelerating fuzzy cellular automata for modeling crowd dynamics. J. Comput. Sci. 32, 125–140 (2019)

    Article  Google Scholar 

  19. Giordano, A., De Rango, A., D’Ambrosio, D., Rongo, R., Spataro, W.: Strategies for parallel execution of cellular automata in distributed memory architectures, pp. 406–413, February 2019. https://doi.org/10.1109/EMPDP.2019.8671639

  20. Giordano, A., et al.: Parallel execution of cellular automata through space partitioning: the landslide simulation Sciddicas3-Hex case study, pp. 505–510, February 2017

    Google Scholar 

  21. Higuera, F., Jimenez, J.: Boltzmann approach to lattice gas simulations. Europhys. Lett. 9(7), 663–668 (1989)

    Article  Google Scholar 

  22. Jammy, S., Mudalige, G., Reguly, I., Sandham, N., Giles, M.: Block-structured compressible Navier-Stokes solution using the ops high-level abstraction. Int. J. Comput. Fluid Dyn. 30(6), 450–454 (2016)

    Article  MathSciNet  Google Scholar 

  23. Kumar, V.: Introduction to Parallel Computing, 2nd edn. Addison-Wesley Longman Publishing Co., Inc., Boston (2002)

    Google Scholar 

  24. Langton, C.: Computation at the edge of chaos: phase transition and emergent computation. Physica D 42, 12–37 (1990)

    Article  MathSciNet  Google Scholar 

  25. Lucà, F., D’Ambrosio, D., Robustelli, G., Rongo, R., Spataro, W.: Integrating geomorphology, statistic and numerical simulations for landslide invasion hazard scenarios mapping: an example in the Sorrento Peninsula (Italy). Comput. Geosci. 67(1811), 163–172 (2014)

    Article  Google Scholar 

  26. McNamara, G., Zanetti, G.: Use of the Boltzmann equation to simulate lattice-gas automata. Phys. Rev. Lett. 61, 2332–2335 (1988)

    Article  Google Scholar 

  27. von Neumann, J.: Theory of Self-Reproducing Automata. University of Illinois Press, Champaign (1966)

    Google Scholar 

  28. Nicol, D.M., Saltz, J.H.: An analysis of scatter decomposition. IEEE Trans. Comput. 39(11), 1337–1345 (1990)

    Article  Google Scholar 

  29. Ninagawa, S.: Dynamics of universal computation and 1/f noise in elementary cellular automata. Chaos, Solitons Fractals 70(1), 42–48 (2015)

    Article  Google Scholar 

  30. Ntinas, V., Moutafis, B., Trunfio, G., Sirakoulis, G.: Parallel fuzzy cellular automata for data-driven simulation of wildfire spreading. J. Comput. Sci. 21, 469–485 (2016)

    Article  Google Scholar 

  31. Oliverio, M., Spataro, W., D’Ambrosio, D., Rongo, R., Spingola, G., Trunfio, G.: OpenMP parallelization of the SCIARA Cellular Automata lava flow model: performance analysis on shared-memory computers. Procedia Comput. Sci. 4, 271–280 (2011)

    Article  Google Scholar 

  32. Procacci, P.: Hybrid MPI/OpenMP implementation of the ORAC molecular dynamics program for generalized ensemble and fast switching alchemical simulations (2016)

    Google Scholar 

  33. Rango, A.D., Spataro, D., Spataro, W., D’Ambrosio, D.: A first multi-GPU/multi-node implementation of the open computing abstraction layer. J. Comput. Sci. 32, 115–124 (2019). https://doi.org/10.1016/j.jocs.2018.09.012, http://www.sciencedirect.com/science/article/pii/S1877750318303922

    Article  Google Scholar 

  34. Reguly, I., et al.: Acceleration of a full-scale industrial CFD application with OP2. IEEE Trans. Parallel Distrib. Syst. 27(5), 1265–1278 (2016). https://doi.org/10.1109/TPDS.2015.2453972

    Article  Google Scholar 

  35. Schoneveld, A., de Ronde, J.F.: P-CAM: a framework for parallel complex systems simulations. Future Gener. Comput. Syst. 16(2–3), 217–234 (1999)

    Article  Google Scholar 

  36. Spataro, D., D’Ambrosio, D., Filippone, G., Rongo, R., Spataro, W., Marocco, D.: The new SCIARA-fv3 numerical model and acceleration by GPGPU strategies. Int. J. High Perform. Comput. Appl. 31(2), 163–176 (2017). https://doi.org/10.1177/1094342015584520

    Article  Google Scholar 

  37. Was, J., Mróz, H., Topa, P.: Gpgpu computing for microscopic simulations of crowd dynamics. Comput. Inform. 34(6), 1418–1434 (2016)

    Google Scholar 

  38. Wolfram, S.: A New Kind of Science. Wolfram Media Inc., Champaign (2002)

    MATH  Google Scholar 

  39. Zito, G., D’Ambrosio, D., Spataro, W., Spingola, G., Rongo, R., Avolio, M.V.: A dynamically load balanced cellular automata library for scientific computing. In: CSC, pp. 322–328 (2009)

    Google Scholar 

Download references

Acknowledgments

Authors thank BS student Rodolfo Calabrò from University of Calabria for helping in code implementation and testing phases.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to William Spataro .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Giordano, A., De Rango, A., Rongo, R., D’Ambrosio, D., Spataro, W. (2020). A Dynamic Load Balancing Technique for Parallel Execution of Structured Grid Models. In: Sergeyev, Y., Kvasov, D. (eds) Numerical Computations: Theory and Algorithms. NUMTA 2019. Lecture Notes in Computer Science(), vol 11973. Springer, Cham. https://doi.org/10.1007/978-3-030-39081-5_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-39081-5_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-39080-8

  • Online ISBN: 978-3-030-39081-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics