Skip to main content

Trace-Based Optimization of Fragmented Programs Execution in LuNA System

  • Conference paper
  • First Online:
Parallel Computing Technologies (PaCT 2021)

Abstract

Automatic construction of high performance distributed numerical simulation programs is used to reduce complexity of distributed parallel programs development and to improve code efficiency as compared to an average manual development. Development of such means, however, is challenging in general case, that’s why a variety of different languages, systems and tools for parallel programs construction exist and evolve. Program tracing (i.e. journaling execution acts of the program) is a valuable source of information, which can be used to optimize efficiency of constructed programs for particular execution conditions and input data peculiarities. One of the optimization techniques is trace playback, which consists in step-by-step reproduction of the trace. This allows reducing run-time overhead, which is relevant for runtime system-based tools. The experimental results demonstrate suitability of the technique for a range of applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://gitlab.ssd.sscc.ru/luna/luna.

  2. 2.

    http://www.jscc.ru.

References

  1. Malyshkin, V.E., Perepelkin, V.A.: LuNA fragmented programming system, main functions and peculiarities of run-time subsystem. In: Malyshkin, V. (ed.) PaCT 2011. LNCS, vol. 6873, pp. 53–61. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23178-0_5

    Chapter  Google Scholar 

  2. Valkovsky, V.A., Malyshkin, V.E.: Synthesis of parallel programs and systems on the basis of computational models. Nauka, Novosibirsk (1988). (in Russian)

    Google Scholar 

  3. Malyshkin, V.: Active knowledge, LuNA and literacy for oncoming centuries. In: Bodei, C., Ferrari, G.-L., Priami, C. (eds.) Programming Languages with Applications to Biology and Security. LNCS, vol. 9465, pp. 292–303. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25527-9_19

    Chapter  Google Scholar 

  4. Akhmed-Zaki, D., Lebedev, D., Malyshkin, V., Perepelkin, V.: Automated construction of high performance distributed programs in LuNA system. In: Malyshkin, V. (ed.) PaCT 2019. LNCS, vol. 11657, pp. 3–9. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25636-4_1

    Chapter  Google Scholar 

  5. Akhmed-Zaki, D., Lebedev, D., Perepelkin, V.: Implementation of a 3D model heat equation using fragmented programming technology. J. Supercomput. 75(12), 7827–7832 (2018). https://doi.org/10.1007/s11227-018-2710-1

    Article  Google Scholar 

  6. Daribayev, B., Perepelkin, V., Lebedev, D., Akhmed-Zaki, D.: Implementation of the two-dimensional elliptic equation model in LuNA fragmented programming system. In: 2018 IEEE 12th International Conference on Application of Information and Communication Technologies (AICT), pp. 1–4 (2018)

    Google Scholar 

  7. Nikolay, B., Perepelkin, V.: Automated GPU support in LuNA fragmented programming system. In: Malyshkin, V. (ed.) PaCT 2017. LNCS, vol. 10421, pp. 272–277. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62932-2_26

    Chapter  Google Scholar 

  8. Malyshkin, V., Perepelkin, V., Schukin, G.: Scalable distributed data allocation in LuNA fragmented programming system. J. Supercomput. 73(2), 726–732 (2016). https://doi.org/10.1007/s11227-016-1781-0

    Article  Google Scholar 

  9. Malyshkin, V.E., Perepelkin, V.A., Tkacheva, A.A.: Control flow usage to improve performance of fragmented programs execution. In: Malyshkin, V. (ed.) PaCT 2015. LNCS, vol. 9251, pp. 86–90. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21909-7_9

    Chapter  Google Scholar 

  10. Malyshkin, V.E., Perepelkin, V.A., Schukin, G.A.: Distributed algorithm of data allocation in the fragmented programming system LuNA. In: Malyshkin, V. (ed.) PaCT 2015. LNCS, vol. 9251, pp. 80–85. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21909-7_8

    Chapter  Google Scholar 

  11. Alias, N., Kireev, S.: Fragmentation of IADE method using LuNA system. In: Malyshkin, V. (ed.) PaCT 2017. LNCS, vol. 10421, pp. 85–93. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62932-2_7

    Chapter  Google Scholar 

  12. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. In: Sixth Symposium on Operating System Design and Implementation, OSDI 2004, San Francisco, CA, pp. 137–150 (2004)

    Google Scholar 

  13. White, T.: Hadoop: The Definitive Guide: Storage and Analysis at Internet Scale, 4th edn, 756 p. O’Reilly Media, Sebastopol (2015). ISBN-13 978-1491901632

    Google Scholar 

  14. Kale, L.V., Bhatele, A.: Parallel Science and Engineering Applications: The Charm++ Approach. Taylor & Francis Group, CRC Press (2013). ISBN 9781466504127

    Google Scholar 

  15. Moskovsky, A., Roganov, V., Abramov, S.: Parallelism granules aggregation with the T-system. In: Malyshkin, V. (ed.) PaCT 2007. LNCS, vol. 4671, pp. 293–302. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73940-1_30

    Chapter  Google Scholar 

  16. Bosilca, G., Bouteiller, A., Danalis, A., Faverge, M., HĂ©rault, T., Dongarra, J.: PaRSEC: a programming paradigm exploiting heterogeneity for enhancing scalability. Comput. Sci. Eng. 99(2013), 1 (2013)

    Google Scholar 

  17. Bauer, M., Treichler, S., Slaughter, E., Aiken, A.: Legion: expressing locality and independence with logical regions. In: Conference on High Performance Computing Networking, Storage and Analysis, SC 2012, Salt Lake City, UT, USA, 11–15 November 2012 (2012). https://doi.org/10.1109/SC.2012.71

  18. Kataev, N.A., Kolganov, A.S.: The experience of using DVM and SAPFOR systems in semi automatic parallelization of an application for 3D modeling in geophysics. J. Supercomput. 75, 7833–7843 (2018)

    Article  Google Scholar 

  19. Kireev, S.: A parallel 3D code for simulation of self-gravitating gas-dust systems. In: Malyshkin, V. (ed.) PaCT 2009. LNCS, vol. 5698, pp. 406–413. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03275-2_40

    Chapter  Google Scholar 

  20. Belyaev, N., Kireev, S.: LuNA-ICLU compiler for automated generation of iterative fragmented programs. In: Malyshkin, V. (ed.) PaCT 2019. LNCS, vol. 11657, pp. 10–17. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25636-4_2

    Chapter  Google Scholar 

Download references

Acknowledgements

The work was supported by the budget project of the ICMMG SB RAS No. 0251-2021-0005.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vladislav Perepelkin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Malyshkin, V., Perepelkin, V. (2021). Trace-Based Optimization of Fragmented Programs Execution in LuNA System. In: Malyshkin, V. (eds) Parallel Computing Technologies. PaCT 2021. Lecture Notes in Computer Science(), vol 12942. Springer, Cham. https://doi.org/10.1007/978-3-030-86359-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86359-3_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86358-6

  • Online ISBN: 978-3-030-86359-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics