Skip to main content

Collaborative Development and Use of Scientific Applications in Orlando Tools: Integration, Delivery, and Deployment

  • Conference paper
  • First Online:
High Performance Computing (CARLA 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1087))

Included in the following conference series:

Abstract

The paper addresses practical challenges related to the development and application of distributed software packages of the Orlando Tools framework to solve real problems. Such packages include a special class of scientific applications characterized by a wide class of problem solvers, modular structure of software, algorithmic knowledge implemented by modules, computations scalability, execution in heterogeneous resources, etc. It is adapted for various categories of users: developers, administrators, and end-users. Unlike other tools for developing scientific applications, Orlando Tools provides supports for the intensive evolution of algorithmic knowledge, adaptation of existed and designing new ones. It has the capability to extend the class of solved problems. We implement and automate the non-trivial technological sequence of the collaborative development and use of packages including the continuous integration, delivery, deployment, and execution of package modules in a heterogeneous distributed environment that integrates grid and cloud computing. This approach reduces the complexity of the collaborative development and use of packages, and increases software operation predictability through the preliminary detecting and eliminating errors with significant reduction of the correcting cost.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barker, A., van Hemert, J.: Scientific workflow: a survey and research directions. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2007. LNCS, vol. 4967, pp. 746–753. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-68111-3_78

    Chapter  Google Scholar 

  2. Duvall, P.M., Matyas, S., Glover, A.: Continuous Integration: Improving Software Quality and Reducing Risk. Addison Wesley Professional, Boston (2007)

    Google Scholar 

  3. Deelman, E., et al.: The future of scientific workflows. Int. J. High Perform. Comput. Appl. 32(1), 159–175 (2018)

    Article  Google Scholar 

  4. Krol, M., Rene, S., Ascigil, O., Psaras, I.: ChainSoft: collaborative software development using smart contracts. In: 1st Workshop on Cryptocurrencies and Blockchains for Distributed Systems, pp. 1–6. ACM (2018)

    Google Scholar 

  5. Sochat, V.: Containershare: open source registry to build, test, deploy with CircleCI. J. Open Source Softw. 3(28), 1–3 (2018)

    Article  Google Scholar 

  6. Soni, M., Berg, A.M.: Jenkins 2.x Continuous Integration Cookbook. Packt Publishing, Birmingham (2017)

    Google Scholar 

  7. Machiraju, S., Gaurav, S.: Deployment via TeamCity and Octopus Deploy. In: Machiraju, S., Gaurav, S. (eds.) DevOps for Azure Applications, pp. 11–38. Apress, New York (2018)

    Chapter  Google Scholar 

  8. Beller, M., Gousios, G., Zaidman, A.: Oops, my tests broke the build: an explorative analysis of travis CIDD with GitHub. In: 14th International Conference on Mining Software Repositories, pp. 356–367. IEEE (2017)

    Google Scholar 

  9. Gruver, G.: Start and Scaling Devops in the Enterprise. BookBaby, Pennsauken (2016)

    Google Scholar 

  10. Shahin, M., Babar, M.A., Zhu, L.: Continuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practices. IEEE Access 5, 3909–3943 (2017)

    Article  Google Scholar 

  11. Wolff, E.: A Practical Guide to Continuous Delivery. Addison-Wesley, Boston (2017)

    Google Scholar 

  12. CruiseControl.NET. https://sourceforge.net/projects/ccnet. Accessed 7 May 2019

  13. Apache Gump. https://gump.apache.org/. Accessed 7 May 2019

  14. Conan C/C++ package manager. https://www.conan.io. Accessed 7 May 2019

  15. BuildMaster. https://inedo.com/buildmaster. Accessed 7 May 2019

  16. Heckel, T.: Meet Travis CI: Open Source Continuous Integration, InfoQ (2013). https://www.infoq.com/news/2013/02/travis-ci. Accessed 7 May 2019

  17. Chacon, S., Straub, B.: Pro Git. Apress, New York (2014)

    Book  Google Scholar 

  18. Barrett, D., Silverman, R., Byrnes, R.: SSH: The Secure Shell (The Definitive Guide). O’Reilly, Sebastopol (2005)

    Google Scholar 

  19. Blum, R.: Linux Command Line and Shell Scripting Bible. Wiley, Hoboken (2017)

    Google Scholar 

  20. Colvin, H.: VirtualBox: An Ultimate Guide Book on Virtualization with VirtualBox. CreateSpace Independent Publishing Platform, Scotts Valley (2015)

    Google Scholar 

  21. Parallels RAS. https://www.parallels.com/ru/products/ras/remote-application-server/. Accessed 7 May 2019

  22. Kane, S., Matthias, K.: Docker: Up and Running: Shipping Reliable Containers in Production. O’Relly Media, Sebastopol (2018)

    Google Scholar 

  23. Smith, R.: Docker Orchestration. Packt Publishing, Birmingham (2017)

    Google Scholar 

  24. Luksa, M.: Kubernetes in Action. Manning Publications, Shelter Island (2018)

    Book  Google Scholar 

  25. Container Registry. https://docs.gitlab.com/ee/user/project/container_registry.html. Accessed 7 May 2019

  26. Feoktistov, A., Gorsky, S., Sidorov, I., Kostromin, R., Edelev, A., Massel, L.: Orlando tools: energy research application development through convergence of grid and cloud computing. In: Voevodin, V., Sobolev, S. (eds.) RuSCDays 2018. CCIS, vol. 965, pp. 289–300. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-05807-4_25

    Chapter  Google Scholar 

  27. Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. Part O J. Risk Reliab. 222(2), 235–243 (2008)

    Article  Google Scholar 

  28. Irkutsk Supercomputer center of SB RAS. http://hpc.icc.ru. Accessed 7 May 2019

  29. Edelev, A.V., Sidorov, I.A., Feoktistov, A.G.: Heterogeneous distributed computing environment for vulnerability analysis of energy critical infrastructures. In: Massel, L., Makagonova, N., Kopaygorodsky, A., Massel, A. (eds.) 5th International workshop on Critical infrastructures: Contingency management, Intelligent, Agent-based, Cloud computing and Cyber security. Advances in Intelligent Systems Research, vol. 158, pp. 37–42 (2018)

    Google Scholar 

Download references

Acknowledgment

The study is supported by the Russian Foundation of Basic Research, projects no. 19-07-00097-a and no. 18-07-01224-a. This work was also supported in part by Basic Research Program of SB RAS, projects no. IV.38.1.1 and no. III.17.5.1.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Alexander Feoktistov , Sergei Gorsky or Andrei Tchernykh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feoktistov, A., Gorsky, S., Sidorov, I., Bychkov, I., Tchernykh, A., Edelev, A. (2020). Collaborative Development and Use of Scientific Applications in Orlando Tools: Integration, Delivery, and Deployment. In: Crespo-Mariño, J., Meneses-Rojas, E. (eds) High Performance Computing. CARLA 2019. Communications in Computer and Information Science, vol 1087. Springer, Cham. https://doi.org/10.1007/978-3-030-41005-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41005-6_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41004-9

  • Online ISBN: 978-3-030-41005-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics