Skip to main content
SpringerLink
Log in

Fog-based architecture for scheduling multiple workflows with high availability requirement

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

Given the significant development of the Internet of Things (IoT) in recent years as well as the growing need for data around the world, cloud computing alone is not able to manage this volume of data. Accordingly, fog computing has just now become a popular paradigm for further data analysis in close proximity to devices generating and processing data instantly, in order to solve various problems of existing cloud-only based systems. With regard to the complexity and the wide variety of types of computational resources such as cloud servers and fog nodes, workflow scheduling is thus one of the most important challenges in fog computing environments. To address such a problem, this paper presents software architecture for scheduling multiple workflows in cloud-fog environments simultaneously. Within this scheduling, workflow clustering and priority of workflows are also taken into account. As well, architecture layers, components, as well as their major interactions are represented using 4 + 1 architectural view models. The architecture components are ultimately proposed to meet quality attributes such as availability, reliability, recoverability, interoperability, and performance. The proposed architecture evaluation is based on the Architecture Tradeoff Analysis Method (ATAM) is a scenario-based technique. Compared with previous works, various scenarios and more quality attributes are discussed within this evaluation in addition to clustering and prioritizing workflows.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. Rodriguez MA, Buyya R (2018) Scheduling dynamic workloads in multi-tenant scientific workflow as a service platforms. Future Generation Computer Systems 79:739–750

    Article  Google Scholar 

  2. Rimal BP, Maier M (2016) Workflow scheduling in multi-tenant cloud computing environments. IEEE Trans Parallel Distrib Syst 28(1):290–304

    Article  Google Scholar 

  3. Zhao Y et al (2015) Enabling scalable scientific workflow management in the Cloud. Future Generation Computer Systems 46:3–16

    Article  Google Scholar 

  4. Fakhfakh, F., H.H. Kacem, and A.H. Kacem. Workflow scheduling in cloud computing: a survey. in 2014 IEEE 18th International Enterprise Distributed Object Computing Conference Workshops and Demonstrations. 2014. IEEE.

  5. Ahmed, A., Arkian, H., Battulga, D., Fahs, A. J., Farhadi, M., Giouroukis, D., ... & Wu, L. (2019). Fog computing applications: Taxonomy and requirements. arXiv preprint

  6. Atlam H, Walters R, Wills G (2018) Fog computing and the internet of things: a review. Big data and cognitive computing. 2(2):10

    Article  Google Scholar 

  7. Ding, R., et al. A Cost-Effective Time-Constrained Multi-workflow Scheduling Strategy in Fog Computing. in Service-Oriented Computing – ICSOC 2018 Workshops. 2019. Cham: Springer International Publishing.

  8. Kayabay, K., et al. [WiP] A Workflow and Cloud Based Service-Oriented Architecture for Distributed Manufacturing in Industry 4.0 Context. in 2018 IEEE 11th Conference on Service-Oriented Computing and Applications (SOCA). 2018. IEEE.

  9. Atkinson M et al (2017) Scientific workflows: Past, present and future. Elsevier, NewYork

    Google Scholar 

  10. Rodriguez MA, Buyya R (2017) Scientific workflow management system for clouds. Software Architecture for Big Data and the Cloud. Elsevier, NewYork, pp 367–387

    Chapter  Google Scholar 

  11. Pierce ME et al (2015) Apache Airavata: design and directions of a science gateway framework. Concurrency and Computation: Practice and Experience 27(16):4282–4291

    Article  Google Scholar 

  12. Merchant N et al (2016) The iPlant collaborative: cyberinfrastructure for enabling data to discovery for the life sciences. PLoS Biol 14(1):e1002342

    Article  Google Scholar 

  13. Zhao, Y., et al. Swift: Fast, reliable, loosely coupled parallel computation. in 2007 IEEE Congress on Services (Services 2007). 2007. IEEE.

  14. Goecks J, Nekrutenko A, Taylor J (2010) Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 11(8):R86

    Article  Google Scholar 

  15. Kumar R, Charu S (2015) Comparison between cloud computing, grid computing, cluster computing and virtualization. International Journal of Modern Computer Science and Applications 3(1):42–47

    Google Scholar 

  16. Hashemi SM, Bardsiri AK (2012) Cloud computing vs grid computing. ARPN journal of systems and software. 2(5):188–194

    Google Scholar 

  17. Nepal S et al (2015) TruXy: Trusted storage cloud for scientific workflows. IEEE transactions on cloud computing 5(3):428–442

    Article  Google Scholar 

  18. Wen Z et al (2020) Dynamically Partitioning Workflow over Federated Clouds for Optimising the Monetary Cost and Handling Run-Time Failures. IEEE Transactions on Cloud Computing 8(4):1093–1107

    Article  Google Scholar 

  19. Liu, X., et al., SwinDeW-C: a peer-to-peer based cloud workflow system, in Handbook of Cloud Computing. 2010, Springer. p. 309–332.

  20. Deelman E et al (2016) Pegasus in the Cloud: Science Automation through Workflow Technologies. IEEE Internet Comput 20(1):70–76

    Article  Google Scholar 

  21. Roy, B., et al. Towards a reference architecture for cloud-based plant genotyping and phenotyping analysis frameworks. in 2017 IEEE International Conference on Software Architecture (ICSA). 2017. IEEE.

  22. Goecks J et al (2010) Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 11(8):R86

    Article  Google Scholar 

  23. Ralha CG et al (2019) Multiagent system for dynamic resource provisioning in cloud computing platforms. Future Generation Computer Systems 94:80–96

    Article  Google Scholar 

  24. Deelman E et al (2015) Pegasus, a workflow management system for science automation. Future Generation Computer Systems 46:17–35

    Article  Google Scholar 

  25. Fahringer, T., et al. ASKALON: a Grid application development and computing environment. in The 6th IEEE/ACM International Workshop on Grid Computing, 2005. 2005.

  26. Ostermann, S., R. Prodan, and T. Fahringer. Extending grids with cloud resource management for scientific computing. in 2009 10th IEEE/ACM International Conference on Grid Computing. 2009. IEEE.

  27. Lin, C., et al. Service-oriented architecture for VIEW: a visual scientific workflow management system. in 2008 IEEE International Conference on Services Computing. 2008. IEEE.

  28. Abouelhoda M, Issa SA, Ghanem M (2012) Tavaxy: Integrating Taverna and Galaxy workflows with cloud computing support. BMC Bioinformatics 13(1):77

    Article  Google Scholar 

  29. Paterson T, Law A (2009) An XML transfer schema for exchange of genomic and genetic mapping data: implementation as a web service in a Taverna workflow. BMC Bioinformatics 10(1):252

    Article  Google Scholar 

  30. de Oliveira, D., et al. Scicumulus: A lightweight cloud middleware to explore many task computing paradigm in scientific workflows. in 2010 IEEE 3rd International Conference on Cloud Computing. 2010. IEEE.

  31. Altintas, I., O. Barney, and E. Jaeger-Frank. Provenance collection support in the kepler scientific workflow system. in International Provenance and Annotation Workshop. 2006. Springer.

  32. Jedrusik, S.Z.M., et al. Workflow Management System with Automatic Correction. in Multimedia Communications, Services and Security: 10th International Conference, MCSS 2020, Kraków, Poland, October 8–9, 2020, Proceedings. 2020. Springer Nature.

  33. Liu D et al (2018) A cloud service adaptive framework based on reliable resource allocation. Future Generation Computer Systems 89:455–463

    Article  Google Scholar 

  34. Kruchten PB (1995) The 4+ 1 view model of architecture. IEEE Softw 12(6):42–50

    Article  Google Scholar 

  35. Cloutier R et al (2010) The concept of reference architectures. Systems Engineering 13(1):14–27

    MathSciNet  Google Scholar 

  36. Arkian HR, Diyanat A, Pourkhalili A (2017) MIST: Fog-based data analytics scheme with cost-efficient resource provisioning for IoT crowdsensing applications. Journal of Network and Computer Applications 82:152–165

    Article  Google Scholar 

  37. Barbacci MR (2003) Software quality attributes and architecture tradeoffs. Carnegie Mellon University, Pittsburgh, Software Engineering Institute

    Google Scholar 

  38. Berander P et al (2005) Software quality attributes and trade-offs. Blekinge Institute of Technology 97(98):19

    Google Scholar 

  39. Meng, S., et al. The “4+ 1 “view model on safe home system architecture. in 2010 IEEE International Conference on Software Engineering and Service Sciences. 2010. IEEE.

  40. Babar MA et al (2006) An empirical study of groupware support for distributed software architecture evaluation process. J Syst Softw 79(7):912–925

    Article  Google Scholar 

  41. Raza A et al (2019) Software Architecture Evaluation Methods: A Comparative Study. International Journal of Computing and Communication Networks 1(2):1–9

    Google Scholar 

  42. Bass, L., P. Clements, and R. Kazman, Software architecture in practice. 2003: Addison-Wesley Professional.

  43. Mattsson, M., H. Grahn, and F. Mårtensson. Software architecture evaluation methods for performance, maintainability, testability, and portability. in Second International Conference on the Quality of Software Architectures. 2006. Citeseer.

  44. Kazman, R., M. Klein, and P. Clements, ATAM: Method for architecture evaluation. 2000, Carnegie-Mellon Univ Pittsburgh PA Software Engineering Inst.

  45. Hu H et al (2018) Multi-objective scheduling for scientific workflow in multicloud environment. Journal of Network and Computer Applications 114:108–122

    Article  Google Scholar 

  46. Kumari, P. and P. Kaur, A survey of fault tolerance in cloud computing. Journal of King Saud University-Computer and Information Sciences, 2018. ISSN 1319 -1578. https://doi.org/10.1016/j.jksuci.2018.09.021

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, North Tehran Branch, Islamic Azad University, Tehran, Iran

    Fatemeh Davami & Sahar Adabi

  2. Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Ali Rezaee & Amir Masoud Rahmani

Authors
  1. Fatemeh Davami
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sahar Adabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ali Rezaee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amir Masoud Rahmani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Sahar Adabi or Ali Rezaee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Davami, F., Adabi, S., Rezaee, A. et al. Fog-based architecture for scheduling multiple workflows with high availability requirement. Computing 104, 169–208 (2022). https://doi.org/10.1007/s00607-021-00905-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-021-00905-1

Keywords

Mathematics subject classification

Search

Navigation