Skip to main content

Advertisement

SpringerLink
Log in

FOCALB: Fog Computing Architecture of Load Balancing for Scientific Workflow Applications

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Fog computing has a broad scope in real-time applications. It appears in the middle of Internet of Things (IoT) users and the cloud layer. The main applications of fog computing are to decrease latency and improve resource utilization for the end-users. Along with many advantages, fog computing also faces many challenges such as overloaded resources, security, deployment of nodes, and energy consumption. Load balancing is a challenging problem in a fog computing environment wherein, in more IoTs, the load distribution is required among all resources. Utilization of resources can be increased by the distribution of load in equal proportion among all fog resources. In scientific workflow systems, fog computing aids in proper resource utilization by uniformly dividing the workload. In this paper, we have proposed a Fog Computing Architecture of Load Balancing (FOCALB) for scientific workflow applications. The paper also proposed hybridized load balancing algorithm for scientific workflows (Tabu-GWO-ACO), which is an amalgamation of tabu search, Grey Wolf Optimization (GWO), and Ant Colony Optimization (ACO). The proposed model has been designed to enhance resource utilization by implementing load balancing at the fog layer. In the fog nodes, load scheduling is done when tasks are initialized, and local controller in fog clusters does load balancing. The simulation results are obtained with the help of iFogSim and Eclipse for 20 to 200 fog nodes. Simulated studies based on execution time, cost, and energy compared with various existing models show that FOCALB reduces energy consumption at fog nodes and reduces the execution time and implementation cost as well. The article is summarized by providing open challenges and future research directions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability Statement (DAS)

The datasets analysed during the current study are available in the “pegasus” repository https://pegasus.isi.edu/workflow_gallery/.

References

  1. Abbasi, M., Pasand, E.M., Khosravi, M.R.: Workload allocation in iot-fog-cloud architecture using a multi-objective genetic algorithm. J. Grid Comput., 1–14 (2020)

  2. Al-khafajiy, M., Baker, T., Asim, M., Guo, Z., Ranjan, R., Longo, A., Puthal, D., Taylor, M.: Comitment: a fog computing trust management approach. J. Parallel Distrib. Comput. 137, 1–16 (2020)

    Article  Google Scholar 

  3. Alaasam, A.B., Radchenko, G.I., Tchernykh, A.N.: Micro-workflows data stream processing model for industrial internet of things. Supercomput. Front. Innov. 8(1), 82–98 (2021)

    Google Scholar 

  4. Aron, R.: Resource Provisioning Strategy for Scientific Workflows in Cloud Computing Environment. In: Cloud Computing for Optimization: Foundations, Applications, and Challenges, pp. 99–122. Springer (2018)

  5. Biswas, T., Kuila, P., Ray, A.K.: A novel workflow scheduling with multi-criteria using particle swarm optimization for heterogeneous computing systems. Clust. Comput., 1–17 (2020)

  6. Bittencourt, L.F., Madeira, E.R.M.: Hcoc: a cost optimization algorithm for workflow scheduling in hybrid clouds. J. Internet Serv. Appl. 2(3), 207–227 (2011)

    Article  Google Scholar 

  7. Brown, D.A., Brady, P.R., Dietz, A., Cao, J., Johnson, B., McNabb, J.: A Case Study on the Use of Workflow Technologies for Scientific Analysis: Gravitational Wave Data Analysis. In: Workflows for E-Science, pp. 39–59. Springer (2007)

  8. Callaghan, S., Maechling, P., Deelman, E., Vahi, K., Mehta, G., Juve, G., Milner, K., Graves, R., Field, E., Okaya, D., et al: Reducing Time-To-Solution Using Distributed High-Throughput Mega-Workflows-Experiences from Scec Cybershake. In: 2008 IEEE Fourth International Conference on Escience, pp. 151–158. IEEE (2008)

  9. Chirkin, A.M., Belloum, A.S., Kovalchuk, S.V., Makkes, M.X., Melnik, M.A., Visheratin, A.A., Nasonov, D.A.: Execution time estimation for workflow scheduling. Fut. Gener. Comput. Syst. 75, 376–387 (2017)

    Article  Google Scholar 

  10. De Maio, V., Kimovski, D.: Multi-objective scheduling of extreme data scientific workflows in fog. Future Generation Computer Systems (2020)

  11. Deelman, E., Callaghan, S., Field, E., Francoeur, H., Graves, R., Gupta, N., Gupta, V., Jordan, T.H., Kesselman, C., Maechling, P., et al: Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance Tracking: The Cybershake Example. In: 2006 Second IEEE International Conference on E-Science and Grid Computing (E-Science’06), pp. 14–14. IEEE (2006)

  12. Ding, R., Li, X., Liu, X., Xu, J.: A Cost-Effective Time-Constrained Multi-Workflow Scheduling Strategy in Fog Computing. In: International Conference on Service-Oriented Computing, pp. 194–207. Springer (2018)

  13. Elsherbiny, S., Eldaydamony, E., Alrahmawy, M., Reyad, A.E.: An extended intelligent water drops algorithm for workflow scheduling in cloud computing environment. Egypt. Inf. J. 19 (1), 33–55 (2018)

    Google Scholar 

  14. Gupta, H., Vahid Dastjerdi, A., Ghosh, S.K., Buyya, R.: ifogsim: a toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Softw. Practice Exper. 47(9), 1275–1296 (2017)

    Article  Google Scholar 

  15. Hussein, M.K., Mousa, M.H.: Efficient task offloading for iot-based applications in fog computing using ant colony optimization. IEEE Access 8, 37191–37201 (2020)

    Article  Google Scholar 

  16. Ijaz, S., Munir, E.U., Ahmad, S.G., Rafique, M.M., Rana, O.F.: Energy-makespan optimization of workflow scheduling in fog–cloud computing. Computing, 1–27 (2021)

  17. Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. Futur. Gener. Comput. Syst. 29(3), 682–692 (2013)

    Article  Google Scholar 

  18. Kashani, M.H., Ahmadzadeh, A., Mahdipour, E.: Load balancing mechanisms in fog computing: A systematic review. arXiv:2011.14706 (2020)

  19. Kaur, A., Gupta, P., Singh, M.: Hybrid balanced task clustering algorithm for scientific workflows in cloud computing. Scalable Comput. Practice Exper. 20(2), 237–258 (2019)

    Article  Google Scholar 

  20. Kaur, M., Aron, R.: Equal Distribution Based Load Balancing Technique for Fog-Based Cloud Computing. In: International Conference on Artificial Intelligence: Advances and Applications 2019, pp. 189–198. Springer (2020)

  21. Khan, W., Rehman, M., Zangoti, H., Afzal, M., Armi, N., Salah, K.: Industrial internet of things: Recent advances, enabling technologies and open challenges. Comput. Electr. Eng. 81, 106522 (2020)

    Article  Google Scholar 

  22. Li, H., Ruan, J., Durbin, R.: Maq: Mapping and assembly with qualities. Version 6(3), 0 (2008)

    Google Scholar 

  23. Li, Z., Ge, J., Yang, H., Huang, L., Hu, H., Hu, H., Luo, B.: A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds. Futur. Gener. Comput. Syst. 65, 140–152 (2016)

    Article  Google Scholar 

  24. Livny, J., Teonadi, H., Livny, M., Waldor, M.K.: High-throughput, kingdom-wide prediction and annotation of bacterial non-coding rnas. PloS one 3(9), e3197 (2008)

    Article  Google Scholar 

  25. Maechling, P., Deelman, E., Zhao, L., Graves, R., Mehta, G., Gupta, N., Mehringer, J., Kesselman, C., Callaghan, S., Okaya, D., et al: Scec Cybershake Workflows—Automating Probabilistic Seismic Hazard Analysis Calculations. In: Workflows for E-Science, pp. 143–163. Springer (2007)

  26. Mahmud, R., Buyya, R.: Modelling and simulation of fog and edge computing environments using ifogsim toolkit. Fog and edge computing: Principles and paradigms, pp. 1–35 (2019)

  27. Markus, A., Kertesz, A.: A survey and taxonomy of simulation environments modelling fog computing. Simul. Model. Pract. Theory 101, 102042 (2020)

    Article  Google Scholar 

  28. MIRTAHERI, S.L., SHIRZAD, H.R.: Optimized distributed resource management in fog computing by using ant-olony optimization c. Fut. Trends HPC Disruptive Scenario 34, 206 (2019)

    Google Scholar 

  29. Naik, K.J., Naik, D.H.: Minimizing deadline misses and total run-time with load balancing for a connected car systems in fog computing. Scalable Comput. Practice Exper. 21(1), 73–84 (2020)

    Article  Google Scholar 

  30. Naqvi, S.A.A., Javaid, N., Butt, H., Kamal, M.B., Hamza, A., Kashif, M.: Metaheuristic Optimization Technique for Load Balancing in Cloud-Fog Environment Integrated with Smart Grid. In: International Conference on Network-Based Information Systems, pp. 700–711. Springer (2018)

  31. Natesan, G., Chokkalingam, A.: Optimal task scheduling in the cloud environment using a mean grey wolf optimization algorithm. Int. J. Technol. 10(1), 126–136 (2019)

    Article  Google Scholar 

  32. Niemi, N.A., Oskin, M., Rockwell, T.K.: Southern california earthquake center geologic vertical motion database. Geochem. Geophys. Geosyst. 9(7) (2008)

  33. Patel, D., Patra, M.K., Sahoo, B.: Gwo Based Task Allocation for Load Balancing in Containerized Cloud. In: 2020 International Conference on Inventive Computation Technologies (ICICT), pp. 655–659. IEEE (2020)

  34. Princess, G.A.P., Radhamani, A.: A hybrid meta-heuristic for optimal load balancing in cloud computing. J. Grid Comput. 19(2), 1–22 (2021)

    Google Scholar 

  35. Puthal, D., Obaidat, M.S., Nanda, P., Prasad, M., Mohanty, S.P., Zomaya, A.Y.: Secure and sustainable load balancing of edge data centers in fog computing. IEEE Commun. Mag. 56(5), 60–65 (2018)

    Article  Google Scholar 

  36. Rehman, A., Hussain, S.S., ur Rehman, Z., Zia, S., Shamshirband, S.: Multi-objective approach of energy efficient workflow scheduling in cloud environments. Concurr. Comput. Practice Exper. 31(8), e4949 (2019)

    Article  Google Scholar 

  37. Rizvi, N., Ramesh, D.: Fair budget constrained workflow scheduling approach for heterogeneous clouds. Clust. Comput. 23(4), 3185–3201 (2020)

    Article  Google Scholar 

  38. Rodriguez, M.A., Buyya, R.: Budget-driven scheduling of scientific workflows in iaas clouds with fine-grained billing periods. ACM Trans. Auton. Adapt. Syst. (TAAS) 12(2), 1–22 (2017)

    Article  Google Scholar 

  39. Saeedi, S., Khorsand, R., Bidgoli, S.G., Ramezanpour, M.: Improved many-objective particle swarm optimization algorithm for scientific workflow scheduling in cloud computing. Comput. Ind. Eng. 147, 106649 (2020)

    Article  Google Scholar 

  40. Saroa, M.K., Aron, R.: Fog Computing and Its Role in Development of Smart Applications. In: 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/Socialcom/Sustaincom), pp. 1120–1127. IEEE (2018)

  41. Serhani, M.A., El-Kassabi, H.T., Shuaib, K., Navaz, A.N., Benatallah, B., Beheshti, A.: Self-adapting cloud services orchestration for fulfilling intensive sensory data-driven iot workflows. Future Generation Computer Systems (2020)

  42. Shahid, M.H., Hameed, A.R., ul Islam, S., Khattak, H.A., Din, I.U., Rodrigues, J.J.: Energy and delay efficient fog computing using caching mechanism. Computer Communications (2020)

  43. Shojafar, M., Sookhak, M.: Internet of everything, networks, applications and computing systems. (ioenacs) (2020)

  44. Siasi, N., Jaesim, A., Ghani, N.: Tabu Search for Efficient Service Function Chain Provisioning in Fog Networks. In: 2019 IEEE 5Th International Conference on Collaboration and Internet Computing (CIC), pp. 145–150. IEEE (2019)

  45. Singh, S.P., Sharma, A., Kumar, R.: Design and exploration of load balancers for fog computing using fuzzy logic. Simul. Model. Pract. Theory 101, 102017 (2020)

    Article  Google Scholar 

  46. de Souza Toniolli, J.L., Jaumard, B.: Resource allocation for multiple workflows in cloud-fog computing systems. In: Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion, pp. 77–84 (2019)

  47. Talaat, F.M., Saraya, M.S., Saleh, A.I., Ali, H.A., Ali, S.H.: A load balancing and optimization strategy (lbos) using reinforcement learning in fog computing environment. J. Ambient. Intell. Humaniz. Comput., pp. 1–16 (2020)

  48. Team, C.: Dagman (directed acyclic graph manager). See website at http://www.cs.wisc.edu/condor/dagman (2005)

  49. Téllez, N., Jimeno, M., Salazar, A., Nino-Ruiz, E.: A tabu search method for load balancing in fog computing. Int. J. Artif. Intell. 16(2) (2018)

  50. Tsai, C.W., Rodrigues, J.J.: Metaheuristic scheduling for cloud: a survey. IEEE Syst. J. 8(1), 279–291 (2013)

    Article  Google Scholar 

  51. Wadhwa, H., Aron, R.: Tram: Technique for resource allocation and management in fog computing environment. J. Supercomput., 1–24 (2021)

  52. Wang, J., Li, D., Hu, M.Y.: Fog nodes deployment based on space-time characteristics in smart factory. IEEE Transactions on Industrial Informatics (2020)

  53. Wang, J., Wang, L.: A computing resource allocation optimization strategy for massive internet of health things devices considering privacy protection in cloud edge computing environment. J. Grid Comput. 19(2), 1–14 (2021)

    Google Scholar 

  54. Xie, Y., Zhu, Y., Wang, Y., Cheng, Y., Xu, R., Sani, A.S., Yuan, D., Yang, Y.: A novel directional and non-local-convergent particle swarm optimization based workflow scheduling in cloud–edge environment. Futur. Gener. Comput. Syst. 97, 361–378 (2019)

    Article  Google Scholar 

  55. Xu, R., Wang, Y., Cheng, Y., Zhu, Y., Xie, Y., Sani, A.S., Yuan, D.: Improved Particle Swarm Optimization Based Workflow Scheduling in Cloud-Fog Environment. In: International Conference on Business Process Management, pp. 337–347. Springer (2018)

  56. Zhou, X., Zhang, G., Sun, J., Zhou, J., Wei, T., Hu, S.: Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based heft. Futur. Gener. Comput. Syst. 93, 278–289 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Engineering, Lovely Professional University, Jalandhar, Punjab, India

    Mandeep Kaur

  2. Computer Science Engineering, Chandigarh University, Gharuan, Punjab, India

    Mandeep Kaur

  3. SVKM’s Narsee Monjee Institute of Management Studies (NMIMS) University, Mumbai, Maharashtra, India

    Rajni Aron

Authors
  1. Mandeep Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajni Aron
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mandeep Kaur.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kaur, M., Aron, R. FOCALB: Fog Computing Architecture of Load Balancing for Scientific Workflow Applications. J Grid Computing 19, 40 (2021). https://doi.org/10.1007/s10723-021-09584-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10723-021-09584-w

Keywords

Search

Navigation