Abstract
These days, fog computing is an emerging paradigm that offers ubiquitous and omnipresent latency-aware services to delay applications. However, due to the mobility features of applications, the resource allocation to the workload of applications in distributed dynamic fog networks is becoming a challenging problem. This paper investigates the resource allocation problem in software define network (SDN) enable fog networks. Based on SDN, we distributed the fog network, which consists of many fog nodes. The considered problem contains many stringent constraints (e.g., mobility, deadline, and resource capacity), which are must be satisfied during the execution of applications. Offloading some tasks to fog system performance can be improved by reducing the latency and energy consumption, which are the two important metrics of interest in fog networks. The study proposes a novel container-based architecture with different fog nodes. Based on architecture, the study devises the deep-learning-Q-network based resource-allocation, which consists of various components to solve the problem. The parts are mobility controller, resource searching, and resource allocation, and task migration. Performance evaluation shows that the proposed architecture and schemes better perform existing studies in terms of application costs (energy and execution time) by 30%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahmad, M., Bilal, M., Jolfaei, A., Mehmood, R.M.: Mobility aware blockchain enabled offloading and scheduling in vehicular fog cloud computing. IEEE Trans. Intell. Transp. Syst. 22, 4212–4223 (2021)
Arshad, H., Shah, M.A., Khattak, H.A., Ameer, Z., Abbas, A., Khan, S.U.: Evaluating bio-inspired optimization techniques for utility price estimation in fog computing. In: 2018 IEEE International Conference on Smart Cloud (SmartCloud). IEEE, pp. 84–89 (2018)
Ashraf, S., Abdullah, S., Mahmood, T.: Spherical fuzzy dombi aggregation operators and their application in group decision making problems. J. Ambient Intell. Human. Comput. 11(7), 2731–2749 (2020)
Attar, H.H., Solyman, A.A., Alrosan, A., Chakraborty, C., Khosravi, M.R.: Deterministic cooperative hybrid ring-mesh network coding for big data transmission over lossy channels in 5G networks. EURASIP J. Wirel. Commun. Netw. 2021(1), 1–18 (2021)
Chen, J., Sun, S., Bao, N., Zhu, Z., Zhang, L.-b.: Improved reconstruction for CS based ECG acquisition in internet of medical things. IEEE Sens. J. 3, 1–17 (2021a)
Chen, J., Sun, S., Zhang, L.-b. Yang, B., Wang, W.: Compressed sensing framework for heart sound acquisition in internet of medical things. IEEE Trans. Ind. Inform. (2021b). https://doi.org/10.1109/TII.2021.3088465
Dootio, M.A., Sodhro, A.H., Sandeep, S., Groenli, T.M., Khokhar, M.S., Wang, L.: Cost-efficient service selection and execution and blockchain-enabled serverless network for internet of medical things. (2022)
Lakhan, A., Li, X.: Content aware task scheduling framework for mobile workflow applications in heterogeneous mobile-edge-cloud paradigms: Catsa framework. In: IEEE International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing and Communications, Social Computing and Networking (ISPA/BDCloud/SocialCom/SustainCom). IEEE, pp. 242–249 (2019a)
Lakhan, A., Li, X.: Mobility and fault aware adaptive task offloading in heterogeneous mobile cloud environments. EAI Endorsed Trans. Mobile Commun. Appl. 5(16) (2019b)
Lakhan, A., Li, X.: Transient fault aware application partitioning computational offloading algorithm in microservices based mobile cloudlet networks. Computing 102, 105–139 (2020). https://doi.org/10.1007/s00607-019-00733-4
Lakhan, A., Xiaoping, L.: Energy aware dynamic workflow application partitioning and task scheduling in heterogeneous mobile cloud network. In: 2018 International Conference on Cloud Computing, Big Data and Blockchain (ICCBB). IEEE, pp. 1–8 (2018)
Li, C., Tang, J., Tang, H., Luo, Y.: Collaborative cache allocation and task scheduling for data-intensive applications in edge computing environment. Future Gen. Comput. Syst. 95, 249–264 (2019)
Lakhan, A., Khan, F.A., Abbasi, Q.H.,et al.: Dynamic content and failure aware task offloading in heterogeneous mobile cloud networks. In: 2019 International Conference on Advances in the Emerging Computing Technologies (AECT). IEEE, pp. 1–6 (2020)
Mohammed, M.A., Kozlov, S., Rodrigues, J.J.: Mobile-fog-cloud assisted deep reinforcement learning and blockchain-enable IoMT system for healthcare workflows. Trans. Emerg. Telecommun. Technol. (2021a). https://doi.org/10.1002/ett.4363
Mohammed, M.A., Rashid, A.N., Kadry, S., Panityakul, T., Abdulkareem, K.H., Thinnukool, O.: Smart-contract aware ethereum and client-fog-cloud healthcare system. Sensors 21(12), 4093 (2021b)
Ning, Z., Dong, P., Wang, X., Rodrigues, J.J., Xia, F.: Deep reinforcement learning for vehicular edge computing: an intelligent offloading system. ACM Trans. Intell. Syst. Technol. (TIST) 10(6), 60 (2019)
Rahman, A., Chakraborty, C., Anwar, A., et al.: SDN–IOT empowered intelligent framework for industry 4.0 applications during covid-19 pandemic. Cluster Comput. (2021). https://doi.org/10.1007/s10586-021-03367-4
Raja, D., Ravi, G.: Dynamic modeling and control of five phase SVPWM inverter fed induction motor drive with intelligent speed controller. J. Ambient Intell. Human. Comput. (2020). https://doi.org/10.1007/s12652-020-01717-5
Roy, S., Sarkar, D., De, D.: Entropy-aware ambient iot analytics on humanized music information fusion. J. Ambient Intell. Human. Comput. 11(1), 151–171 (2020)
Sajnani, D.K., Mahesar, A.R., Lakhan, A., Jamali, I.A., et al.: Latency aware and service delay with task scheduling in mobile edge computing. Commun. Netw. 10(04), 127 (2018)
Song, H., Vajdi, A., Wang, Y., Zhou, J., et al.: Blockchain for consortium: a practical paradigm in agricultural supply chain system. Expert Syst. Appl. 184, 115425 (2021)
Sathio, A.A., Dootio, M.A., Rehman, M.ur, Pnhwar, A.O., Sahito, M.A.: Pervasive futuristic healthcare and blockchain enabled digital identities-challenges and future intensions. In: 2021 International Conference on Computing, Electronics and Communications Engineering (iCCECE). IEEE, pp. 30–35 (2021)
Triantaphyllou, E.: Topsis-multi-criteria decision making methods. In: Multi-criteria Decision Making Methods: A Comparative Study. Springer, pp. 5–21 (2000)
Wang, T., Wei, X., Tang, C., Fan, J.: Efficient multi-tasks scheduling algorithm in mobile cloud computing with time constraints. Peer-to-Peer Netw. Appl. 11(4), 793–807 (2018)
Wang, T., Wei, X., Liang, T., Fan, J.: Dynamic tasks scheduling based on weighted bi-graph in mobile cloud computing. Sustain. Comput. Inform. Syst. 19, 214–222 (2018)
Wang, J.-Q., Yang, Y., Li, L.: Multi-criteria decision-making method based on single-valued neutrosophic linguistic maclaurin symmetric mean operators. Neural Comput. Appl. 30(5), 1529–1547 (2018)
Wang, S., Xu, J., Zhang, N., Liu, Y.: Service migration in mobile edge computing. IEEE Access 6, 23511–23528 (2018)
Yin, L., Luo, J., Luo, H.: Tasks scheduling and resource allocation in fog computing based on containers for smart manufacturing. IEEE Trans. Ind. Inform. 14(10), 4712–4721 (2018)
Zhang, C., Zheng, Z.: Task migration for mobile edge computing using deep reinforcement learning. Future Gen. Comput. Syst. 96, 111–118 (2019)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lakhan, A., Mohammed, M.A., Obaid, O.I. et al. Efficient deep-reinforcement learning aware resource allocation in SDN-enabled fog paradigm. Autom Softw Eng 29, 20 (2022). https://doi.org/10.1007/s10515-021-00318-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10515-021-00318-6