Skip to main content

Advertisement

SpringerLink
Log in

An efficient computational offloading framework using HAA optimization-based deep reinforcement learning in edge-based cloud computing architecture

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

Mobile Cloud Computing (MCC) has emerged as a popular model for bringing the benefits of cloud computing to the proximity of mobile devices. MCC's preliminary goal is to improve service availability as well as performance and mobility features. Edge computing, a novel paradigm, provides rich computing capabilities at the edge of pervasive radio access networks close to users. Designing an efficient offloading technique for edge computing is a major research challenge given the constrained resources. Offloading speeds up processing, which has an impact on service quality in heterogeneous devices. Due to the difficulties of the network states' distribution environment, allocating computing resources is a difficult process. In this study, inputs from various sorts of devices such as cars, mobile phones, and heterogeneous building sources are considered. When an accurate energy estimation model is established to compute the energy consumption of the tasks during offloading, an effective task offloading technique can be derived. The model should select whether or not to conduct offloading based on the computed energy cost. This study proposed a Hybrid Arithmetic Archimedes Optimization algorithm-based Deep Reinforcement Learning model for computation offloading in heterogeneous devices. The effectiveness of the proposed method is evaluated using different state-of-art methods such as First Upload Round and Second Upload Round (FUR-SUR), Efficient Dynamic-Decision Based Task Scheduler, Context‐aware computation offloading and Price-based distributed offloading. The proposed method offers superior results to other existing methods. The user’s average utility of the proposed method increases by 410% contrasted to FUR-SUR.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

References

  1. Shadi M, Abrishami S, Mohajerzadeh AH, Zolfaghari B (2021) Ready-time partitioning algorithm for computation offloading of workflow applications in mobile cloud computing. J Supercomput 77(6):6408–6434

    Article  Google Scholar 

  2. uz Zaman SK, Jehangiri AI, Maqsood T, Ahmad Z, Umar AI, Shuja J, Alanazi E, Alasmary W (2021) Mobility-aware computational offloading in mobile edge networks: a survey. Cluster Comput 1:1–22

    Google Scholar 

  3. Ali Z, Abbas ZH, Abbas G, Numani A, Bilal M (2021) Smart computational offloading for mobile edge computing in next-generation Internet of Things networks. Comput Netw 198:108356

    Article  Google Scholar 

  4. Yu S, Wang X, Langar R (2017) Computation offloading for mobile edge computing: a deep learning approach. In: IEEE 28th annual international symposium on personal, indoor, and mobile radio communications (PIMRC). IEEE, pp 1–6

  5. Zhang H, Yang Y, Huang X, Fang C, Zhang P (2021) Ultra-low latency multi-task offloading in mobile edge computing. IEEE Access 9:32569–32581

    Article  Google Scholar 

  6. Wang Y, Wang L, Zheng R, Zhao X, Liu M (2021) Latency-optimal computational offloading strategy for sensitive tasks in smart homes. Sensors 21(7):2347

    Article  Google Scholar 

  7. Ko J, Choi YJ, Paul R (2021) Computation offloading technique for energy efficiency of smart devices. J Cloud Comput 10(1):1–14

    Article  Google Scholar 

  8. Dinh TQ, Tang J, La QD, Quek TQ (2017) Offloading in mobile edge computing: task allocation and computational frequency scaling. IEEE Trans Commun 65(8):3571–3584

    Google Scholar 

  9. Aldmour R, Yousef S, Baker T, Benkhelifa E (2021) An approach for offloading in mobile cloud computing to optimize power consumption and processing time. Sustain Comput: Inf Syst 31:100562

    Google Scholar 

  10. Ali A, Iqbal MM, Jamil H, Qayyum F, Jabbar S, Cheikhrouhou O, Baz M, Jamil F (2021) An efficient dynamic-decision based task scheduler for task offloading optimization and energy management in mobile cloud computing. Sensors 21(13):4527

    Article  Google Scholar 

  11. Farahbakhsh F, Shahidinejad A, Ghobaei-Arani M (2021) Context-aware computation offloading for mobile edge computing. J Ambient Intell Hum Comput 1:1–13

    Google Scholar 

  12. Liu M, Liu Y (2017) Price-based distributed offloading for mobile-edge computing with computation capacity constraints. IEEE Wirel Commun Lett 7(3):420–423

    Article  Google Scholar 

  13. Patel YS, Reddy M, Misra R (2021) Energy and cost trade-off for computational tasks offloading in mobile multi-tenant clouds. Cluster Comput 1:1–32

    Google Scholar 

  14. Dinh TQ, La QD, Quek TQ, Shin H (2018) Learning for computation offloading in mobile edge computing. IEEE Trans Commun 66(12):6353–6367

    Article  Google Scholar 

  15. You C, Huang K, Chae H, Kim BH (2016) Energy-efficient resource allocation for mobile-edge computation offloading. IEEE Trans Wirel Commun 16(3):1397–1411

    Article  Google Scholar 

  16. Burguera I, Zurutuza U, Nadjm-Tehrani S (2011) Crowdroid: behavior-based malware detection system for android. In: Proceedings of the 1st ACM workshop on Security and privacy in smartphones and mobile devices, pp 15–26

  17. You C, Huang K (2016) Multiuser resource allocation for mobile-edge computation offloading. In: 2016 IEEE global communications conference (GLOBECOM). IEEE, pp 1–6

  18. Ren J, Yu G, Cai Y, He Y (2018) Latency optimization for resource allocation in mobile-edge computation offloading. IEEE Trans Wirel Commun 17(8):5506–5519

    Article  Google Scholar 

  19. Abualigah L, Diabat A, Mirjalili S, Abd Elaziz M, Gandomi AH (2021) The arithmetic optimization algorithm. Comput Methods Appl Mech Eng 376:113609

    Article  MathSciNet  MATH  Google Scholar 

  20. Hashim FA, Hussain K, Houssein EH, Mabrouk MS, Al-Atabany W (2021) Archimedes optimization algorithm: a new metaheuristic algorithm for solving optimization problems. Appl Intell 51(3):1531–1551

    Article  MATH  Google Scholar 

  21. Zhan Y, Guo S, Li P, Zhang J (2020) A deep reinforcement learning based offloading game in edge computing. IEEE Trans Comput 69(6):883–893

    Article  MathSciNet  MATH  Google Scholar 

  22. Wang Z, Schaul T, Hessel M, Hasselt H, Lanctot M, Freitas N (2016) Dueling network architectures for deep reinforcement learning. In International conference on machine learning. PMLR, pp 1995–2003

  23. Sehgal A, La H, Louis S, Nguyen H (2019) Deep reinforcement learning using genetic algorithm for parameter optimization. In: 3rd IEEE international conference on robotic computing (IRC). IEEE, pp 596–601

  24. Buşoniu L, Babuška R, De Schutter B (2010) Multi-agent reinforcement learning: An overview. Innov Multi-agent Syst Appl 1:183–221

    Article  MathSciNet  Google Scholar 

  25. Zheng Z, Li M, Xiao X, Wang J (2013) Coordinated resource provisioning and maintenance scheduling in cloud data centers. In: Proceedings IEEE INFOCOM. IEEE, pp 345–349

  26. Sztrik J (2010) Queueing theory and its applications, a personal view. In: Proceedings of the 8th international conference on applied informatics, vol 1, pp 9–30

  27. Skarlat O, Schulte S, Borkowski M, Leitner P (2016) Resource provisioning for IoT services in the fog. In: IEEE 9th international conference on service-oriented computing and applications (SOCA). IEEE, pp 32–39

  28. Wang T, Luo H, Zeng X, Yu Z, Liu A, Sangaiah AK (2020) Mobility based trust evaluation for heterogeneous electric vehicles network in smart cities. IEEE Trans Intell Transp Syst 22(3):1797–1806

    Article  Google Scholar 

  29. Chen M, Wang T, Ota K, Dong M, Zhao M, Liu A (2020) Intelligent resource allocation management for vehicles network: An A3C learning approach. Comput Commun 151:485–494

    Article  Google Scholar 

  30. Zhang T, Chen W (2021) Computation offloading in heterogeneous mobile edge computing with energy harvesting. IEEE Trans Green Commun Netw 5(1):552–565

    Article  Google Scholar 

  31. Zhao T, Zhou S, Song L, Jiang Z, Guo X, Niu Z (2020) Energy-optimal and delay-bounded computation offloading in mobile edge computing with heterogeneous clouds. China Commun 17(5):191–210

    Article  Google Scholar 

  32. Saranya G, Sasikala E (2021) Offloading methodologies for energy consumption in mobile edge computing, 2021. In: 2nd International Conference on Smart Electronics and Communication (ICOSEC), pp 832–838

  33. Kumaran K, Sasikala E (2021) Learning based latency minimization techniques in mobile edge computing (MEC) systems: A Comprehensive Survey. In: 2021 International conference on system, computation, automation and networking (ICSCAN), pp 1–6

  34. Zhou S, Jadoon W, Shuja J (2021) Machine learning-based offloading strategy for lightweight user mobile edge computing tasks. Complexity

  35. Zhu X, Zhou M (2021) Multiobjective Optimized Cloudlet Deployment and Task Offloading for Mobile-Edge Computing. IEEE Internet Things J 8(20):15582–15595

    Article  Google Scholar 

  36. Manukumar ST, Muthuswamy V (2019) A novel multi-objective efficient offloading decision framework in cloud computing for mobile computing applications. Wireless Pers Commun 107(4):1625–1642

    Article  Google Scholar 

  37. Wu H (2018) Multi-objective decision-making for mobile cloud offloading: A survey. IEEE Access 6:3962–3976

    Article  Google Scholar 

  38. Sadatdiynov K, Cui L, Zhang L, Huang JZ, Salloum S, Mahmud MS (2022) A review of optimization methods for computation offloading in edge computing networks. Digit Commun Netw

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, SRM Institute of Science and Technology, Chennai, India

    G. Saranya

  2. Department of Data Science and Business System, SRM Institute of Science and Technology, Chennai, India

    E. Sasikala

Authors
  1. G. Saranya
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. Sasikala
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors agreed on the content of the study. G.S. and E.S. collected all the data for analysis G.S. and E.S. agreed on the methodology. G.S. and E.S. completed the analysis based on agreed steps. Results and conclusions are discussed and written together. The author read and approved the final manuscript.

Corresponding author

Correspondence to G. Saranya.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human or animal subjects performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saranya, G., Sasikala, E. An efficient computational offloading framework using HAA optimization-based deep reinforcement learning in edge-based cloud computing architecture. Knowl Inf Syst 65, 409–433 (2023). https://doi.org/10.1007/s10115-022-01746-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-022-01746-w

Keywords

Search

Navigation