Abstract
The limited resources of mobile devices (MDs) pose an emerging requirement, resulting in its essential to reducing task processing latency and energy consumption on MDs with efficient task offloading and scheduling strategies. In this paper, we aim to minimize the weighted sum of the task processing time and energy consumption of MDs in end-edge-cloud orchestrated computing (EECOC). To solve the non-convex problem caused by joint optimization and multiple constraints, a task offloading and resource allocation method based on deep reinforcement learning (DRL) is proposed. The proposed algorithm adopts a hierarchical structure, where the upper layer employs game theory to determine task offloading strategies through a competitive game among MDs. The lower layer leverages the proximal policy optimization (PPO) approach to optimize the channel bandwidth and computation capability problem of servers. We conducted multiple experiments in diverse EECOC scenarios to evaluate the performance of our proposed approach. Experimental results demonstrate that the proposed method outperforms traditional offloading algorithms and effectively reduces the task processing time and energy consumption of MDs.
This work is supported by Heilongjiang Provincial Science and Technology Program (No. 2022ZX01A16) and Sichuan Science and Technology Program (No. 2022ZHCG0001).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Sarawi, S., Anbar, M., Abdullah, R., Al Hawari, A.B.: Internet of things market analysis forecasts, 2020–2030. In: 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), pp. 449–453. IEEE (2020)
Aceto, L., Morichetta, A., Tiezzi, F.: Decision support for mobile cloud computing applications via model checking. In: 2015 3rd IEEE International Conference on Mobile Cloud Computing, Services, and Engineering, pp. 199–204. IEEE (2015)
Erol-Kantarci, M., Sukhmani, S.: Caching and computing at the edge for mobile augmented reality and virtual reality (AR/VR) IN 5G. In: Zhou, Y., Kunz, T. (eds.) Ad Hoc Networks. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 223, pp. 169–177. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-74439-1_15
Sun, X., Ansari, N.: Latency aware workload offloading in the cloudlet network. IEEE Commun. Lett. 21(7), 1481–1484 (2017)
Ren, J., Zhang, D., He, S., Zhang, Y., Li, T.: A survey on end-edge-cloud orchestrated network computing paradigms: transparent computing, mobile edge computing, fog computing, and cloudlet. ACM Comput. Surv. (CSUR) 52(6), 1–36 (2019)
Liang, J., Li, K., Liu, C., Li, K.: Joint offloading and scheduling decisions for DAG applications in mobile edge computing. Neurocomputing 424, 160–171 (2021)
Wang, H., et al.: Architectural design alternatives based on cloud/edge/fog computing for connected vehicles. IEEE Commun. Surv. Tutorials 22(4), 2349–2377 (2020)
Hong, Z., Chen, W., Huang, H., Guo, S., Zheng, Z.: Multi-hop cooperative computation offloading for industrial IoT-edge-cloud computing environments. IEEE Trans. Parallel Distrib. Syst. 30(12), 2759–2774 (2019)
Qu, G., Wu, H., Li, R., Jiao, P.: DMRO: a deep meta reinforcement learning-based task offloading framework for edge-cloud computing. IEEE Trans. Netw. Serv. Manage. 18(3), 3448–3459 (2021)
Ding, Y., Li, K., Liu, C., Li, K.: A potential game theoretic approach to computation offloading strategy optimization in end-edge-cloud computing. IEEE Trans. Parallel Distrib. Syst. 33(6), 1503–1519 (2021)
Zhou, W., Lin, C., Duan, J., Ren, K., Zhang, X., Dou, W.: An optimized greedy-based task offloading method for mobile edge computing. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds.) Algorithms and Architectures for Parallel Processing. Lecture Notes in Computer Science(), vol. 13155, pp. 494–508. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-95384-3_31
Peng, K., Huang, H., Wan, S., Leung, V.C.: End-edge-cloud collaborative computation offloading for multiple mobile users in heterogeneous edge-server environment. Wireless Netw., 1–12 (2020)
Li, Y., Qi, F., Wang, Z., Yu, X., Shao, S.: Distributed edge computing offloading algorithm based on deep reinforcement learning. IEEE Access 8, 85204–85215 (2020)
Yang, L., Zhang, H., Li, X., Ji, H., Leung, V.C.: A distributed computation offloading strategy in small-cell networks integrated with mobile edge computing. IEEE/ACM Trans. Networking 26(6), 2762–2773 (2018)
Zhang, W., Wen, Y., Guan, K., Kilper, D., Luo, H., Wu, D.O.: Energy-optimal mobile cloud computing under stochastic wireless channel. IEEE Trans. Wireless Commun. 12(9), 4569–4581 (2013)
Wei, F., Chen, S., Zou, W.: A greedy algorithm for task offloading in mobile edge computing system. China Commun. 15(11), 149–157 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Peng, B., Peng, S.L., Li, Q., Chen, C., Zhou, Y.Z., Lei, X. (2024). A Task Offloading and Resource Allocation Optimization Method in End-Edge-Cloud Orchestrated Computing. In: Tari, Z., Li, K., Wu, H. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2023. Lecture Notes in Computer Science, vol 14492. Springer, Singapore. https://doi.org/10.1007/978-981-97-0811-6_18
Download citation
DOI: https://doi.org/10.1007/978-981-97-0811-6_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-0810-9
Online ISBN: 978-981-97-0811-6
eBook Packages: Computer ScienceComputer Science (R0)