Abstract
Edge computing is an emerging promising computing paradigm that brings computation and storage resources to the network edge, significantly reducing service latency. In this paper, we aim to divide the task into several sub-tasks through its inherent interrelation, guided by the idea of high concurrency for synchronization, and then offload sub-tasks to other edge servers so that they can be processed to minimize the cost. Furthermore, we propose a DRL-based Multi-Task Dependency Offloading Algorithm (MTDOA) to solve challenges caused by dependencies between sub-tasks and dynamic working scenes. Firstly, we model the Markov decision process as the task offloading decision. Then, we use the graph attention network to extract the dependency information of different tasks and combine Long Short-term Memory (LSTM) with Deep Q Network (DQN) to deal with time-dependent problems. Finally, simulation experiments demonstrate that the proposed algorithm boasts good convergence ability and is superior to several other baseline algorithms, proving this algorithm’s effectiveness and reliability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bonomi, F., Milito, R., Zhu, J., Addepalli, S.: Fog computing and its role in the internet of things. In: Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, pp. 13–16 (2012)
Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Internet Things J. 3(5), 637–646 (2016)
Ullman, J.D.: NP-complete scheduling problems. J. Comput. Syst. Sci. 10(3), 384–393 (1975)
Liu, Y., et al.: Dependency-aware task scheduling in vehicular edge computing. IEEE Internet Things J. 7(6), 4961–4971 (2020)
Lin, L., Liao, X., Jin, H., Li, P.: Computation offloading toward edge computing. Proc. IEEE 107(8), 1584–1607 (2019)
Yan, J., Bi, S., Zhang, Y.J.A.: Offloading and resource allocation with general task graph in mobile edge computing: a deep reinforcement learning approach. IEEE Trans. Wireless Commun. 19(8), 5404–5419 (2020)
Li, Y.: Deep reinforcement learning: an overview. arXiv preprint arXiv:1701.07274 (2017)
Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Trans. Neural Networks 20(1), 61–80 (2008)
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. arXiv preprint arXiv:1710.10903 (2017)
Qiao, G., Leng, S., Maharjan, S., Zhang, Y., Ansari, N.: Deep reinforcement learning for cooperative content caching in vehicular edge computing and networks. IEEE Internet Things J. 7(1), 247–257 (2019)
He, Y., Zhao, N., Yin, H.: Integrated networking, caching, and computing for connected vehicles: a deep reinforcement learning approach. IEEE Trans. Veh. Technol. 67(1), 44–55 (2017)
Yu, B., Pu, L., Xie, Y., Jian, Z.: Joint task offloading and base station association in mobile edge computing. J. Comput. Res. Dev 55, 537–550 (2018)
Wang, C., Yu, F.R., Liang, C., Chen, Q., Tang, L.: Joint computation offloading and interference management in wireless cellular networks with mobile edge computing. IEEE Trans. Veh. Technol. 66(8), 7432–7445 (2017)
Xu, J., Chen, L., Zhou, P.: Joint service caching and task offloading for mobile edge computing in dense networks. In: IEEE INFOCOM 2018-IEEE Conference on Computer Communications, pp. 207–215. IEEE (2018)
Dai, Y., Xu, D., Zhang, K., Maharjan, S., Zhang, Y.: Deep reinforcement learning and permissioned blockchain for content caching in vehicular edge computing and networks. IEEE Trans. Veh. Technol. 69(4), 4312–4324 (2020)
Lin, X., Wang, Y., Xie, Q., Pedram, M.: Task scheduling with dynamic voltage and frequency scaling for energy minimization in the mobile cloud computing environment. IEEE Trans. Serv. Comput. 8(2), 175–186 (2014)
Neto, J.L.D., Yu, S.Y., Macedo, D.F., Nogueira, J.M.S., Langar, R., Secci, S.: ULOOF: a user level online offloading framework for mobile edge computing. IEEE Trans. Mob. Comput. 17(11), 2660–2674 (2018)
Yan, J., Bi, S., Zhang, Y.J., Tao, M.: Optimal task offloading and resource allocation in mobile-edge computing with inter-user task dependency. IEEE Trans. Wireless Commun. 19(1), 235–250 (2019)
Chen, W., Wang, D., Li, K.: Multi-user multi-task computation offloading in green mobile edge cloud computing. IEEE Trans. Serv. Comput. 12(5), 726–738 (2018)
Acknowledgements
This work is supported in part by the Science Foundation of Fujian Province of China under Grand No. 2019J01245, and the National Natural Science Foundation of China under Grand No. 83419114.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lin, T., Lin, CK., Chen, Z., Cheng, H. (2022). Computation Offloading Algorithm Based on Deep Reinforcement Learning and Multi-Task Dependency for Edge Computing. In: Hsieh, SY., Hung, LJ., Klasing, R., Lee, CW., Peng, SL. (eds) New Trends in Computer Technologies and Applications. ICS 2022. Communications in Computer and Information Science, vol 1723. Springer, Singapore. https://doi.org/10.1007/978-981-19-9582-8_10
Download citation
DOI: https://doi.org/10.1007/978-981-19-9582-8_10
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-9581-1
Online ISBN: 978-981-19-9582-8
eBook Packages: Computer ScienceComputer Science (R0)