Abstract
Mobile edge computing (MEC) is a new technology for reducing the network delay in dealing with computing tasks. Considering unmanned aerial vehicle (UAV) with advantage of strong mobility and reliability, a UAV-assisted MEC system is always adopted and researched to provide computing service in wide-range areas. However, since the problems of task allocation are highly nonconvex, it is difficult to reach the optimal solution. In this paper, deep reinforcement learning is used for solving the problem of task allocation in the UAV-assisted MEC system. With the modeling of the UAV-assisted MEC system, the problems of task allocation are formulated. The Markov Decision Process (MDP) is developed for the nonconvexity during solving the task allocation problem. Since the MDP has continuous action space, a dual-delay depth deterministic strategy gradient algorithm is suggested for obtaining the joint optimal strategy of task allocation. Experiment results show better performance of the proposed method compared with other optimization approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shahidinejad, A., Farahbakhsh, F., Ghobaei-Arani, M., et al.: Context-aware multi-user offloading in mobile edge computing: a federated learning-based approach. J. Grid Comput. 19(2), 1570–7873 (2021). https://doi.org/10.1007/s10723-021-09559-x
Pan, Y., Da, X., Hu, H., et al.: Efficient design optimisation for UAV-enabled mobile edge computing in cognitive radio networks. IET Commun. 14(15), 2509–2515 (2020)
Pfeifer, C., Rümmler, M.C., Mustafa, O.: Assessing colonies of Antarctic shags by unmanned aerial vehicle (UAV) at South Shetland Islands, Antarctica. Antarct. Sci. 33, 1–17 (2021)
Wang, Y., Ru, Z.Y., Wang, K., et al.: Joint deployment and task scheduling optimization for large-scale mobile users in multi-UAV-enabled mobile edge computing. IEEE Trans. Cybern. 50(9), 3984–3997 (2020)
Elgendy, I.A., Zhang, W.Z., He, H., et al.: Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms. Wireless Netw. 27(3), 2023–2038 (2021)
He, Y., Zhai, D., Huang, F., et al.L Joint task offloading, resource allocation, and security assurance for mobile edge computing-enabled UAV-assisted VANETs. Remote Sens. 13(8), 1547 (2021)
Wang, G., Yu, X., Xu, F., et al.: Task offloading and resource allocation for UAV-assisted mobile edge computing with imperfect channel estimation over Rician fading channels. EURASIP J. Wireless Commun. Netw. 2020(1), 169 (2020)
Zhong, S., Tan, J., Dong, H., et al.: Modeling-learning-based actor-critic algorithm with gaussian process approximator. J. Grid Comput. 18(2), 181–195 (2020)
Liu, M., Li, J., Hu, Z., et al.: A dynamic bidding strategy based on model-free reinforcement learning in display advertising. IEEE Access 8, 213587–213601 (2020)
Fujimoto, S., Hoof, H., Meger, D.: Addressing function approximation error in actor-critic methods. In: International Conference on Machine Learning, PMLR, pp. 1587–1596 (2018)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, C., Du, W., Ren, F., Zhao, N. (2022). Deep Reinforcement Learning for Task Allocation in UAV-enabled Mobile Edge Computing. In: Barolli, L., Chen, HC., Miwa, H. (eds) Advances in Intelligent Networking and Collaborative Systems. INCoS 2021. Lecture Notes in Networks and Systems, vol 312. Springer, Cham. https://doi.org/10.1007/978-3-030-84910-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-84910-8_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-84909-2
Online ISBN: 978-3-030-84910-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)