Na Lin
ABSTRACT
Device-to-device (D2D) content caching is a promising technology to mitigate the backhaul pressure, and reduce the contents transmission delay. In this paper, to improve the content hit rate (CHR) and the utilization efficiency of the limited caching capacity, we put forward a caching content placement strategy by predicting the user preference and the content popularity, where unmanned aerial vehicles (UAVs) are introduced into the D2D networks to provide computation offloading services to the users. A <u>d</u>ynamic <u>r</u>esource <u>a</u>llocation <u>o</u>ptimization <u>a</u>lgorithm (DRAOA) is proposed to deploy UAVs and plan UAVs trajectory adaptively according to the users' task requirements. Simulation results show that the proposed caching content placement policy outperforms the existing baselines. Additionally, the DRAOA can effectively improve the network capacity and mitigate the computation delay compared to the other two DRL algorithms.
- Akram Al-Hourani, Sithamparanathan Kandeepan, and Simon Lardner. 2014. Optimal LAP Altitude for Maximum Coverage. IEEE Wireless Communications Letters 3, 6 (2014), 569--572. Google Scholar
Cross Ref
- Tong Bai, Jingjing Wang, Yong Ren, and Lajos Hanzo. 2019. Energy-Efficient Computation Offloading for Secure UAV-Edge-Computing Systems. IEEE Transactions on Vehicular Technology 68, 6 (2019), 6074--6087. Google ScholarCross Ref
- Petros S. Bithas, Viktor Nikolaidis, Athanasios G. Kanatas, and George K. Karagiannidis. 2020. UAV-to-Ground Communications: Channel Modeling and UAV Selection. IEEE Transactions on Communications 68, 8 (2020), 5135--5144. Google ScholarCross Ref
- Mingjie Feng and Marwan Krunz. 2021. Program Placement Optimization for Storage-constrained Mobile Edge Computing Systems: A Multi-armed Bandit Approach. In 2021 IEEE 22nd International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM). 149--158. Google ScholarCross Ref
- Amal Feriani and Ekram Hossain. 2021. Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial. IEEE Communications Surveys Tutorials 23, 2 (2021), 1226--1252. Google ScholarCross Ref
- Lav Gupta, Raj Jain, and Gabor Vaszkun. 2016. Survey of Important Issues in UAV Communication Networks. IEEE Communications Surveys Tutorials 18, 2 (2016), 1123--1152. Google ScholarDigital Library
- Jiequ Ji, Kun Zhu, Dusit Niyato, and Ran Wang. 2020. Joint Cache Placement, Flight Trajectory, and Transmission Power Optimization for Multi-UAV Assisted Wireless Networks. IEEE Transactions on Wireless Communications 19, 8 (2020), 5389--5403. Google ScholarCross Ref
- Jiequ Ji, Kun Zhu, Dusit Niyato, and Ran Wang. 2021. Joint Trajectory Design and Resource Allocation for Secure Transmission in Cache-Enabled UAV-Relaying Networks With D2D Communications. IEEE Internet of Things Journal 8, 3 (2021), 1557--1571. Google ScholarCross Ref
- Jiequ Ji, Kun Zhu, Changyan Yi, and Dusit Niyato. 2021. Energy Consumption Minimization in UAV-Assisted Mobile-Edge Computing Systems: Joint Resource Allocation and Trajectory Design. IEEE Internet of Things Journal 8, 10 (2021), 8570--8584. Google ScholarCross Ref
- Wei Jiang, Bin Han, Mohammad Asif Habibi, and Hans Dieter Schotten. 2021. The Road Towards 6G: A Comprehensive Survey. IEEE Open Journal of the Communications Society 2 (2021), 334--366. Google ScholarCross Ref
- Yanxiang Jiang, Miaoli Ma, Mehdi Bennis, Fu-Chun Zheng, and Xiaohu You. 2019. User Preference Learning-Based Edge Caching for Fog Radio Access Network. IEEE Transactions on Communications 67, 2 (2019), 1268--1283. Google ScholarCross Ref
- Wei-Kuang Lai, You-Chiun Wang, He-Cian Lin, and Jian-Wen Li. 2020. Efficient Resource Allocation and Power Control for LTE-A D2D Communication With Pure D2D Model. IEEE Transactions on Vehicular Technology 69, 3 (2020), 3202--3216. Google ScholarCross Ref
- Xujie Li, Jichang Shen, Ying Sun, Ziya Wang, and Xuedong Zheng. 2020. A Smart Content Caching and Replacement Scheme for UAV-Assisted Fog Computing Network. In 2020 International Conference on Wireless Communications and Signal Processing (WCSP). 1040--1045. Google ScholarCross Ref
- Junyan Liu, Dapeng Li, and Youyun Xu. 2020. Collaborative Online Edge Caching With Bayesian Clustering in Wireless Networks. IEEE Internet of Things Journal 7, 2 (2020), 1548--1560. Google ScholarCross Ref
- Paolo Di Lorenzo and Gesualdo Scutari. 2016. NEXT: In-Network Nonconvex Optimization. IEEE Transactions on Signal and Information Processing over Networks 2, 2 (2016), 120--136. Google ScholarCross Ref
- Volodymyr Mnih, Adria Puigdomenech Badia, Mehdi Mirza, Alex Graves, Timothy Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu. 2016. Asynchronous methods for deep reinforcement learning. In International conference on machine learning. PMLR, 1928--1937.Google Scholar
- Jieying Ren and Shaoyi Xu. 2021. DDPG Based Computation Offloading and Resource Allocation for MEC Systems with Energy Harvesting. In 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring). 1--5. Google ScholarCross Ref
- Yuris Mulya Saputra, Dinh Thai Hoang, Diep N. Nguyen, and Eryk Dutkiewicz. 2021. A Novel Mobile Edge Network Architecture with Joint Caching-Delivering and Horizontal Cooperation. IEEE Transactions on Mobile Computing 20, 1 (2021), 19--31. Google ScholarDigital Library
- Shreshth Tuli, Shashikant Ilager, Kotagiri Ramamohanarao, and Rajkumar Buyya. 2022. Dynamic Scheduling for Stochastic Edge-Cloud Computing Environments Using A3C Learning and Residual Recurrent Neural Networks. IEEE Transactions on Mobile Computing 21, 3 (2022), 940--954. Google ScholarCross Ref
- Duc Van Le and Chen-Khong Tham. 2018. A deep reinforcement learning based offloading scheme in ad-hoc mobile clouds. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 760--765. Google ScholarCross Ref
- Dianhan Xie, Jiawei Zhang, Aimin Tang, and Xudong Wang. 2020. Multi-Dimensional Busy-Tone Arbitration for OFDMA Random Access in IEEE 802.11ax. IEEE Transactions on Wireless Communications 19, 6 (2020), 4080--4094. Google ScholarCross Ref
- Yong Zeng, Rui Zhang, and Teng Joon Lim. 2016. Wireless Communications with Unmanned Aerial Vehicles: Opportunities and Challenges. IEEE Communications Magazine 54, 5 (2016), 36--42. Google ScholarDigital Library
- Shangwei Zhang, Jiajia Liu, Hongzhi Guo, Mingping Qi, and Nei Kato. 2020. Envisioning Device-to-Device Communications in 6G. IEEE Network 34, 3 (2020), 86--91. Google ScholarCross Ref
- Xijian Zhong, Yan Guo, Ning Li, and Yancheng Chen. 2020. Joint Optimization of Relay Deployment, Channel Allocation, and Relay Assignment for UAVs-Aided D2D Networks. IEEE/ACM Transactions on Networking 28, 2 (2020), 804--817. Google ScholarDigital Library
Index Terms
- Deep reinforcement learning empowered multiple UAVs-assisted caching and offloading optimization in D2D wireless networks
Recommendations
Adaptive reservation-assisted collision resolution protocol for wireless local area networks
WCNC'09: Proceedings of the 2009 IEEE conference on Wireless Communications & Networking ConferenceIn conventional IEEE 802.11 medium access control protocol, the distributed coordination function is designed for the wireless stations (WSs) to perform channel contention within the wireless local area networks (WLANs). Packet collision is considered ...
Joint Downlink and Uplink Edge Computing Offloading in Ultra-Dense HetNets
AbstractThe deployment of ultra-dense heterogeneous networks (HetNets) are envisioned as the essentials to embrace of intelligent applications for the next-generation wireless networks. For ultra-dense HetNets, the small scale heterogeneous edge servers ...
Energy Efficient D2D-Assisted Offloading with Wireless Power Transfer
GLOBECOM 2017 - 2017 IEEE Global Communications ConferenceTraffic offloading via device-to-device (D2D) communications has been proposed to improve the network capacity and alleviate the increasing traffic burden on cellular base stations (BSs). However, the success of D2D communications largely relies on the ...
Comments