Abstract
In this paper, a resource allocation algorithm based on deep reinforcement learning (DRL) is proposed to solve the problem of co-existing enhanced mobile broadband (eMBB) slices and ultrareliable low latency communication (URLLC) slices based on Non-orthogonal Multiple Access (NOMA) in downlink network scenarios. Double Deep Q network (DDQN) is designed to output subcarrier and power allocation simultaneously. In addition, expert data is added in the training process to accelerate network convergence, and our goal is to optimize the spectral efficiency of the system. Simulation results show that compared with the baseline based on heuristic joint user pairing and power allocation algorithm [1] and Orthogonal Multiple Access (OMA), proposed algorithm can achieve higher spectral efficiency and ensure isolation between slices.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bao, J., Zheng, W.J., Shao, W., Ma, T., Qie, W., Zhang, Y.: Joint user pairing and power allocation in multi-slicing NOMA system. J. China Univ. Posts Telecommun. 28(3), 28–35 (2021)
Xu, Y., Gu, X.: Resource allocation for NOMA-based V2V system. In: 2018 International Conference on Network Infrastructure and Digital Content (IC-NIDC) (2018)
Sinaie, M., Ng, D.W.K., Jorswieck, E.A.: Resource allocation in NOMA virtualized wireless networks under statistical delay constraints. Wirel. Commun. Lett. IEEE 7(6), 954–957 (2018)
Jang, G., Lee, C., Kim, N., Kang, W., Cho, S.: Throughput maximization for uplink IoT NOMA systems with efficient resource allocation. In: 2020 International Conference on Information and Communication Technology Convergence (ICTC) (2020)
Sun, G., Zemuy, G.T., Xiong, K.: Dynamic reservation and deep reinforcement learning based autonomous resource management for wireless virtual networks. In: 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC) (2019)
Zhang, Y., Kang, C., Teng, Y., Li, S., Zheng, W., Fang, J.: Deep reinforcement learning framework for joint resource allocation in heterogeneous networks. In: 2019 IEEE 90th Vehicular Technology Conference (VTC2019-Fall) (2019)
Wang, C.L., Hung, C.W.: Proportional-fairness resource allocation for a downlink multicarrier NOMA system. In: 2020 14th International Conference on Signal Processing and Communication Systems (ICSPCS) (2020)
Wen, X., Zhang, H., Zhang, H., Fang, F.: Interference pricing resource allocation and user-subchannel matching for NOMA hierarchy fog networks. IEEE J. Sel. Top. Sign. Proces. 13(3), 467–479 (2019)
Wei, Y., Yu, F. R., Mei, S., Zhu, H.: User scheduling and resource allocation in HetNets with hybrid energy supply: An actor-critic reinforcement learning approach. IEEE Trans. Wirel. Commun. (2017)
Acknowledgment
This work was supported by Headquarters Science and Technology Project of State Grid Corporation of China: Research and Application of Optimized Evolution Technology of Wireless Private Network for Multi-service Ubiquitous Access (Grant No. 5700-202019174A-0-0-00).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, Z., Zheng, W., Shao, W., Zhang, Y., Guo, D. (2022). Resource Allocation for Multi-service NOMA System Based on Deep Reinforcement Learning. In: Zu, Q., Tang, Y., Mladenovic, V., Naseer, A., Wan, J. (eds) Human Centered Computing. HCC 2021. Lecture Notes in Computer Science, vol 13795. Springer, Cham. https://doi.org/10.1007/978-3-031-23741-6_20
Download citation
DOI: https://doi.org/10.1007/978-3-031-23741-6_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23740-9
Online ISBN: 978-3-031-23741-6
eBook Packages: Computer ScienceComputer Science (R0)