Skip to main content

Advertisement

SpringerLink
Log in

Deep Reinforcement Learning Aided Cell Outage Compensation Framework in 5G Cloud Radio Access Networks

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

As one of the key technologies of 5G, Cloud Radio Access Networks (C-RAN) with cloud BBUs (Base Band Units) pool architecture and distributed RRHs (Remote Radio Heads) can provide the ubiquitous services. When failure occurs at RRH, it can’t be alleviated in time and will lead to a significant drop in network performance. Therefore, the cell outage compensation (COC) problem for RRH in 5G C-RAN is very important. Although deep reinforcement learning (DRL) has been applied to many scenarios related to the self-organizing network (SON), there are fewer applications for cell outage compensation. And most intelligent algorithms are hard to obtain globally optimized solutions. In this paper, aiming at the cell outage scenario in C-RAN with the goal of maximizing the energy efficiency, connectivity of RRH while meeting service quality demands of each compensation user, a framework based on DRL is presented to solve it. Firstly, compensation users are allocated to adjacent RRHs by using the K-means clustering algorithm. Secondly, DQN is used to find the antenna downtilt and the power allocated to compensation users. Comparing to different genetic algorithms, simulation result shows that the proposed framework converges quickly and tends to be stable, and reaches 95% of the maximum target value. It verifies the efficiency of the DRL-based framework and its effectiveness in meeting user requirements and handling cell outage compensation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Sun S, Kadoch M, Gong L, Rong B (2015) Integrating network function virtualization with SDR and SDN for 4G/5G networks. IEEE Network 29(3):54–59

    Article  Google Scholar 

  2. Peng M, Li Y, Zhao Z, Wang C (2015) System architecture and key technologies for 5G heterogeneous cloud radio access networks. IEEE Network 29(2):6–14

    Article  Google Scholar 

  3. Peng M, Sun Y, Li X, et al. (2016) "Recent advances in cloud radio access networks: system architectures, key techniques, and open issues," IEEE Communications Surveys & Tutorials 18(3):2282–2308

  4. Ahmad A, Farooq H, Imran A (2018) "Self-healing in emerging cellular networks: review, challenges, and research directions," IEEE Communications Surveys & Tutorials 20(3):1682–1709

    Article  Google Scholar 

  5. 3GPP Standard TS 32.551. Telecommunication management; Self-Organizing Networks (SON); concepts and requirements. Release 13, 2016

  6. Samdanis K, Taleb T, Kutscher D et al. (2012) Self organized network management functions for energy efficient cellular urban infrastructures, Mobile Network and Applications 17(1):119–131

  7. Aliu OG, Imran A, Imran MA, Evans B (2013) A survey of self organisation in future cellular networks. IEEE Communications Surveys & Tutorials 15(1):336–361

  8. Selim M, Kamal AE, Elsayed K, Abdel-Atty HM, Alnuem M (2016) Fronthaul cell outage compensation for 5G networks. IEEE Communications Magazine 54(8):169–175

  9. Ayoubi S, Limam N, Salahuddin MA, Shahriar N, Boutaba R, Estrada-Solano F, Caicedo OM (2018) Machine learning for cognitive network management. IEEE Communication Magazine 56(1):158–165

  10. Sun S, Kadoch M, Ran T (2015) Adaptive SON and cognitive smart LPN for 5G heterogeneous networks. Mobile Network and Applications 20(6):745–755

    Article  Google Scholar 

  11. Mwanje SS, Schmelz LC, Mitschele-Thiel A (2016) Cognitive cellular networks: a Q-Learning framework for self-organizing networks. IEEE Transactions on Network and Service Management 13(1):85–98

    Article  Google Scholar 

  12. Iacoboaiea O, Sayrac B, Ben Jemaa S, Bianchi P (2016) SON coordination in heterogeneous networks: a reinforcement learning framework. IEEE Transactions on Wireless Communications 15(9):5835–5847

  13. J. Moysen and L. Giupponi, "A Reinforcement Learning Based Solution for Self-Healing in LTE Networks," in 2014 IEEE 80th vehicular technology conference (VTC2014-fall), Vancouver, BC, 2014, pp. 1–6

  14. Mao Q, Hu F, Hao Q (2018) Deep learning for intelligent wireless networks: a comprehensive survey. IEEE Communications Surveys & Tutorials 20(4):2595–2621

    Article  Google Scholar 

  15. Fernández Maimó L, Perales Gómez ÁL, García Clemente FJ, Gil Pérez M, Martínez Pérez G (2018) A self-adaptive deep learning-based system for anomaly detection in 5G networks. IEEE Access (6):7700–7712

  16. de la Bandera I, Munoz P, Serrano I, Barco R (2018) Adaptive cell outage compensation in self-organizing networks. IEEE Transactions on Vehicular Technology 67(6):5231–5244

    Article  Google Scholar 

  17. Wang W, Zhang Q (2014) Local cooperation architecture for self-healing femtocell networks. IEEE Wireless Communications 21(2):42–49

  18. Fan S, Tian H (2015) Cooperative resource allocation for self-healing in small cell networks, IEEE Communication Letters 19(7):1221–1224

    Article  Google Scholar 

  19. M. Amirijoo, L. Jorguseski, R. Litjens, and R. Nascimento, “Effectiveness of cell outage compensation in LTE networks,” in 2011 IEEE Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA, 2011, pp. 642–647

  20. Li W, Yu P, Yin M, Meng L (2014) A distributed cell outage compensation mechanism based on RS power adjustment in LTE networks. China Communications 11(13):40–47

  21. Yin M, Li W, Feng L, Yu P, Qiu X (2017) Multi-cell cooperative outage compensation in cloud-RANs based 5G public safety network. IEEE Access (5):17309–17321

  22. Cao G, Lu Z, Wen X, Lei T, Hu Z (2018) "AIF: an artificial intelligence framework for smart wireless network management," in IEEE Communication Letter 22(2):400–403

    Article  Google Scholar 

  23. X. Wang, X. Li, V C M Leung (2015) "Artificial intelligence-based techniques for emerging heterogeneous network: state of the arts, opportunities, and challenges," in IEEE Access (3):1379–1391

  24. Klaine PV, Imran MA, Onireti O, Souza RD (2017) A survey of machine learning techniques applied to self-organizing cellular networks. in IEEE Communications Surveys & Tutorials 19(4):2392–2431

    Article  Google Scholar 

  25. Wang J, Phan NQ, Pan Z, Nan L, You X et al (2016) "An improved TCM-based approach for cell outage detection for self-healing in LTE HetNets," in 2016 IEEE 83rd vehicular technology conference (VTC spring). Nanjing, China, pp 1–5

    Google Scholar 

  26. Y. Wang, P. Long, N. Liu, Z. Pan and X. You (2018) "A Cooperative Outage Detection Approach Using an Improved RBF Neural Network with Genetic ABC Algorithm," 10th international conference on wireless communications and signal processing (WCSP). Hangzhou 2018:1–6

  27. Alias M, Saxena N, Roy A (2016) Efficient Cell Outage Detection in 5G HetNets Using Hidden Markov Model. IEEE Communication Letter 20(3):562–565

  28. Palacios D, Fortes S, de-la-Bandera I, Barco R (2018) Self-healing framework for next-generation networks through dimensionality reduction. IEEE Communication Magazine 56(7):170–176

    Article  Google Scholar 

  29. Z. Xu, Y. Wang, J. Tang, J. Wang and M. C. Gursoy (2017) "A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs," in IEEE International Conference on Communications (ICC), Paris, 2017, pp. 1–6

  30. Liu J, Krishnamachari B, Zhou S, Niu Z (2018) DeepNap: data-driven base station sleeping operations through deep reinforcement learning. in IEEE Internet of Things Journal 5(6):4273–4282

    Article  Google Scholar 

  31. Han S, Huang Y, Meng W, Li C, Xu N, Chen D (2019) Optimal power allocation for SCMA downlink systems based on maximum capacity. inIEEE Transactions on Communications 67(2):1480–1489

  32. Li W, Yu P, Yin M, Feng L et al (2016) "Automated cell outage compensation mechanism based on downtilt adjustments in cellular networks," 16th international symposium on communications and information technologies (ISCIT). Qingdao, China, pp 1–6

    Google Scholar 

  33. Lee W, Schober R (2016) "Analysis of coverage in heterogeneous cellular networks," in IEEE Commun Lett 20(6):1211–1214

    Article  Google Scholar 

  34. P. Savazzi and L. Favalli (2007) "Dynamic cell sectorization using clustering algorithms," in IEEE 65th vehicular technology conference - VTC2007-spring. Dublin 2007:604–608

  35. JinHuaXu and HongLiu (2010) "Web user clustering analysis based on KMeans algorithm," International Conference on Information, Networking and Automation (ICINA), Kunming, 2010, pp. V2–6-V2–9

  36. Han S, Xu S, Meng W, Li C (2018) Dense-device-enabled cooperative networks for efficient and secure transmission. in IEEE Network 32(2):100–106

    Article  Google Scholar 

  37. Xiao Z, Xia P, Xia X (2016) "Enabling UAV cellular with millimeter-wave communication: potentials and approaches," in. IEEE Communication Magazine 54(5):66–73

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No. 61901054).

Author information

Authors and Affiliations

  1. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, 100876, China

    Peng Yu, Xiao Yang, Fanqin Zhou, Hao Li, Lei Feng, Wenjing Li & Xuesong Qiu

Authors
  1. Peng Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiao Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fanqin Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lei Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wenjing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xuesong Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peng Yu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, P., Yang, X., Zhou, F. et al. Deep Reinforcement Learning Aided Cell Outage Compensation Framework in 5G Cloud Radio Access Networks. Mobile Netw Appl 25, 1644–1654 (2020). https://doi.org/10.1007/s11036-020-01574-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-020-01574-8

Keywords

Search

Navigation