skip to main content
10.1145/3570361.3613276acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

Enabling Resilience in Virtualized RANs with Atlas

Published:02 October 2023Publication History

ABSTRACT

Virtualized radio access networks (vRANs), which allow running RAN processing on commodity servers instead of proprietary hardware, are gaining adoption in cellular networks. Two properties of the vRAN's "Distributed Unit (DU)" that implements the lower RAN layers---its real-time deadlines and its black-box nature---make it challenging to provide resilience features such as upgrades and failover without long service disruptions. These properties preclude the use of existing resilience techniques like virtual machine migration or state replication that are used for typical workloads. This paper presents Atlas, the first system that provides resilience for the DU. The central insight in Atlas is to repurpose existing cellular mechanisms for wireless resilience, namely handovers and cell reselection, to provide software resilience for the DU. For planned resilience events like upgrades, we design a novel technique that simultaneously serves cells from both the old and new DUs via the same radio, and uses handovers between these cells to migrate user devices. For unplanned failures, we identify deficiencies in existing RAN protocols that disrupt cell reselection after DU failure, and show how we can eliminate these disruptions using a middlebox between the DU and higher layers. Our evaluation with a state-of-the-art 5G vRAN testbed shows that Atlas achieves minimal disruption to cellular connectivity during resilience events, while incurring low overhead.

References

  1. 2020. 5G Network Resource Model (NRM) (3GPP TS 28.541 version 16.6.0 Release 16). https://www.etsi.org/deliver/etsits/128500128599/128541/16.06.0060/ts128541v160600p.pdf.Google ScholarGoogle Scholar
  2. 2020. F1 Application Protocol (F1AP) (3GPP TS 38.473 version 15.8.0 Release 15). https://www.etsi.org/deliver/etsits/138400138499/138473/15.08.0060/ts138473v150800p.pdf.Google ScholarGoogle Scholar
  3. 2022. The Journey to a Cloud-Native, Fully Software-Defined vRAN Architecture. https://www.vodafone.com/sites/default/files/2022-12/journey-to-cloud-native-fully-software-defined-vran-architecture.pdf.Google ScholarGoogle Scholar
  4. 2023. OpenAirInterface. https://gitlab.eurecom.fr/oai/openairinterface5g.Google ScholarGoogle Scholar
  5. 3GPP. 2018. Procedures for the 5G System (3GPP TS 23.502 version 15.2.0 Release 15). https://www.etsi.org/deliver/etsits/123500123599/123502/15.02.0060/ts123502v150200p.pdf.Google ScholarGoogle Scholar
  6. 3GPP. 2020. User Equipment (UE) Procedures in Idle Mode and in RRC Inactive State (3GPP TS 38.304 version 15.6.0 Release 15). https://www.etsi.org/deliver/etsits/138300138399/138304/15.06.0060/ts138304v150600p.pdf.Google ScholarGoogle Scholar
  7. Kazi Main Uddin Ahmed, Manuel Alvarez, and Math H. J. Bollen. 2020. Characterizing Failure and Repair Time of Servers in a Hyper-Scale Data Center. In IEEE PES Innovative Smart Grid Technologies Europe, ISGT Europe 2020, Delft, The Netherlands, October 26--28, 2020. IEEE, 660--664. Google ScholarGoogle ScholarCross RefCross Ref
  8. ORAN Alliance. 2020. O-RAN Near-Real-time RAN Intelligent Controller E2 Service Model (E2SM), RAN Function Network Interface (NI) 1.0. ORAN-WG3.E2SM-NI-v01.00 (2020).Google ScholarGoogle Scholar
  9. ORAN Alliance. 2022. Control, User and Synchronization Plane Specification. O-RAN Fronthaul Working Group, ORAN-WG4.CUS.0-v10.00 (2022).Google ScholarGoogle Scholar
  10. ORAN Alliance. 2023. E2 Service Model (E2SM). O-RAN Fronthaul Working Group, O-RAN.WG3.E2SM-R003-v03.00 (2023).Google ScholarGoogle Scholar
  11. ORAN Alliance. 2023. Near-RT RIC Architecture. O-RAN Fronthaul Working Group, O-RAN.WG3.RICARCH-R003-v04.00 (2023).Google ScholarGoogle Scholar
  12. ORAN Alliance. 2023. O-RAN E2 Service Model (E2SM) KPM 3.0. O-RAN.WG3.E2SM-KPM-R003-v03.00 (2023).Google ScholarGoogle Scholar
  13. Altiostar. 2021. Altiostar and Rakuten Mobile Demonstrate Success Across Performance and Scalability for Open RAN Network. https://www.prnewswire.com/news-releases/altiostar-and-rakuten-mobile-demonstrate-success-across-performance-and-scalability-for-open-ran-network-301254947.html.Google ScholarGoogle Scholar
  14. The Kubernetes Authors. 2023. Kubernetes. https://kubernetes.io/.Google ScholarGoogle Scholar
  15. Robert Birke, Ioana Giurgiu, Lydia Y. Chen, Dorothea Wiesmann, and Ton Engbersen. 2014. Failure Analysis of Virtual and Physical Machines: Patterns, Causes and Characteristics. In 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks. 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Karim Boutiba, Adlen Ksentini, Bouziane Brik, Yacine Challal, and Amar Balla. 2022. NRflex: Enforcing Network Slicing in 5G New Radio. Computer Communications 181 (2022), 284--292.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. O-RAN Software Community. 2023. O-RAN Software Community DU. https://github.com/o-ran-sc/o-du-l2.Google ScholarGoogle Scholar
  18. eBPF.io. 2023. eBPF. https://ebpf.io/.Google ScholarGoogle Scholar
  19. CapGemini Engineering. 2023. CapGemini 5G gNodeB. https://capgemini-engineering.com/nl/en/services/next-core/wireless-frameworks/.Google ScholarGoogle Scholar
  20. Robert Falkenberg and Christian Wietfeld. 2019. FALCON: An Accurate Real-Time Monitor for Client-Based Mobile Network Data Analytics. In 2019 IEEE Global Communications Conference (GLOBECOM). 1--7. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Dash Industry Forum. 2023. Low Latency Streaming Powered by DASH.js. https://reference.dashif.org/dash.js/latest/samples/low-latency/testplayer/testplayer.html.Google ScholarGoogle Scholar
  22. Xenofon Foukas, Bozidar Radunovic, Matthew Balkwill, and Zhihua Lai. 2023. Taking 5G RAN Analytics and Control to a New Level. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. 1--16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Scott Geba. 2023. Introduction to Port Mirroring. https://arista.my.site.com/AristaCommunity/s/article/introduction-to-port-mirroring.Google ScholarGoogle Scholar
  24. Steven S. Hong, Jeffrey Mehlman, and Sachin Katti. 2012. Picasso: Flexible RF and Spectrum Slicing. SIGCOMM Comput. Commun. Rev. 42, 4 (Aug 2012), 37--48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Intel. 2023. Data Plane Development Kit (DPDK). http://dpdk.org/.Google ScholarGoogle Scholar
  26. Intel. 2023. FlexRA Reference Architecture for Wireless Access. https://www.intel.com/content/www/us/en/developer/topic-technology/edge-5g/tools/flexran.html.Google ScholarGoogle Scholar
  27. iovisor. 2023. Userspace eBPF VM. https://github.com/iovisor/ubpf.Google ScholarGoogle Scholar
  28. David Johnson, Dustin Maas, and Jacobus Van Der Merwe. 2022. NexRAN: Closed-loop RAN slicing in POWDER-A top-to-bottom open-source open-RAN use case. In Proceedings of the 15th ACM Workshop on Wireless Network Testbeds, Experimental evaluation & CHaracterization. 17--23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Antonios Katsarakis, Zhaowei Tan, Matthew Balkwill, Bozidar Radunovic, Andrew Bainbridge, Aleksandar Dragojevic, Boris Grot, and Yongguang Zhang. 2021. rVNF: Reliable, Scalable and Performant Cellular VNFs in the Cloud. Technical Report. Technical Report MSR-TR-2021-7, Microsoft.Google ScholarGoogle Scholar
  30. Maicon Kist, Juergen Rochol, Luiz A DaSilva, and Cristiano Bonato Both. 2018. SDR Virtualization in Future Mobile Networks: Enabling Multi-Programmable Air-Interfaces. In 2018 IEEE International Conference on Communications (ICC). IEEE, 1--6.Google ScholarGoogle Scholar
  31. Andrea Lacava, Michele Polese, Rajarajan Sivaraj, Rahul Soundrarajan, Bhawani Shanker Bhati, Tarunjeet Singh, Tommaso Zugno, Francesca Cuomo, and Tommaso Melodia. 2023. Programmable and Customized Intelligence for Traffic Steering in 5G Networks Ssing Open RAN Architectures. IEEE Transactions on Mobile Computing (2023).Google ScholarGoogle Scholar
  32. Nikita Lazarev, Tao Ji, Anuj Kalia, Daehyeok Kim, Ilias Marinos, Francis Y. Yan, Christina Delimitrou, Zhiru Zhang, and Aditya Akella. 2023. Resilient Baseband Processing in Virtualized RANs with Slingshot. In ACM SIGCOMM.Google ScholarGoogle Scholar
  33. Yuanjie Li, Qianru Li, Zhehui Zhang, Ghufran Baig, Lili Qiu, and Songwu Lu. 2020. PBeyond 5G: Reliable Extreme Mobility Management. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM). Association for Computing Machinery, New York, NY, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Yuanjie Li, Zengwen Yuan, and Chunyi Peng. 2017. A Control-Plane Perspective on Reducing Data Access Latency in LTE Networks. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (MobiCom '17). Association for Computing Machinery, New York, NY, USA, 56--69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Yuanjie Li, Zengwen Yuan, and Chunyi Peng. 2017. A Control-Plane Perspective on Reducing Data Access Latency in LTE Networks. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (MobiCom '17). Association for Computing Machinery, New York, NY, USA, 56--69. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Xingqin Lin, Jingya Li, Robert Baldemair, Jung-Fu Thomas Cheng, Stefan Parkvall, Daniel Chen Larsson, Havish Koorapaty, Mattias Frenne, Sorour Falahati, Asbjorn Grovlen, et al. 2019. 5G New Radio: Unveiling the Essentials of the Next Generation Wireless Access Technology. IEEE Communications Standards Magazine 3, 3 (2019), 30--37.Google ScholarGoogle ScholarCross RefCross Ref
  37. Xingqin Lin, Dongsheng Yu, and Henning Wiemann. 2021. A Primer on Bandwidth Parts in 5G New Radio. 5G and Beyond: Fundamentals and Standards (2021), 357--370.Google ScholarGoogle Scholar
  38. Mavenir. 2023. World's First 5G SA Network Using Open vRAN on a Public Cloud. https://www.mavenir.com/case-studies/mavenir-and-dish/.Google ScholarGoogle Scholar
  39. José Mendes, Xianjun Jiao, Andres Garcia-Saavedra, Felipe Huici, and Ingrid Moerman. 2017. Cellular Access Multi-Tenancy through Small Cell Virtualization and Common RF Front-End Sharing. 35--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Binh Nguyen, Tian Zhang, Bozidar Radunovic, Ryan Stutsman, Thomas Karagiannis, Jakub Kocur, and Jacobus Van der Merwe. 2018. ECHO: A Reliable Distributed Cellular Core Network for Hyper-Scale Public Clouds. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom '18). Association for Computing Machinery, New York, NY, USA, 163--178. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Sofia Nyberg. 2016. Physical Cell ID Allocation in Cellular Networks.Google ScholarGoogle Scholar
  42. O-RAN Alliance. 2023. Cloud Architecture and Deployment Scenarios for O-RAN Virtualized RAN. https://www.o-ran.org/specifications.Google ScholarGoogle Scholar
  43. p4.org. 2023. P4_16 Language Specification. https://p4.org/p4-spec/docs/P4-16-v1.2.0.html.Google ScholarGoogle Scholar
  44. Zafar Ayyub Qazi, Melvin Walls, Aurojit Panda, Vyas Sekar, Sylvia Ratnasamy, and Scott Shenker. 2017. A High Performance Packet Core for Next Generation Cellular Networks. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. 348--361.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Mubashir Adnan Qureshi, Ajay Mahimkar, Lili Qiu, Zihui Ge, Max Zhang, and Ioannis Broustis. 2017. Coordinating Rolling Software Upgrades for Cellular Networks. In 25th IEEE International Conference on Network Protocols, ICNP 2017, Toronto, ON, Canada, October 10--13, 2017. IEEE Computer Society. Google ScholarGoogle ScholarCross RefCross Ref
  46. Shunmugapriya Ramanathan, Koteswararao Kondepu, and Andrea Fumagalli. 2022. Resiliency in Open-Source Solutions for Disaggregated 5G Cloud Radio Access and Transport Networks. In 2022 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN). IEEE, 124--129.Google ScholarGoogle ScholarCross RefCross Ref
  47. Muhammad Taqi Raza, Zhowei Tan, Ali Tufail, and Fatima Muhammad Anwar. 2022. LTE NFV Rollback Recovery. IEEE Transactions on Network and Service Management 19, 3 (2022), 2468--2477.Google ScholarGoogle ScholarCross RefCross Ref
  48. Rethink Technology Research. 2023. Rakuten Claims Huge Edge Cloud, as Other Operators Follow Suit. https://rethinkresearch.biz/articles/rakuten-claims-huge-edge-cloud-as-other-operators-follow-suit/.Google ScholarGoogle Scholar
  49. Karen Schulz. 2022. Verizon Deploys More Than 8,000 VRAN Cell Sites, Rapidly Marches Towards Goal of 20,000. https://www.verizon.com/about/news/verizon-deploys-more-8000-vran-cell-sites.Google ScholarGoogle Scholar
  50. Kun Tan, Haichen Shen, Jiansong Zhang, and Yongguang Zhang. 2012. Enable Flexible Spectrum Access With Spectrum Virtualization. In 2012 IEEE International Symposium on Dynamic Spectrum Access Networks. 47--58. Google ScholarGoogle ScholarCross RefCross Ref
  51. Xing Xu, Ioannis Broustis, Zihui Ge, Ramesh Govindan, Ajay Mahimkar, N. K. Shankaranarayanan, and Jia Wang. 2015. Magus: Minimizing Cellular Service Disruption During Network Upgrades. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies, CoNEXT 2015, Heidelberg, Germany, December 1--4, 2015. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Sen Yang, Yan He, Zihui Ge, Dongmei Wang, and Jun Xu. 2017. Predictive Impact Analysis for Designing a Resilient Cellular Backhaul Network. Proceedings of the ACM on Measurement and Analysis of Computing Systems 1, 2 (2017), 1--33.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Ali A Zaidi, Robert Baldemair, Vicent Molés-Cases, Ning He, Karl Werner, and Andreas Cedergren. 2018. OFDM Numerology Design for 5G New Radio to Support IoT, eMBB, and MBSFN. IEEE Communications Standards Magazine 2, 2 (2018), 78--83.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Enabling Resilience in Virtualized RANs with Atlas

                    Recommendations

                    Comments

                    Login options

                    Check if you have access through your login credentials or your institution to get full access on this article.

                    Sign in
                    • Published in

                      cover image ACM Conferences
                      ACM MobiCom '23: Proceedings of the 29th Annual International Conference on Mobile Computing and Networking
                      October 2023
                      1605 pages
                      ISBN:9781450399906
                      DOI:10.1145/3570361

                      Copyright © 2023 ACM

                      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

                      Publisher

                      Association for Computing Machinery

                      New York, NY, United States

                      Publication History

                      • Published: 2 October 2023

                      Permissions

                      Request permissions about this article.

                      Request Permissions

                      Check for updates

                      Qualifiers

                      • research-article

                      Acceptance Rates

                      Overall Acceptance Rate440of2,972submissions,15%
                    • Article Metrics

                      • Downloads (Last 12 months)352
                      • Downloads (Last 6 weeks)87

                      Other Metrics

                    PDF Format

                    View or Download as a PDF file.

                    PDF

                    eReader

                    View online with eReader.

                    eReader