Abstract
In this paper, we provide a comparative performance evaluation study of Deep-Q-Network (DQN) and Dueling DQN in the context where we address network slicing in 5G networks and beyond through solving SFC orchestration problem leveraging Software Defined Networking (SDN) and Network Function Virtualization (NFV) capabilities and using Deep Reinforcement Learning (DRL) approach aiming to maximize Quality of Experience (QoE) while meeting Quality of Service (QoS) requirements. We intend through such investigation to highlight how the DRL agent behaves along the training phase while orchestrating each network slice (or Service Function Chain (SFC)) on a Physical Substrate Network (PSN) in terms of reaching a suitable compromise between performance and convergence. The network slice orchestration is achieved by deploying the corresponding SFC request composed of a set of ordered Virtualized Network Functions (VNFs) linked through virtual links that packets need to traverse within a network slice to achieve specific service requirements. We show throughout numerical experiments how Dueling DQN outperforms DQN in this scenario and how we can compare its performances with those of reference algorithms referred to as violent and random. The investigated performance evaluation study is based on two performance metrics concerning the QoE score and the rejection ratio (RR). Furthermore we assess the quality of learning for the two metrics by testing the ability of the DRL agent to reach a near-optimal solution, along the last 100 runs of the learning phase, quantified by a pre-defined QoE threshold score.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arulkumaran, K., et al.: Deep reinforcement learning: a brief survey. IEEE Signal Process. Mag. 34(6), 26–38 (2017)
Benzekki, K., El Fergougui, A., Elbelrhiti Elalaoui, A.: Software-defined networking (SDN): a survey. Secur. Commun. Netw. 9(18), 5803–5833 (2016)
Bhamare, D., et al.: A survey on service function chaining. J. Netw. Comput. Appl. 75, 138–155 (2016)
Barakabitze, A.A., et al.: 5G network slicing using SDN and NFV: a survey of taxonomy, architectures and future challenges. Comput. Netw. 167, 106984 (2020)
Moreno, C., Fernando, J., et al.: Online service function chain deployment for live-streaming in virtualized content delivery networks: a deep reinforcement learning approach. Future Internet 13(11), 278 (2021)
Chen, X., et al.: Reinforcement learning-based QoS/QoE-aware service function chaining in software-driven 5G slices. Trans. Emerg. Telecommun. Technol. 29(11), e3477 (2018)
Fiedler, M., Hossfeld, T., Tran-Gia, P.: A generic quantitative relationship between quality of experience and quality of service. IEEE Netw. 24(2), 36–41 (2010)
Sánchez, H., Andrea, J., Casilimas, K., Rendon, O.M.C.: Deep reinforcement learning for resource management on network slicing: a survey. Sensors 22(8), 3031 (2022)
Lin, L.J.: RL for Robots Using Neural Networks. Carnegie Mellon University, Pittsburgh (1992)
Li, R., et al.: Deep reinforcement learning for resource management in network slicing. IEEE Access 6, 74429–74441 (2018)
Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)
Reichl, P., et al.: The logarithmic nature of QoE and the role of the Weber-Fechner law in QoE assessment. In: 2010 IEEE International Conference on Communications. IEEE (2010)
Sarker, I.H.: Deep learning: a comprehensive overview on techniques, taxonomy, applications and research directions. SN Comput. Sci. 2(6), 420 (2021)
Wang, Z., et al.: Dueling network architectures for deep reinforcement learning. In: International Conference on Machine Learning. PMLR (2016)
Yang, W., et al.: Dynamic URLLC and eMBB multiplexing design in 5G new radio. In: 2020 IEEE 17th Annual Consumer Communications & Networking Conference (CCNC). IEEE (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Taktak, W., Escheikh, M., Barkaoui, K. (2024). A QoE Driven DRL Approach for Network Slicing Based on SFC Orchestration in SDN/NFV Enabled Networks. In: Ben Hedia, B., Maleh, Y., Krichen, M. (eds) Verification and Evaluation of Computer and Communication Systems. VECoS 2023. Lecture Notes in Computer Science, vol 14368. Springer, Cham. https://doi.org/10.1007/978-3-031-49737-7_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-49737-7_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-49736-0
Online ISBN: 978-3-031-49737-7
eBook Packages: Computer ScienceComputer Science (R0)