Abstract
With the rapid development of network function virtualization, delay-sensitive applications including auto-driving, online gaming, and multimedia conferencing can be served by virtual network function (VNF) chains with low operation expense/capital expense and high flexibility. However, as the service requests are highly dynamic and different services require distinct bandwidth occupation amount and time, how to schedule the paths of flows and place VNFs efficiently to guarantee the performances of network applications and maximize the utilization of the underlying network is a challenging problem. In this paper, we present a joint optimization approach of flow path scheduling and VNF placement, named JOSP, which explores the best utilization of bandwidth from two different aspects to reduce the network delay. We first present a delay scaling strategy that adds the penalty to the link bandwidth occupation that may cause congestion in accordance with the network placement locations. Then we consider the bandwidth occupation time and present a long-short flow differentiating strategy for the data flows with different duration. Furthermore, we present a reinforcement learning framework and use both the flow path delay and the network function-related delay to calculate the reward of placing VNFs adaptively. Performance evaluation results show that the JOSP can reduce the network delay by 40% on average compared with the existing methods.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig8_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11036-021-01868-5/MediaObjects/11036_2021_1868_Fig9_HTML.png)
Similar content being viewed by others
References
Do TX, Kim YH (2019) State management function placement for service-based 5G mobile core architecture. Mob Netw Appl 24(2):504–516
Sun G, Zhou R, Sun J, Yu HF, Vasilakos AV (2020) Energy-efficient provisioning for service function chains to support delay-sensitive applications in network function virtualization. IEEE Internet Things J 7(7):6116–6131
Deng Y, Zhang TH, Lou GN, Zheng X, Jin J, Han QL (2021) Deep learning-based autonomous driving systems: a survey of attacks and defenses. arXiv:2104.01789
Mo HM, Ding S, Yang SL, Zheng X, Vasilakos AV (2020) DLRRMS: Deep learning based respiratory rate monitoring system using mobile robots and edges. arXiv:2011.08482
Dibaei M, Zheng X, Xia Y, Xu X, Jolfaei A, Bashir AK, Tariq U, Yu D, Vasilakos AV (2020) Investigating the prospect of leveraging blockchain and machine learning to secure vehicular networks: A survey, Piscataway
Liu JQ, Li Y, Zhang Y, Su L, Jin DP (2017) Improve service chaining performance with optimized middlebox placement. IEEE Trans Serv Comput 10(4):560–573
Yang S, Li F, Trajanovski S, Chen X, Wang Y, Fu XM (2021) Delay-aware virtual network function placement and routing in edge clouds. IEEE Trans Mob Comput 20(2):445–459
Pei JN, Hong PL, Xue KP, Li DF, Wei D, Wu F (2020) Two-phase virtual network function selection and chaining algorithm based on deep learning in SDN/NFV-enabled networks. IEEE J Sel Areas Commun 38(6):1102–1117
Gvozdiev N, Vissicchio S, Karp B, Handley M (2018) On low-latency-capable topologies, and their impact on the design of intra-domain routing. In: Proc. of the 2018 conference of the ACM special interest group on data communication, Budapest, Hungary, pp 88–102
Mijumbi R, Hasija S, Davy S, Davy A, Jennings B, Boutaba R (2017) Topology-aware prediction of virtual network function resource requirements. IEEE Trans Netw Serv Manag 14(1):106–120
Chen Y, Wu J (2020) Flow scheduling of service chain processing in a NFV-based network. IEEE Trans Netw Sci Eng 8(1):389–399
Attaoui W, Sabir E, Elbiaze H, Sadik M (2020) Combined latency-aware and resource-effective virtual network function placement. In: Proc. of IEEE Canadian conference on electrical and computer engineering (CCECE), London, ON, Canada, pp 1–7
Zhang SQ, Zhang Q, Bannazadeh H, Leon-Garcia A (2015) Routing algorithms for network function virtualization enabled multicast topology on SDN. IEEE Trans Netw Serv Manag 12(4):580–594
Reyhanian N, Farmanbar H, Mohajer S, Luo ZQ (2020) Joint resource allocation and routing for service function chaining with in-subnetwork processing. In: Proc. of ICASSP 2020-2020 IEEE international conference on acoustics, speech and signal processing (ICASSP), Barcelona, Spain, pp 4990–4994
Hawilo H, Jammal M, Shami A (2019) Network function virtualization-aware orchestrator for service function chaining placement in the cloud. IEEE J Sel Areas Commun 37(3):643–655
Wang S, Bi J, Wu JP, Vasilakos AV, Fan QL (2019) VNE-TD: A virtual network embedding algorithm based on temporal-difference learning. Comput Netw 161:251–263
Jin PP, Fei XC, Zhang QX, Liu F, Li B (2020) Latency-aware vnf chain deployment with efficient resource reuse at network edge. In: Proc. of IEEE conference on computer communications, Toronto, ON, Canada, pp 267–276
Ma WR, Beltran J, Pan ZL, Pan D, Pissinou N (2017) SDN-based traffic aware placement of NFV middleboxes. IEEE Trans Netw Serv Manag 14(3):528–542
Kumar G, Dukkipati N, Jang K, Wassel HMG, Wu X, Montazeri B, Wang YG, Springborn K, Alfeld C, Ryan M (2020) Swift: Delay is simple and effective for congestion control in the datacenter. In: Proc. of the annual conference of the ACM special interest group on data communication on the applications, virtual event, USA, pp 514–528
Zhang X, Hou WG, Guo L, Zhang QH, Guo PX, Li RJ (2020) Joint optimization of latency monitoring and traffic scheduling in software defined heterogeneous networks. Mob Netw Appl 25(1):102–113
Bogle J, Bhatia N, Ghobadi M, Menache I, Bjørner N, Valadarsky A, Schapira M (2019) TEAVAR: striking the right utilization-availability balance in WAN traffic engineering. In: Proc. of the 2019 conference of the ACM special interest group on data communication, Beijing, China, pp 29–43
Lyu Q, Zhu H (2019) Optimizing network latency with fast path assignment for incoming flows. Int J Comput Inf Eng 13(9):465–471
Kar B, Wu EHK, Lin YD (2017) Energy cost optimization in dynamic placement of virtualized network function chains. IEEE Trans Netw Serv Manag 15(1):372–386
Khoshkholghi MA, Khan MG, Noghani KA, Taheri J, Bhamare D, Kassler A, Xiang ZZ, Deng SG, Yang XX (2020) Service function chain placement for joint cost and latency optimization. Mob Netw Appl 25:2191–2205
Li DF, Hong PL, Xue KP, Pei JN (2018) Virtual network function placement considering resource optimization and SFC requests in cloud datacenter. IEEE Trans Parallel Distrib Syst 29(7):1664–1677
Qazi Z, Tu CC, Miao R, Chiang L, Sekar V, Yu ML (2013) Practical and incremental convergence between sdn and middleboxes, Open Network Summit, Santa Clara, CA, pp 1–13
Manias DM, Jammal M, Hawilo H, Shami A, Heidari P, Larabi A, Brunner R (2019) Machine learning for performance-aware virtual network function placement. In: Proc. of IEEE global communications conference (GLOBECOM), Waikoloa, HI, USA, pp 1–6
Pei JN, Hong PL, Pan M, Liu JQ, Zhou JS (2020) Optimal VNF placement via deep reinforcement learning in SDN/NFV-enabled networks. IEEE J Sel Areas in Commun 38(2):263– 278
Nam H, Kim KH, Schulzrinne H (2016) QoE matters more than QoS: Why people stop watching cat videos. In: Proc. of the 35th annual IEEE international conference on computer communications, San Francisco, CA, USA, pp 1–9
N Bozkurt I, Aguirre A, Chandrasekaran B, Godfrey PB, Laughlin G, Maggs A, Singla B (2017) Why is the internet so slow?!. In: Proc. of international conference on passive and active network measurement, Sydney, Australia, pp 173–187
Shaikh A, Rexford J, Shin KG (1999) Load-sensitive routing of long-lived IP flows. ACM SIGCOMM Comput Commun Rev 29(4):215–226
Truong-Huu T, Gurusamy M, Girisankar ST (2017) Dynamic flow scheduling with uncertain flow duration in optical data centers. IEEE Access 5:11200–11214
Antunes N, Pipiras V (2015) Sampling and censoring in estimation of flow distributions. In: Proc. of the 2015 IEEE international conference on communications (ICC), London, UK, pp 5865–5871
Chen L, Lingys J, Chen K, Liu F (2018) Auto: Scaling deep reinforcement learning for datacenter-scale automatic traffic optimization. In: Proc. of the 2018 conference of the ACM special interest group on data communication, Budapest, Hungary, pp 191–205
Chen AY, Jin Y, Cao J, Li LE (2020) Tracking long duration flows in network traffic. In: Proc. of the 2010 IEEE international conference on computer communications, San Diego, CA, USA, pp 1–5
Poupart P, Chen ZT, Jaini P, Fung F, Susanto H, Geng YH, Chen L, Chen K, Jin H (2016) Online flow size prediction for improved network routing. In: Proc. of the 24th IEEE international conference on network protocols (ICNP), Singapore , pp 1–6
Liu WX, Cai J, Wang Y, Chen QC, Zeng JQ (2020) Fine-grained flow classification using deep learning for software defined data center networks. J Netw Comput Appl 168:1–16
Durner R, Kellerer W (2020) Network function offloading through classification of elephant flows. IEEE Trans Netw Serv Manag 17(2):807–820
Wang X, Shi WQ, Xiang Y, Li J (2015) Efficient network security policy enforcement with policy space analysis. IEEE/ACM Trans Netw 24(5):2926–2938
Dijkstra EW (1959) A note on two problems in connexion with graphs. Numer Math 1(1):269–271
Watkins CJ, Dayan P (1992) Q-learning. Mach Learn 8(3-4):279–292
Cormen TH, Leiserson CE, Rivest RL, Stein C (2009) Introduction to algorithms. MIT Press, Cambridge
Leskovec J, Krevl A (2014) SNAP: Stanford network analysis project. https://snap.stanford.edu
Munir A, Qazi IA, Uzmi ZA, Mushtaq A, Ismail SN, Iqbal MS, Khan B (2013) Minimizing flow completion times in data centers. In: Proc. of the 2013 IEEE international conference on computer communications, Turin, Italy, pp 2157–2165
Acknowledgements
This work was supported by the National Natural Science Foundation of China (NSFC) under Grant 61872212, Grant 61902044, Grant 62072060 and Grant 62102053, the Australian Research Council Linkage Project under Grant LP190100676, the Natural Science Foundation Projects in Chongqing under Grant cstc2019jcyj-msxmX0442 and Grant cstc2019jcyj-msxmX0589, and the Chongqing Key Laboratory of Digital Cinema Art and Technology under Grant KJJ-CQ-2020007.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lyu, Q., Zhou, Y., Fan, Q. et al. JOSP: Joint Optimization of Flow Path Scheduling and Virtual Network Function Placement for Delay-Sensitive Applications. Mobile Netw Appl 27, 1642–1658 (2022). https://doi.org/10.1007/s11036-021-01868-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-021-01868-5