Abstract
This paper presents guaranteed Latency Based Forwarding (gLBF), a solution that allows for the delivery of packets with end-to-end latency guarantees and that provides per-hop bounded latency with zero jitter. gLBF combines the benefits of earlier algorithms, Urgency-Based Scheduling and Cyclic Queuing and Forwarding, while avoiding their respective downsides. Specifically, gLBF does not need to maintain per-flow state at forwarding devices and does not require strict clock synchronization across the network. As a result, gLBF results in network deployments of significantly reduced complexity and lower cost than previous solutions.










Similar content being viewed by others
Code Availability
Per the references, available at https://github.com/network2030/glbf-validation.
References
Specht, J., Samii, S.: Urgency-based scheduler for time-sensitive switched ethernet networks. In: 2016 28th Euromicro Conference on Real-Time Systems (ECRTS) (2016)
Shenker, S., Partridge, C., Guerin, R.: Specification of guaranteed quality of service. Internet Requests for Comments. IETF RFC 2212 (1997)
IEEE Time-Sensitive Networking (TSN) Task Group: IEEE Std 802.1Qch-2017: IEEE Standard for Local and Metropolitan Area Networks—Bridges and Bridged Networks—Amendment 29: Cyclic Queuing and Forwarding. https://standards.ieee.org/ieee/802.1Qch/6072/ (2017)
Grossman, E.: Deterministic networking use cases. RFC Editor (2019). https://doi.org/10.17487/RFC8578. https://www.rfc-editor.org/info/rfc8578
Viswanathan, A., Rosen, E.C., Callon, R.: Multiprotocol label switching architecture. RFC Editor (2001). https://doi.org/10.17487/RFC3031. https://www.rfc-editor.org/info/rfc3031
Eckert, T., Clemm, A., Bryant, S.: glbf: per-flow stateless packet forwarding with guaranteed latency and near-synchronous jitter. In: 2021 17th International Conference on Network and Service Management (CNSM), pp. 578–584 (2021). https://doi.org/10.23919/CNSM52442.2021.9615538. https://dl.ifip.org/db/conf/cnsm/cnsm2021/1570754857.pdf
Farrel, A., Zhao, Q., Li, Z., Zhou, C.: An architecture for use of PCE and the PCE Communication Protocol (PCEP) in a network with central control. Internet Requests for Comments. IETF RFC 8283 (2017)
Vasseur, J., Farrel, A., Ash, G.: A Path Computation Element (PCE)-Based Architecture. RFC Editor (2006). https://doi.org/10.17487/RFC4655. https://www.rfc-editor.org/info/rfc4655
Carugi, M., McDysan, D.: Service requirements for layer 3 Provider Provisioned Virtual Private Networks (PPVPNs). RFC Editor (2005). https://doi.org/10.17487/RFC4031. https://www.rfc-editor.org/info/rfc4031
Nasrallah, A., Balasubramanian, V., Thyagaturu, A., Reisslein, M., ElBakoury, H.: TSN algorithms for large scale networks: a survey and conceptual comparison. arXiv (2019). arXiv:1905.08478
Finn, N., Boudec, J.-Y.L., Mohammadpour, E., Zhang, J., Varga, B.: Deterministic Networking (DetNet) bounded latency. RFC Editor (2022). https://doi.org/10.17487/RFC9320. https://www.rfc-editor.org/info/rfc9320
Specht, J.: IEEE Time-Sensitive Networking (TSN) Task Group: IEEE Std P802.1Qcr: Bridges and Bridged Networks Amendment: Asynchronous Traffic Shaping. https://standards.ieee.org/ieee/802.1Qcr/7420/ (2020)
Qiang, L., Geng, X., Liu, B., Eckert, T., Geng, L., Li, G.: Large-Scale Deterministic IP Network. Internet-Draft draft-qiang-detnet-large-scale-detnet-05, Internet Engineering Task Force (September 2019). Work in Progress. https://datatracker.ietf.org/doc/html/draft-qiang-detnet-large-scale-detnet-05
Liu, B., Dang, J.: A queuing mechanism with multiple cyclic buffers. Internet-Draft draft-dang-queuing-with-multiple-cyclic-buffers-00, Internet Engineering Task Force (February 2021). Work in Progress. https://datatracker.ietf.org/doc/html/draft-dang-queuing-with-multiple-cyclic-buffers-00
Clemm, A., Eckert, T.: High-precision latency forwarding over packet-programmable networks. 2020 IEEE/IFIP Network Operations and Management Symposium (NOMS) (2020)
Eckert, T., Bryant, S.: Problems with existing DetNet bounded latency queuing mechanisms. Internet-Draft draft-eckert-detnet-bounded-latency-problems-00, Internet Engineering Task Force (July 2021). Work in Progress. https://datatracker.ietf.org/doc/html/draft-eckert-detnet-bounded-latency-problems-00
Filsfils, C., Previdi, S., Ginsberg, L., Decraene, B., Litkowski, S., Shakir, R.: Segment routing architecture. RFC Editor (2018). https://doi.org/10.17487/RFC8402. https://www.rfc-editor.org/info/rfc8402
Awduche, D.O., Berger, L., Gan, D.-H., Li, T., Srinivasan, D.V., Swallow, G.: RSVP-TE: extensions to RSVP for LSP tunnels. RFC Editor (2001). https://doi.org/10.17487/RFC3209. https://www.rfc-editor.org/info/rfc3209
Fenner, B., Handley, M.J., Holbrook, H., Kouvelas, I., Parekh, R., Zhang, Z.J., Zheng, L.: Protocol Independent Multicast—Sparse Mode (PIM-SM): Protocol Specification (Revised). RFC Editor (2016). https://doi.org/10.17487/RFC7761. https://www.rfc-editor.org/info/rfc7761
Wijnands, I., Rosen, E.C., Dolganow, A., Przygienda, T., Aldrin, S.: Multicast using Bit Index Explicit Replication (BIER). RFC Editor (2017). https://doi.org/10.17487/RFC8279. https://www.rfc-editor.org/info/rfc8279
Boudec, J.L.: A theory of traffic regulators for deterministic networks with application to interleaved regulators. CoRR (2018) arXiv:1801.08477
Boyer, M., Fraboul, C.: Tightening end to end delay upper bound for AFDX network calculus with rate latency fifo servers using network calculus. In: 2008 IEEE International Workshop on Factory Communication Systems, pp. 11–20 (2008). https://doi.org/10.1109/WFCS.2008.4638728
Bouillard, A., Jouhet, L., Thierry, E.: Tight performance bounds in the worst-case analysis of feed-forward networks. In: 2010 Proceedings IEEE INFOCOM, pp. 1–9 (2010). https://doi.org/10.1109/INFCOM.2010.5461912
Bouillard, A., Stea, G.: Exact worst-case delay in fifo-multiplexing feed-forward networks. IEEE/ACM Trans. Netw. 23(5), 1387–1400 (2015). https://doi.org/10.1109/TNET.2014.2332071
Deering, D.S.E., Hinden, B.: Internet Protocol, Version 6 (IPv6) Specification. RFC Editor (2017). https://doi.org/10.17487/RFC8200. https://www.rfc-editor.org/info/rfc8200
Filsfils, C., Dukes, D., Previdi, S., Leddy, J., Matsushima, S., Voyer, D.: IPv6 Segment Routing Header (SRH). RFC Editor (2020). https://doi.org/10.17487/RFC8754. https://www.rfc-editor.org/info/rfc8754
Li, R., Makhijani, K., Dong, L.: New ip: a data packet framework to evolve the internet: invited paper. In: 2020 IEEE 21st International Conference on High Performance Switching and Routing (HPSR), pp. 1–8 (2020). https://doi.org/10.1109/HPSR48589.2020.9098996
Li, R., Chunduri, U.S., Clemm, A., Dong, L.: New IP: enabling the next wave of networking innovation. In: Boucadair, M., Jacquenet, C. (eds.) Design Innovation and Network Architecture for the Future Internet, pp. 1–42. IGI Global, Hershey (2021)
Dong, L., Mak, K., Li, R.: Qualitative communication via network coding and new ip: invited paper. In: 2020 IEEE 21st International Conference on High Performance Switching and Routing (HPSR), pp. 1–5 (2020). https://doi.org/10.1109/HPSR48589.2020.9098976
François, J., Clemm, A., Maintenant, V., Tabor, S.: Bpp over p4: exploring frontiers and limits in programmable packet processing. In: GLOBECOM 2020—2020 IEEE Global Communications Conference, pp. 1–6 (2020). https://doi.org/10.1109/GLOBECOM42002.2020.9322572
Bryant, S., Clemm, A.: Token cell routing: a new sub-ip layer protocol. In: 2021 17th International Conference on Network and Service Management (CNSM), pp. 153–159 (2021). https://doi.org/10.23919/CNSM52442.2021.9615569
Eckert, T.: Simple gLBF validation tool (2021). https://github.com/network2030/glbf-validation
Funding
Performed as part of our work for our employer, Futurewei Technologies (Stewart Bryant was a consultant with Futurewei at the time).
Author information
Authors and Affiliations
Contributions
The authors co-wrote the manuscript and jointly developed the concepts. TE was the lead author for most of the sections. AC did an editorial scrub across the paper and contributed several text portions including 2.2.4. and portions of 1, 7. SB contributed section 4.6. Each author reviewed the paper prior to submitting. Test code was developed by TE; test cases were run jointly by TE and AC.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interest.
Consent to participate
Yes.
Consent for publication
Yes.
IPR Disclosure
A patent was filed with the USPTO on the gLBF mechanism that is described in the paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Eckert, T., Clemm, A. & Bryant, S. High Precision Latency Forwarding for Wide Area Networks Through Intelligent In-Packet Header Processing (gLBF). J Netw Syst Manage 31, 34 (2023). https://doi.org/10.1007/s10922-022-09718-9
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10922-022-09718-9