Loading [a11y]/accessibility-menu.js
DRL-OR: Deep Reinforcement Learning-based Online Routing for Multi-type Service Requirements | IEEE Conference Publication | IEEE Xplore

DRL-OR: Deep Reinforcement Learning-based Online Routing for Multi-type Service Requirements


Abstract:

Emerging applications raise critical QoS requirements for the Internet. The improvements of flow classification technologies, software defined networks (SDN), and program...Show More

Abstract:

Emerging applications raise critical QoS requirements for the Internet. The improvements of flow classification technologies, software defined networks (SDN), and programmable network devices make it possible to fast identify users’ requirements and control the routing for fine-grained traffic flows. Meanwhile, the problem of optimizing the forwarding paths for traffic flows with multiple QoS requirements in an online fashion is not addressed sufficiently. To address the problem, we propose DRL-OR, an online routing algorithm using multi-agent deep reinforcement learning. DRL-OR organizes the agents to generate routes in a hop-by-hop manner, which inherently has good scalability. It adopts a comprehensive reward function, an efficient learning algorithm, and a novel deep neural network structure to learn an appropriate routing policy for different types of flow requirements. To guarantee the reliability and accelerate the online learning process, we further introduce safe learning mechanism to DRL-OR. We implement DRL-OR under SDN architecture and conduct Mininet-based experiments by using real network topologies and traffic traces. The results validate that DRL-OR can well satisfy the requirements of latency-sensitive, throughput-sensitive, latency-throughput-sensitive, and latency-loss-sensitive flows at the same time, while exhibiting great adaptiveness and reliability under the scenarios of link failure, traffic change, and partial deployment.
Date of Conference: 10-13 May 2021
Date Added to IEEE Xplore: 26 July 2021
ISBN Information:

ISSN Information:

Conference Location: Vancouver, BC, Canada

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.