Distributed and Adaptive Traffic Engineering with Deep Reinforcement Learning | IEEE Conference Publication | IEEE Xplore

Distributed and Adaptive Traffic Engineering with Deep Reinforcement Learning

Publisher: IEEE

Abstract:

Lots of studies focus on distributed traffic engineering (TE) where routers make routing decisions independently. Existing approaches usually tackle distributed TE proble...View more

Abstract:

Lots of studies focus on distributed traffic engineering (TE) where routers make routing decisions independently. Existing approaches usually tackle distributed TE problems through traditional optimization methods. However, due to the intrinsic complexity of the distributed TE problems, routing decisions cannot be obtained efficiently, which leads to significant performance degradation, especially for highly dynamic traffic. Emerging machine learning technologies like deep reinforcement learning (DRL) provide a new choice to address TE problems in an experience-driven method. In this paper, we propose DATE, a distributed and adaptive TE framework with DRL. DATE distributes well-trained agents to the routers in the located network. Each agent makes local routing decisions independently based on link utilization ratios flooded by each router periodically. To coordinate the distributed agents to achieve the global optimization in different traffic conditions, we construct candidate paths, develop the agents carefully, and realize a virtual environment to train the agents with a DRL algorithm. We do extensive simulations and experiments using real-world network topologies with both real and synthetic traffic traces. The results show that DATE outperforms some existing approaches and yields near-optimal performance with superior robustness.
Date of Conference: 25-28 June 2021
Date Added to IEEE Xplore: 26 August 2021
ISBN Information:
Print on Demand(PoD) ISSN: 1548-615X
Publisher: IEEE
Conference Location: Tokyo, Japan

Funding Agency:


References

References is not available for this document.