Maddalena Nurchis
ABSTRACT
Classical routing protocols for WMNs are typically designed to achieve specific target objectives (e.g., maximum throughput), and they offer very limited flexibility. As a consequence, more intelligent and adaptive mesh networking solutions are needed to obtain high performance in diverse network conditions. To this end, we propose a reinforcement learning-based routing framework that allows each mesh device to dynamically select at run time a routing protocol from a pre-defined set of routing options, which provides the best performance. The most salient advantages of our solution are: i) it can maximize routing performance considering different optimization goals, ii) it relies on a compact representation of the network state and it does not need any model of its evolution, and iii) it efficiently applies Q-learning methods to guarantee convergence of the routing decision process. Through extensive ns-2 simulations we show the superior performance of the proposed routing approach in comparison with two alternative routing schemes.
- D. Aguayo, J. Bicket, S. Biswas, G. Judd, and R. Morris. Link-level Measurements from an 802.11b Mesh Network. SIGCOMM Comput. Commun. Rev., 34(4):121--132, 2004. Google Scholar
Digital Library
- S. Biswas and R. Morris. ExOR: opportunistic multi-hop routing for wireless networks. SIGCOMM Comput. Commun. Rev., 35(4):133--144, October 2005. Google ScholarDigital Library
- J. Boice, J. Garcia-Luna-Aceves, and K. Obraczka. Combining on-demand and opportunistic routing for intermittently connected networks. Ad Hoc Networks, 7:201--218, 2009. Google ScholarDigital Library
- R. Bruno, M. Conti, and E. Gregori. Mesh Networks: Commodity Multihop Ad Hoc Networks. IEEE Commun. Mag., 43(3):123--131, March 2005. Google ScholarDigital Library
- R. Bruno, M. Conti, and M. Nurchis. Opportunistic packet scheduling and routing in wireless mesh networks. In IFIP Wireless Days'10, 2010.Google ScholarCross Ref
- R. Bruno and M. Nurchis. Survey on diversity-based routing in wireless mesh networks: Challenges and solutions. Computer Communications, 33(3):269--282, February 2010. Google ScholarDigital Library
- T. Clausen and P. Jaquet. Optimized Link State Routing Protocol (OLSR). RFC 3626, October 2003. Google ScholarDigital Library
- R. Draves, J. Padhye, and B. Zill. Routing in Multi-Radio, Multi-Hop Wireless Mesh Networks. In Proc. of ACM MobiCom, pages 114--128, Philadelphia, PE, USA, Sept. 26--Oct. 1 2004. Google ScholarDigital Library
- A. Forster. Machine Learning Techniques Applied to Wireless Ad-Hoc Networks: Guide and Survey. In IEEE ISSNIP'07, December 3--6 2007.Google ScholarCross Ref
- M. Genetzakis and V. Siris. A Contention-Aware Routing Metric for Multi-Rate Multi-Radio Mesh Networks. In Proc. IEEE SECON 2008, pages 242--250, San Francisco, CA, USA, June 16--20, 2008.Google ScholarCross Ref
- X.-Y. Li, A. Nusairat, Y. Wu, Y. Qi, J. Zhao, X. Chu, and Y. Liu. Joint throughput optimization for wireless mesh networks. IEEE Transactions on Mobile Computing, 8(7):895--909, July 2009. Google ScholarDigital Library
- C. Perkins, E. Belding-Royer, and S. Das. Ad hoc On-Demand Distance Vector (AODV) Routing. RFC 3561, July 2003. Google ScholarDigital Library
- R. Sutton and A. Barto. Reinforcement Learning: An Introduction. The MIT Press, March 1998. Google ScholarDigital Library
- C. Watkins and P. Dayan. Q-learning. Machine Learning, 8:279--292, 1992. Google ScholarDigital Library
- J. Wellons, L. Dai, Y. Xue, and Y. Cui. Augmenting predictive with oblivious routing for wireless mesh networks under traffic uncertainty. Computer Networks, 54:178--195, 2010. Google ScholarDigital Library
- P. Zou, X. Wang, and R. Rao. Asymptotic Capacity of Infrastructure Wireless Mesh Networks. IEEE Trans. Mobile Comput., 7(8):1011--1024, August 2008. Google ScholarDigital Library
Index Terms
- A self-adaptive routing paradigm for wireless mesh networks based on reinforcement learning
Recommendations
Reinforcement learning based routing in wireless mesh networks
This paper addresses the problem of efficient routing in backbone wireless mesh networks (WMNs) where each mesh router is equipped with multiple radio interfaces and a subset of nodes serve as gateways to the Internet. Most routing schemes have been ...
Polynomial-time algorithms for multirate anypath routing in wireless multihop networks
In this paper, we present a new routing paradigm that generalizes opportunistic routing for wireless multihop networks. In multirate anypath routing, each node uses both a set of next-hops and a selected transmission rate to reach a destination. Using ...
Survey on diversity-based routing in wireless mesh networks: Challenges and solutions
Wireless multi-hop networks often experience severe performance degradations when legacy routing algorithms are employed, because they are not optimized to take advantage of the peculiarities of wireless links. Indeed, the wireless channel is ...
Comments