Abstract
WSNs are becoming an increasingly attractive technology thanks to the significant benefits they can offer to a wide range of application domains. Extending the system lifetime while preserving good network performance is one of the main challenges in WSNs. In this paper, a novel MAC protocol (QL-MAC) based on Q-Learning is proposed. Thanks to a distributed learning approach, the radio sleep-wakeup schedule is able to adapt to the network traffic load. The simulation results show that QL-MAC provides significant improvements in terms of network lifetime and packet delivery ratio with respect to standard MAC protocols. Moreover, the proposed protocol has a moderate computational complexity so to be suitable for practical deployments in currently available WSNs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Yick, J., Mukherjee, B., Ghosal, D.: Wireless sensor network survey. Computer Networks 52, 2292–2330 (2008)
Liotta, A.: The Cognitive Net is Coming. IEEE Spectrum 50, 26–31 (2013)
Bosman, H., Liotta, A., Iacca, G., Woertche, H.: Online extreme learning on fixed-point sensor networks. In: Proceedings of IEEE ICDM 2013 Workshop on Data Mining in Networks (DaMNet), Dallas, USA (2013)
Bosman, H., Liotta, A., Iacca, G., Woertche, H.: Anomaly detection in sensor systems using lightweight machine learning. In: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), Manchester, UK (2013)
Kaelbling, L.P., Littman, M.L., Moore, A.P.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)
Liotta, A., Exarchakos, G.: Networks for Pervasive Services: Six Ways to Upgrade the Internet. Springer (2011)
Galzarano, S., Savaglio, C., Liotta, A., Fortino, G.: Gossiping-based AODV for Wireless Sensor Networks. In: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), Manchester, UK (2013)
Havinga, P.J., Smit, G.J.: Energy-efficient tdma medium access control protocol scheduling. In: Asian International Mobile Computing Conf., AMOC, pp. 1–10 (2000)
Ye, W., Heidemann, J., Estrin, D.: An energy-efficient mac protocol for wireless sensor networks. In: Proc. 21st International Annual Joint Conference of the IEEE Computer and Communications Societies, New York, USA (2002)
van Dam, T., Langendoen, K.: An adaptive energy-efficient mac protocol for wireless sensor networks. In: Proceedings of the 1st International Conference on Embedded Networked Sensor Systems, SenSys 2003 (2003)
Zheng, T., Radhakrishnan, S., Sarangan, V.: Pmac: an adaptive energy-efficient mac protocol for wireless sensor networks. In: Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium, 8 p. (2005)
Liu, Z., Elhanany, I.: RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks. Int. J. Sen. Netw. 1, 117–124 (2006)
Mihaylov, M., Tuyls, K., Nowé, A.: Decentralized learning in wireless sensor networks. In: Taylor, M.E., Tuyls, K. (eds.) ALA 2009. LNCS, vol. 5924, pp. 60–73. Springer, Heidelberg (2010)
Chu, Y., Mitchell, P., Grace, D.: ALOHA and q-learning based medium access control for wireless sensor networks. In: 2012 International Symposium on Wireless Communication Systems (ISWCS), pp. 511–515 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Galzarano, S., Liotta, A., Fortino, G. (2013). QL-MAC: A Q-Learning Based MAC for Wireless Sensor Networks. In: Aversa, R., Kołodziej, J., Zhang, J., Amato, F., Fortino, G. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2013. Lecture Notes in Computer Science, vol 8286. Springer, Cham. https://doi.org/10.1007/978-3-319-03889-6_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-03889-6_31
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03888-9
Online ISBN: 978-3-319-03889-6
eBook Packages: Computer ScienceComputer Science (R0)