Abstract
In Wireless Body Area Networks (WBANs), on the one hand, the energy of nodes is limited. On the other hand, the network topology often changes due to human movement or posture changes. Unstable network topology is easy to cause packet loss, and packet loss will cause inaccurate data collection. Therefore, how to effectively use energy to transmit data reliably becomes a key issue. For this problem, we propose an optimized routing protocol namely Energy Efficient and Reliable Routing based on Reinforcement Learning and Fuzzy Logic (EERR-RLFL). In EERR-RLFL, considering the heterogeneity of nodes in WBANs, we first establish a node rank division mechanism, by which sensor nodes are divided into different ranks from three aspects. Each rank is considered to be one of the factors that affect the link quality. Then, we propose the Fuzzy-Logic-based Link Quality Evaluation (FLLQE) algorithm. It makes use of the fuzzy evaluation method of fuzzy logic and considers the comprehensive influence of multiple factors to evaluate the link quality between two nodes, which will provide reference for routing path selection. In the process of data transmission, based on the FLLQE algorithm, we use a hybrid data transmission mode, in which the time when a forwarding node is needed is first determined, and then the Reinforcement Learning algorithm is used to select the global optimized routing path. Simulation results show that EERR-RLFL outperforms Single Hop Transmission and Optimized Cost Effective and Energy Efficient Routing in terms of network lifetime, packet loss ratio and energy efficiency.
























Similar content being viewed by others
Availability of data and material
Not applicable.
References
Fort, A., Ryckaert, J., & Desset, C. (2006). Ultra-wideband channel model for communication around the human body. IEEE Journal on Selected Areas in Communications, 24(4), 927–933.
Zuhra, F. T., Bakar, K. A., Ahmed, A., & Tunio, M. A. (2017). Routing protocols in wireless body sensor networks: A comprehensive survey. Journal of Network and Computer Applications, 99, 73–97.
Tang, Q., Tummala, N., Gupta, S. K., & Schwiebert, L. (2005). TARA: thermal-aware routing algorithm for implanted sensor networks. In IEEE International Conference on Distributed Computing in Sensor Systems (pp. 206–217).
Bag, A., & Bassiouni, M.A. (2006). Energy efficient thermal aware routing algorithms for embedded biomedical sensor networks. In Proceedings of the Mobile Ad hoc and Sensor Systems (pp. 604–609).
Bhangwar, A. R., Kumar, P., Ahmed, A., & Channa, M. I. (2017). Trust and thermal aware routing protocol (TTRP) for wireless body area networks. Wireless Personal Communications, 97(12), 1–16.
Watteyne, T., Auge-Blum, I., Dohler, M., & Barthel, D. (2007). Anybody: a self-organization protocol for body area networks. In Proceedings of the ICST 2nd international conference on Body area networks (pp. 641–647).
Culpepper, B. J., Dung, L., & Moh, W. M. (2004). Design and analysis of hybrid indirect transmissions (HIT) for data gathering in wireless micro sensor networks. ACM Sigmobile Mobile Computing & Communications Review, 8(1), 61–83.
Ullah, F., Khan, M. Z., Faisal, M., Rehman, H. U., Abbas, S., & Mubarek, F. S. (2021). Energy efficient and reliable routing scheme to enhance the stability period in wireless body area networks. Computer Communications, 165, 20–32.
Ruzzelli, A.G., Jurdak, R., Ohare, G.M., & Stok, P.V.D. (2007). Energy-efficient multi-hop medical sensor networking. In ACM SIGMOBILE International Workshop on Systems and Networking Support for Healthcare and Assisted Living Environments (pp. 37–42).
Braem, B., Latre, B., Moerman, I., Blondia, C., & Demeester, P. (2006). The wireless autonomous spanning tree protocol for multihop wireless body area networks. In Proceeding of the Third Annual International Conference on Mobile and Ubiquitous Systems: Networking Services (pp.1–8).
Elhadj, H. B., Elias, J., Chaari, L., & Kamoun, L. (2015). A priority based cross layer routing protocol for healthcare applications. Ad Hoc Networks, 42, 1–18.
Javaid, N., Ahmad, A., Nadeem, Q., Imran, M., & Haider, N. (2015). iM-SIMPLE: Improved stable increased-throughput multi-hop link efficient routing protocol for wireless body area networks. Computers in Human Behavior, 51, 1003–1011.
Kaur, N., & Singh, S. (2017). Optimized cost effective and energy efficient routing protocol for wireless body area networks. Ad Hoc Networks, 61, 65–84.
Movassaghi, S., Abolhasan, M., & Lipman, J. (2012). Energy efficient thermal and power aware (ETPA) routing in body area networks. In 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications (pp. 1108–1113).
Ahmed, S., Javaid, N., Yousaf, S., Ahmad, A., Sandhu, M. M., Imran, M., Khan, Z. A., & Alrajeh, N. (2015). Co-LAEEBA: Cooperative link aware and energy efficient protocol for wireless body area networks. Computers in Human Behavior, 51, 1205–1215.
Liang, L., Ge, Y., Feng, G., Ni, W., & Wai, A. A. P. (2014). A low overhead tree-based energy-efficient routing scheme for multi-hop wireless body area networks. Computer Networks, 70, 45–58.
Klir, G. J., & Yuan, B. (1995). Fuzzy sets and fuzzy logic: Theory and applications (pp. 20–62). Prentice Hall.
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4(1), 237–285.
Banuselvasaraswathy, B., & Rathinasabapathy, V. (2020). Self-heat controlling energy efficient OPOT routing protocol for WBAN. Wireless Networks, 26(5), 3781–3792.
Javaid, N., Abbas, Z., Fareed, M. S., Khan, Z. A., & Alrajeh, N. (2013). M-ATTEMPT: A new energy-efficient routing protocol for wireless body area sensor networks. Procedia Computer, 19, 224–231.
Srinivas, M. B. (2016). Cluster based energy efficient routing protocol using ANT colony optimization and breadth first search. Procedia Computer Science, 89, 124–133.
Afsana, F., Asif-ur-rahman, M. D., Ahmed, M. R., Mahmud, M., & Kaiser, M. S. (2018). An energy conserving routing scheme for wireless body sensor nanonetwork communication. IEEE Access, 6, 9186–9200.
Kumar, K. R. (2020). Energy efficient dynamic cluster head and routing path selection strategy for WBANs. Wireless Personal Communications, 113, 33–58.
Shimly, S., Smith, D.B., & Movassaghi, S. (2017). Cross-layer optimized routing with low duty cycle TDMA across multiple wireless body area networks. In IEEE International Conference on Communications (pp.1–6).
Yang, G. S., Wu, X. W., Li, Y., & Ye, Q. B. (2020). Energy efficient protocol for routing and scheduling in wireless body area networks. Wireless Networks, 26(2), 1265–1273.
Littman, M. L. (2015). Reinforcement learning improves behaviour from evaluative feedback. Nature, 521(7553), 445–451.
Krieken, E. V., Acar, E., & Harmelen, F. V. (2022). Analyzing differentiable fuzzy logic operators. Artificial Intelligence, 302, 1–46.
Heinzelman, W.R., Chandrakasan, A., & Balakrishnan, H. (2000). Energy-efficient communication protocol for wireless microsensor networks. In The 33rd Annual Hawaii International Conference on System Science (pp. 1–10).
Astrin, A.(2012). IEEE Std 802.15.6–2012. IEEE standard for local and metropolitan area networks part 15.6: Wireless body area networks (pp. 1–271).
Benmansour, T., Ahmed, T., Moussaoui, S., & Doukha, Z. (2020). Performance analyses of the IEEE 802.15.6 wireless body area network with heterogeneous traffic. Journal of Network and Computer Applications, 163, 1–19.
Acknowledgements
The work was supported by Shanghai Municipal Natural Science Foundation (Grant No.18ZR1401200).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have no relevant financial or non-financial interests to disclose.
Code availability
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Guo, W., Wang, Y., Gan, Y. et al. Energy efficient and reliable routing in wireless body area networks based on reinforcement learning and fuzzy logic. Wireless Netw 28, 2669–2693 (2022). https://doi.org/10.1007/s11276-022-02997-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-022-02997-9