Skip to main content

Advertisement

Log in

Energy efficient and reliable routing in wireless body area networks based on reinforcement learning and fuzzy logic

  • Original Paper
  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

In Wireless Body Area Networks (WBANs), on the one hand, the energy of nodes is limited. On the other hand, the network topology often changes due to human movement or posture changes. Unstable network topology is easy to cause packet loss, and packet loss will cause inaccurate data collection. Therefore, how to effectively use energy to transmit data reliably becomes a key issue. For this problem, we propose an optimized routing protocol namely Energy Efficient and Reliable Routing based on Reinforcement Learning and Fuzzy Logic (EERR-RLFL). In EERR-RLFL, considering the heterogeneity of nodes in WBANs, we first establish a node rank division mechanism, by which sensor nodes are divided into different ranks from three aspects. Each rank is considered to be one of the factors that affect the link quality. Then, we propose the Fuzzy-Logic-based Link Quality Evaluation (FLLQE) algorithm. It makes use of the fuzzy evaluation method of fuzzy logic and considers the comprehensive influence of multiple factors to evaluate the link quality between two nodes, which will provide reference for routing path selection. In the process of data transmission, based on the FLLQE algorithm, we use a hybrid data transmission mode, in which the time when a forwarding node is needed is first determined, and then the Reinforcement Learning algorithm is used to select the global optimized routing path. Simulation results show that EERR-RLFL outperforms Single Hop Transmission and Optimized Cost Effective and Energy Efficient Routing in terms of network lifetime, packet loss ratio and energy efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

Availability of data and material

Not applicable.

References

  1. Fort, A., Ryckaert, J., & Desset, C. (2006). Ultra-wideband channel model for communication around the human body. IEEE Journal on Selected Areas in Communications, 24(4), 927–933.

    Article  Google Scholar 

  2. Zuhra, F. T., Bakar, K. A., Ahmed, A., & Tunio, M. A. (2017). Routing protocols in wireless body sensor networks: A comprehensive survey. Journal of Network and Computer Applications, 99, 73–97.

    Article  Google Scholar 

  3. Tang, Q., Tummala, N., Gupta, S. K., & Schwiebert, L. (2005). TARA: thermal-aware routing algorithm for implanted sensor networks. In IEEE International Conference on Distributed Computing in Sensor Systems (pp. 206–217).

  4. Bag, A., & Bassiouni, M.A. (2006). Energy efficient thermal aware routing algorithms for embedded biomedical sensor networks. In Proceedings of the Mobile Ad hoc and Sensor Systems (pp. 604–609).

  5. Bhangwar, A. R., Kumar, P., Ahmed, A., & Channa, M. I. (2017). Trust and thermal aware routing protocol (TTRP) for wireless body area networks. Wireless Personal Communications, 97(12), 1–16.

    Google Scholar 

  6. Watteyne, T., Auge-Blum, I., Dohler, M., & Barthel, D. (2007). Anybody: a self-organization protocol for body area networks. In Proceedings of the ICST 2nd international conference on Body area networks (pp. 641–647).

  7. Culpepper, B. J., Dung, L., & Moh, W. M. (2004). Design and analysis of hybrid indirect transmissions (HIT) for data gathering in wireless micro sensor networks. ACM Sigmobile Mobile Computing & Communications Review, 8(1), 61–83.

    Article  Google Scholar 

  8. Ullah, F., Khan, M. Z., Faisal, M., Rehman, H. U., Abbas, S., & Mubarek, F. S. (2021). Energy efficient and reliable routing scheme to enhance the stability period in wireless body area networks. Computer Communications, 165, 20–32.

    Article  Google Scholar 

  9. Ruzzelli, A.G., Jurdak, R., Ohare, G.M., & Stok, P.V.D. (2007). Energy-efficient multi-hop medical sensor networking. In ACM SIGMOBILE International Workshop on Systems and Networking Support for Healthcare and Assisted Living Environments (pp. 37–42).

  10. Braem, B., Latre, B., Moerman, I., Blondia, C., & Demeester, P. (2006). The wireless autonomous spanning tree protocol for multihop wireless body area networks. In Proceeding of the Third Annual International Conference on Mobile and Ubiquitous Systems: Networking Services (pp.1–8).

  11. Elhadj, H. B., Elias, J., Chaari, L., & Kamoun, L. (2015). A priority based cross layer routing protocol for healthcare applications. Ad Hoc Networks, 42, 1–18.

    Article  Google Scholar 

  12. Javaid, N., Ahmad, A., Nadeem, Q., Imran, M., & Haider, N. (2015). iM-SIMPLE: Improved stable increased-throughput multi-hop link efficient routing protocol for wireless body area networks. Computers in Human Behavior, 51, 1003–1011.

    Article  Google Scholar 

  13. Kaur, N., & Singh, S. (2017). Optimized cost effective and energy efficient routing protocol for wireless body area networks. Ad Hoc Networks, 61, 65–84.

    Article  Google Scholar 

  14. Movassaghi, S., Abolhasan, M., & Lipman, J. (2012). Energy efficient thermal and power aware (ETPA) routing in body area networks. In 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications (pp. 1108–1113).

  15. Ahmed, S., Javaid, N., Yousaf, S., Ahmad, A., Sandhu, M. M., Imran, M., Khan, Z. A., & Alrajeh, N. (2015). Co-LAEEBA: Cooperative link aware and energy efficient protocol for wireless body area networks. Computers in Human Behavior, 51, 1205–1215.

    Article  Google Scholar 

  16. Liang, L., Ge, Y., Feng, G., Ni, W., & Wai, A. A. P. (2014). A low overhead tree-based energy-efficient routing scheme for multi-hop wireless body area networks. Computer Networks, 70, 45–58.

    Article  Google Scholar 

  17. Klir, G. J., & Yuan, B. (1995). Fuzzy sets and fuzzy logic: Theory and applications (pp. 20–62). Prentice Hall.

    MATH  Google Scholar 

  18. Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4(1), 237–285.

    Article  Google Scholar 

  19. Banuselvasaraswathy, B., & Rathinasabapathy, V. (2020). Self-heat controlling energy efficient OPOT routing protocol for WBAN. Wireless Networks, 26(5), 3781–3792.

    Article  Google Scholar 

  20. Javaid, N., Abbas, Z., Fareed, M. S., Khan, Z. A., & Alrajeh, N. (2013). M-ATTEMPT: A new energy-efficient routing protocol for wireless body area sensor networks. Procedia Computer, 19, 224–231.

    Article  Google Scholar 

  21. Srinivas, M. B. (2016). Cluster based energy efficient routing protocol using ANT colony optimization and breadth first search. Procedia Computer Science, 89, 124–133.

    Article  Google Scholar 

  22. Afsana, F., Asif-ur-rahman, M. D., Ahmed, M. R., Mahmud, M., & Kaiser, M. S. (2018). An energy conserving routing scheme for wireless body sensor nanonetwork communication. IEEE Access, 6, 9186–9200.

    Article  Google Scholar 

  23. Kumar, K. R. (2020). Energy efficient dynamic cluster head and routing path selection strategy for WBANs. Wireless Personal Communications, 113, 33–58.

    Article  Google Scholar 

  24. Shimly, S., Smith, D.B., & Movassaghi, S. (2017). Cross-layer optimized routing with low duty cycle TDMA across multiple wireless body area networks. In IEEE International Conference on Communications (pp.1–6).

  25. Yang, G. S., Wu, X. W., Li, Y., & Ye, Q. B. (2020). Energy efficient protocol for routing and scheduling in wireless body area networks. Wireless Networks, 26(2), 1265–1273.

    Article  Google Scholar 

  26. Littman, M. L. (2015). Reinforcement learning improves behaviour from evaluative feedback. Nature, 521(7553), 445–451.

    Article  Google Scholar 

  27. Krieken, E. V., Acar, E., & Harmelen, F. V. (2022). Analyzing differentiable fuzzy logic operators. Artificial Intelligence, 302, 1–46.

    MathSciNet  MATH  Google Scholar 

  28. Heinzelman, W.R., Chandrakasan, A., & Balakrishnan, H. (2000). Energy-efficient communication protocol for wireless microsensor networks. In The 33rd Annual Hawaii International Conference on System Science (pp. 1–10).

  29. Astrin, A.(2012). IEEE Std 802.15.6–2012. IEEE standard for local and metropolitan area networks part 15.6: Wireless body area networks (pp. 1–271).

  30. Benmansour, T., Ahmed, T., Moussaoui, S., & Doukha, Z. (2020). Performance analyses of the IEEE 802.15.6 wireless body area network with heterogeneous traffic. Journal of Network and Computer Applications, 163, 1–19.

    Article  Google Scholar 

Download references

Acknowledgements

The work was supported by Shanghai Municipal Natural Science Foundation (Grant No.18ZR1401200).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wenjing Guo.

Ethics declarations

Conflicts of interest

The authors have no relevant financial or non-financial interests to disclose.

Code availability

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, W., Wang, Y., Gan, Y. et al. Energy efficient and reliable routing in wireless body area networks based on reinforcement learning and fuzzy logic. Wireless Netw 28, 2669–2693 (2022). https://doi.org/10.1007/s11276-022-02997-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11276-022-02997-9

Keywords

Navigation