Skip to main content
SpringerLink
Log in

AQ-Routing: mobility-, stability-aware adaptive routing protocol for data routing in MANET–IoT systems

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Internet of Things, is an innovative technology which allows the connection of physical things with the digital world through the use of heterogeneous networks and communication technologies. In an IoT system, a major role is played by the wireless sensor network as its components comprise: sensing, data acquiring, heterogeneous connectivity and data processing. Mobile ad-hoc networks are highly self reconfiguring networks of mobile nodes which communicate through wireless links. In such a network, each node acts both as a router and host at the same time. The interaction between MANETs and Internet of Things opens new ways for service provision in smart environments and challenging issues in its networking aspects. One of the main issues in MANET–IoT systems is the mobility of the network nodes: routing protocol must react effectively to the topological changes into the algorithm design. We describe the design and implementation of AQ-Routing, and analyze its performance using both simulations and measurements based on our implementation. In general, the networking of such a system is very challenging regarding routing aspects. Also, it is related to system mobility and limited network sensor resources. This article builds upon this observation an adaptive routing protocol (AQ-Routing) based on Reinforcement Learning (RL) techniques, which has the ability to detect the level of mobility at different points of time so that each individual node can update routing metric accordingly. The proposed protocol introduces: (i) new model, developed via Q-learning technique, to detect the level of mobility at each node in the network; (ii) a new metric, called \(Q_{\textit{metric}},\) which account for the static and dynamic routing metrics, and which are combined and updated to the changing network topologies. The protocol can efficiently handle network mobility by a way of preemptively adapting its behaviour thanks to the mobility detection model. The presented results of simulation provide an effective approach to improve the stability of links in both static and mobile scenario and, hence, increase the packet delivery ratio in the global MANET–IoT system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Alameri, I.A.: MANETS and Internet of Things: the development of a data routing algorithm. Eng. Technol. Appl. Sci. Res. 8(1), 2604–2608 (2018)

    Google Scholar 

  2. Luigi, Atzori, Antonio, Iera, Giacomo, Morabito: The internet of things: a survey. Comput Netw. 54(15), 2787–805 (2010)

    Article  Google Scholar 

  3. Mukherjee, S., Biswas, G.P.: Networking for IoT and applications using existing communication technology. Egypt. Inf. J. 19(2), 107–127 (2018)

    Article  Google Scholar 

  4. Karlsson, J., Dooley, L.S., Pulkkis, G.: Secure routing for MANET connected Internet of Things systems. In: 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, pp. 114–119 (2018)

  5. Noorul, T.M., Pramila, R.S., Islam, N.: An analysis of routing protocols in MANETs and Internet of Things. In: 2017 International Conference on IoT and Application (ICIOT), Nagapattinam, pp. 1–8 (2017)

  6. Airehrour, D., Gutierrez, J., Ray, S.K.: Secure routing for Internet of Things: a survey. J. Netw. Comput. Appl. 66, 198–213 (2016)

    Article  Google Scholar 

  7. Boukerche, A., Turgut, B., Aydin, N., Ahmad, M.Z., Boloni, L., Turgut, D.: Routing protocols in ad hoc networks: a survey. Comput. Netw. 55(13), 3032–3080 (2011)

    Article  Google Scholar 

  8. Clausen, T., Jacquet, P. (eds.): Optimized Link State Routing Protocol (OLSR). IETF RFC 3626, October 2003

  9. Perkins, C., Belding-Royer, E., Das, S. (eds.): Ad hoc On-Demand Distance Vector (AODV) Routing. TETF RFC 3561, July 2003

  10. Hoebeke, J., Moerman, I., Demeester, P.: Adaptive routing for mobile ad hoc networks. EURASIP J. Wireless Commun. Netw. 2012(1), 126 (2012)

    Article  Google Scholar 

  11. Giannoulis, S., et al.: A hybrid adaptive routing protocol for ad hoc wireless networks. In: Proceedings of 2004 IEEE International Workshop on Factory Communication Systems (2004)

  12. Seba Lagraa, H.: ARPM: an adaptive routing protocol for MANETs. In: IEEE International Conference on Pervasive Services, Lyon, France (2006)

  13. Fathy, C., El-Hadidi, M.T., El-Nasr, M.A.: Fuzzy-based adaptive cross layer routing protocol for delay sensitive applications in MANET. In: 2012 IEEE International Conference on Communications (ICC) (2012)

  14. Ramachandran, B., Shanmugavel, S.: Mobility adaptive cross layer design for reliable route discovery in ad-hoc networks. In: Third International Conference on Wireless Communication and Sensor Networks, 2007 (WCSN ’07) (2007)

  15. Son, T.T. et al.: Self-adaptive proactive routing scheme for mobile ad-hoc networks. IET Netw. 4(2), 128–136 (2015)

    Article  Google Scholar 

  16. Watkins, C.J.C.H., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279–292 (1992)

    MATH  Google Scholar 

  17. Boyan, J.A., Littman, M.L.: Packet routing in dynamically changing networks: a reinforcement learning approach. In: Proceedings of the 6th International Conference on Neural Information Processing Systems (NIPS’93). Morgan Kaufmann, San Francisco, pp. 671–678 (1993)

  18. De Couto, Douglas S.J., Aguayo, Daniel, Bicket, John, Morris, Robert: A high-throughput path metric for multi-hop wireless routing. Wireless Netw. 11(4), 419–434 (2005)

    Article  Google Scholar 

  19. Wu, C., Kumekawa, K., Kato, T.: A MANET protocol considering link stability and bandwidth efficiency. In: 2009 International Conference on Ultra Modern Telecommunications & Workshops, St. Petersburg, pp. 1–8 (2009)

  20. Ayodele, T.O.: Introduction to machine learning. In: New Advances in Machine Learning, pp. 1–9. InTech, Rijeka (2010)

  21. Forster, A.: Machine learning techniques applied to wireless ad-hoc networks: guide and survey. In: 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 365–370. IEEE (2007)

  22. Forster, A., Murphy, A.L.: Machine Learning Across the WSN Layers in Emerging Communications for Wireless Sensor Networks, pp. 165–181. InTech, Rijeka (2011)

    Chapter  Google Scholar 

  23. Abu-Mostafa, Y.S., Magdon-Ismail, M., Lin, H.-T.: Learning from Data. AMLBook, Chicago (2012)

    Google Scholar 

  24. Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning, vol. 2. MIT, Cambridge (2006)

    Book  Google Scholar 

  25. Puterman, Martin L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York (2008)

    MATH  Google Scholar 

  26. Sutton, R.S., Barto, A.G.: Reinforcement Learning. MIT, Cambridge (1997)

    MATH  Google Scholar 

  27. Johnson, D., Hu, Y., Maltz, D.: The Dynamic Source Routing Protocol (DSR) for mobile ad hoc networks for IPv4. IETF REC (2007)

  28. Sarkar, S.K., Basavaraju, T.G., Puttamadappa, C.: Ad Hoc Mobile Wireless Networks: Principles, Protocols and Applications, 1st edn. Auerbach Publications, Boston (2007)

    Book  Google Scholar 

  29. Draves, R., Padhye, J., Zill, B.: Comparison of routing metrics for static multi-hop wireless networks. SIGCOMM Comput. Commun. Rev. 34(4), 133–144 (2004)

    Article  Google Scholar 

  30. Li, J., Blake, C., Couto, D.S.J.D., Lee, H.I., Morris, R.: Capacity of Ad Hoc wireless networks. In: 7th Annual International Conference on Mobile Computing and Networking (MobiCom ’01), pp. 61–69. ACM, New York (2001)

  31. Adya, A., Bahl, P., Padhye, J., Wolman, A., Zhou, L.: A multi-radio unification protocol for IEEE 802.11 wireless networks. In: 1st International Conference on Broadband Networks (BROADNETS ’04), pp. 344–354. IEEE Computer Society, Washington (2004)

  32. Khelil, A., Marron, P.J., Rothermel, K.: Contact-based mobility metrics for delay-tolerant ad hoc networking. In: 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 435–444 (2005)

  33. Ingelrest, F., Mitton, N., Simplot-Ryl, D.: A Turnover based adaptive HELLO protocol for mobile ad hoc and sensor networks. In: 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, Istanbul, pp. 9–14 (2007)

  34. Grossglauser, M., Vetterli, M.: Locating nodes with EASE: last encounter routing in ad hoc networks through mobility diffusion. In: IEEE 2003 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No. 03CH37428) (INFOCOM), vol. 3, pp. 1954–1964 (2003)

  35. Boleng, J., Navidi, W., Camp, T.: Metrics to enable adaptive protocols for mobile ad hoc networks. In: Proceedings of International Conference on Wireless Networks (ICWN’02), pp. 293–296 (2002)

  36. Macone, D., Oddi, G., Pietrabissa, A.: MQ-Routing: Mobility-, GPS- and energy-aware routing protocol in MANETs for disaster relief scenarios. Ad Hoc Netw. 11(3), 861–878 (2013)

    Article  Google Scholar 

  37. Son, Tran The, Le Minh, Hoa, Sexton, Graham, Aslam, Nauman: A novel encounter-based metric for mobile ad-hoc networks routing. Ad Hoc Netw. 14, 2–14 (2014)

    Article  Google Scholar 

  38. Richard, D., Jitendra, P., Brian, Z.: Routing in multi-radio, multi-hop wireless mesh networks. In: Proceedings of the MOBICOM Conference (2004)

  39. Edalat, N., Tham, C.-K., Xiao, W.: An auction-based strategy for distributed task allocation in wireless sensor networks. Comput. Commun. 35(8), 916–928 (2012)

    Article  Google Scholar 

  40. Chun, L.D., Hyeon, L.D.: Novel routing protocol scheme for real-time applications in mobile ad hoc networks. Clust. Comput. 20(77), 1–12 (2017)

    Google Scholar 

  41. Mase, K., Speakman, L., Akima, K., Owada, Y.: Loop Detection for MANET. Internet Engineering Task Force (2007). https://datatracker.ietf.org/doc/html/draft-mase-manet-loopdetect-00

  42. Perkins, C., Bhagwat, P.: Highly Dynamic Destination-Sequenced Distance-Vector Routing (DSDV) for mobile computers. In: ACM SIGCOMM’94 Conference on Communications Architectures, Protocols and Applications, pp. 234–244 (1994)

  43. Garcia-Luna, J., Spohn, M.: Source Tree Adaptive Routing Internet Draft. draft-ietf-manet-star-00.txt, work in progress, October 1999

  44. Macker, J. (ed.): Simplified Multicast Forwarding. RFC 6621, May 2012. https://doi.org/10.17487/RFC6621, http://www.rfc-editor.org/info/rfc6621

  45. ns-3 Development Team, ns-3 Network Simulator (2014). https://www.nsnam.org/doxygen- release/group__mobility.html

  46. Camp, T., Boleng, J., Davies, V.: A survey of mobility models for ad hoc network research. Wirel. Commun. Mob. Comput. 2, 483–502 (2002). https://doi.org/10.1002/wcm.72

    Article  Google Scholar 

  47. IEEE 802.11TM Wireless Local Area Networks: the Working Group for WLAN Standards. http://www.ieee802.org/11/. Accessed Oct 2011

Download references

Author information

Authors and Affiliations

  1. RAI2S, INPT, University of Mohammed V, Rabat, Morocco

    Abdellatif Serhani & Najib Naja

  2. RI2M, ENSA, University of Hassan I, Settat, Morocco

    Abdellah Jamali

Authors
  1. Abdellatif Serhani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Najib Naja
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdellah Jamali
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abdellatif Serhani.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Serhani, A., Naja, N. & Jamali, A. AQ-Routing: mobility-, stability-aware adaptive routing protocol for data routing in MANET–IoT systems. Cluster Comput 23, 13–27 (2020). https://doi.org/10.1007/s10586-019-02937-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-019-02937-x

Keywords

Search

Navigation