Skip to main content

Advertisement

SpringerLink
Log in

MDP-Based Network Selection Scheme by Genetic Algorithm and Simulated Annealing for Vertical-Handover in Heterogeneous Wireless Networks

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

The hybrid algorithm for real-time vertical handover using different objective functions has been presented to find the optimal network to connect with a good quality of service in accordance with the user’s preferences. Markov processes are widely used in performance modelling of wireless and mobile communication systems. We address the problem of optimal wireless network selection during vertical handover, based on the received information, by embedding the decision problem in a Markov decision process (MDP) with genetic algorithm (GA), we use GA to find a set of optimal decisions that ensures the best trade-off between QoS based on their priority level. Then, we emerge improved genetic algorithm (IGA) with simulated annealing (SA) as leading methods for search and optimization problems in heterogeneous wireless networks. We formulate the vertical handoff decision problem as a MDP, with the objectives of maximizing the expected total reward and minimizing average number of handoffs. A reward function is constructed to assess the QoS during each connection, and the AHP method are applied in an iterative way, by which we can work out a stationary deterministic handoff decision policy. As it is, the characteristics of the current mobile devices recommend using fast and efficient algorithms to provide solutions near to real-time. These constraints have moved us to develop intelligent algorithm that avoid the slow and massive computations. This paper compares the formulation and results of five recent optimization algorithms: artificial bee colony, GA, differential evolution, particle swarm optimization and hybrid of (GA–SA). Simulation results indicated that choosing the SA rules would minimize the cost function, and also that, the IGA–SA algorithm could decrease the number of unnecessary handovers, and thereby prevent the ‘Ping-Pong’ effect.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Jiang, D., Xu, Z., & Lv, Z. (2015). A multicast delivery approach with minimum energy consumption for wireless multi-hop networks. Telecommunication Systems, 62(4), 771–782.

    Article  Google Scholar 

  2. Jiang, D., Xu, Z., Wang, W., Wang, Y., & Han, Y. (2015). A collaborative multi-hop routing algorithm for maximum achievable rate. Journal of Network and Computer Applications, 57, 182–191.

    Article  Google Scholar 

  3. Jiang, D., Wang, Y., Yao, C., & Han, Y. (2015). An effective dynamic spectrum access algorithm for multi-hop cognitive wireless networks. Computer Networks, 84, 1–16.

    Article  Google Scholar 

  4. Jiang, D., Xu, Z., Li, W., & Chen, Z. (2015). Network coding-based energy-efficient multicast routing algorithm for multi-hop wireless networks. Journal of Systems and Software, 104, 152–165.

    Article  Google Scholar 

  5. Singhrova, A., & Prakash, N. (2009, June). Adaptive vertical handoff decision algorithm for wireless heterogeneous networks. In 11th IEEE international conference on high performance computing and communications, 2009. HPCC’09 (pp. 476–481). IEEE

  6. Ahmed, A., Boulahia, L. M., & Gaïti, D. (2014). Enabling vertical handover decisions in heterogeneous wireless networks: A state-of-the-art and a classification. IEEE Communications Surveys and Tutorials, 16(2), 776–811.

    Article  Google Scholar 

  7. Paul, S., Pan, J., & Jain, R. (2011). Architectures for the future networks and the next generation internet: A survey. Computer Communications, 34(1), 2–42.

    Article  Google Scholar 

  8. TalebiFard, P., Wong, T., & Leung, V. C. M. (2010). Access and service convergence over the mobile internet—A survey. Computer Networks, 54(4), 545–557.

    Article  MATH  Google Scholar 

  9. Movahedi, Z., Ayari, M., Langar, R., & Pujolle, G. (2012). A survey of autonomic network architectures and evaluation criteria. IEEE Communications Surveys and Tutorials, 14(2), 464–490.

    Article  Google Scholar 

  10. Jiang, D., Ying, X., Han, Y., & Lv, Z. (2016). Collaborative multi-hop routing in cognitive wireless networks. Wireless Personal Communications, 86(2), 901–923.

    Article  Google Scholar 

  11. Rakovic, V., & Gavrilovska, L. (2010). Novel RAT selection mechanism based on Hopfield neural networks. In Paper presented at the 2010 international congress on ultra modern telecommunications and control systems and workshops (ICUMT).

  12. Chandralekha, M. R. S., & Praffula, K. B. (2010). Minimization of number of handoff using genetic algorithm in heterogeneous wireless networks. International Journal of Latest Trends in Computing, 1(2), 24–28.

    Google Scholar 

  13. McNair, J., & Zhu, F. (2004). Vertical handoffs in fourth-generation multinetwork environments. Wireless Communications, IEEE, 11(3), 8–15.

    Article  Google Scholar 

  14. Çalhan, A., & Çeken, C. (2013). Artificial neural network based vertical handoff algorithm for reducing handoff latency. Wireless Personal Communications, 71(4), 2399–2415.

    Article  Google Scholar 

  15. ÇAlhan, A., & ÇEken, C. (2013). Case study on handoff strategies for wireless overlay networks. Computer Standards and Interfaces, 35(1), 170–178.

    Article  Google Scholar 

  16. Lera, G., & Pinzolas, M. (2002). Neighborhood based Levenberg–Marquardt algorithm for neural network training. IEEE Transactions on Neural Networks, 13(5), 1200–1203.

    Article  Google Scholar 

  17. Kordos, M., & Duch, W. (2004). Variable step search algorithm for MLP training. In Paper presented at the the 8th IASTED international Conference on artificial intelligence and soft computing, Marbella, Spain.

  18. Nan, W., Wenxiao, S., Shaoshuai, F., & Shuxiang, L. (2011). PSO-FNN-based vertical handoff decision algorithm in heterogeneous wireless networks. Procedia Environmental Sciences, 11, 55–62.

    Article  Google Scholar 

  19. Liu, X., & Jiang, L. (2012). A novel vertical handoff algorithm based on fuzzy logic in aid of grey prediction theory in wireless heterogeneous networks. Journal of Shanghai Jiaotong University (Science), 17, 25–30.

    Article  Google Scholar 

  20. Singhrova, A., & Prakash, N. (2012). Vertical handoff decision algorithm for improved quality of service in heterogeneous wireless networks. IET Communications, 6(2), 211–223.

    Article  MathSciNet  MATH  Google Scholar 

  21. Pahlavan, K., Krishnamurthy, P., Hatami, A., Ylianttila, M., Makela, J., Pichna, R., et al. (2000). Handoff in hybrid mobile data networks. IEEE Personal Communications, 7(2), 34–47.

    Article  Google Scholar 

  22. Giacomini, D., & Agarwal, A. (2012). Vertical handover decision making using QoS reputation and GM (1, 1) prediction. In 2012 IEEE International conference on communications (ICC). IEEE.

  23. Zhang, C., Wang, X., & Huang, M. (2013). A multi-objective genetic algorithm based handoff decision scheme with ABC supported intelligent computing theories (pp. 217–226). Berlin: Springer.

    Google Scholar 

  24. Jaraiz-Simon, M. D., Gomez-Pulido, J. A., & Vega-Rodriguez, M. A. (2015). Embedded intelligence for fast QoS-based vertical handoff in heterogeneous wireless access networks. Pervasive and Mobile Computing, 19, 141–155.

    Article  Google Scholar 

  25. Lin, F.-T., Kao, C.-Y., & Hsu, C.-C. (1993). Applying the genetic approach to simulated annealing in solving some NP-hard problems. IEEE Transactions on Systems, Man and Cybernetics, 23(6), 1752–1767.

    Article  Google Scholar 

  26. Li, X.-G., & Wei, X. (2008). An improved genetic algorithm-simulated annealing hybrid algorithm for the optimization of multiple reservoirs. Water Resources Management, 22(8), 1031–1049.

    Article  Google Scholar 

  27. Giupponi, L., Agusti, R., Pérez-Romero, J., & Sallent, O. (2005). A novel joint radio resource management approach with reinforcement learning mechanisms. In Paper presented at the performance, computing, and communications conference, 2005, IPCCC 2005, 24th IEEE International.

  28. Wilson, A., Lenaghan, A., & Malyan, R. (2005). Optimising wireless access network selection to maintain qos in heterogeneous wireless environments. In Paper presented at the wireless personal multimedia communications.

  29. Pedrasa, J. R., & Seneviratne, A. P. (2011). Determining network availability on the move. In 2011 17th Asia-Pacific conference on communications (APCC). IEEE.

  30. Zhu, F., & McNair, J. (2004). Optimizations for vertical handoff decision algorithms. In Wireless communications and networking conference, 2004. WCNC. 2004 IEEE (Vol. 2, pp. 867–872). IEEE.

  31. Andrews, J., Singh, S., Ye, Q., Lin, X., & Dhillon, H. (2014). An overview of load balancing in HetNets: Old myths and open problems. IEEE Wireless Communications, 21(2), 18–25.

    Article  Google Scholar 

  32. Ning, Z., Song, Q., Huang, Y., & Guo, L. (2014). A channel estimation based opportunistic scheduling scheme in wireless bidirectional networks. Journal of Network and Computer Applications, 39, 61–69.

    Article  Google Scholar 

  33. Ning, Z., Song, Q., & Yu, Y. (2013). A novel scheduling algorithm for physical-layer network coding under Markov model in wireless multi-hop network. Computers and Electrical Engineering, 39(6), 1625–1636.

    Article  Google Scholar 

  34. Tepedelenlioğlu, C., & Giannakis, G. B. (2001). On velocity estimation and correlation properties of narrow-band mobile communication channels. IEEE Transactions on Vehicular Technology, 50(4), 1039–1052.

    Article  Google Scholar 

  35. Zahran, A. H., Liang, B., & Saleh, A. (2006). Signal threshold adaptation for vertical handoff in heterogeneous wireless networks. Mobile Networks and Applications, 11(4), 625–640.

    Article  Google Scholar 

  36. Stevens-Navarro, E., Lin, Y., & Wong, V. W. (2008). An MDP-based vertical handoff decision algorithm for heterogeneous wireless networks. IEEE Transactions on Vehicular Technology, 57(2), 1243–1254.

    Article  Google Scholar 

  37. Saaty, T. L. (1988). What is the analytic hierarchy process?. Berlin: Springer.

    Book  MATH  Google Scholar 

  38. Karaboga, D. (2005). An idea based on honey bee swarm for numerical optimization. Technical report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department.

  39. John, H. (1992). Holland, adaptation in natural and artificial systems. Cambridge, MA: MIT Press.

    Google Scholar 

  40. Li, Z., & Schonfeld, P. (2015). Hybrid simulated annealing and genetic algorithm for optimizing arterial signal timings under oversaturated traffic conditions. Journal of Advanced Transportation, 49(1), 153–170.

    Article  Google Scholar 

  41. Price, K., Storn, R. M., & Lampinen, J. A. (2006). Differential evolution: A practical approach to global optimization. Berlin: Springer.

    MATH  Google Scholar 

  42. AlRashidi, M. R., & El-Hawary, M. E. (2009). A survey of particle swarm optimization applications in electric power systems. IEEE Transactions on Evolutionary Computation, 13(4), 913–918.

    Article  Google Scholar 

  43. Aarts, E., & Korst, J. (1988). Simulated annealing and Boltzmann machines. New York: Wiley.

    MATH  Google Scholar 

  44. Jha, M. K., & Abdullah, J. (2006). A Markovian approach for optimizing highway life-cycle with genetic algorithms by considering maintenance of roadside appurtenances. Journal of the Franklin Institute, 343(4), 404–419.

    Article  MATH  Google Scholar 

  45. Tsai, C.-C., Huang, H.-C., & Chan, C.-K. (2011). Parallel elite genetic algorithm and its application to global path planning for autonomous robot navigation. IEEE Transactions on Industrial Electronics, 58(10), 4813–4821.

    Article  Google Scholar 

  46. Karaboga, N., Kockanat, S., & Dogan, H. (2013). The parameter extraction of the thermally annealed Schottky barrier diode using the modified artificial bee colony. Applied Intelligence, 38(3), 279–288.

    Article  Google Scholar 

  47. Dede, T., & Ayvaz, Y. (2015). Combined size and shape optimization of structures with a new meta-heuristic algorithm. Applied Soft Computing, 28, 250–258.

    Article  Google Scholar 

  48. Perkins, C. E., & Royer, E. M. (1999). Ad hoc on-demand distance vector routing. In Paper presented at the proceedings of mobile computing systems and applications, 1999. Second IEEE Workshop on WMCSA’99.

  49. Nkansah-Gyekye, Y., & Agbinya, J. I. (2007). Vertical handoff decision algorithm for UMTS-WLAN. In Paper presented at the the 2nd international conference on wireless broadband and ultra wideband communications, 2007. AusWireless.

  50. Ahmed, T., Kyamakya, K., Ludwig, M., Anne, K. R., Schroeder, J., & Galler, S., et al. (2006). A context-aware vertical handover decision algorithm for multimode mobile terminals and its performance

  51. Group, IEEE 802.11 Working. Draft Supplement to Part 11: Wireless Medium Access Control (MAC) and physical layer (PHY) specifications: Medium Access Control (MAC) Enhancements for Quality of Service (QoS): IEEE.

  52. Lee, C. W., Chen, L. M., Chen, M. C., & Sun, Y. S. (2005). A framework of handoffs in wireless overlay networks based on mobile IPv6. IEEE Journal on Selected Areas in Communications, 23(11), 2118–2128.

    Article  Google Scholar 

  53. Park, H. S., Yoon, S. H., Kim, T. H., Park, J. S., Do, M. S., & Lee, J. Y. (2003). Vertical Hando. Procedure and algorithm between IEEE802. 11 WLAN and CDMA cellular network mobile communications (pp. 103–112). Berlin: Springer.

    Google Scholar 

  54. Pfister, H. D., Soriaga, J. B., & Siegel, P. H. (2001). On the achievable information rates of finite state ISI channels. In Paper presented at the global telecommunications conference, 2001, GLOBECOM’01. IEEE.

  55. Rakesh, J., & Dalal, U. (2010). A survey of mobile WiMax IEEE 802.16 m standard. http://arxiv.org/abs/1005.0976.

  56. Reza, F. R. (2012). Optimum ranges for data transmission in mobile communications. International Journal of Scientific and Engineering Research, 3, 481–489.

    Google Scholar 

  57. Shaddad, R. Q., Mohammad, A. B., Al-Gailani, S. A., Al-hetar, A. M., & Elmagzoub, M. A. (2014). A survey on access technologies for broadband optical and wireless networks. Journal of Network and Computer Applications, 41, 459–472.

    Article  Google Scholar 

  58. Singh, A. K., & Mishra, B. (2012). Comparative study on wireless local area network standards. International Journal of Applied Engineering and Technology ISSN, 2.

  59. Sourangsu, B, & Rahul, S. C. (2013). WiFi & WiMAX: A comparative study. Journal of Indian Journal of Engineering, 2(5), 1–5.

    Google Scholar 

  60. Storn, R., & Price, K. (1997). Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization, 11(4), 341–359.

    Article  MathSciNet  MATH  Google Scholar 

  61. Yan, X., Şekercioğlu, Y. A., & Narayanan, S. (2010). A survey of vertical handover decision algorithms in fourth generation heterogeneous wireless networks. Computer Networks, 54(11), 1848–1863.

    Article  MATH  Google Scholar 

  62. Barash, D. (1999). A genetic search in policy space for solving Markov decision processes. In AAAI spring symposium on search techniques for problem solving under uncertainty and incomplete information, Stanford University.

  63. Chin, H., & Jafari, A. (1998). Genetic algorithm methods for solving the best stationary policy of finite Markov decision processes. In Proceedings of the 30th southeastern symposium on system theory (pp. 538–543).

  64. Lin, A. Z.-Z., Bean, J., & White, C, I. I. I. (2004). A hybrid genetic/optimization algorithm for finite horizon partially observed Markov decision processes. INFORMS Journal on Computing, 16(1), 27–38.

    Article  MathSciNet  MATH  Google Scholar 

  65. Wells, C., Lusena, C., & Goldsmith, J. (1999). Genetic algorithms for approximating solutions to POMDPs. Department of Computer Science Technical Report TR-290-99, University of Kentucky. http://cs.engr.uky.edu/goldsmit/papers/gen.ps

Download references

Author information

Authors and Affiliations

  1. Communication System and Network (iKohza) Research Group, Malaysia-Japan International Institute of Technology (MJIIT), Universiti Teknologi Malaysia, Jalan Semarak, 54100, Kuala Lumpur, Malaysia

    Shidrokh Goudarzi & Wan Haslina Hassan

  2. Department of Computer System and Technology, Faculty of Computer Science and Information Technology, University of Malaya, 50603, Kuala Lumpur, Malaysia

    Mohammad Hossein Anisi

  3. Faculty of Computing, Universiti Teknologi Malaysia, UTM Johor Bahru, 81310, Johor, Malaysia

    Seyed Ahmad Soleymani

Authors
  1. Shidrokh Goudarzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wan Haslina Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammad Hossein Anisi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seyed Ahmad Soleymani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shidrokh Goudarzi.

Appendices

Appendix 1: Artificial Bee Colony (ABC)

figure f
figure g

Appendix 2: Genetic Algorithm (GA)

figure h

Appendix 3: Differential Evolution (DE)

figure i

Appendix 4: Particle Swarm Optimization (PSO)

figure j
figure k

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Goudarzi, S., Hassan, W.H., Anisi, M.H. et al. MDP-Based Network Selection Scheme by Genetic Algorithm and Simulated Annealing for Vertical-Handover in Heterogeneous Wireless Networks. Wireless Pers Commun 92, 399–436 (2017). https://doi.org/10.1007/s11277-016-3549-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-016-3549-5

Keywords

Search

Navigation