Home > Published Issues > 2021 > Volume 16, No. 5, May 2021 >

Dynamic Q-learning and Fuzzy CNN Based Vertical Handover Decision for Integration of DSRC, mmWave 5G and LTE in Internet of Vehicles (IoV)

Shaik Mazhar Hussain and Kamaludin Mohamad Yusof
Department of Communications Engineering & Advanced Telecommunication Technology (ATT), School of Electrical Engineering, Faculty of Engineering, Universiti Teknologi Malaysia

Abstract—Internet of vehicles commonly known as IOV is a newly emerged area which with the help of internet assisted communication provides the support to the vehicles. Due to the access of more than one radio access network, 5G makes the connectivity ubiquitous. Vehicle mobility demands for handover in such heterogeneous networks. Instead of using better technology for long ranges and other types of traffic, the vehicles are using devoted short range communications at short ranges. Commonly, networks for handovers were used to be selected directly or with the available radio access it used to connect automatically. With the help of this, the hand over occurrence now takes places frequently. This paper is based on the incorporation of DSRC, LTE as well as mm Wave on Internet of vehicles which is integrated with the Handover decision making algorithm, Network Selection and Routing. The decision of the handovers is to ensure that if there is any requirement of the vertical handovers using dynamic Q-learning algorithms in which entropy function is used to predict the threshold according to the characteristics of the environment. The network selection process is done using Fuzzy Convolution Neural Network commonly known as FCNN which makes the fuzzy rules by considering the parameters such as strength of its signal, its distance, the density of the vehicle, the type of its data as well the Line of Sight (LoS). V2V chain routing is presented in such a manner that V2V pairs are also selected with the help of jellyfish optimization algorithm considering three metrics – Vehicle metrics, Channel metrics and Vehicle performance metrics. OMNET++ simulator is the software in which system is developed. The performance evaluation is done according to its Handover Success Probability, Handover Failure, Redundant Handover, Mean Throughput, delay and Packet Loss.
 
Index Terms—4G LTE, DSRC, internet of vehicles, mmWave 5G, network selection, vertical handover

Cite: Shaik Mazhar Hussain and Kamaludin Mohamad Yusof, "Dynamic Q-learning and Fuzzy CNN Based Vertical Handover Decision for Integration of DSRC, mmWave 5G and LTE in Internet of Vehicles (IoV)," Journal of Communications vol. 16, no. 5, pp. 155-166, May 2021. Doi: 10.12720/jcm.16.5.155-166

Copyright © 2021 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.