Survey paperPerformance evaluation and comparative study of main VDTN routing protocols under small- and large-scale scenarios
Introduction
The rapid population growth and the large expanse of urban areas have led to real-life transportation problems like accidents and traffic jams, which by a domino effect, have resulted in economic and ecologic concerns, namely: a notable increase in goods delivery delays, a waste of precious resources, especially oil, and a rise in pollution. In fact, the World Health Organization (WHO) reported in [1] that more than 1.2 million people die each year due to road injuries, making it the first cause of death among people aged between 15 and 29 years. In the meantime, the Texas Transportation Institute has estimated the cost of congestion to be up to 160 billion dollars with 6.9 billion hours lost and 11.7 billion litres of oil wasted in 471 major urban areas of the United-States in 2014 alone [2].
In order to tackle these problems, researchers proposed a Traffic Information System (TIS) that specifically addresses traffic jams thanks to notification systems based on GPS-capable equipment. Despite the use of TIS which provides directional guidance, the lack of cooperation between vehicles, the limited application scope of TIS along with the development of affordable information technology nowadays, such as cellular networks and Wi-Fi, foster the emergence of enhanced and augmented TIS, called Intelligent Transportation Systems (ITS). These differ ostensibly from their predecessors. Firstly, their application scope is threefold: road safety, road traffic information and any third-party application with multimedia content. Secondly, unlike TIS, they make use of global and on-board sensors to gather information on the state of road traffic. They also introduce the concept of Inter-Vehicle Communication (IVC) which involves a wide range of technology and standards dedicated to communication from a car to any other entity in the network (C2X), like Dedicated Short Range Communication (DSRC) [3] and IEEE 802.11p Wi-Fi standard [4], [5]. With IVC, vehicles play an active role in gathering information, cooperating with other vehicles and finally reporting information to the main system [6].
In this global context, networks constituted by vehicles, commonly named Vehicular Networks or Vehicular Ad-hoc Networks (VANETs) have emerged as a hot research topic with the goal of providing the ITS applications cited before to road network users. However, running such applications over VANETs is a challenging task because routing protocols must overcome relevant problems that arise from vehicular environments. Indeed, the high mobility and speed of vehicles engender a very dynamic network topology with short contact durations, whereas urban environments limit transmission ranges due to physical obstacles and radio interference. Therefore, in a realistic VANET context, it is often hard to establish and maintain an end-to-end path between the sender and the recipient due to network issues like topology partitioning and intermittent connectivity. This severely limits the potential use of the conventional routing approach based on the TCP/IP protocol suite. Consequently, and to overcome these problems, VANETs are extended using main Delay-Tolerant Networks (DTNs) principles, leading to the advent of two categories of vehicular networks. The first ones, conventionally called VANETs, are delay-sensitive and operate only when full connectivity exists to support the end-to-end semantics of existing transport and application network layers. Thus they are strongly adapted to road safety applications where data must be delivered on-time. The latter ones are Vehicular Delay Tolerant Networks (VDTNs)[7], characterised by a good resilience to delay and to network disconnections, thanks to the Store, Carry and Forward (SCF) concept inherited from DTNs, which allows a forwarder to carry messages until it finds a suitable relay. Therefore, VDTNs can support applications with intermittent connectivity, such as road traffic information, or third-party services that range from emails, web access or any time unconstrained applications like multimedia content download or geographic services discovery. This work addresses the VDTN category with a focus on routing protocols that can support road traffic information and the kind of application operating with intermittent connectivity.
Many VDTN routing protocols are proposed in the literature following various forwarding approaches and replication strategies which differ ostensibly regarding the information needed to make the forwarding decision. Nevertheless, in practice, there are still few operational use cases and almost no wide-ranging implementations. In fact, whilst modelling VDTNs and studying their topology & behaviour can be achieved through theoretical approaches like temporal networks, to extract key facts which are able to provide general guidance for researchers, the evaluation of routing protocols dedicated to VDTNs requires a more concrete and straightforward approach, by relying, for instance, on real world experimentation or on realistic and sufficient large-scale testbeds. However, since these experiments are difficult to conduct and existing testbeds are not largely accessible to the research community for large-scale evaluation, computer simulations remain the main tool for large-scale assessment of VDTN routing protocols, especially when multiple simulators and tools exist and are widely available. Regarding the investigated protocols, in many cases, they are envisioned to provide data routing for a specific range of applications/services. Therefore, their evaluation scenarios are limited to the targeted use cases. It is then difficult to extend and reproduce the obtained results to other scenarios, protocols, and applications. In some cases, a simplification of the simulation scenario is introduced with the aim of reducing the processing time, which can be prohibitive when simulating realistic VDTN environments. While such an approach can help to quickly allow observation of general trends in the performance of some protocols, the obtained results have limited and contextual validation, since the evaluation context is not reflective of the characteristics of a realistic vehicular environment.
In [8], the authors identify three key aspects that are essential to ensure the validity, the compatibility and the reproducibility of the assessment through simulations of VDTN routing protocols. The first one is related to the considered network simulation tool. For instance, some simulation frameworks focus mainly on the behaviour of the routing protocol, at the networking layer, and make a partial or total abstraction of other components in the communication stack, the underlying transmission conditions and application traffic patterns. Such approaches are useful for understanding the behaviour of a VDTN routing protocol in an isolated manner but are far from being realistic and cannot be considered to offer a valid overall evaluation. The second and third aspects are related to the specificities of the vehicular environment: namely, the considered vehicles mobility model and the road topology. Indeed, these two aspects have an important impact on the routing protocol performances because they dictate the dynamics of Vehicle-To-Vehicle (V2V) communication. Consequently, in order to avoid overestimating the performances of VDTN routing protocols, the researchers are invited to use realistic road topologies and detailed representations of the vehicular traffic both at microscopic level (individual vehicle physical characteristics and behaviour) as well as macroscopic level (flow patterns based on diurnal cycles, population synthesis and activities). These last two points can be satisfied with real vehicle mobility traces and road topology extracted from real street maps [9].
Another important practical issue that arises when evaluating VDTN routing protocols is related to the availability of implementation codes of these protocols in the same simulation environment. While several VDTN routing protocols were evaluated in different simulation frameworks, each having its own degree of realism and parameter setting, only a limited number of implementation codes are publicly available. Moreover, most of the implementations are dedicated to different simulators. Thus, an important gap that must be addressed is the availability of DTN routing protocol implementations in a common simulation environment.
Through this work, we aim to contribute to the research on VDTN routing protocols by presenting a performance evaluation and a quantitative comparison of main VDTN routing protocols, based on the joint use of realistic simulators/tools and vehicle mobility datasets. To the best of our knowledge, this is the first extensive study that compares, in the same realistic simulation environment, the main flag-carriers of various categories of VDTN routing protocols, namely Epidemic, Direct Delivery, Prophet and GeoSpray protocols. We analyse the obtained results under different simulation scenarios, ranging from small-scale topologies to a realistic large-scale scenario defined in the TAPAS Cologne simulation scenario. We discuss the sensitivity of the results for the considered small-scale vs large-scale scenarios and we extract some key facts and recommendations that can guide future work in order to improve the performance of current VDTN protocols.
The rest of this paper is organised as follows. Taxonomy of VDTN routing protocols and the state of the art on their performance evaluations are presented under Sections 2 and 3, respectively. In Section 4, we describe in detail four VDTN protocols that we selected as representative of proposed forwarding strategies and metrics, replication policies, etc, namely Epidemic [10], Direct-Delivery [11], Prophet protocol [12], [13] and GeoSpray [14]. Then, in Section 5, we discuss various criteria for choosing an adapted simulation tool and we justify our choice for Omnet++ [15] and the vehicular simulation framework Veins [16] from among the plethora of available network simulators. We then describe the architectural design, which forms the basis of our common implementation of the four above-mentioned protocols in the same Omnet++/Veins simulation framework. In Section 6, a performance evaluation of the considered protocols is conducted under a synthetic small-scale scenario as well as under a large-scale scenario provided by the TAPAS-Cologne dataset [9]. We provide a deep analysis of the observed performances of each protocol with respect to different metrics (Delivery Ratio, Overhead, Average Delay and Hop Counts) and discuss the sensitivity of the observations for the considered simulation settings (e.g. small-scale vs. large-scale topologies). After comparing the different protocols, we focus on GeoSpray to reveal the potentiality to increase its performance. Finally, we conclude this paper in Section 7 by summarising some key facts and observations that arise from this study.
Section snippets
From VANETs and DTNs to VDTNs
As stated before, VDTNs are derived from VANETs and DTNs and as a consequence, understanding the former must be preceded by a good comprehension of their historical background. The following section provides a step-by-step overview of research work about vehicular networking and more specially, VDTNs.
Related work
Performance evaluation of multiple VDTN routing protocols is an active research topic with numerous pieces of related work. It is possible to classify these works easily into two distinct categories: those which propose a new routing protocol and therefore run a performance evaluation of their proposal against other well-known routing protocols, and those which consist of doing a pure performance evaluation of already established routing protocols without proposing a new one. Our work falls
Choice of protocols
For the purpose of evaluating the performance of VDTN routing protocols under both realistic network simulators and scenarios, we selected, in this work, four well-known protocols, namely: Direct Delivery, Epidemic, Prophet, and GeoSpray. This selection was not undertaken lightly since it relates to different criteria and is somewhat dictated by a global consensus across the research community.
Basically, we tried to pick the most representative or the best routing protocols for some routing
Choice of simulator
As explained above, the evaluation of the performance of VDTN routing protocols is commonly built upon simulations and therefore based on a single or a set of tools and/or simulators. While it makes sense that the process of selecting the right tools/simulators may be guided by researcher preferences or some specific constraints, it should be noted that this process is a critical aspect since simulator characteristics may differ ostensibly so that simulators may simulate with a high degree of
Evaluation and simulation results
The main goal of this work is to provide a global overview of protocol performance for on-field researchers. To that end, a quantitative evaluation of selected protocols under small- and large-scale scenarios is conducted, based on synthetic as well as realistic vehicle mobility. In fact, while an evaluation under a small and synthetic scenario is what is usually done, the need for a realistic and large-scale scenario makes sense since the main use case of studied protocols is routing data
Conclusion and perspectives
In this paper, we focus on Vehicular Delay Tolerant Networks (VDTNs) and, in particular, routing protocols dedicated to them. Therefore, extensive work was conducted that covers various relevant aspects. Firstly, the origins & historical background of VDTNs in parallel with the taxonomy of their routing protocols were covered. Then, related works and comparative studies found in the literature were analysed. Following that, four (04) main protocols were selected according to multiple criteria
Arslane Hamza-Cherif is a Ph.D. Candidate, since December 2012, at the University of Abou Bakr Belkaïd, Tlemcen, Algeria. He received a License degree in Computer Sciences from the University of Ahmed Ben Bella, Oran, Algeria in 2010 and a Master degree in Computer Sciences, specialized in Networking & Distributed Systems, in 2012 from the same University. His research interests cover Computer Networks, Wireless Networks, P2P. Currently, his research focuses on Intelligent Transportation
References (65)
- et al.
Ad hoc On-Demand Distance Vector (AODV) Routing
Internet Request for Comment RFC
(2003) - et al.
A routing strategy for vehicular ad hoc networks in city environments
Intelligent Vehicles Symposium, 2003. Proceedings. IEEE
(2003) Global Status Report on Road Safety 2015
(2015)- et al.
2015 Urban mobility scorecard
Texas A&M Transp. Inst. Inrix
(2015) Dedicated short-range communications (dsrc) standards in the united states
Proc. IEEE
(2011)- et al.
IEEE Standard for Information Technology– Telecommunications and Information Exchange Between Systems– Local and Metropolitan Area Networks– Specific Requirements : Part 11 : Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications : Amendment 6: Wireless Access in Vehicular Environments
(2010) - et al.
IEEE Standard for Information Technology : Telecommunications and Information Exchange Between Systems : Local and Metropolitan Area Networks–Specific Requirements
(2012) Intelligent Transport Systems (ITS); Communications Architecture
EN
(2010)- et al.
Delay-Tolerant Networking Architecture
RFC
(2007) - et al.
Toward reproducibility and comparability of IVC simulation studies: a literature survey
IEEE Commun. Mag.
(2012)
Large-scale urban vehicular mobility for networking research
IEEE Vehicular Networking Conference, VNC
Epidemic Routing for Partially-Connected Ad Hoc Networks
Technical Report
Single-copy routing in intermittently connected mobile networks
Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004. 2004 First Annual IEEE Communications Society Conference on
Probabilistic routing in intermittently connected networks
ACM SIGMOBILE Mob. Comput. Commun. Rev.
The evolution of a DTN routing protocol - PRoPHETv2
Proceedings of the 6th ACM workshop on Challenged networks (2)
GeoSpray: A geographic routing protocol for vehicular delay-tolerant networks
Inf. Fusion
An overview of the OMNeT++ simulation environment
Proceedings of the 1st International Conference on Simulation Tools and Techniques for Communications, Networks and Systems & Workshops
Bidirectionally coupled network and road traffic simulation for improved IVC analysis
IEEE Trans. Mob. Comput.
Gpsr: Greedy perimeter stateless routing for wireless networks
Proceedings of the 6th Annual International Conference on Mobile Computing and Networking
Geographic routing in city scenarios
ACM SIGMOBILE Mobile Comput. Commun. Rev.
Delay-tolerant networking: an approach to interplanetary internet
IEEE Commun. Mag.
Bundle Protocol Specification
RFC 5050
An empirical study on the temporal structural characteristics of VANETs on a taxi GPS dataset
IEEE Access
Temporal connectivity of vehicular networks: The power of store-carry-and-forward
2015 IEEE Vehicular Networking Conference (VNC)
Routing protocols in vehicular delay tolerant networks: A comprehensive survey
Comput. Commun.
Routing in internet of vehicles: a review
IEEE Trans. Intell. Transp. Syst.
Dtn protocols for vehicular networks: An application oriented overview
IEEE Commun. Surv. Tutor.
Spray and wait: An efficient routing scheme for intermittently connected mobile networks
Proceedings of the 2005 ACM SIGCOMM Workshop on Delay-tolerant Networking
Social network analysis for routing in disconnected delay-tolerant manets
Proceedings of the 8th ACM International Symposium on Mobile ad hoc Networking and Computing
Zoom: Scaling the mobility for fast opportunistic forwarding in vehicular networks
INFOCOM, 2013 Proceedings IEEE
Knowledge-based opportunistic forwarding in vehicular wireless ad hoc networks
Vehicular Technology Conference, 2005. VTC 2005-Spring. 2005 IEEE 61st
Cited by (11)
Power efficient Memetic Optimized and Adjacent Exponentially Distributed Routing in Mobile Ad Hoc Networks
2020, Computer CommunicationsCitation Excerpt :A heuristic model and collaborative routing algorithms was introduced in [13]. A comparative study of routing protocols was designed in [14]. Totally Opportunistic Routing Algorithm (TORA) was investigated in [15] to defeat void node issue and maximize throughput and energy efficiency.
An efficient vehicular-relay selection scheme for vehicular communication
2023, Soft ComputingConnectivity Analysis in Vehicular Ad-hoc Network based on VDTN
2023, Journal of Communications Software and SystemsSynchronizing Tasks for Distributed Learning in Connected and Autonomous Vehicles
2022, Journal of Communications and NetworksA Fog-Based IOV for Distributed Learning in Autonomous Vehicles
2022, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Arslane Hamza-Cherif is a Ph.D. Candidate, since December 2012, at the University of Abou Bakr Belkaïd, Tlemcen, Algeria. He received a License degree in Computer Sciences from the University of Ahmed Ben Bella, Oran, Algeria in 2010 and a Master degree in Computer Sciences, specialized in Networking & Distributed Systems, in 2012 from the same University. His research interests cover Computer Networks, Wireless Networks, P2P. Currently, his research focuses on Intelligent Transportation Systems, Vehicular Networks, Delay Tolerant Networks and lastly on the design and the development of routing protocols for Vehicular Networks, more specifically Vehicular Delay Tolerant Networks.
Khaled Boussetta is associate professor at L2TI laboratory of the Institut Galilée, University Paris 13, since September 2004. He received an M.S. degree in Computer Science from University Paris 6 in 1996 and in 2003 a Ph.D. degree in Computer Science, with the highest honors, from the University of Versailles. In 2001, he worked as a visiting researcher at the Network Research Lab at UCLA. In 2003 he joined the Networks and Performances Analysis team within the LIP6 laboratory, University Paris 6, as a postdoc researcher. Since 2012, he is external collaborator of the INRIA AGORA (former Urbanet) team located in Lyon. His research interests cover designing, modeling and performance evaluation of wireless networks. Currently, his research focuses on IoT, vehicular networks, Edge/Fog/Cloud, infrastructures dimensioning and network mechanisms to support delay sensitive applications. He is actively involved in the community as a TPC member, and a reviewer for many top-tier conferences and journals.
Gladys Diaz is associated professor, since 2001, at the University of Paris 13, France. She is member of the Network team at L2TI laboratory (Laboratory of Information Processing and Transmission). She received her Ph.D. degree in 2000 from INPL (Institut National Polytechnique de Lorraine), Nancy, France. She has obtained her HDR degree (Habilitation Diriger les Recherches) in 2016 from the UPMC University (Université Pierre et Marie Curie, Paris 6), Paris, France.
Her research interests are network and service architectures (SOA, Cloud Networking and Virtual networks), QoS and information modeling, ITS architectures and network management. More recent works are currently focused on the convergence between architectural and informational dimensions of the Services/Networks of the future, in special with the architectures and platforms in the Cloud, the dynamic orchestration and deployment of network services in virtualized environments (SDN/NFV). This work is concerning different uses cases: 5G network slicing, ITS routing, IoT platforms.
Fedoua Lahfa received her Master in Telecommunications from the University of Tlemcen, Algeria in 1990. Since 1991, she has been assistant professor in computer engineering. She has served on the scientific council and other Committees of Computer Department of the University of Tlemcen. Her research interest now is mobile networks and services, QoS service provisioning, Performance evaluation, modeling and security of large scale distributed system.