Liheng Li
ABSTRACT
In the realm of high-dynamic-flight self-organizing networks, traditional proactive and reactive routing protocols confront challenges arising from the delayed and inflexible determination of the validity of neighbour nodes. An untimely assessment of node validity may lead to an escalated overall network packet loss rate, consequently causing a proportional decrease in throughput. To mitigate this issue, this paper introduces a Reinforcement Learning based Topoloty Maintenance Algorithm (RLTM). This algorithm integrates the mobility characteristics and remaining energy of neighbour nodes into a stability metric for these nodes. By conceptualizing the validity of neighbour nodes in topology maintenance as a Markov process and incorporating the stability metric as a dimension in the state space, the model undergoes training via Proximal Policy Optimization (PPO) to generate decisions for establishing the effective time of neighbour nodes. Simulation results demonstrate that, in comparison to other topology maintenance optimization algorithms, the proposed algorithm amplifies the average packet delivery rate and throughput of unmanned aerial vehicle (UAV) nodes in high-speed mobility scenarios.
- Shakhatreh H, Sawalmeh AH, Al-Fuqaha A, Dou Z, Almaita E, Khalil I, Othman NS, Khreishah A, Guizani M. Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges. Ieee Access. 2019, Apr 9; 7: 48572-634.Google Scholar
- Idries A, Mohamed N, Jawhar I, Mohamed F, Al-Jaroodi J. Challenges of developing UAV applications: A project management view. In2015 International Conference on Industrial Engineering and Operations Management (IEOM) 2015, Mar 3 (pp. 1-10). IEEE.Google ScholarCross Ref
- Arafat MY, Poudel S, Moh S. Medium access control protocols for flying ad hoc networks: A review. IEEE Sensors Journal. 2020 ,Oct 29; 21(4):4097-121.Google Scholar
- Malhotra A, Kaur S. A comprehensive review on recent advancements in routing protocols for flying ad hoc networks. Transactions on Emerging Telecommunications Technologies. 2022, Mar;33(3): e3688.Google Scholar
- Wheeb AH, Al-Jamali NA. Performance analysis of OLSR protocol in mobile ad hoc networks. iJIM. 2022, 16(01):107.Google Scholar
- Saini TK, Sharma SC. Recent advancements, review analysis, and extensions of the AODV with the illustration of the applied concept. Ad Hoc Networks. 2020, Jun 1;103:102148.Google Scholar
- Qiu X, Xu L, Wang P, Yang Y, Liao Z. A data-driven packet routing algorithm for an unmanned aerial vehicle swarm: A multi-agent reinforcement learning approach. IEEE Wireless Communications Letters. 2022, Aug 3;11(10):2160-4.Google Scholar
- Zeng Y, Zhou J, Liu Y, Cao T, Yang D, Liu Y, Shi X. Stable routing protocol for unmanned aerial vehicle ad‐hoc networks based on DQN‐OLSR. IET Communications. 2023, Jan;17(1):73-85.Google Scholar
- Liu Q, Zhu X, Zhou C, Dong C. Advanced Fast Recovery OLSR Protocol for UAV Swarms in the Presence of Topological Change. In2023 26th International Conference on Computer Supported Cooperative Work in Design (CSCWD) 2023, May 24 (pp. 709-714). IEEE.Google Scholar
- Ayub MS, Adasme P, Melgarejo DC, Rosa RL, Rodríguez DZ. Intelligent hello dissemination model for FANET routing protocols. IEEE Access. 2022, Apr 25;10:46513-25.Google Scholar
- Jovel, F., McCartney, J., Teller, P. J., Ruiz, E., & McGarry, M. P. 2017. Neighbour discovery message hold times for MANETs. Computer Communications, 112, 38-46.Google ScholarDigital Library
Index Terms
- Topology Maintenance Optimization Algorithm Based on Deep Reinforcement Learning in High Dynamic Flying Ad-Hoc Networks
Recommendations
Topology construction and topology adjustment in flying Ad hoc networks for relay transmission
AbstractA flying ad hoc network (FANET) is formed by multiple unmanned aerial vehicles (UAVs) in an ad hoc manner in which UAVs can cooperate more effectively to complete complex tasks. In this paper, we mainly investigate the topology construction and ...
Ant colony optimization based enhanced dynamic source routing algorithm for mobile Ad-hoc network
Due to the dynamic nature of the Mobile Ad-hoc Network (MANET), routing in MANET becomes challenging especially when certain QoS requirements (like high data packet delivery ratio, low end to end delay, low routing overhead, and low energy consumption) ...
Flying Ad-Hoc Networks (FANETs)
One of the most important design problems for multi-UAV (Unmanned Air Vehicle) systems is the communication which is crucial for cooperation and collaboration between the UAVs. If all UAVs are directly connected to an infrastructure, such as a ground ...
Comments