Topology-Aware Resilient Routing Protocol for FANETs: An Adaptive Q -Learning Approach

Отказоустойчивый протокол маршрутизации для FANET с учетом топологии: адаптивный подход на основе Q-обучения
Zhiyong Feng, Zhiqing Wei, Qixun Zhang, Heng Yang, Yanpeng Cui, Ce Shi
2022-03-29

FANET routingadaptive Q-learningneighbor change ratepacket delivery ratetopology-aware routing
Flying ad hoc networks (FANETs) play a crucial role in numerous military and civil applications since it shortens mission duration and enhances coverage significantly compared with a single unmanned aerial vehicle (UAV). Whereas, designing an energy-efficient FANETs routing protocol with a high packet delivery rate (PDR) and low delay is challenging owing to the dynamic topology changes. In this article, we propose a topology-aware resilient routing strategy based on adaptive$Q$-learning (TARRAQ) to accurately capture topology changes with low overhead and make routing decisions in a distributed and autonomous way. First, we analyze the dynamic behavior of UAVs nodes via the queuing theory, and then the closed-form solutions of neighbors’ change rate (NCR) and neighbors’ change interarrival time (NCIT) distribution are derived. Based on the real-time NCR and NCIT, a resilient sensing interval (SI) is determined by defining the expected sensing delay of network events. Besides, we also present an adaptive$Q$-learning approach that enables UAVs to make distributed, autonomous, and adaptive routing decisions, where the above SI ensures that the action space can be updated in time with low cost. The simulation results verify the accuracy of the topology dynamic analysis model, and also prove that our TARRAQ outperforms the$Q$-learning-based topology-aware routing (QTAR), mobility prediction-based virtual routing (MPVR), and greedy perimeter stateless routing based on energy-efficient hello (EE-Hello) in terms of 25.23%, 20.24%, and 13.73% lower overhead, 9.41%, 14.77%, and 16.70% higher PDR, and 5.12%, 15.65%, and 11.31% lower energy consumption, respectively.
1
A queuing-theoretic model derives closed-form expressions for neighbor change rate and neighbor change interarrival-time distributions, accurately characterizing UAV topology dynamics.
2
Compared with QTAR, MPVR, and EE-Hello, TARRAQ reduces overhead by 25.23%, 20.24%, and 13.73%, respectively.
3
Real-time neighbor-change metrics determine a resilient sensing interval that reduces topology-monitoring overhead while maintaining timely action-space updates.
4
TARRAQ increases packet delivery rate by 9.41%, 14.77%, and 16.70% and reduces energy consumption by 5.12%, 15.65%, and 11.31% relative to those baselines, respectively.
5
TARRAQ is a topology-aware, resilient FANET routing strategy using adaptive Q-learning for distributed and autonomous routing decisions.

Flying ad hoc networks (FANETs) of unmanned aerial vehicle (UAV) nodes

Topology-aware resilient routing performance, including overhead, packet delivery rate, delay, and energy consumption, under dynamic topology changes

Publication Details
Publication Date
2022-03-29
Journal
Publisher
ISSN
Cited by
145
Access Type
Author Information
Authors
Zhiyong Feng
Zhiqing Wei
Qixun Zhang
Heng Yang
Yanpeng Cui
Ce Shi
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%