Due to its strong flexibility, easy deployment, high maneuverability and extensive connectivity, unmanned aerial vehicle (UAV) swarm has been widely used in the construction of emergency communication network in recent years. Among them, packet routing in a resilient and adaptive manner is one of the fundamental problems for cooperation between multiple UAVs to complete search and rescue tasks. Recently, reinforcement learning (RL) technique has provided a new opportunity for network-related applications, including routing. However, most existing RL-based routing protocols suffer from issues such as local optimum, blind exploration and slow convergence speed. Additionally, the routing protocols based on deep reinforcement learning (DRL) has high computational complexity, making them unsuitable for energy-limited emergency relief scenarios. In this paper, we proposed a Q-learning aided resilient routing protocol with hindsight pre-calculation (QR2HPC) in UAV swarm for the construction of the emergency networks. Firstly, a dynamic exploration and exploitation coefficient is proposed based on the number and speed of neighbors. Secondly, a warm-start mechanism is proposed in the exploration phase that modifies the traditional random next hop selection to a routing approach guided by various indicators. Finally, we introduce a hindsight pre-calculation (HPC) mechanism to improve the robustness of Q-table to traffic flow changes. The experimental results manifest that our protocols can make effective routing decisions in dynamic wireless multi-hop networks, thereby enhancing the system performances in terms of packet delivery ratio, end-to-end delay, throughput and network lifetime.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Distributed and Adaptive Routing Protocol for UAV-aided Emergency Networks


    Beteiligte:
    Tang, Jie (Autor:in) / Zhou, Zihao (Autor:in) / Feng, Wanmei (Autor:in) / Wong, Kai Kit (Autor:in)


    Erscheinungsdatum :

    10.10.2023


    Format / Umfang :

    1575095 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    An Adaptive Strategy for Location-Aided Routing Protocol in Vehicular Ad Hoc Networks

    Meng, Jia / Wu, Hao / Tang, Hengliang et al. | IEEE | 2013


    A static-node assisted adaptive routing protocol in vehicular networks

    Yong, Ding / Wang, Chen / Li, Xiao | Tema Archiv | 2007


    Adaptive emergency evacuation routing: A graph-based approach

    Behrooz, Hojat / Ilbeigi, Mohammad | Elsevier | 2024

    Freier Zugriff

    A new distributed routing protocol using partial traffic information for vehicular ad hoc networks

    Tian, Rui / Zhang, Baoxian / Zheng, Jun et al. | Tema Archiv | 2014