Faced with the abundance of mobile ad-hoc network (MANET) applications, there emerges a strong incentive to provision MANET in millimeter wave. However, the deafness of directional antennas and the decentralized structure of MANET make it difficult to achieve consistent medium access control (MAC) among nodes through random competition. Therefore, graph coloring-based MAC (GC-MAC) scheme is proposed to implement time division multiplexed scheduling, but it allocates equal slots to links, disregarding the unbalanced and piecewise stationary traffic distribution in task-driven MANETs. Here, we propose a continual multi-agent reinforcement learning (RL)-assisted traffic-adaptive scheme to enhance the agility of slot allocation. Specifically, we add a contention period to frames of GC-MAC, during which nodes analyze stochastic characteristics of traffic to derive link traffic distribution for each task, and adjust slot assignment to reach cooperation through decentralized multi-agent deep Q-network (MA-DQN). Besides, considering the traffic variation due to task switch, continual RL is incorporated to accommodate changes of the environment more sensitively. Finally, simulation results prove the proposed scheme achieves faster convergence speed, lower delay and higher throughput.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Continual MARL-assisted Traffic-Adaptive GC-MAC Protocol for Task-Driven Directional MANETs


    Beteiligte:
    Wang, Qinyu (Autor:in) / Wang, Chan (Autor:in) / Li, Rongpeng (Autor:in) / Wei, Hanyu (Autor:in) / Zhao, Minjian (Autor:in)


    Erscheinungsdatum :

    07.10.2024


    Format / Umfang :

    591575 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures

    Fares, Ahmed / A. Khamis, Mohamed / Gomaa, Walid | Springer Verlag | 2022


    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures

    Fares, Ahmed / Gomaa, Walid / Khamis, Mohamed A. | ArXiv | 2018

    Freier Zugriff

    Industriebahnen in Marl

    Moskon, Arnd | SLUB | 2010


    Efficient ECGDH algorithm through protected multicast routing protocol in MANETs

    Muwel, Mukesh / Mishra, Prakash / Samvatsar, Makrand et al. | IEEE | 2017


    Novel Cluster Maintenance Protocol for Efficient Satellite Integration in MANETs

    Hamdi, M. / Franck, L. / Lagrange, X. et al. | British Library Conference Proceedings | 2011