Faced with the abundance of mobile ad-hoc network (MANET) applications, there emerges a strong incentive to provision MANET in millimeter wave. However, the deafness of directional antennas and the decentralized structure of MANET make it difficult to achieve consistent medium access control (MAC) among nodes through random competition. Therefore, graph coloring-based MAC (GC-MAC) scheme is proposed to implement time division multiplexed scheduling, but it allocates equal slots to links, disregarding the unbalanced and piecewise stationary traffic distribution in task-driven MANETs. Here, we propose a continual multi-agent reinforcement learning (RL)-assisted traffic-adaptive scheme to enhance the agility of slot allocation. Specifically, we add a contention period to frames of GC-MAC, during which nodes analyze stochastic characteristics of traffic to derive link traffic distribution for each task, and adjust slot assignment to reach cooperation through decentralized multi-agent deep Q-network (MA-DQN). Besides, considering the traffic variation due to task switch, continual RL is incorporated to accommodate changes of the environment more sensitively. Finally, simulation results prove the proposed scheme achieves faster convergence speed, lower delay and higher throughput.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Continual MARL-assisted Traffic-Adaptive GC-MAC Protocol for Task-Driven Directional MANETs


    Contributors:
    Wang, Qinyu (author) / Wang, Chan (author) / Li, Rongpeng (author) / Wei, Hanyu (author) / Zhao, Minjian (author)


    Publication date :

    2024-10-07


    Size :

    591575 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures

    Fares, Ahmed / A. Khamis, Mohamed / Gomaa, Walid | Springer Verlag | 2022


    MARL-FWC: Optimal Coordination of Freeway Traffic Control Measures

    Fares, Ahmed / Gomaa, Walid / Khamis, Mohamed A. | ArXiv | 2018

    Free access

    Industriebahnen in Marl

    Moskon, Arnd | SLUB | 2010


    Efficient ECGDH algorithm through protected multicast routing protocol in MANETs

    Muwel, Mukesh / Mishra, Prakash / Samvatsar, Makrand et al. | IEEE | 2017


    Novel Cluster Maintenance Protocol for Efficient Satellite Integration in MANETs

    Hamdi, M. / Franck, L. / Lagrange, X. et al. | British Library Conference Proceedings | 2011