Cognitive networking applications continuously adapt actions according to observations of the environment and assigned performance goals. In this paper, one such cognitive networking application is evaluated where the aim is to route bundles over parallel links of different characteristics. Several machine learning algorithms may be suitable for the task. This research tested different reinforcement learning methods as potential enablers for this application: Q-Routing, Double Q-Learning, an actor-critic Learning Automata implementing the S-model, and the Cognitive Network Controller (CNC), which uses on a spiking neural network for Q-value prediction. All cases are evaluated under the same experimental conditions. Working with either a stable or time-varying environment with respect to the quality of the links, each routing method was evaluated with an identical number of bundle transmissions generated at a common rate. The measurements indicate that in general, the Cognitive Network Controller (CNC) produces better performance than the other methods followed by the Learning Automata. In the presented tests, the performance of Q-Routing and Double Q-Learning achieved similar performance to a non-learning round-robin approach. It is expect that these results will help to guide and improve the design of this and future cognitive networking applications.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Evaluating Reinforcement Learning Methods for Bundle Routing Control


    Beteiligte:


    Erscheinungsdatum :

    01.06.2019


    Format / Umfang :

    136642 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reinforcement Learning and Energy-Aware Routing

    Frohlich, Piotr / Gelenbe, Erol / Nowak, Mateusz | BASE | 2021

    Freier Zugriff

    EFFICIENT ROUTING WITH INVERSE REINFORCEMENT LEARNING

    Subramanian, Srikrishnan / Sankar, Adithya Raam | BASE | 2018

    Freier Zugriff

    Adaptive routing based on predictive reinforcement learning

    Desai, Rahul / Patil, B. P. | British Library Online Contents | 2018


    Sequential Cooperative Reinforcement Learning of Mothership Routing Problem

    Lee, Jaeho / Park, Junwoo / Lee, Dongwoo et al. | TIBKAT | 2023


    Sequential Cooperative Reinforcement Learning of Mothership Routing Problem

    Lee, Jaeho / Park, Junwoo / Lee, Dongwoo et al. | AIAA | 2023