The future of space exploration depends on robust, reliable communication systems. As the number of such communication systems increase, automation is fast becoming a requirement to achieve this goal. A reinforcement learning solution can be employed as a possible automation method for such systems. The goal of this study is to build a reinforcement learning algorithm which optimizes data throughput of a single actor. A training environment was created to simulate a link within the NASA Space Communication and Navigation (SCaN) infrastructure, using state of the art simulation tools developed by the SCaN Center for Engineering, Networks, Integration, and Communications (SCENIC) laboratory at NASA Glenn Research Center to obtain the closest possible representation of the real operating environment. Reinforcement learning was then used to train an agent inside this environment to maximize data throughput. The simulation environment contained a single actor in low earth orbit capable of communicating with twenty-five ground stations that compose the Near-Earth Network (NEN). Initial experiments showed promising training results, so additional complexity was added by augmenting simulation data with link fading profiles obtained from real communication events with the International Space Station. A grid search was performed to find the optimal hyperparameters and model architecture for the agent. Using the results of the grid search, an agent was trained on the augmented training data. Testing shows that the agent performs well inside the training environment and can be used as a foundation for future studies with added complexity and eventually tested in the real space environment.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning Applied to Cognitive Space Communications


    Beteiligte:


    Erscheinungsdatum :

    2019-06-01


    Format / Umfang :

    3370544 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-objective reinforcement learning-based deep neural networks for cognitive space communications

    Ferreira, Paulo Victor R. / Paffenroth, Randy / Wyglinski, Alexander M. et al. | IEEE | 2017


    Multi-Objective Reinforcement Learning for Cognitive Radio--Based Satellite Communications

    Ferreira, Paulo / Paffenroth, Randy / Wyglinski, Alexander et al. | AIAA | 2016


    COGNITIVE COMMUNICATIONS FOR NASA SPACE SYSTEMS

    Chelmins, David / Briones, Janette / Downey, Joseph et al. | TIBKAT | 2021


    Latent Space Reinforcement Learning

    Luck, Kevin Sebastian | BASE | 2014

    Freier Zugriff

    Cognitive Communications for NASA Space Systems

    Chelmins, David / Briones, Janette / Downey, Joseph et al. | NTRS | 2019