The future of space exploration depends on robust, reliable communication systems. As the number of such communication systems increase, automation is fast becoming a requirement to achieve this goal. A reinforcement learning solution can be employed as a possible automation method for such systems. The goal of this study is to build a reinforcement learning algorithm which optimizes data throughput of a single actor. A training environment was created to simulate a link within the NASA Space Communication and Navigation (SCaN) infrastructure, using state of the art simulation tools developed by the SCaN Center for Engineering, Networks, Integration, and Communications (SCENIC) laboratory at NASA Glenn Research Center to obtain the closest possible representation of the real operating environment. Reinforcement learning was then used to train an agent inside this environment to maximize data throughput. The simulation environment contained a single actor in low earth orbit capable of communicating with twenty-five ground stations that compose the Near-Earth Network (NEN). Initial experiments showed promising training results, so additional complexity was added by augmenting simulation data with link fading profiles obtained from real communication events with the International Space Station. A grid search was performed to find the optimal hyperparameters and model architecture for the agent. Using the results of the grid search, an agent was trained on the augmented training data. Testing shows that the agent performs well inside the training environment and can be used as a foundation for future studies with added complexity and eventually tested in the real space environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning Applied to Cognitive Space Communications


    Contributors:


    Publication date :

    2019-06-01


    Size :

    3370544 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-objective reinforcement learning-based deep neural networks for cognitive space communications

    Ferreira, Paulo Victor R. / Paffenroth, Randy / Wyglinski, Alexander M. et al. | IEEE | 2017


    Multi-Objective Reinforcement Learning for Cognitive Radio--Based Satellite Communications

    Ferreira, Paulo / Paffenroth, Randy / Wyglinski, Alexander et al. | AIAA | 2016


    COGNITIVE COMMUNICATIONS FOR NASA SPACE SYSTEMS

    Chelmins, David / Briones, Janette / Downey, Joseph et al. | TIBKAT | 2021


    Latent Space Reinforcement Learning

    Luck, Kevin Sebastian | BASE | 2014

    Free access

    Cognitive Communications for NASA Space Systems

    Chelmins, David / Briones, Janette / Downey, Joseph et al. | NTRS | 2019