Advancements in machine learning and artificial intelligence have found broad applications across various domains. However, their integration into space-related scenarios, especially satellite tasking, has been relatively limited. As satellite architectures shift from a few high-end systems to constellations of simpler, more numerous spacecraft, dynamically tasking payload sensors becomes intricate. This complexity underscores the importance of researching effective sensor tasking methods, a challenge ideally suited for Reinforcement Learning (RL). This study expands upon prior work in RL for Low Earth Orbit (LEO) satellite Hyper Spectral Imaging (HSI) sensor tasking, broadening its scope to encompass multi-agent, multi-target scenarios.To enable the effective use of RL in multi-agent systems, we propose an enhanced Python-based modeling and simulation environment. This framework facilitates the development and assessment of coordination and decision-making processes among multiple independent satellites acting as agents in the LEO domain. Through the incorporation of multi-agent reinforcement learning (MARL) methodologies, the framework fosters collaboration and communication among satellites while optimizing their individual tasking goals. Additionally, we extend the RL framework to support the simultaneous tracking of multiple targets. This involves adapting existing algorithms to accommodate multi-target reinforcement learning (MTRL) strategies, where each satellite agent dynamically allocates its sensing resources to diverse targets based on relevance and importance. This work showcases a computationally efficient extension from a single-agent, single-target approach to a multi-agent, multi-target context. We outline steps to streamline the multi-target association into a single-target context, thus expanding RL capabilities with minimal added computational complexity.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-Agent and Multi-Target Reinforcement Learning for Satellite Sensor Tasking


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    02.03.2024


    Format / Umfang :

    9132180 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Space-Based Sensor Tasking Using Deep Reinforcement Learning

    Siew, Peng Mun / Jang, Daniel / Roberts, Thomas G. et al. | Springer Verlag | 2022

    Freier Zugriff

    Dynamic Sensor Tasking for Space Situational Awareness via Reinforcement Learning

    Linares, Richard | British Library Conference Proceedings | 2016


    Cislunar Space Situational Awareness Sensor Tasking using Deep Reinforcement Learning Agents

    Siew, Peng Mun | British Library Conference Proceedings | 2022


    Multi-Agent Multi-Target Tracking Using Curriculum Learning for Reinforcement Learning

    Vincent, Caroline R. / Henshall, Andrea / Cannataro, Begum et al. | AIAA | 2025