Tracking resident space objects (RSOs), which include functional and non-functional satellites and space debris, requires flexible and adaptive tasking of sensors that operate in a distributed network. Allocating sensors to RSOs for maintaining track needs a multitude of criteria such as timely access to information, rapid decision making over complex outcomes, and integration between sensors to maintain coverage over extended period of time. Recent studies have shown promising potential of Deep Reinforcement Learning (DRL) for solving the sensor allocation problem (SAP). These DRL solutions, nevertheless, are not transparent and the inner combinatorial complexity of SAP remains uninterpretable. In this paper, we incorporate causality into the DRL approaches in an effort to make DRL based SAP solutions interpretable and explainable. We propose a structural causal model (SCM) of DRL and show that the state space can be reduced and the learning efficiency of DRL agent can be improved. We carry out a series of simulation experiments to illustrate the effectiveness of the simplified model. Performance results show that the simplified DRL agent using causal model can achieve the same level of performance as a non-simplified agent with an added capability of potentially explaining the resulting learning policy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Sensor Tasking for Space Situation Awareness: Combining Reinforcement Learning and Causality


    Contributors:
    Fan, Zhengyana (author) / Chang, KC (author) / Raz, Ali K. (author) / Harvey, Ashton (author) / Chen, Genshe (author)


    Publication date :

    2023-03-04


    Size :

    1499339 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Dynamic Sensor Tasking for Space Situational Awareness via Reinforcement Learning

    Linares, Richard | British Library Conference Proceedings | 2016


    Cislunar Space Situational Awareness Sensor Tasking using Deep Reinforcement Learning Agents

    Siew, Peng Mun | British Library Conference Proceedings | 2022


    Situation Awareness, Multi-tasking and Distraction

    Chen, Fang / Terken, Jacques | Springer Verlag | 2022


    Space-Based Sensor Tasking Using Deep Reinforcement Learning

    Siew, Peng Mun / Jang, Daniel / Roberts, Thomas G. et al. | Springer Verlag | 2022

    Free access

    Evidence-based Sensor Tasking for Space Domain Awareness

    Jaunzemis, Andris D. | British Library Conference Proceedings | 2016