This work focuses on autonomous contingency planning for scientific missions by enabling rapid policy computation from any off-nominal point in the state space in the event of a delay or deviation from the nominal mission plan. Successful contingency planning involves managing risks and rewards, often probabilistically associated with actions, in stochastic scenarios. Markov Decision Processes (MDPs) are used to mathematically model decision-making in such scenarios. However, in the specific case of planetary rover traverse planning, the vast action space and long planning time horizon pose computational challenges. A bi-level MDP framework is proposed to improve computational tractability, while also aligning with existing mission planning practices and enhancing explainability and trustworthiness of AI-driven solutions. We discuss the conversion of a mission planning MDP into a bi-level MDP, and test the framework on RoverGridWorld, a modified GridWorld environment for rover mission planning. We demonstrate the computational tractability and near-optimal policies achievable with the bi-level MDP approach, highlighting the trade-offs between compute time and policy optimality as the problem’s complexity grows. This work facilitates more efficient and flexible contingency planning in the context of scientific missions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Contingency Planning Using Bi-level Markov Decision Processes for Space Missions


    Beteiligte:
    Banerjee, Somrita (Autor:in) / Balaban, Edward (Autor:in) / Shirley, Mark (Autor:in) / Bradner, Kevin (Autor:in) / Pavone, Marco (Autor:in)


    Erscheinungsdatum :

    02.03.2024


    Format / Umfang :

    2375203 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Planning using hierarchical constrained Markov decision processes

    Feyzabadi, S. | British Library Online Contents | 2017


    Ground Delay Program Planning Using Markov Decision Processes

    Cox, Jonathan / Kochenderfer, Mykel J. | AIAA | 2016




    Exploring Contingency Responses to Disruptive Events During Transitions in Deep Space Missions

    Vaccino, Luca / Azimi, Mohsen / Dyke, Shirley J. et al. | AIAA | 2025