For the safe deployment of multirobot systems, accurate position estimation is necessary. We present a multirobot navigation algorithm that accomplishes the dual objective of reaching designated goal positions and maintaining low position uncertainty. We pose the problem as a ρ -partially observable Markov decision process ( ρ POMDP) to capture position uncertainty through a belief-based reward. The multirobot system employs a centralized extended Kalman filter (EKF) for state estimation, whose output is used as the observation as well as the belief in the ρ POMDP. Using the EKF output as the observation and belief allows for the integration of the EKF in the action planning module of the system. To solve the ρ POMDP, we adapt the online information particle filter tree algorithm to be compatible with the EKF closed-form output being used as both the observation and belief. We present results for the proposed navigation algorithm that show emergent behaviors for a multirobot system, where the robots move to provide inter-ranging measurements that minimize position uncertainty for all robots in the system. We also demonstrate that the proposed method outperforms a state-of-the-art solver (partially observable Monte Carlo planning with observation widening) and a direct-to-goal planner in terms of minimizing position uncertainty.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multirobot Navigation Using Partially Observable Markov Decision Processes with Belief-Based Rewards


    Contributors:

    Published in:

    Publication date :

    2023-06-06


    Size :

    10 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Signal Source Localization Using Partially Observable Markov Decision Processes

    Dressel, Louis K. / Kochenderfer, Mykel J. | AIAA | 2015


    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011



    Signal Source Localization Using Partially Observable Markov Decision Processes (AIAA 2015-0116)

    Dressel, Louis K. / Kochenderfer, Mykel J. | British Library Conference Proceedings | 2015


    Health-Aware Multi-UAV Planning using Decentralized Partially Observable Semi-Markov Decision Processes

    Omidshafiei, Shayegan / Agha-mohammadi, Ali-akbar / Amato, Christopher et al. | AIAA | 2016