For the safe deployment of multirobot systems, accurate position estimation is necessary. We present a multirobot navigation algorithm that accomplishes the dual objective of reaching designated goal positions and maintaining low position uncertainty. We pose the problem as a ρ -partially observable Markov decision process ( ρ POMDP) to capture position uncertainty through a belief-based reward. The multirobot system employs a centralized extended Kalman filter (EKF) for state estimation, whose output is used as the observation as well as the belief in the ρ POMDP. Using the EKF output as the observation and belief allows for the integration of the EKF in the action planning module of the system. To solve the ρ POMDP, we adapt the online information particle filter tree algorithm to be compatible with the EKF closed-form output being used as both the observation and belief. We present results for the proposed navigation algorithm that show emergent behaviors for a multirobot system, where the robots move to provide inter-ranging measurements that minimize position uncertainty for all robots in the system. We also demonstrate that the proposed method outperforms a state-of-the-art solver (partially observable Monte Carlo planning with observation widening) and a direct-to-goal planner in terms of minimizing position uncertainty.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multirobot Navigation Using Partially Observable Markov Decision Processes with Belief-Based Rewards


    Contributors:

    Published in:

    Publication date :

    2023-08-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011

    Free access

    Signal Source Localization Using Partially Observable Markov Decision Processes

    Dressel, Louis K. / Kochenderfer, Mykel J. | AIAA | 2015


    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011


    Unmanned Aircraft Collision Avoidance Using Partially Observable Markov Decision Processes

    S. Temizer / M. J. Koehenderfer / L. P. Kaelbling et al. | NTIS | 2009