For the safe deployment of multirobot systems, accurate position estimation is necessary. We present a multirobot navigation algorithm that accomplishes the dual objective of reaching designated goal positions and maintaining low position uncertainty. We pose the problem as a ρ -partially observable Markov decision process ( ρ POMDP) to capture position uncertainty through a belief-based reward. The multirobot system employs a centralized extended Kalman filter (EKF) for state estimation, whose output is used as the observation as well as the belief in the ρ POMDP. Using the EKF output as the observation and belief allows for the integration of the EKF in the action planning module of the system. To solve the ρ POMDP, we adapt the online information particle filter tree algorithm to be compatible with the EKF closed-form output being used as both the observation and belief. We present results for the proposed navigation algorithm that show emergent behaviors for a multirobot system, where the robots move to provide inter-ranging measurements that minimize position uncertainty for all robots in the system. We also demonstrate that the proposed method outperforms a state-of-the-art solver (partially observable Monte Carlo planning with observation widening) and a direct-to-goal planner in terms of minimizing position uncertainty.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multirobot Navigation Using Partially Observable Markov Decision Processes with Belief-Based Rewards


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    01.08.2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Signal Source Localization Using Partially Observable Markov Decision Processes

    Dressel, Louis K. / Kochenderfer, Mykel J. | AIAA | 2015


    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011

    Freier Zugriff

    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011


    Unmanned Aircraft Collision Avoidance Using Partially Observable Markov Decision Processes

    S. Temizer / M. J. Koehenderfer / L. P. Kaelbling et al. | NTIS | 2009


    UAV Guidance Algorithms via Partially Observable Markov Decision Processes

    Ragi, Shankarachary / Chong, Edwin K. P. | Springer Verlag | 2014