Autonomous mobile robots employed in industrial applications often operate in complex and uncertain environments. In this paper we propose an approach based on an extension of Partially Observable Monte Carlo Planning (POMCP) for robot velocity regulation in industrial-like environments characterized by uncertain motion difficulties. The velocity selected by POMCP is used by a standard engine controller which deals with path planning. This two-layer approach allows POMCP to exploit prior knowledge on the relationships between task similarities to improve performance in terms of time spent to traverse a path with obstacles. We also propose three measures to support human-understanding of the strategy used by POMCP to improve the performance. The overall architecture is tested on a Turtlebot3 in two environments, a rectangular path and a realistic production line in a research lab. Tests performed on a C++ simulator confirm the capability of the proposed approach to profitably use prior knowledge, achieving a performance improvement from 0.7% to 3.1% depending on the complexity of the path. Experiments on a Unity simulator show that the proposed two-layer approach outperforms also single-layer approaches based only on the engine controller (i.e., without the POMCP layer). In this case the performance improvement is up to 37% comparing to a state-of-the-art deep reinforcement learning engine controller, and up to 51% comparing to the standard ROS engine controller. Finally, experiments in a real-world testing arena confirm the possibility to run the approach on real robots.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Partially Observable Monte Carlo Planning with state variable constraints for mobile robot navigation



    Erscheinungsdatum :

    2021-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Risk-aware shielding of Partially Observable Monte Carlo Planning policies

    Giulio Mazzi / Alberto Castellini / Alessandro Farinelli | BASE | 2023

    Freier Zugriff


    Robot planning in partially observable continuous domains

    Porta, Josep M. / Spaan, Matthijs T. J. / Vlassis, Nikos | BASE | 2005

    Freier Zugriff

    State Estimation for Mobile Robot using Partially Observable Markov Decision Process

    Kang, D. / Hashimoto, H. / Harashima, F. | British Library Online Contents | 1996