Task learning in robotics requires repeatedly executing the same actions in different states to learn the model of the task. However, in real-world domains, there are usually sequences of actions that, if executed, may produce unrecoverable errors (e.g. breaking an object). Robots should avoid repeating such errors when learning, and thus explore the state space in a more intelligent way. This requires identifying dangerous action effects to avoid including such actions in the generated plans, while at the same time enforcing that the learned models are complete enough for the planner not to fall into dead-ends. We thus propose a new learning method that allows a robot to reason about dead-ends and their causes. Some such causes may be dangerous action effects (i.e., leading to unrecoverable errors if the action were executed in the given state) so that the method allows the robot to skip the exploration of risky actions and guarantees the safety of planned actions. If a plan might lead to a dead-end (e.g., one that includes a dangerous action effect), the robot tries to find an alternative safe plan and, if not found, it actively asks a teacher whether the risky action should be executed. This method permits learning safe policies as well as minimizing unrecoverable errors during the learning process. Experimental validation of the approach is provided in two different scenarios: a robotic task and a simulated problem from the international planning competition. Our approach greatly increases success ratios in problems where previous approaches had high probabilities of failing. ; Peer Reviewed ; Postprint (author's final draft)


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Safe robot execution in model-based reinforcement learning

    Martínez, David / Alenyà, Guillem / Torras, Carme | BASE | 2015

    Freier Zugriff

    Safe Exploration in Model-Based Reinforcement Learning

    Cohen, Max / Belta, Calin | Springer Verlag | 2023


    Temporal Logic Guided Safe Model-Based Reinforcement Learning

    Cohen, Max / Belta, Calin | Springer Verlag | 2023


    Safe Trajectory Sampling in Model-Based Reinforcement Learning

    Zwane, S / Hadjivelichkov, D / Luo, Y et al. | BASE | 2023

    Freier Zugriff

    Compliant Task Execution and Learning for Safe Mixed-Initiative Human-Robot Operations

    Dong, S. / Shah, J. / Conrad, P. et al. | British Library Conference Proceedings | 2011