Reinforcement Learning is a commonly used technique for learning tasks in robotics, however, traditional algorithms are unable to handle large amounts of data coming from the robot’s sensors, require long training times, and use dis-crete actions. This work introduces TS-RRLCA, a two stage method to tackle these problems. In the first stage, low-level data coming from the robot’s sensors is transformed into a more natural, relational representation based on rooms, walls, corners, doors and obstacles, significantly reducing the state space. We use this representation along with Be-havioural Cloning, i.e., traces provided by the user; to learn, in few iterations, a relational control policy with discrete actions which can be re-used in different environments. In the second stage, we use Locally Weighted Regression to transform the initial policy into a continuous actions policy. We tested our approach in simulation and with a real ser-vice robot on different environments for different navigation and following tasks. Results show how the policies can be used on different domains and perform smoother, faster and shorter paths than the original discrete actions policies.


    Access

    Download


    Export, share and cite



    Title :

    Relational reinforcement learning with continuous actions by combining behavioural cloning and locally weighted regression



    Publication date :

    2010-01-01


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    SDR – Self Driving Car Implemented using Reinforcement Learning & Behavioural Cloning

    Tippannavar, Sanjay S / S D, Yashwanth / K M, Puneeth | IEEE | 2023



    Estimation of Vehicle Trajectories with Locally Weighted Regression

    Toledo, Tomer / Koutsopoulos, Haris N. / Ahmed, Kazi I. | Transportation Research Record | 2007


    Relational reinforcement learning with guided demonstrations

    Martínez Martínez, David / Alenyà Ribas, Guillem / Torras, Carme | BASE | 2017

    Free access

    Quality Control for Steel Products through Locally-weighted Regression

    Shigemori, H. / Nagao, R. / Hirata, N. et al. | British Library Online Contents | 2008