Decision making for self‐driving cars is usually tackled by manually encoding rules from drivers’ behaviours or imitating drivers’ manipulation using supervised learning techniques. Both of them rely on mass driving data to cover all possible driving scenarios. This study presents a hierarchical reinforcement learning method for decision making of self‐driving cars, which does not depend on a large amount of labelled driving data. This method comprehensively considers both high‐level manoeuvre selection and low‐level motion control in both lateral and longitudinal directions. The authors firstly decompose the driving tasks into three manoeuvres, including driving in lane, right lane change and left lane change, and learn the sub‐policy for each manoeuvre. Then, a master policy is learned to choose the manoeuvre policy to be executed in the current state. All policies, including master policy and manoeuvre policies, are represented by fully‐connected neural networks and trained by using asynchronous parallel reinforcement learners, which builds a mapping from the sensory outputs to driving decisions. Different state spaces and reward functions are designed for each manoeuvre. They apply this method to a highway driving scenario, which demonstrates that it can realise smooth and safe decision making for self‐driving cars.


    Access

    Download


    Export, share and cite



    Title :

    Hierarchical reinforcement learning for self‐driving decision‐making without reliance on labelled driving data


    Contributors:
    Jingliang Duan (author) / Shengbo Eben Li (author) / Yang Guan (author) / Qi Sun (author) / Bo Cheng (author)


    Publication date :

    2020




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Hierarchical reinforcement learning for self‐driving decision‐making without reliance on labelled driving data

    Duan, Jingliang / Eben Li, Shengbo / Guan, Yang et al. | Wiley | 2020

    Free access

    Hierarchical reinforcement learning for self-driving decision-making without reliance on labelled driving data

    Duan, Jingliang / Eben Li, Shengbo / Guan, Yang et al. | IET | 2020

    Free access

    Automatic driving decision-making method and device based on hierarchical reinforcement learning

    LI DONGCHEN / ZHANG YIHAO / WEI CHONGSHAN et al. | European Patent Office | 2022

    Free access

    Automatic driving decision-making control method and system based on hierarchical reinforcement learning

    CAI YINGFENG / YANG SHAOQING / TENG CHENGLONG et al. | European Patent Office | 2020

    Free access

    Automatic driving decision-making system based on deep reinforcement learning

    ZHENG XIAOYAO / YAO QINGHE / ZHANG JIANPENG et al. | European Patent Office | 2024

    Free access