Training reinforcement learning (RL) agents for motion planning in heavily constrained solution spaces may require extensive exploration, leading to long training times. In automated driving, RL agents have to learn multiple skills at once, such as collision avoidance, traffic rule adherence, and goal reaching. In this work, we decompose this complicated learning task by applying curriculum learning for the first time onto an RL agent based on graph neural networks. The curriculum's sequence of sub-tasks gradually increases the difficulty of the longitudinal and lateral motion planning problem for the agent. Each of our sub-tasks contains a set of rewards, including novel rewards for temporal-logic-based traffic rules for speed, safety distance, and braking. Unlike prior work, the agent's state is extended by map and traffic rule information. Its performance is evaluated on prerecorded, real-world traffic data instead of simulations. Our numerical results show that the multi-stage curricula let the agent learn goal-seeking highway driving faster than in baseline setups trained from scratch. Including traffic rule information in both the RL state and rewards stabilizes the training and improves the agent's final goal-reaching performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Graph-Based Autonomous Driving with Traffic-Rule-Enhanced Curriculum Learning


    Contributors:


    Publication date :

    2023-09-24


    Size :

    6820183 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Efficient-Enhanced Reinforcement Learning for Autonomous Driving in Urban Traffic Scenarios

    Yin, Jianwen / Jiang, Zhengmin / Liang, Qingyi et al. | IEEE | 2023


    ST-GRAPH LEARNING BASED DECISION FOR AUTONOMOUS DRIVING VEHICLE

    XU KECHENG / FAN HAOYANG / ZHANG YAJIA et al. | European Patent Office | 2020

    Free access

    AUTONOMOUS DRIVING APPARATUS, RULE DETERMINATION APPARATUS, AUTONOMOUS DRIVING METHOD, AND RULE DETERMINATION METHOD

    KUMANO SHUNYA / YOSHIKAWA SATORU / OSAWA HIROYUKI | European Patent Office | 2021

    Free access

    System and methods of adaptive traffic rule-based decision making for autonomous driving

    MA BIAO / TAL LIOR | European Patent Office | 2023

    Free access

    SYSTEM AND METHODS FOR ADAPTIVE TRAFFIC RULE-BASED DECISION MAKING FOR AUTONOMOUS DRIVING

    MA BIAO / TAL LIOR | European Patent Office | 2023

    Free access