Learning to drive in urban areas is an open challenge for autonomous vehicles (AVs), as complex decision making requirements are needed in multi-task co-ordinations environments. In this paper, we propose a hybrid framework with a new perception model involving affordance learning to simplify the surrounding urban scenes for training an AV agent, along with a planned trajectory and the associated driving measurements. Our proposed solution encompasses two main aspects. Firstly, a supervised learning network is used to map the input sensory data into affordance predictions. The predicted affordances provide a low-dimensional representation of surrounding scenes of the AV in the form of key perception indicators, e.g., true or false with respect to a traffic light signal. Secondly, a deep deterministic policy gradient model that maps the perception information into a series of actions is devised. We evaluate the proposed solution using the CARLA driving simulator in an urban town and evaluate the performance in a new, unseen town under different weather conditions. The quantitative and qualitative results indicate that our proposed solution can generalize well to cope with different traffic solutions and environmental conditions. Our proposed solution also outperforms other baseline methods in a comparative study in handling various AV driving tasks with different levels of difficulty. In addition, the model trained with simulated scenes yields promising prediction results when testing on recorded video streams on real-world highway and suburb environments with varying traffic and weather conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Policy-Based Reinforcement Learning for Training Autonomous Driving Agents in Urban Areas With Affordance Learning


    Contributors:


    Publication date :

    2022-08-01


    Size :

    1999528 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Urban Autonomous Driving of Emergency Vehicles with Reinforcement Learning

    Tong, Zherui / Ayala, Angel / Sandoval, Eduardo Benitez et al. | IEEE | 2023


    Deep Reinforcement-Learning-based Driving Policy for Autonomous Road Vehicles

    Makantasis, Konstantinos / Kontorinaki, Maria / Nikolos, Ioannis | ArXiv | 2019

    Free access

    Refine Reinforcement Learning for Safety Training of Autonomous Driving

    Yang, Fukun / Hu, Zhiqun / Zhang, Yuanming et al. | IEEE | 2024