Learning to drive in urban areas is an open challenge for autonomous vehicles (AVs), as complex decision making requirements are needed in multi-task co-ordinations environments. In this paper, we propose a hybrid framework with a new perception model involving affordance learning to simplify the surrounding urban scenes for training an AV agent, along with a planned trajectory and the associated driving measurements. Our proposed solution encompasses two main aspects. Firstly, a supervised learning network is used to map the input sensory data into affordance predictions. The predicted affordances provide a low-dimensional representation of surrounding scenes of the AV in the form of key perception indicators, e.g., true or false with respect to a traffic light signal. Secondly, a deep deterministic policy gradient model that maps the perception information into a series of actions is devised. We evaluate the proposed solution using the CARLA driving simulator in an urban town and evaluate the performance in a new, unseen town under different weather conditions. The quantitative and qualitative results indicate that our proposed solution can generalize well to cope with different traffic solutions and environmental conditions. Our proposed solution also outperforms other baseline methods in a comparative study in handling various AV driving tasks with different levels of difficulty. In addition, the model trained with simulated scenes yields promising prediction results when testing on recorded video streams on real-world highway and suburb environments with varying traffic and weather conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Policy-Based Reinforcement Learning for Training Autonomous Driving Agents in Urban Areas With Affordance Learning


    Contributors:


    Publication date :

    2022-08-01


    Size :

    1999528 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Urban Autonomous Driving of Emergency Vehicles with Reinforcement Learning

    Tong, Zherui / Ayala, Angel / Sandoval, Eduardo Benitez et al. | IEEE | 2023


    Autonomous Driving using Deep Reinforcement Learning in Urban Environment

    Hashim Shakil Ansari / Goutam R | BASE | 2019

    Free access

    Model-free Deep Reinforcement Learning for Urban Autonomous Driving

    Chen, Jianyu / Yuan, Bodi / Tomizuka, Masayoshi | IEEE | 2019


    Policy Gradient Based Reinforcement Learning Approach for Autonomous Highway Driving

    Aradi, Szilard / Becsi, Tamas / Gaspar, Peter | IEEE | 2018