Navigation in complex urban environments is very difficult, mainly due to perceptual uncertainty caused by obstructions in the field of view. The perceptual uncertainty is mainly due to sensors obstructed by obstacles. This has a significant impact on the safety of autonomous vehicles. Existing approaches based on partially observable Markov decision processes or reinforcement learning for the uncertainty problem may lead to conservative planning and expensive computation. We propose caution-driven networks combined with distributional reinforcement learning fully parameterized quantile function, which termed Intrinsic caution module – fully parameterized quantile function (ICM-FQF). The method is also applied in the continuous action space. The method is used to evaluate two challenging scenarios, pedestrians crossing with occlusion and a unsignalized intersection with a limited field of view. The algorithm is trained and evaluated using the CARLA simulator. Compared to conventional RL algorithms, the method makes smarter decisions and reduces the rate of collisions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Navigating autonomous vehicles in uncertain environments with distributional reinforcement learning


    Contributors:
    Xu, Shuyuan (author) / Hao, Jiachen (author) / Chen, Xuemei (author) / Hu, Yuhui (author)


    Publication date :

    2024-10-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Navigating the Future: Deep Reinforcement Learning for Smart Autonomous Vehicles

    Venkateswarlu, M. / Himaja, G. V. N. Shri / Reddy, V. Sainath et al. | IEEE | 2025



    NAVIGATING AERIAL VEHICLES USING DEEP REINFORCEMENT LEARNING

    CANDIDO SALVATORE J / GONG JUN / GENDRON-BELLEMARE MARC et al. | European Patent Office | 2021

    Free access

    Reinforcement Learning with Autonomous Small Unmanned Aerial Vehicles in Cluttered Environments

    Tran, Loc / Cross, Charles / Montague, Gilbert et al. | NTRS | 2015


    Heterogeneous Information Fusion-Based Distributional Reinforcement Learning for Autonomous Driving

    Yin, Jianwen / Jiang, Zhengmin / Liang, Qingyi et al. | IEEE | 2024