Most environment perception methods in autonomous vehicles rely on deep neural networks because of their impressive performance. However, neural networks have black-box characteristics in nature, which may lead to perception uncertainty and untrustworthy autonomous vehicles. Thus, this work proposes a decision-making method to adapt the potential perception uncertainty due to the sensor noises, fuzzy features, and unfamiliar inputs. The whole method is named as Perception Neural Networks Uncertainty Aware Decision-Making (PNNUAD) method. PNNUAD first uses the Monte Carlo dropout method to estimate the perception neural network uncertainty into a distribution around the original output. Then, the perception uncertainty will be considered in a designed reinforcement learning-based planner using a distributed value function. Finally, a backup policy will maintain the vehicle’s performance to avoid disastrous perception uncertainty. The evaluation section uses an augmented reality urban driving scenario; namely, the scenario builds in the CARLA simulator while the perception uncertainty comes from the real dataset. This case study focuses on the object class uncertainty of a widely used neural network, i.e., YOLO-V3. The results indicate that the proposed method can maintain AV safety even with poor perception performance. Meanwhile, the AV has not become too conservative by defending the perception uncertainty. This work is necessary for applying the statistics neural networks to safety-critical autonomous vehicles, and the source code will be open-source in this work.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    PNNUAD: Perception Neural Networks Uncertainty Aware Decision-Making for Autonomous Vehicle


    Contributors:
    Liu, Jiaxin (author) / Wang, Hong (author) / Peng, Liang (author) / Cao, Zhong (author) / Yang, Diange (author) / Li, Jun (author)

    Published in:

    Publication date :

    2022-12-01


    Size :

    4992556 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Prediction-Uncertainty-Aware Decision-Making for Autonomous Vehicles

    Tang, Xiaolin / Yang, Kai / Wang, Hong et al. | IEEE | 2022


    Uncertainty-Aware Decision-Making for Autonomous Driving at Uncontrolled Intersections

    Tang, Xiaolin / Zhong, Guichuan / Li, Shen et al. | IEEE | 2023


    Autonomous vehicle behavior decision-making system based on enhanced perception

    XIA YUYANG / LIU SHUNCHENG / HU RUI et al. | European Patent Office | 2023

    Free access

    Interaction-Aware Decision-Making for Autonomous Vehicles

    Chen, Yongli / Li, Shen / Tang, Xiaolin et al. | IEEE | 2023


    Autonomous vehicle decision making

    MISU TERUHISA / TAWARI ASHISH / MARTIN SUJITHA CATHERINE | European Patent Office | 2021

    Free access