Automated Vehicles (AVs) need to be thoroughly evaluated in order to ensure their driving capabilities. However, comprehensive evaluations are intractable due to both time and monetary costs. To address this problem, we propose an Adaptive Design of Experiments (ADOE) method to evaluate the safety of AVs. Using this method, a Surrogate Model (SM) is established and updated iteratively. SM in ADOE is used to approximate the results of AV testing and help to select the next concrete scenario to be tested in each iteration. Two different ADOE approaches are proposed in this study for different testing purposes. Since the choice of the surrogate model has a profound impact on the performance of the ADOE method, 6 surrogate models were compared with two logical scenarios at different scales – a car following logical scenario and a cut-in logical scenario. Results show that Extreme Gradient Boosting (XGB) is suitable for both ADOE approaches. And both proposed ADOE approaches achieved desired performance. Scenario-oriented ADOE made full use of each concrete scenario, capturing one collision case for every 1.12 test runs in the car following logical scenario, while SM-oriented ADOE successfully depicted the boundary between safety and danger. Using 0.46% test resources compared to enumeration, the SM-oriented ADOE found 93.9% dangerous scenarios with 90.9% precision. ADOE approaches have great potential in accelerating the evaluation of AV safety.
Adaptive Design of Experiments for Safety Evaluation of Automated Vehicles
IEEE Transactions on Intelligent Transportation Systems ; 23 , 9 ; 14497-14508
2022-09-01
4152628 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Safety Evaluation for Automated Vehicles in Intersection Crossing
Springer Verlag | 2023
|Automated vehicles: multi-agent safety
TIBKAT | 2020
|Safety Assurance for Automated Vehicles
Springer Verlag | 2017
|