Performance testing and evaluation always plays an important role in the developmental process of a vehicle, which also applies to autonomous vehicles. The complex nature of an autonomous vehicle from architecture to functionality demands even more quality-and-quantity controlled testing and evaluation than ever before. Most of the existing testing methodologies are task-or-scenario based and can only support single or partial functional testing. These approaches may be helpful at the initial stage of autonomous vehicle development. However, as the integrated autonomous system gets mature, these approaches fall short of supporting comprehensive performance evaluation. This paper proposes a novel hierarchical and systematic testing and evaluation approach to bridge the above-mentioned gap. In this paper, firstly a three-dimensional evaluation model conforming to the functional architecture of autonomous vehicles was built, with each dimension representing one of the three key functional layers of autonomous vehicle including sensing & perception, decision-making ﹠ planning, control & execution. Each dimension has a set of metrics carefully defined with their weights fairly determined based on an entropy weights method. Then, considering environment effect on vehicle functions, we innovatively determine task-scenarios for testing the performance of each dimension. Besides, we design a hierarchical systematic testing method which could specially testing each function layer of autonomous vehicle. Fuzzy comprehensive and TOPSIS evaluation method was proposed to quantitatively evaluate the comprehensive performance of autonomous vehicles under defined task-scenarios. Finally, our methods are used to evaluate three candidate vehicles based on simulation scenario in PanoSim. Compared to traditional approach based on external task performance, the proposed approach can not only provide convincing results of the overall system performance but can also peek into each of the key functional layer and provide insights about their performance. Therefore, this approach provides better guidance for autonomous vehicle research.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Comprehensive Testing and Evaluation Approach for Autonomous Vehicles


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Wang, Guojun (Autor:in) / Wang, Jinsong (Autor:in) / Yang, Shun (Autor:in) / Zhang, Sumin (Autor:in) / Deng, Weiwen (Autor:in)

    Kongress:

    WCX World Congress Experience ; 2018



    Erscheinungsdatum :

    03.04.2018




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    A Comprehensive Testing and Evaluation Approach for Autonomous Vehicles

    Wang, Guojun / Deng, Weiwen / Zhang, Sumin et al. | British Library Conference Proceedings | 2018


    Intelligence Testing for Autonomous Vehicles: A New Approach

    Li, Li / Huang, Wu-Ling / Liu, Yuehu et al. | IEEE | 2016


    Testing Predictions For Autonomous Vehicles

    FAIRFIELD NATHANIEL / FURMAN VADIM | Europäisches Patentamt | 2021

    Freier Zugriff

    Testing environment for autonomous vehicles

    WATSON ADAM / REARICK JOHNATHAN / BEMBIC ANTHONY | Europäisches Patentamt | 2020

    Freier Zugriff

    Automatic testing of autonomous vehicles

    NIELSEN ERIK / KAUFMAN CHASE | Europäisches Patentamt | 2023

    Freier Zugriff