The validation of automated driving requires billions of kilometers of test drives to be performed so that safety-in-use is assured. It is difficult to validate it only making use of data acquired on field tests in public roads due to the lack of controllability, e.g. over environment conditions. Therefore, the automotive industry relies on test drives to be executed on a proving ground under controlled conditions or in environment simulation software. The first is realistic, but costly in terms of time and effort. The latter provides a high level of reproducibility, but it is still uncertain how valid the delivered test results are. In this paper, a test method for measuring the simulation-to-reality gap is proposed. For this purpose, a test scenario is defined, built on a proving ground and reproduced in two environment simulation software. Four different environment conditions are considered: day, night, fog and rain. The video data of the real and simulated test drives are recorded and fed into a series-produced multi-class object detection algorithm for automated driving. Performance metrics are calculated across the real and virtual domains. Finally, the test results are compared so that the simulation-to-reality gap concerning object detection is measured.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Test Method for Measuring the Simulation-to-Reality Gap of Camera-based Object Detection Algorithms for Autonomous Driving


    Contributors:


    Publication date :

    2020-10-19


    Size :

    2706897 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    AUGMENTED REALITY BASED AUTONOMOUS DRIVING SIMULATION METHOD AND SYSTEM

    WON JONG HOON / AHN SANG HUN / IM JIUNG | European Patent Office | 2020

    Free access

    Robust and Accurate Object Velocity Detection by Stereo Camera for Autonomous Driving

    Saito, Toru / Okubo, Toshimi / Takahashi, Naoki | IEEE | 2020


    BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving

    Rashed, Hazem / Essam, Mariam / Mohamed, Maha et al. | IEEE | 2021


    STEREO CAMERA-BASED AUTONOMOUS DRIVING METHOD, AUTONOMOUS DRIVING APPARATUS, AND COMPUTER PROGRAM

    KIM CHANG-HYUN / KANG HYOA / SHEN CHANG YU et al. | European Patent Office | 2018

    Free access

    Online Camera LiDAR Fusion and Object Detection on Hybrid Data for Autonomous Driving

    Banerjee, Koyel / Notz, Dominik / Windelen, Johannes et al. | IEEE | 2018