Verification and robustness testing of machine learning algorithms for autonomous driving is crucial. Due to the increasing complexity and quantity of those systems in a single vehicle, just driving the required distance with a newly developed vehicle is not feasible anymore: billions of hours on the street without failure are necessary to qualify for industry standards like ISO 26262. That is where simulation comes into play: machine learning algorithms are trained and evaluated on well known image data sets like KITTI or Cityscapes. But today’s data sets mostly contain images taken under perfect weather conditions and therefore do not harden optical object detection algorithms against various weather conditions. This paper focuses on reusing these established and labeled data sets by augmenting them with adverse weather effects like snow and fog. Those effects are rendered physically correct and life like while being added to existing real world images. Thanks to easy parametrization the weather influences may be varied as necessary and allow for finely tuned learning and optimization processes. The weather effects are evaluated with regard to realism and impact on an established object detection algorithm. These newly created weather-influenced images may be used to validate or train new object detection algorithms.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Simulating Photo-realistic Snow and Fog on Existing Images for Enhanced CNN Training and Evaluation


    Contributors:


    Publication date :

    2019-10-01


    Size :

    669942 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Simulating Transportation for Realistic Engineering Education and Training

    Liao, Chen-Fu / Liu, Henry X. / Levinson, David M. | Transportation Research Record | 2009



    Photo-realistic facial expression synthesis

    Ghent, J. / McDonald, J. | British Library Online Contents | 2005



    Synthesizing Realistic Snow Effects in Driving Images Using GANs and Real Data with Semantic Guidance*

    Yang, Hanting / Ding, Ming / Carballo, Alexander et al. | IEEE | 2023