Adverse weather conditions are extremely challenging for autonomous driving as most state-of-the-art sensors do not function reliably under such circumstances. One method to increase the detection performance is to fuse the raw data signal with neural networks that learn robust features from multiple inputs. Nevertheless noise due to adverse weather is complex, and in addition, automotive sensors fail asymmetrically. Neural networks that perform feature level sensor fusion can be particularly vulnerable if one sensor is corrupted by noise outside the training data distribution compared to decision level fusion. The reason for this is that no built-in mathematical mechanism prevents noise in one sensor channel from corrupting the overall network even though other sensor channels may provide high-quality data. We propose a simple data augmentation scheme that shows a neural network may be able to ignore data from underperforming sensors even though it has never seen that data during training. One can summarize this as a learned “OR” operation at fusion stage. This learned operation is also generally applicable to other noise-types not present during training.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Robustness Against Unknown Noise for Raw Data Fusing Neural Networks


    Contributors:


    Publication date :

    2018-11-01


    Size :

    1903329 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Fusing Data with Unknown or Uncertain Level of Correlation

    Mokhtarzadeh, H. / Gebre-Egziabher, D. | AIAA | 2016


    Fusing Data with Unknown or Uncertain Level of Correlation

    Mokhtarzadeh, H | Online Contents | 2016


    Neural networks estimation of truck static weights by fusing weight-in-motion data

    Mangeas, M. / Glaser, S. / Dolcemascolo, V. | IEEE | 2002


    Neural networks estimation of truck static weights by fusing weight-in-motion data

    Mangeas, M. / Glaser, S. / Dolscemascolo, V. et al. | British Library Conference Proceedings | 2002


    Robustness of a Kalman Filter Against Uncertainties of Noise Covariances

    Sasa, S. | British Library Online Contents | 1993