Image corruptions due to noise, blur, contrast change, etc., could lead to a significant performance decline of Deep Neural Networks (DNN), which poses a potential threat to DNN-based autonomous vehicles. Previous works attempted to explain corruption from a Fourier perspective. By comparing the absolute Fourier spectrum difference between corrupted images and clean images in the RGB color space, they regard the noise from some corruptions (Gaussian noise, defocus blur, etc.) as concentrating on the high-frequency components while others (contrast, fog, etc.) concentrate on the low-frequency components. In this work, we present a new perspective that unifies corruptions as noise from high frequency and thus propose an image augmentation algorithm to achieve a more robust performance against common corruptions. First, we notice the 1/fα statistical rule of the natural image's spectrum and the channels-wise differential sensitivity on the YCbCr color space of the Human Visual System. Thus we present a new perspective of the relative Fourier spectrum in the YCbCr color space which unifies the noise from all 15 common corruptions as noise concentrating on the high-frequency components. From the new perspective, the SOTA (state-of-the-art) image augmentation algorithm shows insufficient coverage of frequency change compared with common corruptions and an insufficient improvement in robustness against perturbations on the frequency domain. Second, based on the unified understanding of image corruptions and limitations of the SOTA image augmentation algorithm, we present a frequency-based image augmentation that adds noise to the high-frequency components in the YCbCr color space with the amplitude of noise proportional to the spectrum amplitude of the image. Compared with previous works, the proposed method achieves SOTA performance against corruptions on common datasets (CIFAR-10 and tiny-ImageNet) and real-world driving tests.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Unified Frequency Understanding of Image Corruptions and its Application to Autonomous Driving


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Meng, Dejian (Autor:in) / Zhang, Lijun (Autor:in) / Tian, Wei (Autor:in) / Xiao, Wei (Autor:in) / Zhang, Zhuang (Autor:in)

    Kongress:

    WCX SAE World Congress Experience ; 2023



    Erscheinungsdatum :

    2023-04-11




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    A Unified Frequency Understanding of Image Corruptions and its Application to Autonomous Driving

    Zhang, Zhuang / Zhang, Lijun / Meng, Dejian et al. | British Library Conference Proceedings | 2023


    A Unified Evaluation Framework for Autonomous Driving Vehicles

    Roshdi, Myada / Nayeer, Nasif / Elmahgiubi, Mohammed et al. | IEEE | 2020


    A UNIFIED EVALUATION FRAMEWORK FOR AUTONOMOUS DRIVING VEHICLES

    Roshdi, Myada / Nayeer, Nasif / Elmahgiubi, Mohammed et al. | British Library Conference Proceedings | 2020


    Auditory Scene Understanding for Autonomous Driving

    Furletov, Yury / Willert, Volker / Adamy, Jurgen | IEEE | 2021


    Reliable Autonomous Driving Environment Model With Unified State-Extended Boundary

    Jiao, Xinyu / Chen, Junjie / Jiang, Kun et al. | IEEE | 2023