The high amount of sensors required for autonomous driving poses enormous challenges on the capacity of automotive bus systems. There is a need to understand tradeoffs between bitrate and perception performance. In this paper, we compare the image compression standards JPEG, JPEG2000, and WebP to a modern encoder/decoder image compression approach based on generative adversarial networks (GANs). We evaluate both the pure compression performance using typical metrics such as peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and others, but also the performance of a subsequent perception function, namely a semantic segmentation (characterized by the mean intersection over union (mIoU) measure). Not surprisingly, for all investigated compression methods, a higher bitrate means better results in all investigated quality metrics. Interestingly, however, we show that the semantic segmentation mIoU of the GAN autoencoder in the highly relevant low-bitrate regime (at 0.0625 bit/pixel) is better by 3.9 % absolute than JPEG2000, although the latter still is considerably better in terms of PSNR (5.91dB difference). This effect can greatly be enlarged by training the semantic segmentation model with images originating from the decoder, so that the mIoU using the segmentation model trained by GAN reconstructions exceeds the use of the model trained with original images by almost 20 % absolute. We conclude that distributed perception in future autonomous driving will most probably not provide a solution to the automotive bus capacity bottleneck by using standard compression schemes such as JPEG2000, but requires modern coding approaches, with the GAN encoder/decoder method being a promising candidate.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    On Low-Bitrate Image Compression for Distributed Automotive Perception: Higher Peak SNR Does Not Mean Better Semantic Segmentation


    Contributors:


    Publication date :

    2019-06-01


    Size :

    551625 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    ON LOW-BITRATE IMAGE COMPRESSION FOR DISTRIBUTED AUTOMOTIVE PERCEPTION: HIGHER PEAK SNR DOES NOT MEAN BETTER SEMANTIC SEGMENTATION

    Löhdefink, Jonas / Bär, Andreas / Schmidt, Nico M. et al. | British Library Conference Proceedings | 2019


    SEMANTIC SEGMENTATION ON AUTOMOTIVE RADAR MAPS

    Prophet, Robert / Li, Gang / Sturm, Christian et al. | British Library Conference Proceedings | 2019


    Semantic Segmentation on Automotive Radar Maps

    Prophet, Robert / Li, Gang / Sturm, Christian et al. | IEEE | 2019


    High-bitrate multimedia information hiding for digital image/video under lossy compression

    Yang, M. / Bourbakis, N. | British Library Online Contents | 2007


    Semantic-Aware Video Compression for Automotive Cameras

    Wang, Yiting / Chan, Pak Hung / Donzella, Valentina | IEEE | 2023