A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs), providing high-fidelity images. The main challenge is synthesizing photorealistic images while following given constraints. In this work, we propose to improve the quality of generated images by rethinking the discriminator architecture. The focus is on the class of problems where images are generated given semantic inputs, such as scene segmentation maps or human body poses. We build on successful cGAN models to propose a new semantically-aware discriminator that better guides the generator. We aim to learn a shared latent representation that encodes enough information to jointly do semantic segmentation, content reconstruction, along with a coarse-to-fine grained adversarial reasoning. The achieved improvements are generic and simple enough to be applied to any architecture of conditional image synthesis. We demonstrate the strength of our method on the scene, building, and human synthesis tasks across three different datasets. The code is available https://github.com/vita-epfl/SemDisc.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Shared Representation for Photorealistic Driving Simulators


    Beteiligte:
    Saadatnejad, Saeed (Autor:in) / Li, Siyuan (Autor:in) / Mordan, Taylor (Autor:in) / Alahi, Alexandre (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-08-01


    Format / Umfang :

    1927077 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Autonomous Driving Simulators

    Shi, Weisong / Liu, Liangkai | Springer Verlag | 2021


    Dynamic Driving Simulators

    Schöner, Hans-Peter / Morys, Bernhard | Springer Verlag | 2015


    Architecture of Driving Simulators

    Arioui, Hichem / Nehaoua, Lamri | Wiley | 2013



    Winter testing in driving simulators

    Bruzelius, Fredrik / Kusachov, Artem | BASE | 2018

    Freier Zugriff