In recent years, small-scale driving testbeds have been developed as controlled physical environments for the evaluation of autonomous vehicle controllers. Such controllers are heavily dependent on computer vision algorithms that enable the vehicle to perceive its surroundings. To bridge the Sim2Real content and appearance gap between simulated and real-world image data for training these algorithms, we propose a novel transfer learning approach that performs domain adaptation using StyleGAN to generate style-mixed images that closely resemble real-world images. We explain our approach within the context of our small-scale driving testbed, CHARTOPOLIS, and demonstrate it on synthetic image data of two object classes, vehicles and buildings, from the driving simulator CARLA. Our results show that this approach works on the vehicle object class while failing on the building object class. This paper thus provides a plausible approach to bridging the Sim2Real gap through the use of custom pipelines that augment image datasets using a mix of techniques for domain adaptation and domain randomization.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    GAN-Based Domain Adaptation for Creating Digital Twins of Small-Scale Driving Testbeds: Opportunities and Challenges




    Publication date :

    2024-06-02


    Size :

    5763818 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Digital twins in aircraft production and MRO: challenges and opportunities

    Moenck, Keno / Rath, Jan-Erik / Koch, Julian et al. | Springer Verlag | 2024

    Free access

    Digital twins in aircraft production and MRO: challenges and opportunities

    Moenck, Keno / Rath, Jan-Erik / Koch, Julian et al. | Springer Verlag | 2024

    Free access

    Digital twins in aircraft production and MRO : challenges and opportunities

    Moenck, Keno / Rath, Jan-Erik / Koch, Julian et al. | DataCite | 2024

    Free access

    Space Algorithm Testbeds - Small Business Pipelinefor Technology Innovation

    Ewart, R. / Jacquot, J. / Lew, P. et al. | British Library Conference Proceedings | 2009


    Standard Avionics Testbeds

    SLAVICEK, J. | AIAA | 1981