Synthetic data holds significant potential for improving the efficiency of perception tasks in autonomous driving. This paper proposes a practical data synthesis pipeline that employs multi-agent reinforcement learning (MARL) to automatically generate dynamic traffic participant trajectories and leverages augmented reality (AR) processes to produce photo-realistic images. This AR process blends clean static background images extracted from real photos using image matting techniques, with dynamic foreground images rendered from 3D Computer Aided Design (CAD) models in a rendering engine. We posit that this data synthetic pipe line has strong image photorealism, flexible way of interaction scenarios generation and mature tool chain, which has the prospect of large-scale engineering application.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Synthesizing Data for Autonomous Driving: Multi-Agent Reinforcement Learning Meets Augmented Reality


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Meng, Chao (Autor:in) / Wang, Hanchao (Autor:in) / Mei, Jinren (Autor:in) / Gu, Kai (Autor:in) / Zhang, Song (Autor:in) / Wang, Tong (Autor:in)

    Kongress:

    SAE 2023 Intelligent and Connected Vehicles Symposium ; 2023



    Erscheinungsdatum :

    2023-12-20




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    MontiSim: Agent-Based Simulation for Reinforcement Learning of Autonomous Driving

    Hofer, Tristan / Hoppe, Mattis / Kusmenko, Evgeny et al. | IEEE | 2023


    AUTONOMOUS DRIVING VEHICLE AND METHOD FOR PROVIDING AUGMENTED REALITY IN AUTONOMOUS DRIVING VEHICLE

    JI AETTIE / LEE KIHYUNG / JUNG DUKYUNG et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    The augmented cockpit - virtual reality meets automotive

    Bolle,M. / Bosch,Stuttgart,DE | Kraftfahrwesen | 2013


    AUGMENTED REALITY BASED AUTONOMOUS DRIVING SIMULATION METHOD AND SYSTEM

    WON JONG HOON / AHN SANG HUN / IM JIUNG | Europäisches Patentamt | 2020

    Freier Zugriff

    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023