The combination of the Metaverse and intelligent transportation systems (ITS) holds significant developmental promise, especially for visual perception tasks. However, the acquisition of high-quality scene data poses a challenging and expensive endeavor. Meanwhile, the visual disparity between the Metaverse and the physical world poses an impact on the practical applicability of the visual perception tasks. In this paper, a Metaverse Intelligent Traffic Visual Framework, MITVF, is developed to guide the implementation of visual perception tasks in the physical world. Firstly, a two-stage metadata optimization strategy is proposed that can efficiently provide diverse and high-quality scene data for traffic perception models. Specifically, an element reconfigurability strategy is proposed to flexibly combine dynamic and static traffic elements to enrich the data with a low cost. A diffusion model-based metadata optimization acceleration strategy is proposed to achieve efficient improvement of image resolution. Secondly, a Meta-Physical adaptive learning method is proposed, and further applied to visual perception tasks to compensate for the visual disparity between the Metaverse and the physical world. Experimental results show that MITVF achieves a $10\times $ acceleration in optimization speed, ensuring the image quality and reconstructing diverse. Further, MITVF is applied to the traffic object detection task to verify the effectiveness and validity. The performance of the model trained with 5k real data exceeded that of the model trained with 200k real data, with AP50 reaching 67.7%.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Metaverse Meets Intelligent Transportation System: An Efficient and Instructional Visual Perception Framework


    Contributors:
    Wang, Junfan (author) / Chen, Yi (author) / Ji, Xiaoyue (author) / Dong, Zhekang (author) / Gao, Mingyu (author) / Sing Lai, Chun (author)

    Published in:

    Publication date :

    2024-10-01


    Size :

    7050578 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Transportation monitoring framework based on dynamic environment intelligent perception

    Qiong Wang, / Haofeng Zhang, / Minxian Li, et al. | IEEE | 2011


    Transportation Engineering Instructional Practices

    Hurwitz, David S. / Bernhardt, Kristen L. Sanford / Turochy, Rod E. et al. | Transportation Research Record | 2015


    Prospects and challenges of Metaverse application in data‐driven intelligent transportation systems

    Judith Nkechinyere Njoku / Cosmas Ifeanyi Nwakanma / Gabriel Chukwunonso Amaizu et al. | DOAJ | 2023

    Free access

    Prospects and challenges of Metaverse application in data‐driven intelligent transportation systems

    Njoku, Judith Nkechinyere / Nwakanma, Cosmas Ifeanyi / Amaizu, Gabriel Chukwunonso et al. | Wiley | 2023

    Free access

    Intelligent instructional car braking system

    XU TIE / SONG LICHANG / CHEN CHANGHUI et al. | European Patent Office | 2022

    Free access