In the era of big data, the massive multi-modal data accumulated in traditional manufacturing enterprises are chaotic and redundant, the huge hidden value in those data cannot be mined through complementary learning among multi-modal data so as to realize the transformation of enterprises from digitalization to intelligence. In order to solve the problem of multi-source heterogeneous data perception fusion in intelligent manufacturing, this paper proposes a multi-modal data cross-media perception fusion algorithm based on digital twin. Firstly, aiming at the synchronous fusion of physical space and information space in the manufacturing process, the digital twin modeling method and multi-perception fusion method are adopted to restore complete product processing processes in real-time and dynamically. Secondly, the multi-modal data feature extraction models are established respectively to solve the cross-media perception fusion problem of multi-modal data. Then, the method of multi-feature fusion and multi-model coupling is adopted to disperse the uncertainty of these models. Finally, an overall solution of omnidirectional perception and cross-media virtual reality fusion for multi-modal data processing is realized. The research results of this paper also have a certain practical value to intelligent processing workshop and their assembly processes.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Research on Multi-modal Data Cross-Media Perception Fusion Algorithm Based on Digital Twin


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Wang, Yi (Herausgeber:in) / Martinsen, Kristian (Herausgeber:in) / Yu, Tao (Herausgeber:in) / Wang, Kesheng (Herausgeber:in) / Wan, Xiang (Autor:in) / Liu, Lilan (Autor:in) / Feng, Bowen (Autor:in) / Chen, Chen (Autor:in) / Wang, Yi (Autor:in)

    Kongress:

    International Workshop of Advanced Manufacturing and Automation ; 2020 ; Zhanjiang, China October 12, 2020 - October 13, 2020



    Erscheinungsdatum :

    2021-01-23


    Format / Umfang :

    9 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Traffic accident decision-making system based on multi-modal fusion perception technology

    ZHOU CHANGJUN / HUANG HUIHUA / HUANG GANG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Aerodynamic Data Fusion Toward the Digital Twin Paradigm

    Renganathan, S. Ashwin / Harada, Kohei / Mavris, Dimitri N. | AIAA | 2020


    Digital Twin-Driven Surface Roughness Prediction Based on Multi-sensor Fusion

    Zhang, Xiangyu / Liu, Lilan / Wu, Fang et al. | Springer Verlag | 2021


    Digital Twin-Driven Surface Roughness Prediction Based on Multi-sensor Fusion

    Zhang, Xiangyu / Liu, Lilan / Wu, Fang et al. | TIBKAT | 2021