The invention discloses a traffic prediction method based on multi-modal data fusion and application, and the method comprises the steps: 1, constructing multi-modal input data, 2, processing the multi-modal input data through an input conversion module, 3, generating a space-time embedding module through space-time information, 4, processing data among different modals through a cross-modal attention module, and 5, generating a time-space embedding module through the cross-modal attention module. The method comprises the following steps of 1, carrying out multi-modal data fusion by utilizing a maximum pool fusion layer, 6, carrying out data conversion by utilizing a space-time attention module, 7, outputting a prediction result by utilizing output linear layer conversion, and 8, carrying out network training through iteration to obtain a trained model. According to the method, accurate traffic state prediction can be realized by efficiently combining traffic data of various modes, so that urban traffic managers can be effectively helped to carry out overall arrangement in advance, and urban road congestion is reduced.
本发明公开了一种基于多模态数据融合的交通预测方法及应用,该方法步骤包括:1、构建多模态输入数据,2、利用输入转化模块对多模态输入数据进行处理,3、利用时空信息,产生时空嵌入模块,4、利用跨模态注意力模块处理不同模态间的数据,5、利用最大池融合层将多模态的数据进行融合,6、利用时空注意力模块,进一步进行数据转化,7、利用输出线性层转化输出预测结果,8、迭代进行网络训练,得到训练后的模型。本发明能高效地结合多种模态的交通数据来实现准确的交通状态预测,从而能有效帮助城市交通管理者提前进行统筹安排,减少城市道路拥塞。
Traffic prediction method based on multi-modal data fusion and application
一种基于多模态数据融合的交通预测方法及应用
2022-11-04
Patent
Electronic Resource
Chinese
IPC: | G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06K Erkennen von Daten , RECOGNITION OF DATA / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
High-speed traffic flow prediction method based on multi-modal fusion and graph attention mechanism
European Patent Office | 2020
|Traffic situation perception prediction method and system based on multi-modal traffic large model
European Patent Office | 2023
|Deep neural network robust traffic prediction method based on multi-modal spatio-temporal data
European Patent Office | 2021
|Urban traffic flow prediction method based on multi-source data fusion
European Patent Office | 2020
|