The invention provides a pedestrian subjective intention judgment method and system based on multi-dimensional information fusion. The method comprises the following steps: step 1, acquiring pedestrian video stream information under the angles of a plurality of video sources and audio sources in an area where a target vehicle is located and audio stream information inside and outside the vehicle in a driving process; 2, framing the video stream information and the audio stream information, and preprocessing each frame of image and audio respectively; step 3, extracting limb micro-motion features of pedestrians in the image and audio features of persons in the audio; 4, according to the limb micro-action features and the audio features, whether a posture change behavior and a sound change behavior of an intentional accident exist in the current image and the audio is judged; 5, comprehensively judging whether a suspected intentional accident behavior exists or not according to the judgment result of the current image and the audio; and step 6, when the target vehicle has a traffic accident, storing related video stream information and audio stream information, and prompting a comprehensive judgment result by voice.
本发明提供一种基于多维信息融合的行人主观意图判断方法及系统。该方法包括:步骤1:获取目标车辆行驶过程中所在区域内多个视频源和音频源角度下的行人视频流信息和车内外的音频流信息;步骤2:对视频流信息和音频流信息进行分帧,对每帧图像和音频分别进行预处理;步骤3:提取图像中行人的肢体微动作特征和音频中人员的音频特征;步骤4:根据肢体微动作特征和音频特征分别判断当前图像和音频中是否存在故意制造事故的姿态变化行为和声音变化行为;步骤5:根据当前图像和音频的判断结果,综合判断是否存在疑似故意制造事故行为;步骤6:当目标车辆发生交通事故时,存储相关视频流信息和音频流信息,并语音提示综合判断结果。
Pedestrian subjective intention judgment method and system based on multi-dimensional information fusion
基于多维信息融合的行人主观意图判断方法及系统
2024-02-06
Patent
Elektronische Ressource
Chinesisch
No-signal control road section active interaction system based on pedestrian intention judgment
Europäisches Patentamt | 2024
|Pedestrian intention early warning system and method based on pedestrian-vehicle-road cooperation
Europäisches Patentamt | 2023
|