The invention provides a pedestrian subjective intention judgment method and system based on multi-dimensional information fusion. The method comprises the following steps: step 1, acquiring pedestrian video stream information under the angles of a plurality of video sources and audio sources in an area where a target vehicle is located and audio stream information inside and outside the vehicle in a driving process; 2, framing the video stream information and the audio stream information, and preprocessing each frame of image and audio respectively; step 3, extracting limb micro-motion features of pedestrians in the image and audio features of persons in the audio; 4, according to the limb micro-action features and the audio features, whether a posture change behavior and a sound change behavior of an intentional accident exist in the current image and the audio is judged; 5, comprehensively judging whether a suspected intentional accident behavior exists or not according to the judgment result of the current image and the audio; and step 6, when the target vehicle has a traffic accident, storing related video stream information and audio stream information, and prompting a comprehensive judgment result by voice.

    本发明提供一种基于多维信息融合的行人主观意图判断方法及系统。该方法包括:步骤1:获取目标车辆行驶过程中所在区域内多个视频源和音频源角度下的行人视频流信息和车内外的音频流信息;步骤2:对视频流信息和音频流信息进行分帧,对每帧图像和音频分别进行预处理;步骤3:提取图像中行人的肢体微动作特征和音频中人员的音频特征;步骤4:根据肢体微动作特征和音频特征分别判断当前图像和音频中是否存在故意制造事故的姿态变化行为和声音变化行为;步骤5:根据当前图像和音频的判断结果,综合判断是否存在疑似故意制造事故行为;步骤6:当目标车辆发生交通事故时,存储相关视频流信息和音频流信息,并语音提示综合判断结果。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Pedestrian subjective intention judgment method and system based on multi-dimensional information fusion


    Weitere Titelangaben:

    基于多维信息融合的行人主观意图判断方法及系统


    Beteiligte:
    ZHANG YANBO (Autor:in) / JIANG CHENG (Autor:in) / REN KE (Autor:in) / WANG MENGJUN (Autor:in) / WANG HAIYANG (Autor:in) / LIU BOWEN (Autor:in) / WANG ZIJING (Autor:in) / CHENG QINGQING (Autor:in)

    Erscheinungsdatum :

    2024-02-06


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS



    No-signal control road section active interaction system based on pedestrian intention judgment

    WU NUOYAO / LUO YIFENG / JIN NUO et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Pedestrian intention early warning system and method based on pedestrian-vehicle-road cooperation

    SHENG KAI / CHEN YONGYI / HE XIN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Predicting Pedestrian Crossing Intention With Feature Fusion and Spatio-Temporal Attention

    Yang, Dongfang / Zhang, Haolin / Yurtsever, Ekim et al. | IEEE | 2022


    Pedestrian intention prediction: A convolutional bottom-up multi-task approach

    Razali, Haziq / Mordan, Taylor / Alahi, Alexandre | Elsevier | 2021