The invention relates to audio-based emergency vehicle detection and tracking. Techniques for audio-based sound source detection and tracking are provided. A methodology implementing a technique according to an embodiment includes generating an acoustic signal spectrum from a signal provided by a microphone array; and performing beamforming on the acoustic signal spectrum using the time-frequency mask for noise reduction to generate a beam signal spectrum. The method further includes detecting, by a deep neural network (DNN) classifier, acoustic events associated with the sound source in the beam signal spectrum. The DNN is trained on acoustic features associated with the acoustic event. The method further includes performing a pattern extraction in response to the detection to identify a time-frequency section of the acoustic signal spectrum associated with the acoustic event, and estimating a direction of motion of the source relative to the microphone array based on a Doppler shift of the acoustic event calculated from the extracted time-frequency section of the pattern.
本公开涉及基于音频的紧急车辆检测与追踪。提供了用于基于音频的声源检测和追踪的技术。一种实现根据实施例的技术的方法论包括:根据麦克风阵列所提供的信号生成声学信号频谱;以及使用用于降噪的时间‑频率掩模对声学信号频谱执行波束成形以生成波束信号频谱。该方法还包括由深度神经网络(DNN)分类器在波束信号频谱中检测与声源相关联的声学事件。DNN是在与声学事件相关联的声学特征上训练的。该方法还包括响应于该检测执行模式提取,以标识与声学事件相关联的声学信号频谱的时间‑频率区段,以及基于根据所提取的模式的时间‑频率区段计算的声学事件的多普勒频移来估计该源相对于麦克风阵列的运动方向。
Audio-based emergency vehicle detection and tracking
基于音频的紧急车辆检测与追踪
2021-09-10
Patent
Elektronische Ressource
Chinesisch
EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION
Europäisches Patentamt | 2022
|EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION
Europäisches Patentamt | 2023