The invention relates to the technical field of equipment management and maintenance, in particular to an elevator abnormal behavior detection system based on a multi-modal neural network, which collects visual and inertial measurement and audio data in an elevator car through a data acquisition module, and performs time-frequency domain conversion and feature vectorization on original data by using a data processing module; the multi-modal neural network model is composed of a CNN branch, an RNN branch and a voiceprint recognition network which are parallel, features are integrated through a feature fusion module by adopting a double fusion architecture, and then abnormality is judged through an abnormal behavior classifier based on a hierarchical classification strategy; the alarm and log module gives an alarm in time and records abnormal information, the model optimization module improves the model performance by applying multiple methods, and the system and an elevator control system achieve data interaction through a specific interface. According to the elevator abnormal behavior detection method, multi-modal data and an innovative algorithm are integrated, the accuracy and reliability of elevator abnormal behavior detection are remarkably improved, safe operation of an elevator is effectively guaranteed, and powerful support is provided for intelligent management of the elevator.

    本发明涉及设备管理维护技术领域,尤其为一种基于多模态神经网络的电梯异常行为检测系统,通过数据采集模块收集电梯轿厢内视觉、惯性测量及音频数据,利用数据处理模块对原始数据进行时频域转换与特征向量化;多模态神经网络模型由并行的CNN、RNN分支和声纹识别网络构成,经特征融合模块采用双重融合架构整合特征,再通过基于层次化分类策略的异常行为分类器判断异常;报警与日志模块及时报警并记录异常信息,模型优化模块运用多种方法提升模型性能,系统与电梯控制系统通过特定接口实现数据交互。本发明综合多模态数据与创新算法,显著提高电梯异常行为检测的准确性和可靠性,有效保障电梯安全运行,为电梯智能化管理提供有力支持。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Elevator abnormal behavior detection system based on multi-mode neural network


    Weitere Titelangaben:

    一种基于多模态神经网络的电梯异常行为检测系统


    Beteiligte:
    XIANG LIN (Autor:in) / SUN KE (Autor:in) / ZHANG YINFENG (Autor:in)

    Erscheinungsdatum :

    23.05.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B66B Aufzüge , ELEVATORS



    ELEVATOR ABNORMAL STATE DETECTION DEVICE AND ELEVATOR ABNORMAL STATE DETECTION METHOD

    SONG YAN HOU | Europäisches Patentamt | 2022

    Freier Zugriff

    Elevator abnormal sound detection method and system

    ZHONG CHAOWEN / ZHANG XINGFENG / WAN MIN et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Detection system for abnormal situation during elevator operation

    VILJANEN MIKKO / VIITA-AHO TARVO / TALONEN TAPANI et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Abnormal detection method and detection system for elevator operation

    ZHANG HONGCHEN / LI CHANGMING / LI XIAOGUANG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    DEVICE AND SYSTEM FOR ELEVATOR ABNORMAL OPERATION DETECTION

    SHIN HYUN DAI / JEON CHANG HYEON | Europäisches Patentamt | 2016

    Freier Zugriff