The invention provides a collaborative sensing method for interactive risks of signalling workers and drivers. The collaborative sensing method comprises the following steps: acquiring a limb action image of a signalling worker at the current moment and motion information of a crane; analyzing the motion information of the crane to obtain the motion state of the crane at the current moment; according to the limb action image, a command gesture signal corresponding to the current moment is generated by utilizing a command gesture signal recognition model; comparing the command gesture signal with the crane motion state, and generating an interaction state signal at the current moment; an alarm instruction is generated according to the interaction state signal, and a driver of the crane is warned that wrong operation is executed. Thus, by comparing the command gesture signal of the signalling worker with the crane motion state in real time, the risk that the crane driver mistakenly executes the command gesture signal of the signalling worker can be sensed when the signalling worker interacts with the crane driver, and the operation safety and efficiency are improved.

    本发明提供了一种信号工与驾驶员交互风险的协同感知方法,包括:获取当前时刻信号工的肢体动作图像和起重机的运动信息;对所述起重机的运动信息进行分析得到当前时刻的起重机运动状态;根据所述肢体动作图像,利用指挥手势信号识别模型,生成当前时刻对应的指挥手势信号;对比所述指挥手势信号与所述起重机运动状态,生成所述当前时刻的交互状态信号;根据所述交互状态信号生成报警指令,警告所述起重机的驾驶员执行了错误操作。如此,本发明可以通过实时对比所述信号工的所述指挥手势信号和所述起重机运动状态,能够感知信号工与起重机驾驶员之间交互时,起重机驾驶员错误执行信号工的指挥手势信号的风险,提高作业安全和效率。


    Access

    Download


    Export, share and cite



    Title :

    Collaborative perception method for interactive risk of signalling worker and driver


    Additional title:

    一种信号工与驾驶员交互风险的协同感知方法


    Contributors:
    GUO SHENGYU (author) / ZHANG GAN (author) / WU DI (author) / XIAO TIANLONG (author) / ZHOU XIAOJIE (author) / GONG PEISONG (author)

    Publication date :

    2023-08-01


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / B66C Krane , CRANES / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08B SIGNALLING OR CALLING SYSTEMS , Signalisier- oder Rufsysteme





    Interactive Scenario Modelling for Hazard Perception in Driver Training

    Dumbuya, A. / Reed, N. / Rhys-Tyler, G. et al. | British Library Conference Proceedings | 2005


    Worker Perception of Hazardous Robotic Workstations

    W. B. Karwowski / B. Amarnath / N. Pongpatana | NTIS | 1990


    Cross-cultural differences in driver risk-perception

    Sivak, Michael / Soler, José / Tränkle, Ulrich et al. | Elsevier | 1988