The invention belongs to the technical field of augmented reality, and discloses a forklift operation assisting method and system based on augmented reality, and the method comprises the steps: collecting an internal environment image in a cockpit, recognizing the internal environment image, obtaining a recognition result, and marking the recognition result on the internal environment image to generate a first augmented display image; matching corresponding prompt information according to the current operation information of the forklift and the identification result, and sending the prompt information to a driver; an external environment image of the forklift is collected, parameters of all objects in the external environment image are extracted and determined, and the parameters of all the objects are marked on the external environment image to generate a second enhanced display image; and acquiring external navigation data of the forklift, generating a virtual state display image based on the external navigation data, and overlapping the virtual state display image on the second augmented display image to generate a third augmented reality image. According to the technical scheme of the invention, the method can reduce the time spent by a driver on the operation task, and improves the driving experience.

    本发明属于增强现实技术领域,公开了一种基于增强现实的叉车操作辅助方法及系统,包括:采集驾驶舱内的内部环境图像,对内部环境图像进行识别并获取识别结果,将识别结果标注在内部环境图像上生成第一增强显示图像;根据叉车当前的操作信息和识别结果匹配相对应的提示信息发送给驾驶员;采集叉车的外部环境图像,提取并确定外部环境图像中各个对象的参数,将每个对象的参数标注在外部环境图像上生成第二增强显示图像;获取叉车的外部导航数据,基于外部导航数据生成虚拟状态显示图像,将虚拟状态显示图像叠加在第二增强显示图像上生成第三增强现实图像。根据本发明技术方案,可减少驾驶员花费在操作任务上的时间,提升驾乘体验感。


    Access

    Download


    Export, share and cite



    Title :

    Forklift operation assisting method and system based on augmented reality


    Additional title:

    一种基于增强现实的叉车操作辅助方法及系统


    Contributors:
    PAN JIE (author) / LI FEI (author) / YAO XIN (author)

    Publication date :

    2024-09-06


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B66F HOISTING, LIFTING, HAULING, OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD , Hub-, Verhol- oder Schubvorrichtungen, soweit nicht anderweitig vorgesehen, z.B. Vorrichtungen mit unmittelbarer Krafteinwirkung auf die Last / G06V



    FORKLIFT WORK ASSISTING SYSTEM

    FUJIMORI HIROYUKI | European Patent Office | 2017

    Free access


    Industrial forklift attachment for assisting tire assembly

    XIANG WEIFENG / WANG HENGFEI / ZHONG CHUANHAO et al. | European Patent Office | 2025

    Free access

    Augmented reality method and device for assisting driving

    WANG CHUN / LI WEIMING / LIU ZHIHUA et al. | European Patent Office | 2023

    Free access

    Augmented reality method and device for assisting driving

    CHEN QI | European Patent Office | 2023

    Free access