The invention belongs to the technical field of augmented reality, and discloses a forklift operation assisting method and system based on augmented reality, and the method comprises the steps: collecting an internal environment image in a cockpit, recognizing the internal environment image, obtaining a recognition result, and marking the recognition result on the internal environment image to generate a first augmented display image; matching corresponding prompt information according to the current operation information of the forklift and the identification result, and sending the prompt information to a driver; an external environment image of the forklift is collected, parameters of all objects in the external environment image are extracted and determined, and the parameters of all the objects are marked on the external environment image to generate a second enhanced display image; and acquiring external navigation data of the forklift, generating a virtual state display image based on the external navigation data, and overlapping the virtual state display image on the second augmented display image to generate a third augmented reality image. According to the technical scheme of the invention, the method can reduce the time spent by a driver on the operation task, and improves the driving experience.
本发明属于增强现实技术领域,公开了一种基于增强现实的叉车操作辅助方法及系统,包括:采集驾驶舱内的内部环境图像,对内部环境图像进行识别并获取识别结果,将识别结果标注在内部环境图像上生成第一增强显示图像;根据叉车当前的操作信息和识别结果匹配相对应的提示信息发送给驾驶员;采集叉车的外部环境图像,提取并确定外部环境图像中各个对象的参数,将每个对象的参数标注在外部环境图像上生成第二增强显示图像;获取叉车的外部导航数据,基于外部导航数据生成虚拟状态显示图像,将虚拟状态显示图像叠加在第二增强显示图像上生成第三增强现实图像。根据本发明技术方案,可减少驾驶员花费在操作任务上的时间,提升驾乘体验感。
Forklift operation assisting method and system based on augmented reality
一种基于增强现实的叉车操作辅助方法及系统
2024-09-06
Patent
Electronic Resource
Chinese
IPC: | G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B66F HOISTING, LIFTING, HAULING, OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD , Hub-, Verhol- oder Schubvorrichtungen, soweit nicht anderweitig vorgesehen, z.B. Vorrichtungen mit unmittelbarer Krafteinwirkung auf die Last / G06V |
OPERATION TERMINAL FOR FORKLIFT, OPERATION SYSTEM FOR FORKLIFT, AND OPERATION PROGRAM FOR FORKLIFT
European Patent Office | 2022
|Industrial forklift attachment for assisting tire assembly
European Patent Office | 2025
|Augmented reality method and device for assisting driving
European Patent Office | 2023
|Augmented reality method and device for assisting driving
European Patent Office | 2023
|