The invention provides a vehicle-mounted virtual screen information interaction system based on gesture recognition, and belongs to the field of vehicle-mounted entertainment systems. An RGB camera collects gesture operation image information of a passenger on a windshield; a processor receives the collected information, determines the fingertip clicking position and the gesture operation information and transmits the information to the vehicle-mounted entertainment system; an vehicle-mounted entertainment system carries out command operation of the corresponding position according to the operation interface, and an operation interface after execution is transmitted to the visible light projector. A visible light projector projects the operation interface on the windshield to be displayed.Fingertip clicking positions and gesture operation information are determined, and image preprocessing, hand extraction, gesture effective judgment, gesture recognition, database matching and fingertip positioning acquisition are carried out. The projection screen is adjustable in size and position, and the problems that the size of the screen is limited, and the sight angle is fixed are solved.
本发明提供了一种基于手势识别的车载虚拟屏交互信息系统,属于车载娱乐系统领域。RGB摄像头采集挡风玻璃上的乘员手势操作图像信息,处理器接收采集信息,确定指尖点击位置与手势操作信息,并传输给车载娱乐系统,车载娱乐系统根据操作界面进行对应位置的命令操作,执行结束后的操作界面传输给可见光投影机,可见光投影机将操作界面投影在挡风玻璃上显示;确定指尖点击位置与手势操作信息经过图像预处理、手部提取、手势有效判断、手势识别、数据库匹配和指尖定位获取。本发明的投影屏幕大小和位置可调,解决屏幕大小有限、视线角度固定不变的问题。
Vehicle-mounted virtual screen information interaction system based on gesture recognition
一种基于手势识别的车载虚拟屏交互信息系统
2021-01-01
Patent
Electronic Resource
Chinese
IPC: | G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G03B APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM , Geräte oder Anordnungen zum Aufnehmen, Projizieren oder Betrachten von Fotografien |
Vehicle-mounted gesture recognition device, vehicle-mounted central control system and vehicle
European Patent Office | 2020
|Vehicle-mounted virtual visor system with facial expression control gesture
European Patent Office | 2023
|Vehicle-mounted gesture interaction method and system based on monocular camera
European Patent Office | 2023
|Gesture recognition control method and system of vehicle-mounted terminal
European Patent Office | 2015
|Vehicle-mounted rearview mirror navigator gesture recognition system and method thereof
European Patent Office | 2015
|