The invention provides a vehicle-mounted virtual screen information interaction system based on gesture recognition, and belongs to the field of vehicle-mounted entertainment systems. An RGB camera collects gesture operation image information of a passenger on a windshield; a processor receives the collected information, determines the fingertip clicking position and the gesture operation information and transmits the information to the vehicle-mounted entertainment system; an vehicle-mounted entertainment system carries out command operation of the corresponding position according to the operation interface, and an operation interface after execution is transmitted to the visible light projector. A visible light projector projects the operation interface on the windshield to be displayed.Fingertip clicking positions and gesture operation information are determined, and image preprocessing, hand extraction, gesture effective judgment, gesture recognition, database matching and fingertip positioning acquisition are carried out. The projection screen is adjustable in size and position, and the problems that the size of the screen is limited, and the sight angle is fixed are solved.

    本发明提供了一种基于手势识别的车载虚拟屏交互信息系统,属于车载娱乐系统领域。RGB摄像头采集挡风玻璃上的乘员手势操作图像信息,处理器接收采集信息,确定指尖点击位置与手势操作信息,并传输给车载娱乐系统,车载娱乐系统根据操作界面进行对应位置的命令操作,执行结束后的操作界面传输给可见光投影机,可见光投影机将操作界面投影在挡风玻璃上显示;确定指尖点击位置与手势操作信息经过图像预处理、手部提取、手势有效判断、手势识别、数据库匹配和指尖定位获取。本发明的投影屏幕大小和位置可调,解决屏幕大小有限、视线角度固定不变的问题。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Vehicle-mounted virtual screen information interaction system based on gesture recognition


    Weitere Titelangaben:

    一种基于手势识别的车载虚拟屏交互信息系统


    Beteiligte:
    LI JIEHUI (Autor:in) / WANG JIAN (Autor:in) / ZHOU DEFENG (Autor:in) / WANG YAXIN (Autor:in) / FANG SHENG (Autor:in)

    Erscheinungsdatum :

    2021-01-01


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G03B APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM , Geräte oder Anordnungen zum Aufnehmen, Projizieren oder Betrachten von Fotografien




    Vehicle-mounted virtual visor system with facial expression control gesture

    TODD RICHARD / ZINK JOACHIM / WUDLICH ANDREAS | Europäisches Patentamt | 2023

    Freier Zugriff

    Vehicle-mounted gesture interaction method and system based on monocular camera

    KONG HUIFANG / ZHANG SHUAIJIE | Europäisches Patentamt | 2023

    Freier Zugriff

    Gesture recognition control method and system of vehicle-mounted terminal

    ZHANG JIE | Europäisches Patentamt | 2015

    Freier Zugriff

    Vehicle-mounted rearview mirror navigator gesture recognition system and method thereof

    CHEN YI / ZENG ZHAODE | Europäisches Patentamt | 2015

    Freier Zugriff