The invention discloses an intelligent cabin system based on multimode interaction and virtual reality technology, which comprises a central processing unit, a voice and environment detection system, an in-vehicle state visual monitoring system, an in-vehicle hardware early warning and optimization system, an out-cabin sensing system and an in-vehicle data management system. The voice and environment detection system, the in-vehicle state visual monitoring system, the in-vehicle hardware early warning and optimization system, the out-cabin sensing system and the in-vehicle data management system are in electric signal connection with the central processing unit through CAN buses. The voice and environment detection system, the in-vehicle state visual monitoring system, the in-vehicle hardware early warning and optimization system, the out-cabin sensing system and the in-vehicle data management system perform interactive communication with the central processing unit based on results analyzed by the artificial intelligence model; the intelligent cabin system based on the multi-mode interaction and virtual reality technology has the effect of optimizing the driving experience to the maximum extent while improving the vehicle driving safety.

    本发明公开了一种基于多模交互和虚拟现实技术的智能座舱系统,包括中央处理器、语音及环境检测系统、车内状态视觉监测系统、车内硬件预警及优化系统、舱外感知系统和车内数据管理系统,其特征在于,所述语音及环境检测系统、车内状态视觉监测系统、车内硬件预警及优化系统、舱外感知系统和车内数据管理系统与中央处理器之间以CAN总线进行电信号连接,且语音及环境检测系统、车内状态视觉监测系统、车内硬件预警及优化系统、舱外感知系统和车内数据管理系统将基于经人工智能模型分析出的结果与中央处理器进行交互式通信,本发明公开的基于多模交互和虚拟现实技术的智能座舱系统具有在提高车辆行驶安全的同时最大限度的优化驾乘体验的效果。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent cabin system based on multimode interaction and virtual reality technology


    Additional title:

    一种基于多模交互和虚拟现实技术的智能座舱系统


    Contributors:
    ZHAO JINGYU (author) / ZHANG XUNFANG (author)

    Publication date :

    2022-10-18


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / A63F CARD, BOARD OR ROULETTE GAMES , Kartenspiele, Brettspiele, Roulettespiele / B60N SEATS SPECIALLY ADAPTED FOR VEHICLES , Sitze besonders für Fahrzeuge ausgebildet / B60Q ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL , Anordnung von Signal- oder Beleuchtungsvorrichtungen, deren Einbau oder Halterung oder deren Schaltkreise bei Fahrzeugen allgemein / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler



    Method and system for realizing AR virtual image interaction based on intelligent cabin

    LYU DANPING / ZENG JUN / CUI YONG | European Patent Office | 2022

    Free access

    Research on Virtual Reality Based Civil Aircraft Cabin Customization System

    Ma, Nan ;Liu, Hu ;Tian, Yong Liang | Trans Tech Publications | 2013


    Accessibility Evaluation in Aircraft Cabin Based on Virtual Reality

    Li, Xian ;Liu, Hu | Trans Tech Publications | 2014


    Information interaction method in intelligent vehicle cabin and intelligent vehicle cabin

    ZHANG YIJIA / WANG WEIWEI / LIU YUQI | European Patent Office | 2023

    Free access

    Automobile intelligent cabin system and interaction method

    YANG WEIFENG / CHEN PENG | European Patent Office | 2023

    Free access