The invention provides a vehicle-mounted interaction system based on emotion perception and voice interaction. The system is applied to a vehicle-mounted terminal and comprises an information acquisition module, an emotion analysis module and an execution module. The camera collects passenger information and transmits the passenger information to the analysis module, the emotional state of a passenger is obtained through a facial emotion analysis method, and the execution module starts matched preset operation. The preset operation comprises modes of intelligent voice interaction, automatic driving system starting, RGB atmosphere lamp adjustment, music adjustment, in-vehicle fragrance adjustment and the like. The emotion and intention of the passenger can be captured and analyzed in real time, interaction is carried out in a voice mode, the expectation of the user for intelligent voice and emotional perception is met, for the passenger, the change of the emotion can influence the change of the environment in the vehicle, the change is natural and comfortable, the experience of the passenger in the vehicle can be improved, and the user experience is improved. And natural interaction between people and vehicles is realized.

    本发明提供基于情绪感知和语音交互的车载交互系统。所述系统应用于车载终端,包括信息采集模块、情绪分析模块以及执行模块。由摄像头收集乘客信息传输至分析模块,通过面部情绪分析方法获得乘客情绪状态,执行模块启动相匹配的预设操作。预设操作包括智能语音交互,开启自动驾驶系统,RGB氛围灯调节,音乐调节,车内香氛调节等方式。本发明可实时的捕捉和分析乘客的情绪和意图,通过语音的方式进行交互,满足用户对智能语音和情绪化感知的期待,对于乘客而言,情绪的改变可以影响车内环境的改变,这种改变是自然和舒适的,能够提升乘客在车内的体验,实现人与车的自然交互。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Vehicle-mounted interaction system based on emotion perception and voice interaction


    Weitere Titelangaben:

    基于情绪感知和语音交互的车载交互系统


    Beteiligte:
    SU HAO (Autor:in) / YANG CHANGCHUN (Autor:in) / KATSU (Autor:in) / WEI XING (Autor:in) / WANG ZIYAO (Autor:in) / YANG JINSU (Autor:in)

    Erscheinungsdatum :

    2022-05-06


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / B60H ARRANGEMENTS OR ADAPTATIONS OF HEATING, COOLING, VENTILATING, OR OTHER AIR-TREATING DEVICES SPECIALLY FOR PASSENGER OR GOODS SPACES OF VEHICLES , Anordnung oder Einbau der Heizung, Kühlung, Lüftung oder anderer Luftbehandlungsvorrichtungen für die Fahrzeugräume für Reisende oder Fracht / B60Q ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL , Anordnung von Signal- oder Beleuchtungsvorrichtungen, deren Einbau oder Halterung oder deren Schaltkreise bei Fahrzeugen allgemein / G06K Erkennen von Daten , RECOGNITION OF DATA



    Vehicle-mounted intelligent voice interaction system

    WANG ZHENQIANG / LIU YUFENG / ZHANG KUN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Wake-up-free vehicle-mounted voice interaction system

    LIU PENGBO | Europäisches Patentamt | 2023

    Freier Zugriff

    Automobile vehicle-mounted voice interaction system and method

    XU XIN / NIU DONG / HUANG YUZHEN et al. | Europäisches Patentamt | 2021

    Freier Zugriff


    Voice interaction system and method based on vehicle-mounted camera

    ZHANG HAIYING / SHEN XIAOPENG / LI WENPU | Europäisches Patentamt | 2023

    Freier Zugriff