The invention relates to a human-vehicle interaction system, and the system comprises a voice module which is configured to be used for detecting the voice in a vehicle and recognizing the voice content; a vision capturing device which is configured to be used for monitoring the state of the driver in real time; and a controller which is coupled with the voice module and the visual capturing device; the controller is configured to: when the visual capture device monitors lip movement of the driver and monitors that the sight line of the driver stays in a specific area for a preset time, and the voice module identifies a voice keyword for executing a specific instruction, controlling a corresponding vehicle part to execute the specific instruction indicated by the voice keyword.

    本申请涉及一种人车交互系统,包括:语音模块,被配置成用于检测车内语音并识别语音内容;视觉捕获装置,被配置成用于实时地监测驾驶员的状态;控制器,与所述语音模块以及所述视觉捕获装置耦合,所述控制器被配置成用于:当满足所述视觉捕获装置监测到所述驾驶员的唇动并监测到所述驾驶员的视线停留在特定区域中达预定时间、并且所述语音模块识别到执行特定指令的语音关键词时,控制相应的车辆部件执行由所述语音关键词所指示的所述特定指令。


    Access

    Download


    Export, share and cite



    Title :

    Human-vehicle interaction system


    Additional title:

    一种人车交互系统


    Contributors:
    GU HUILIANG (author) / YAN JIALIANG (author) / WANG HUI (author) / ZHOU JINJIN (author) / YUE WEI (author) / LI TAO (author)

    Publication date :

    2021-09-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS



    HUMAN-VEHICLE INTERACTION

    FEIT STEVEN / MILLER ROSS C / CHAMPI JESSICA | European Patent Office | 2018

    Free access

    Human-vehicle interaction

    FEIT STEVEN / MILLER ROSS C / CHAMPI JESSICA | European Patent Office | 2019

    Free access

    HUMAN-VEHICLE INTERACTION

    FEIT STEVEN / MILLER ROSS C / CHAMPI JESSICA | European Patent Office | 2019

    Free access

    Human-vehicle interaction

    FEIT STEVEN / MILLER ROSS C / CHAMPI JESSICA | European Patent Office | 2021

    Free access

    HUMAN-VEHICLE INTERACTION METHOD AND SYSTEM

    CHEN YINGRUI | European Patent Office | 2023

    Free access