The invention discloses a multi-modal interaction method and system based on an intelligent driving function. The multi-modal interaction method comprises the following steps: acquiring an intelligent driving function scene and a corresponding intelligent driving function; judging the fault occurrence time in the intelligent driving function scene; carrying out interaction hierarchy division according to the fault occurrence opportunity; if the fault occurrence time is before function activation and when a user manually activates a function, prompting an intelligent driving function fault corresponding to the intelligent driving function scene, and performing interaction by using a corresponding interaction mode according to divided interaction levels; and if the fault occurrence opportunity is function activation and when the intelligent driving function performs lane cruising, performing interaction by using a corresponding interaction mode according to the divided interaction levels based on the fault state of a sensing sensor corresponding to the intelligent driving function scene and/or the function state of the intelligent driving function.

    一种基于智能驾驶功能的多模态交互方法及系统,所述多模态交互方法包括:获取智能驾驶功能场景及其对应的智能驾驶功能;判断所述智能驾驶功能场景下的故障发生时机;针对所述故障发生时机进行交互层级的划分;若所述故障发生时机为功能激活前,且当用户手动激活功能时,提示所述智能驾驶功能场景对应的智能驾驶功能故障,并按划分的交互层级使用对应的交互方式进行交互;若所述故障发生时机为功能激活中,且当所述智能驾驶功能车道巡航时,基于所述智能驾驶功能场景对应的感知传感器的故障状态和/或所述智能驾驶功能的功能状态按划分的交互层级使用对应的交互方式进行交互。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Multi-modal interaction method and system based on intelligent driving function


    Weitere Titelangaben:

    基于智能驾驶功能的多模态交互方法及系统


    Beteiligte:
    ZHANG WENHUI (Autor:in) / HE JINPENG (Autor:in) / LOU XINYANG (Autor:in)

    Erscheinungsdatum :

    06.08.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Cloud intelligent driving control system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Driving fatigue intervention method and system based on multi-modal perception interaction

    YUAN XINYI / XIA YONG / WANG YOULAN et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Intelligent driving interaction method, interaction system and vehicle

    YUAN MENG / GUO YANGDONG / SI HUACHAO et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Man-machine interaction method of intelligent driving system, intelligent driving system and automobile

    KUANG FENGQI / ZHAO YUNHUI | Europäisches Patentamt | 2023

    Freier Zugriff

    Automatic driving method and system based on multi-view multi-modal fusion

    LIU CHUNSHENG / SUN JINYING / CHANG FALIANG et al. | Europäisches Patentamt | 2024

    Freier Zugriff