The invention provides a method for increasing the intelligent interactive experience of a vehicle-mounted virtual assistant, and the method comprises the steps: arranging a sound sensor and an image collection device in a cabin, and enabling the sound sensor and the image collection device to be in signal connection with a vehicle machine; the vehicle machine judges whether a signal is from a driver seat or a co-driver seat by analyzing the signal collected by the sound sensor, and sets the driver seat from which the signal is from as a target driver seat; and after the vehicle machine obtains the image frame F of the target driving position through the image acquisition device, the virtual assistant is arranged at a virtual space position closer to the target driving position, and the virtual assistant is rotated to face the target driving position. The space position of the user is calculated through real environment information such as voice and images, the virtual space position and the body orientation of the vehicle-mounted virtual assistant are adjusted in real time, the virtual assistant presents watching and listening reactions similar to those of a real person, and the intelligent interaction experience of the virtual assistant is improved.

    本发明提供一种增加车载虚拟助手智能交互体验的方法,其中,座舱内设有声音传感器、图像采集装置,声音传感器、图像采集装置分别与车机信号连接;车机通过分析声音传感器采集的信号,判断信号来源于驾驶位还是副驾驶位,将信号来源的驾驶位设定为目标驾驶位;车机通过图像采集装置获取目标驾驶位的图像帧F后,将虚拟助手设置到更靠近目标驾驶位的虚拟空间位置,旋转虚拟助手使其朝向目标驾驶位。本发明通过语音、图像等真实环境信息计算出用户的空间位置,实时调整车载虚拟助手的虚拟空间位置和身体朝向,使虚拟助手呈现出与真人相似的注视、倾听反应,增加其智能交互的体验。


    Access

    Download


    Export, share and cite



    Title :

    Method for increasing intelligent interaction experience of vehicle-mounted virtual assistant


    Additional title:

    一种增加车载虚拟助手智能交互体验的方法


    Contributors:
    AN HAICHUAN (author) / YU MINGXING (author)

    Publication date :

    2024-07-02


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion




    Intelligent vehicle-mounted interaction pen, interaction method and vehicle

    HUANG JIBING / WANG HUA / TANG XIANHONG | European Patent Office | 2023

    Free access

    Humanized interaction method and device for vehicle-mounted assistant and automobile

    ZHANG JIN / RAN GUANGWEI / ZHANG YING et al. | European Patent Office | 2020

    Free access

    Method and system for realizing vehicle-mounted intelligent personal assistant and corresponding vehicle

    ZHU QI / CHI SHIYU / CAO JUAN et al. | European Patent Office | 2023

    Free access

    Intelligent interaction method of vehicle-mounted equipment

    ZHANG XINYUE / LI YUNYI / LIN QIUXING et al. | European Patent Office | 2023

    Free access