The invention provides a voice interaction instruction determination method and device, electronic equipment and a storage medium, and relates to the technical field of voice interaction.The method comprises the steps that a user audio library, a face image and a behavior video of a target user are obtained, and the current to-be-improved state of the target user is determined based on the face image and the behavior video; then determining a target audio in multiple audios of a user audio library according to the current to-be-improved state and the historical interaction score, and finally determining a voice interaction instruction corresponding to the current to-be-improved state according to the target audio. Since the historical interaction score can represent the preference degree of the target user to the audio in the to-be-improved state, the target audio determined according to the current to-be-improved state and the historical interaction score can better conform to the preference of the user, and the effect of improving the accuracy of the target audio can be achieved; and thus, the auxiliary effect of the voice interaction instruction is relatively good.

    本申请提供一种语音交互指令确定方法、装置、电子设备及存储介质,涉及语音交互技术领域,该方法通过获取目标用户的用户音频库、面部图像以及行为视频,并基于面部图像以及行为视频确定目标用户的当前待改善状态,之后可以根据当前待改善状态以及历史交互评分在用户音频库的多个音频中确定目标音频,最后可以根据目标音频确定当前待改善状态对应的语音交互指令。由于历史交互评分可以表示目标用户在待改善状态时对音频的喜好程度,进而可以使得根据当前待改善状态以及历史交互评分确定的目标音频较符合用户的喜好,可以达到提高目标音频的准确性的效果,进而可以使得语音交互指令的辅助效果较好。


    Access

    Download


    Export, share and cite



    Title :

    Voice interaction instruction determination method and device, electronic equipment and storage medium


    Additional title:

    语音交互指令确定方法、装置、电子设备及存储介质


    Contributors:

    Publication date :

    2023-07-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V



    Instruction recognition method based on voice interaction, storage medium and electronic equipment

    LIU XIAOWEN / ZHANG CHUXIONG | European Patent Office | 2022

    Free access

    Voice interaction method, electronic equipment and storage medium

    WANG DONGDONG / CHEN YI / QU YUAN et al. | European Patent Office | 2022

    Free access

    Vehicle-mounted voice interaction method and device, electronic equipment and storage medium

    LIU DAQUAN / GU XIUYING | European Patent Office | 2023

    Free access

    Voice interaction method, voice interaction device, server and storage medium

    LI JIAHUI / SUN FANGXUN / CHEN GUANGYI et al. | European Patent Office | 2023

    Free access

    Voice interaction method, voice interaction device, server and readable storage medium

    DU-MENG ZESHAN / WANG CHAO / LI CHENYAN et al. | European Patent Office | 2022

    Free access