The invention relates to a head-up display adjusting method, system and device based on emotion recognition and a medium. The method comprises the following steps: acquiring a face video frame sequence of a driver and a physiological signal sequence corresponding to the face video frame sequence; inputting the face video frame sequence into an expression recognition model, and extracting an expression feature sequence of the face video frame sequence; extracting a physiological feature sequence from the physiological signal sequence according to a physiological feature extraction model; inputting the expression feature sequence and the physiological feature sequence into a multi-modal emotion recognition model to generate an emotion category; and dynamically adjusting the head-up display content on the vehicle according to a preset adjustment strategy based on the emotion category. The head-up display content is dynamically adjusted according to the emotion of the driver, and the driving safety is improved.

    本发明涉及一种基于情绪识别的抬头显示调整方法、系统、设备和介质。方法包括:获取驾驶员的面部视频帧序列以及与之对应的生理信号序列;将所述面部视频帧序列输入至表情识别模型,提取所述面部视频帧序列的表情特征序列;依据生理特征提取模型,从所述生理信号序列中提取生理特征序列;将所述表情特征序列和所述生理特征序列输入至多模态情绪识别模型,生成情绪类别;基于所述情绪类别,依据预设的调整策略,动态调整车辆上抬头显示的内容。本发明根据驾驶员情绪动态调整抬头显示内容,提升了行车安全性。


    Access

    Download


    Export, share and cite



    Title :

    Head-up display adjusting method, system and device based on emotion recognition and medium


    Additional title:

    基于情绪识别的抬头显示调整方法、系统、设备和介质


    Contributors:
    LEE JIN-HAN (author) / MO ZHIQIANG (author)

    Publication date :

    2025-02-25


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V




    Head-up display adjusting method, device and equipment and head-up display system

    YAN KAILIE / XU JIEMING / CHEN TING | European Patent Office | 2024

    Free access

    Vehicle head-up display system adjusting method and device, vehicle and storage medium

    WANG YONGQUAN / GAO MIN / YANG XUEFANG | European Patent Office | 2024

    Free access

    Head-up display position adjusting method and device, equipment and storage medium

    REN HAISHAN / JIANG KUN / LI WENBO et al. | European Patent Office | 2024

    Free access

    Adjusting method and device of head-up display, vehicle and storage medium

    XU GANG / TAN MINGWEI / CAI SHIMIN et al. | European Patent Office | 2024

    Free access