The invention relates to the field of intelligent control, in particular to an AR-HUD intelligent adjusting system and method based on a multi-mode large model, and the system comprises an information interaction layer which is used for obtaining a service request of a user side in real time, orienting to a corresponding service based on the service request of the user side, and returning the provided service to the user side which initiates the request through HUD projection information; wherein the service comprises a navigation route recommendation function and an in-vehicle brightness adjustment function; the input layer is used for collecting multi-modal data of a vehicle in real time; comprising driving information, environment perception information, vehicle condition information and personal information; the execution layer is used for performing projection based on a service request of a user, inputting current navigation information into the trained multi-mode large model, and generating a recommended navigation route in combination with vehicle conditions and driving information; and HUD display parameters are adjusted in combination with the environment perception information. According to the scheme, the problem that the HUD projection information can only serve as navigation information to be transparently transmitted and displayed and cannot be changed in real time in the driving process to make optimal route recommendation can be solved.

    本发明涉及智能控制领域,具体涉及一种基于多模态大模型的AR‑HUD智能调节系统及方法,包括信息交互层,用于实时获取用户端的服务请求,基于用户端的服务请求定向到相应服务,将提供的服务通过HUD投影信息返回给发起请求的用户端;其中,服务包括导航线路推荐功能和车内亮度调节功能;输入层,用于实时采集车辆的多模态数据;包括驾驶信息、环境感知信息、车况信息和个人信息;执行层,用于基于用户的服务请求进行投射,将当前导航信息输入训练好的多模态大模型,结合车况、驾驶信息生成推荐导航路线;并结合环境感知信息调节HUD显示参数。上述方案能够解决HUD投影信息仅能作为导航信息透传展示,无法在驾驶途中实时变化做出最佳路线推荐的问题。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    AR-HUD intelligent adjusting system and method based on multi-modal large model


    Weitere Titelangaben:

    一种基于多模态大模型的AR-HUD智能调节系统及方法


    Beteiligte:
    YIN YUSHAN (Autor:in)

    Erscheinungsdatum :

    15.11.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES



    Intelligent airplane inspection system based on multi-modal large model

    QIN YONGHUI / WANG YANXIA | Europäisches Patentamt | 2025

    Freier Zugriff

    Cloud intelligent driving control system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Intelligent parking method and system based on multi-modal visual tracking

    YAN JUN / WANG YONGFEI / ZHANG JUHUA | Europäisches Patentamt | 2023

    Freier Zugriff

    Multi-modal interaction method and system based on intelligent driving function

    ZHANG WENHUI / HE JINPENG / LOU XINYANG | Europäisches Patentamt | 2024

    Freier Zugriff

    Intelligent traffic management method and system based on multi-modal perception

    YAN JUN / WANG YONGFEI / ZHANG JUHUA | Europäisches Patentamt | 2023

    Freier Zugriff