The invention relates to the field of intelligent control, in particular to an AR-HUD intelligent adjusting system and method based on a multi-mode large model, and the system comprises an information interaction layer which is used for obtaining a service request of a user side in real time, orienting to a corresponding service based on the service request of the user side, and returning the provided service to the user side which initiates the request through HUD projection information; wherein the service comprises a navigation route recommendation function and an in-vehicle brightness adjustment function; the input layer is used for collecting multi-modal data of a vehicle in real time; comprising driving information, environment perception information, vehicle condition information and personal information; the execution layer is used for performing projection based on a service request of a user, inputting current navigation information into the trained multi-mode large model, and generating a recommended navigation route in combination with vehicle conditions and driving information; and HUD display parameters are adjusted in combination with the environment perception information. According to the scheme, the problem that the HUD projection information can only serve as navigation information to be transparently transmitted and displayed and cannot be changed in real time in the driving process to make optimal route recommendation can be solved.

    本发明涉及智能控制领域,具体涉及一种基于多模态大模型的AR‑HUD智能调节系统及方法,包括信息交互层,用于实时获取用户端的服务请求,基于用户端的服务请求定向到相应服务,将提供的服务通过HUD投影信息返回给发起请求的用户端;其中,服务包括导航线路推荐功能和车内亮度调节功能;输入层,用于实时采集车辆的多模态数据;包括驾驶信息、环境感知信息、车况信息和个人信息;执行层,用于基于用户的服务请求进行投射,将当前导航信息输入训练好的多模态大模型,结合车况、驾驶信息生成推荐导航路线;并结合环境感知信息调节HUD显示参数。上述方案能够解决HUD投影信息仅能作为导航信息透传展示,无法在驾驶途中实时变化做出最佳路线推荐的问题。


    Access

    Download


    Export, share and cite



    Title :

    AR-HUD intelligent adjusting system and method based on multi-modal large model


    Additional title:

    一种基于多模态大模型的AR-HUD智能调节系统及方法


    Contributors:
    YIN YUSHAN (author)

    Publication date :

    2024-11-15


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES



    Intelligent airplane inspection system based on multi-modal large model

    QIN YONGHUI / WANG YANXIA | European Patent Office | 2025

    Free access

    Cloud intelligent driving control system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | European Patent Office | 2025

    Free access

    Intelligent parking method and system based on multi-modal visual tracking

    YAN JUN / WANG YONGFEI / ZHANG JUHUA | European Patent Office | 2023

    Free access

    Intelligent traffic management method and system based on multi-modal perception

    YAN JUN / WANG YONGFEI / ZHANG JUHUA | European Patent Office | 2023

    Free access

    Multi-modal interaction method and system based on intelligent driving function

    ZHANG WENHUI / HE JINPENG / LOU XINYANG | European Patent Office | 2024

    Free access