The invention provides a vehicle automatic driving method and system based on a large model. The method comprises the following steps: acquiring sensing data; converting the audio data according to the audio conversion model to obtain first text data, converting the visual data based on the visual conversion model to obtain second text data, and processing the text data input by the user, the first text data and the second text data based on a language large model to obtain perception auxiliary information and decision auxiliary information; obtaining a preliminary decision result according to environmental characteristics around the vehicle, the positioning data and the driving data, wherein the environmental characteristics perform target detection determination on information around the vehicle based on visual data, the positioning data and perception auxiliary information; and obtaining an optimal decision result according to the preliminary decision result and the decision auxiliary information, and generating an optimal planning path according to the optimal decision result to adjust the running state of the vehicle. According to the invention, the characteristics of the environment around the vehicle are fully considered, and the safety of the vehicle in special weather and full scenes is improved.

    本发明提供一种基于大模型的车辆自动驾驶方法及系统,方法包括:获取传感数据;根据音频转换模型对音频数据进行转换得到第一文本数据,基于视觉转换模型对视觉数据进行转换得到第二文本数据,基于语言大模型对用户输入的文本数据、第一文本数据和第二文本数据进行处理,得到感知辅助信息和决策辅助信息;根据车辆周围的环境特征、定位数据和驾驶数据获取初步决策结果,环境特征基于视觉数据、定位数据、感知辅助信息对车辆周围信息进行目标检测确定;根据初步决策结果和决策辅助信息,得到最优决策结果,根据最优决策结果生成最优规划路径以调整车辆运行状态。本发明充分考虑了车辆周围的环境特征,提高了车辆在特殊天气及全场景下的安全性。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Vehicle automatic driving method and system based on large model


    Weitere Titelangaben:

    基于大模型的车辆自动驾驶方法及系统


    Beteiligte:
    CHEN LONG (Autor:in) / LIU KUNHUA (Autor:in) / WANG FEIYUE (Autor:in)

    Erscheinungsdatum :

    2024-03-26


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V



    Automatic driving model, training method, automatic driving method and vehicle

    HUANG JIZHOU / WANG FAN | Europäisches Patentamt | 2023

    Freier Zugriff

    Automatic driving vehicle driving method and automatic driving vehicle

    HE YICHEN / HUA NI / LI XIAO et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    AUTOMATIC DRIVING SYSTEM, VEHICLE, AUTOMATIC DRIVING METHOD, AND AUTOMATIC DRIVING PROGRAM

    SUYAMA ATSUTO / AKITA AKIRA / KUBOTA HITOSHI | Europäisches Patentamt | 2020

    Freier Zugriff


    Automatic driving vehicle control method and system and automatic driving vehicle

    HUANG HAO / ZHU YONGJIAN / HUANG PENGCHI et al. | Europäisches Patentamt | 2022

    Freier Zugriff