The invention provides a vehicle automatic driving method and system based on a large model. The method comprises the following steps: acquiring sensing data; converting the audio data according to the audio conversion model to obtain first text data, converting the visual data based on the visual conversion model to obtain second text data, and processing the text data input by the user, the first text data and the second text data based on a language large model to obtain perception auxiliary information and decision auxiliary information; obtaining a preliminary decision result according to environmental characteristics around the vehicle, the positioning data and the driving data, wherein the environmental characteristics perform target detection determination on information around the vehicle based on visual data, the positioning data and perception auxiliary information; and obtaining an optimal decision result according to the preliminary decision result and the decision auxiliary information, and generating an optimal planning path according to the optimal decision result to adjust the running state of the vehicle. According to the invention, the characteristics of the environment around the vehicle are fully considered, and the safety of the vehicle in special weather and full scenes is improved.

    本发明提供一种基于大模型的车辆自动驾驶方法及系统,方法包括:获取传感数据;根据音频转换模型对音频数据进行转换得到第一文本数据,基于视觉转换模型对视觉数据进行转换得到第二文本数据,基于语言大模型对用户输入的文本数据、第一文本数据和第二文本数据进行处理,得到感知辅助信息和决策辅助信息;根据车辆周围的环境特征、定位数据和驾驶数据获取初步决策结果,环境特征基于视觉数据、定位数据、感知辅助信息对车辆周围信息进行目标检测确定;根据初步决策结果和决策辅助信息,得到最优决策结果,根据最优决策结果生成最优规划路径以调整车辆运行状态。本发明充分考虑了车辆周围的环境特征,提高了车辆在特殊天气及全场景下的安全性。


    Access

    Download


    Export, share and cite



    Title :

    Vehicle automatic driving method and system based on large model


    Additional title:

    基于大模型的车辆自动驾驶方法及系统


    Contributors:
    CHEN LONG (author) / LIU KUNHUA (author) / WANG FEIYUE (author)

    Publication date :

    2024-03-26


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V



    Automatic driving model, training method, automatic driving method and vehicle

    HUANG JIZHOU / WANG FAN | European Patent Office | 2023

    Free access

    Automatic driving vehicle driving method and automatic driving vehicle

    HE YICHEN / HUA NI / LI XIAO et al. | European Patent Office | 2024

    Free access

    AUTOMATIC DRIVING SYSTEM, VEHICLE, AUTOMATIC DRIVING METHOD, AND AUTOMATIC DRIVING PROGRAM

    SUYAMA ATSUTO / AKITA AKIRA / KUBOTA HITOSHI | European Patent Office | 2020

    Free access


    Automatic driving vehicle control method and system and automatic driving vehicle

    HUANG HAO / ZHU YONGJIAN / HUANG PENGCHI et al. | European Patent Office | 2022

    Free access