The invention provides a vehicle automatic driving method and system based on a large model. The method comprises the following steps: acquiring sensing data; converting the audio data according to the audio conversion model to obtain first text data, converting the visual data based on the visual conversion model to obtain second text data, and processing the text data input by the user, the first text data and the second text data based on a language large model to obtain perception auxiliary information and decision auxiliary information; obtaining a preliminary decision result according to environmental characteristics around the vehicle, the positioning data and the driving data, wherein the environmental characteristics perform target detection determination on information around the vehicle based on visual data, the positioning data and perception auxiliary information; and obtaining an optimal decision result according to the preliminary decision result and the decision auxiliary information, and generating an optimal planning path according to the optimal decision result to adjust the running state of the vehicle. According to the invention, the characteristics of the environment around the vehicle are fully considered, and the safety of the vehicle in special weather and full scenes is improved.
本发明提供一种基于大模型的车辆自动驾驶方法及系统,方法包括:获取传感数据;根据音频转换模型对音频数据进行转换得到第一文本数据,基于视觉转换模型对视觉数据进行转换得到第二文本数据,基于语言大模型对用户输入的文本数据、第一文本数据和第二文本数据进行处理,得到感知辅助信息和决策辅助信息;根据车辆周围的环境特征、定位数据和驾驶数据获取初步决策结果,环境特征基于视觉数据、定位数据、感知辅助信息对车辆周围信息进行目标检测确定;根据初步决策结果和决策辅助信息,得到最优决策结果,根据最优决策结果生成最优规划路径以调整车辆运行状态。本发明充分考虑了车辆周围的环境特征,提高了车辆在特殊天气及全场景下的安全性。
Vehicle automatic driving method and system based on large model
基于大模型的车辆自动驾驶方法及系统
2024-03-26
Patent
Electronic Resource
Chinese
Automatic driving model, training method, automatic driving method and vehicle
European Patent Office | 2023
|Automatic driving vehicle driving method and automatic driving vehicle
European Patent Office | 2024
|AUTOMATIC DRIVING SYSTEM, VEHICLE, AUTOMATIC DRIVING METHOD, AND AUTOMATIC DRIVING PROGRAM
European Patent Office | 2020
|AUTOMATIC DRIVING VEHICLE ALLOCATION SYSTEM, AUTOMATIC DRIVING VEHICLE AND VEHICLE ALLOCATION METHOD
European Patent Office | 2019
|Automatic driving vehicle control method and system and automatic driving vehicle
European Patent Office | 2022
|