The invention relates to an automatic driving decision-making method and device and a medium, and relates to the technical field of automatic driving. The method comprises the following steps: acquiring a first preset; generating a sensing prompt text based on first preset; querying the multi-modal large-scale basic model by utilizing the sensing prompt text and the original sensing signal to obtain a scene category, a target and an environment state expected to be obtained; generating a decision prompt text based on a second preset and expected scene category, a target and an environment state; querying the multi-modal large-scale basic model by utilizing the decision prompt text and the original video to obtain a decision result text in a natural language form; according to the decision result text and a third preset, generating an instruction prompt text by using a template prompt function; and converting the instruction prompt text into a decision instruction of a structured natural language. Through the method, scene understanding can be carried out by utilizing the multi-modal large-scale basic model, and the function of the existing sensing module is enhanced or replaced.
本公开涉及一种自动驾驶决策方法、装置及介质,涉及自动驾驶技术领域。其中,该方法包括:获取第一预设;基于第一预设生成感知提示文本;利用感知提示文本和原始感知信号查询多模态大型基础模型,得到期望获得的场景类别、目标及环境状态;基于第二预设和期望获得的场景类别、目标及环境状态生成决策提示文本;利用决策提示文本和原始视频查询多模态大型基础模型,得到自然语言形式的决策结果文本;根据决策结果文本,第三预设并利用模板提示功能生成指令提示文本;将指令提示文本转化为结构化自然语言的决策指令。通过以上方法,能利用多模态大型基础模型进行场景理解,加强或者取代现有感知模块的功能。
Automatic driving decision-making method and device and medium
自动驾驶决策方法、装置及介质
22.03.2024
Patent
Elektronische Ressource
Chinesisch
Automatic driving decision-making method and system, medium, automatic driving system and vehicle
Europäisches Patentamt | 2024
|Automatic driving decision-making method, device and equipment and storage medium
Europäisches Patentamt | 2023
|Automatic driving lane changing decision-making method and device and storage medium
Europäisches Patentamt | 2024
|Automatic driving decision-making method and device, electronic equipment and storage medium
Europäisches Patentamt | 2025
|Automatic driving planning decision-making method and device
Europäisches Patentamt | 2024
|