The invention relates to an automatic driving decision-making method and device and a medium, and relates to the technical field of automatic driving. The method comprises the following steps: acquiring a first preset; generating a sensing prompt text based on first preset; querying the multi-modal large-scale basic model by utilizing the sensing prompt text and the original sensing signal to obtain a scene category, a target and an environment state expected to be obtained; generating a decision prompt text based on a second preset and expected scene category, a target and an environment state; querying the multi-modal large-scale basic model by utilizing the decision prompt text and the original video to obtain a decision result text in a natural language form; according to the decision result text and a third preset, generating an instruction prompt text by using a template prompt function; and converting the instruction prompt text into a decision instruction of a structured natural language. Through the method, scene understanding can be carried out by utilizing the multi-modal large-scale basic model, and the function of the existing sensing module is enhanced or replaced.

    本公开涉及一种自动驾驶决策方法、装置及介质,涉及自动驾驶技术领域。其中,该方法包括:获取第一预设;基于第一预设生成感知提示文本;利用感知提示文本和原始感知信号查询多模态大型基础模型,得到期望获得的场景类别、目标及环境状态;基于第二预设和期望获得的场景类别、目标及环境状态生成决策提示文本;利用决策提示文本和原始视频查询多模态大型基础模型,得到自然语言形式的决策结果文本;根据决策结果文本,第三预设并利用模板提示功能生成指令提示文本;将指令提示文本转化为结构化自然语言的决策指令。通过以上方法,能利用多模态大型基础模型进行场景理解,加强或者取代现有感知模块的功能。


    Access

    Download


    Export, share and cite



    Title :

    Automatic driving decision-making method and device and medium


    Additional title:

    自动驾驶决策方法、装置及介质


    Contributors:
    XIN BINJIAN (author)

    Publication date :

    2024-03-22


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung





    Automatic driving lane changing decision-making method and device and storage medium

    WANG WENYU / HANG CHEN / XIA XIN et al. | European Patent Office | 2024

    Free access


    Automatic driving decision-making method and device, electronic equipment and storage medium

    YAN LIRONG / HU YUFENG / YIN ZHISHUAI et al. | European Patent Office | 2023

    Free access