The invention relates to an automatic driving decision-making method and device and a medium, and relates to the technical field of automatic driving. The method comprises the following steps: acquiring a first preset; generating a sensing prompt text based on first preset; querying the multi-modal large-scale basic model by utilizing the sensing prompt text and the original sensing signal to obtain a scene category, a target and an environment state expected to be obtained; generating a decision prompt text based on a second preset and expected scene category, a target and an environment state; querying the multi-modal large-scale basic model by utilizing the decision prompt text and the original video to obtain a decision result text in a natural language form; according to the decision result text and a third preset, generating an instruction prompt text by using a template prompt function; and converting the instruction prompt text into a decision instruction of a structured natural language. Through the method, scene understanding can be carried out by utilizing the multi-modal large-scale basic model, and the function of the existing sensing module is enhanced or replaced.

    本公开涉及一种自动驾驶决策方法、装置及介质,涉及自动驾驶技术领域。其中,该方法包括:获取第一预设;基于第一预设生成感知提示文本;利用感知提示文本和原始感知信号查询多模态大型基础模型,得到期望获得的场景类别、目标及环境状态;基于第二预设和期望获得的场景类别、目标及环境状态生成决策提示文本;利用决策提示文本和原始视频查询多模态大型基础模型,得到自然语言形式的决策结果文本;根据决策结果文本,第三预设并利用模板提示功能生成指令提示文本;将指令提示文本转化为结构化自然语言的决策指令。通过以上方法,能利用多模态大型基础模型进行场景理解,加强或者取代现有感知模块的功能。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Automatic driving decision-making method and device and medium


    Weitere Titelangaben:

    自动驾驶决策方法、装置及介质


    Beteiligte:
    XIN BINJIAN (Autor:in)

    Erscheinungsdatum :

    22.03.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung





    Automatic driving lane changing decision-making method and device and storage medium

    WANG WENYU / HANG CHEN / XIA XIN et al. | Europäisches Patentamt | 2024

    Freier Zugriff


    Automatic driving planning decision-making method and device

    LUO JINGWEI / YANG JIA / ZHU CHENXI et al. | Europäisches Patentamt | 2024

    Freier Zugriff