The invention discloses an intelligent driving assistance method and system based on ChatGPT, a storage medium and a vehicle, and the method comprises the steps: carrying out the information extraction of a road condition image, obtaining the road condition information, and converting the road condition information into a road condition text; performing information extraction on the voice data to obtain voice information, and converting the voice information into a voice text; calling a ChatGPT model to carry out vision and language multi-modal fusion on the road condition text and the voice text, and outputting a strategy text; performing data classification and analysis on the strategy text, and outputting a prompt text and an instruction text; performing data conversion on the prompt text by adopting a deep neural network, outputting prompt voice, and outputting the prompt voice through a preset loudspeaker device; and performing data conversion on the instruction text by adopting a deep neural network, outputting a control instruction, and controlling the intelligent vehicle based on the control instruction. According to the invention, the technical problem of general precision of planning decision of intelligent driving assistance in the prior art is solved.

    本发明公开了一种基于ChatGPT的智能驾驶辅助方法、系统、存储介质及车辆,该方法包括:对路况图像进行信息提取,得到路况信息,并将路况信息转换成路况文本;对语音数据进行信息提取,得到语音信息,并将语音信息转换成语音文本;调用ChatGPT模型对路况文本与语音文本进行视觉和语言多模态融合,输出策略文本;对策略文本进行数据分类与解析,输出提示文本与指令文本;采用深度神经网络对提示文本进行数据转换,输出提示语音,以通过预设的扬声器件输出提示语音;采用深度神经网络对指令文本进行数据转换,输出控制指令,以基于控制指令对智能车辆进行控制。本发明解决了现有技术中智能驾驶辅助的规划决策存在精度一般的技术问题。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent driving assistance method and system based on ChatGPT, storage medium and vehicle


    Additional title:

    基于ChatGPT的智能驾驶辅助方法、系统、存储介质及车辆


    Contributors:
    GONG XUNFEI (author) / DENG JIANMING (author) / YU QIN (author) / LIAO CHENGLIANG (author) / LUO FENG (author) / ZHAO TING (author) / FAN HUACHUN (author) / ZHANG JUN (author) / XIONG HUIHUI (author)

    Publication date :

    2024-05-28


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Intelligent driving assistance method and system, storage medium and vehicle

    RAHMAN SHIFANA | European Patent Office | 2023

    Free access

    Vehicle driving assistance device, vehicle driving assistance method, and storage medium

    FUKUCHI NOBUAKI / YASUI DAIKI | European Patent Office | 2023

    Free access

    Vehicle driving assistance device, vehicle driving assistance method, and storage medium

    KOBAYASHI MAKOTO | European Patent Office | 2023

    Free access


    Intelligent driving assistance method and device, vehicle and storage medium

    CAI BAOSHUN | European Patent Office | 2023

    Free access