The invention provides an automatic driving model, method and device capable of realizing multi-modal interaction and a vehicle, and relates to the technical field of computers, in particular to the technical field of automatic driving and artificial intelligence. An input layer in the automatic driving model is configured to receive historical decision information, perception information, traffic information and interaction information at the current moment; the encoding layer is configured to encode input information, and the autoregressive reasoning layer is configured to obtain a hidden state of a next moment; and the decoding layer is configured to decode the interaction information at the next moment and the automatic driving decision information for the next moment. Therefore, the automatic driving model can understand the current driving environment through reasoning the perception information, the traffic information and the interaction information, and further can better understand the influence of historical operation on the automatic driving process by combining with reasoning the historical decision data. Therefore, the output result of the automatic driving model has better interpretability and controllability.
本公开提供了一种能够实现多模态交互的自动驾驶模型、方法、装置和车辆,涉及计算机技术领域,尤其涉及自动驾驶和人工智能技术领域。自动驾驶模型中的输入层被配置成接收当前时刻的历史决策信息、感知信息、交通信息以及交互信息;编码层被配置成对输入信息进行编码,自回归推理层被配置成得到下一时刻的隐状态;解码层被配置成解码得到下一时刻的交互信息和用于下一时刻的自动驾驶决策信息。由此,自动驾驶模型可以通过对感知信息、交通信息和交互信息的推理对当前驾驶环境进行理解,进一步还可以结合对历史决策数据进行推理来更好地理解历史操作对自动驾驶过程的影响,从而使得自动驾驶模型的输出结果具有更好的可解释性和可控性。
Automatic driving model, method and device capable of realizing multi-modal interaction and vehicle
能够实现多模态交互的自动驾驶模型、方法、装置和车辆
2024-02-27
Patent
Electronic Resource
Chinese
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen |
AUTONOMOUS DRIVING MODEL, METHOD, APPARATUS AND VEHICLE CAPABLE OF ACHIEVING MULTI-MODAL INTERACTION
European Patent Office | 2025
|AGV (Automatic Guided Vehicle) capable of realizing rapid offline
European Patent Office | 2025
|Vehicle-mounted audio-video entertainment system capable of realizing multi-screen interaction
European Patent Office | 2023
|