The invention discloses an end-to-end automatic driving decision planning method and device combined with meta-learning multi-task optimization, an end-to-end learning mode is adopted to overcome error transmission, a multi-task constraint method is utilized to optimize model convergence, and multi-branch output results of multiple tasks further increase the interpretability of the model. Eight different sub-task branches are designed, including environment perception tasks and self state cognition, and original sensor features are converted into aerial view space through a sub-task design model, so that the accuracy of decision planning prediction is improved. Furthermore, in order to optimize different multi-task combinations, firstly, the multi-task intimacy is adopted to evaluate the different task combinations to obtain initialized task weights, and then a multi-task optimization method based on combination of meta-learning is adopted to dynamically adjust the weights among the different tasks in the training process, so that optimization of main task prediction is realized.

    本发明公开了一种结合元学习多任务优化的端到端自动驾驶决策规划方法及设备,采用端到端学习方式克服误差传递,同时利用多任务约束的方法优化了模型的收敛,多任务的多分支输出结果进一步增加了模型的可解释性。设计八个不同的子任务分支,包含对于环境的感知任务以及对于自身状态的认知,通过子任务的设计模型将原始传感器特征转化到鸟瞰图空间提升了决策规划预测的准确性。进一步,为优化不同的多任务组合,首先采用多任务亲密度对不同任务组合进行评估,得到初始化任务权重,然后采用基于结合元学习的多任务优化方法,在训练过程中动态调整不同任务之间权重,从而实现主任务预测的最优化。


    Access

    Download


    Export, share and cite



    Title :

    End-to-end automatic driving decision planning method and device in combination with meta-learning multi-task optimization


    Additional title:

    一种结合元学习多任务优化的端到端自动驾驶决策规划方法及设备


    Contributors:
    RAO ZHONGYU (author) / CAI YINGFENG (author) / WANG HAI (author) / LI YICHENG (author) / LIU QINGCHAO (author) / CHEN LONG (author) / LIAN YUBO (author) / DONG ZHAOZHI (author)

    Publication date :

    2023-09-12


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V



    Multi-task multi-objective optimization decision planning processing method and system in automatic driving

    DANG DONGFANG / XU WEI / CHEN CAIXIA et al. | European Patent Office | 2024

    Free access

    Automatic driving multi-task coordination decision-making method based on hierarchical rolling optimization

    LIN XINYOU / CHEN QIANLIAN / ZHANG BIAO et al. | European Patent Office | 2023

    Free access

    Automatic driving planning decision-making method and device

    LUO JINGWEI / YANG JIA / ZHU CHENXI et al. | European Patent Office | 2024

    Free access

    Vectorized map and multi-task feature embedding combined end-to-end automatic driving decision planning model and device

    CAI YINGFENG / RAO ZHONGYU / WANG HAI et al. | European Patent Office | 2024

    Free access

    Multi-task sensing method and device for automatic driving

    HUANG PENGCHI / WANG JIANXIN / ZHONG SHENGZHI et al. | European Patent Office | 2024

    Free access