Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and experiential knowledge of humans. In this paper, we propose a fundamental paradigm shift from current pipelines, exploiting Large Language Models (LLMs) as a cognitive agent to integrate human-like intelligence into autonomous driving systems. Our approach, termed Agent-Driver, transforms the traditional autonomous driving pipeline by introducing a versatile tool library accessible via function calls, a cognitive memory of common sense and experiential knowledge for decision-making, and a reasoning engine capable of chain-of-thought reasoning, task planning, motion planning, and self-reflection. Powered by LLMs, our Agent-Driver is endowed with intuitive common sense and robust reasoning capabilities, thus enabling a more nuanced, human-like approach to autonomous driving. We evaluate our approach on the large-scale nuScenes benchmark, and extensive experiments substantiate that our Agent-Driver significantly outperforms the state-of-the-art driving methods by a large margin. Our approach also demonstrates superior interpretability and few-shot learning ability to these methods.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Language Agent for Autonomous Driving


    Beteiligte:
    Mao, Jiageng (Autor:in) / Ye, Junjie (Autor:in) / Qian, Yuxi (Autor:in) / Pavone, Marco (Autor:in) / Wang, Yue (Autor:in)

    Erscheinungsdatum :

    2023


    Anmerkungen:

    COLM 2024. Project Page: https://usc-gvl.github.io/Agent-Driver/


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    A formal multi-agent language for cooperative autonomous driving scenarios

    Witsch, Andreas / Opfer, Stephan / Geihs, Kurt | IEEE | 2014


    AGENT IMPORTANCE PREDICTION FOR AUTONOMOUS DRIVING

    HAZARD CHRISTOPHER / BHAGAT AKSHAY / BUDDHARAJU BALARAMA RAJU et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    AGENT IMPORTANCE PREDICTION FOR AUTONOMOUS DRIVING

    HAZARD CHRISTOPHER / BHAGAT AKSHAY / BUDDHARAJU BALARAMA et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    AGENT IMPORTANCE PREDICTION FOR AUTONOMOUS DRIVING

    HAZARD CHRISTOPHER / BHAGAT AKSHAY / BUDDHARAJU BALARAMA RAJU et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Intelligent agent importance prediction for autonomous driving

    HAZZARD CHRISTIAN / BHAGAT ASHISH / FODOLOJU BRENT R et al. | Europäisches Patentamt | 2024

    Freier Zugriff