Highlights Proposed a knowledge transfer method to promote the utilization of emergency experience and get it reused. Adaptively combined policy distillation with actor-critic structured multi-agent reinforcement learning algorithm. Developed a fast emergency decision making method for freeway accident optimal onsite disposal. Established an MDP model to simulate task-level accident disposal, modelled commonality among different freeway accidents.

    Abstract A large number of freeway accident disposals are well-recorded by accident reports and surveillance videos, but it is not easy to get the emergency experience reused from past recorded accidents. To reuse emergency experience for better emergency decision-making, this paper proposed a knowledge-based experience transfer method to transfer task-level freeway accident disposal experience via multi-agent reinforcement learning algorithm with policy distillation. First, the Markov decision process is used to simulate the emergency decision-making process of multi-type freeway accident scene at the task level. Then, an adaptive knowledge transfer method named policy distilled multi-agent deep deterministic policy gradient (PD-MADDPG) algorithm is proposed to reuse experience from past freeway accident records to current accidents for fast decision-making and optimal onsite disposal. The performance of the proposed algorithm is evaluated on instantiated cases of freeway accidents that occurred on the freeway in Shaanxi Province, China. Aside from achieving better emergency decisions performance than various typical decision-making methods, the result shows decision maker with transferred knowledge owns 65.22%, 11.37%, 9.23%, 7.76% and 1.71% higher average reward than those without in the five studied cases, respectively. Indicating that the emergency experience transferred from past accidents contributes to fast emergency decision-making and optimal accident onsite disposal.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A task-level emergency experience reuse method for freeway accidents onsite disposal with policy distilled reinforcement learning


    Beteiligte:
    Yan, Longhao (Autor:in) / Wang, Ping (Autor:in) / Qi, Fan (Autor:in) / Xu, Zhuohang (Autor:in) / Zhang, Ronghui (Autor:in) / Han, Yu (Autor:in)


    Erscheinungsdatum :

    2023-06-16




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Freeway Fatal Accidents, 1988

    D. W. Howell / C. D. Cutler | NTIS | 1991


    Freeway Fatal Accidents, 1987

    D. W. Howell / C. D. Cutler | NTIS | 1990


    Freeway Fatal Accidents, 1989

    D. W. Howell / C. D. Cutler | NTIS | 1992


    Restoring freeway operation after traffic accidents

    Lynch, Frank L. / Keese, Charles J. | TIBKAT | 1964