Highlights Machine learning (ML) model interpretability is critical for safety data modeling. ML model interpretation methods are reviewed and compared. It is feasible to use ML and SHAP to derive crash modification factors. It is important to differentiate causation from correlation in ML safety studies.

    Abstract Machine learning (ML) model interpretability has attracted much attention recently given the promising performance of ML methods in crash frequency studies. Extracting accurate relationship between risk factors and crash frequency is important for understanding the causal effects of risk factors and developing safety countermeasures. However, there is no study that comprehensively summarizes ML model interpretation methods and provides guidance for safety researchers and practitioners. This research aims to fill this gap. Model-based and post-hoc ML interpretation methods are critically evaluated and compared to study their suitability in crash frequency modeling. These methods include classification and regression tree (CART), multivariate adaptive regression splines (MARS), Local Interpretable Model-agnostic Explanations (LIME), Local Sensitivity Analysis (LSA), Partial Dependence Plots (PDP), Global Sensitivity Analysis (GSA), and SHapley Additive exPlanations (SHAP). Model-based interpretation methods cannot reveal the detailed interaction relationships among risk factors. LIME can only be used to analyze the effects of a risk factor at the prediction level. LSA and PDP assume that different risk factors are independently distributed. Both GSA and SHAP can account for the potential correlation among risk factors. However, only SHAP can visualize the detailed relationships between crash outcomes and risk factors. This study also demonstrates the potential and benefits of using ML and SHAP to derive Crash Modification Factors (CMF). Finally, it is emphasized that statistical and ML models may not directly differentiate causation from correlation. Understanding the differences between them is critical for developing reliable safety countermeasures.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    On the interpretability of machine learning methods in crash frequency modeling and crash modification factor development


    Beteiligte:
    Wen, Xiao (Autor:in) / Xie, Yuanchang (Autor:in) / Jiang, Liming (Autor:in) / Li, Yan (Autor:in) / Ge, Tingjian (Autor:in)


    Erscheinungsdatum :

    2022-02-15




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Crash reconstruction and crash modification factors

    Davis, Gary A. | Online Contents | 2014


    Crash Modification Factors

    Hauer, Ezra / Bonneson, James A. / Council, Forrest et al. | Transportation Research Record | 2012


    Integration of machine learning and statistical models for crash frequency modeling

    Zhou, Dongqin / Gayah, Vikash V. / Wood, Jonathan S. | Taylor & Francis Verlag | 2023


    Helicopter Crash Frequency

    M. D. Brandyberry | NTIS | 1990