Highlights Shows that perturbation based approaches are ill-suited to understand the inner workings of Artificial Neural Networks. Re-conceptualises and pioneers the idea of heat maps to explain predictions of a trained Artificial Neural Network. Develops a method that reveals the rationale behind the trained Artificial Neural Network prediction in a way that is understandable to human analysts.

    Abstract Artificial Neural Networks (ANNs) are rapidly gaining popularity in transportation research in general and travel demand analysis in particular. While ANNs typically outperform conventional methods in terms of predictive performance, they suffer from limited explainability. That is, it is very difficult to assess whether or not particular predictions made by an ANN are based on intuitively reasonable relationships embedded in the model. As a result, it is difficult for analysts to gain trust in ANNs. In this paper, we show that often-used approaches using perturbation (sensitivity analysis) are ill-suited for gaining an understanding of the inner workings of ANNs. Subsequently, and this is the main contribution of this paper, we introduce to the domain of transportation an alternative method, inspired by recent progress in the field of computer vision. This method is based on a re-conceptualisation of the idea of ‘heat maps’ to explain the predictions of a trained ANN. To create a heat map, a prediction of an ANN is propagated backward in the ANN towards the input variables, using a technique called Layer-wise Relevance Propagation (LRP). The resulting heat map shows the contribution of each input value –for example the travel time of a certain mode– to a given travel mode choice prediction. By doing this, the LRP-based heat map reveals the rationale behind the prediction in a way that is understandable to human analysts. If the rationale makes sense to the analyst, the trust in the prediction, and, by extension, in the trained ANN as a whole, will increase. If the rationale does not make sense, the analyst may choose to adapt or re-train the ANN or decide not to use it at all. We show that by reconceptualising the LRP methodology towards the choice modelling and travel demand analysis contexts, it can be put to effective use in application domains well beyond the field of computer vision, for which it was originally developed.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Why did you predict that? Towards explainable artificial neural networks for travel demand analysis


    Beteiligte:


    Erscheinungsdatum :

    2021-04-08




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Forecasting Travel Demand: A Nonlinear Approach Using Neural Networks

    de Carvalho, M. / Transportation Research Forum | British Library Conference Proceedings | 1999


    ONBOARD EXPLAINABLE ARTIFICIAL INTELLIGENCE

    Faggioli, Guglielmo / Varile, Mattia | TIBKAT | 2022



    Explainable and responsible artificial intelligence

    Meske, Christian / Abedin, Babak / Klier, Mathias et al. | Online Contents | 2022

    Freier Zugriff