This paper explores deep learning (DL) methods that are used or have the potential to be used for traffic video analysis, emphasising driving safety for both autonomous vehicles and human‐operated vehicles. A typical processing pipeline is presented, which can be used to understand and interpret traffic videos by extracting operational safety metrics and providing general hints and guidelines to improve traffic safety. This processing framework includes several steps, including video enhancement, video stabilisation, semantic and incident segmentation, object detection and classification, trajectory extraction, speed estimation, event analysis, modelling, and anomaly detection. The main goal is to guide traffic analysts to develop their own custom‐built processing frameworks by selecting the best choices for each step and offering new designs for the lacking modules by providing a comparative analysis of the most successful conventional and DL‐based algorithms proposed for each step. Existing open‐source tools and public datasets that can help train DL models are also reviewed. To be more specific, exemplary traffic problems are reviewed and required steps are mentioned for each problem. Besides, connections to the closely related research areas of drivers' cognition evaluation, crowd‐sourcing‐based monitoring systems, edge computing in roadside infrastructures, automated driving systems‐equipped vehicles are investigated, and the missing gaps are highlighted. Finally, commercial implementations of traffic monitoring systems, their future outlook, and open problems and remaining challenges for widespread use of such systems are reviewed.


    Access

    Download


    Export, share and cite



    Title :

    Deep learning serves traffic safety analysis: A forward‐looking review


    Contributors:
    Razi, Abolfazl (author) / Chen, Xiwen (author) / Li, Huayu (author) / Wang, Hao (author) / Russo, Brendan (author) / Chen, Yan (author) / Yu, Hongbin (author)

    Published in:

    Publication date :

    2023-01-01


    Size :

    50 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Deep learning serves traffic safety analysis: A forward‐looking review

    Abolfazl Razi / Xiwen Chen / Huayu Li et al. | DOAJ | 2023

    Free access


    Vision-Based Forward-Looking Traffic Scene Analysis Scheme

    Chang, Jyh-Yeong / Cho, Chien-Wen | IEEE | 2007


    Vision-Based Forward-Looking Traffic Scene Analysis Scheme

    Chang, J.-Y. / Cho, C.-W. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2007


    Automobile driving forward-looking safety device

    WU SONG | European Patent Office | 2020

    Free access