Anomaly detection in surveillance videos is a crucial and challenging task in the intelligent transportation systems. Previous methods utilize a memory module to store prototypical feature embeddings as normal patterns learned from normal training data. However, due to the complexity of real-world scenarios, it is difficult to choose an appropriate size of memory module which can not only memorize normal patterns comprehensively, but also capable of dealing with unseen normal scenarios. To tackle this problem, we learn normal video patterns by constructing and exploring correlations between visual semantics. In the training stage, we act the self-attention map between embeddings as a description of information association between different visual semantics. A self-attention based feature aggregating module is designed to regenerate a feature map through aggregating embeddings with similar information based on the attention map. By decoding the generated feature map instead of the original one to predict the future frame of the input video clip, the model learns to build strong information association between normal visual semantics. Moreover, we observe that abnormal embeddings hardly build strong association with others. Thus, we design a feature-level anomaly criterion referred as prior deviation to increase the difference between attention maps generated by normal and abnormal frames. In the inferring stage, the proposed prior deviation jointly detects anomalies with pixel-level frame prediction error. Experiment results and ablation studies on mainstream benchmarks demonstrate the effectiveness of our design.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Unsupervised Video Anomaly Detection with Self-Attention Based Feature Aggregating


    Contributors:
    Ye, Zhenhao (author) / Li, Yanlong (author) / Cui, Zhichao (author) / Liu, Yuehu (author) / Li, Li (author) / Wang, Le (author) / Zhang, Chi (author)


    Publication date :

    2023-09-24


    Size :

    3554881 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Unsupervised Scalable Multimodal Driving Anomaly Detection

    Qiu, Yuning / Misu, Teruhisa / Busso, Carlos | IEEE | 2023

    Free access

    UNSUPERVISED ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2021

    Free access

    Unsupervised anomaly detection for autonomous vehicles

    CHANDWANI VIJAY / SIDDAMEID HERBERT / KOROMANSKI KRZYSZTOF et al. | European Patent Office | 2022

    Free access

    UNSUPERVISED ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2021

    Free access

    UNSUPERVISED ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2024

    Free access