Driving anomaly detection aims to identify objects, events or actions that can increase the risk of accidents, reducing road safety. While supervised approaches can effectively identify aspects related to driving anomalies, it is unfeasible to tabulate and address all potential driving anomalies. Instead, it is appealing to design unsupervised approaches that can automatically identify unexpected driving scenarios. This study formulates the detection of driving anomalies as a binary-discrimination task between expected and unexpected driving behaviors. We propose an unsupervised contrastive method using conditional generative adversarial networks (GANs) implemented with the attention model and the triplet loss function. A feature of our framework is its scalability, where it is easy to add new modalities. We consider five different modalities: the vehicle’s CAN-Bus signals, driver’s physiological signals, distance to nearby pedestrians, distance to nearby vehicles and distance to nearby bicycles. Our approach trains a conditional GAN to extract latent features from each of the five modalities. An attention model combines the latent representations from the modalities. The entire framework is trained with the triplet loss function to generate effective representations to discriminate normal and abnormal driving segments. We conduct experimental evaluations on the driving anomaly dataset (DAD), achieving improved performance over alternative approaches.


    Access

    Download


    Export, share and cite



    Title :

    Unsupervised Scalable Multimodal Driving Anomaly Detection


    Contributors:

    Published in:

    Publication date :

    2023-04-01


    Size :

    2079946 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Methods and apparatus for unsupervised multimodal anomaly detection for autonomous vehicles

    GONZALEZ AGUIRRE DAVID I / SHARMA SRIDHAR G / FELIP LEON JAVIER et al. | European Patent Office | 2022

    Free access

    METHODS AND APPARATUS FOR UNSUPERVISED MULTIMODAL ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    GONZALEZ AGUIRRE DAVID I / SHARMA SRIDHAR G / FELIP LEON JAVIER et al. | European Patent Office | 2019

    Free access

    Unsupervised anomaly detection for autonomous vehicles

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2023

    Free access

    UNSUPERVISED ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2021

    Free access

    UNSUPERVISED ANOMALY DETECTION FOR AUTONOMOUS VEHICLES

    SINDHWANI VIKAS / SIDAHMED HAKIM / CHOROMANSKI KRZYSZTOF et al. | European Patent Office | 2021

    Free access