Mulimodal learning is the process of reasoning with different types of data simultaneously using a neural network. This is no easy feat. Challenges to tackle include mapping features from one modality to another and finding a joint representation. As applied to connected vehicles, we propose a multimodal module that detects manipulations in the image sensor through verifying its consistency with the LiDAR sensor.A state-of-the-art multimodal network, Regnet, is adapted and trained for attack detection. Adaptation includes replacing the input layer and abstracting the multimodal input process. The KITTI dataset is extended to represent two attacks on connected vehicles: inpainting and translation. The end product is a smart multimodal module that abstracts connected-vehicle sensor input and guards against data integrity breaches.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-Modal Deep Learning for Vehicle Sensor Data Abstraction and Attack Detection


    Beteiligte:
    Rofail, Mark (Autor:in) / Alsafty, Aysha (Autor:in) / Matousek, Matthias (Autor:in) / Kargl, Frank (Autor:in)


    Erscheinungsdatum :

    01.09.2019


    Format / Umfang :

    739515 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Object velocity detection from multi-modal sensor data

    PRADHAN SABEEK MANI / SLOAN COOPER STOKES | Europäisches Patentamt | 2023

    Freier Zugriff

    Multi-modal corner vehicle sensor module

    TENSELIUS DANIEL / CLAEZON FREDRICH / JOHANSSON MARTIN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Multi-modal, multi-technology vehicle signal detection

    KROISOW CHRISTIAN / THUREMELA DAVID / YU NA et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Deep learning based multi-modal perception and semi-automatic labelling algorithms for automotive sensor data

    Haase-Schütz, Christian / kassel university press | TIBKAT | 2024

    Freier Zugriff

    Multi-modal, multi-technique vehicle signal detection

    CREUSOT CLEMENT / THUREMELLA DIVYA / YU NA et al. | Europäisches Patentamt | 2024

    Freier Zugriff