Integrating information collected by different types of sensors observing the same or related phenomenon can lead to more accurate and robust decision making. The purpose of this article is to review sensor fusion approaches to achieve passive radio frequency (RF) and electro-optical (EO) sensor fusion and to present the proposed fusion of EO/RF neural network (FERNN). While research has been conducted to integrate complementary data collected by EO and RF modalities, the processing of RF data usually applies traditional features, such as Doppler. This article explores the viability of using the histogram of I/Q (in-phase and quadrature) data for the purposes of augmenting the detection accuracy that EO input alone is incapable of achieving. Specifically, by processing the histogram of I/Q data via deep learning and enhancing feature input for neural network fusion. Using the simulated data from the Digital Imaging and Remote Sensing Image Generation dataset, FERNN can achieve 95% accuracy in vehicle detection and scenario categorization, which is a 23% improvement over the accuracy achieved by a stand-alone EO sensor.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Survey of Multimodal Sensor Fusion for Passive RF and EO Information Integration


    Beteiligte:
    Vakil, Asad (Autor:in) / Liu, Jenny (Autor:in) / Zulch, Peter (Autor:in) / Blasch, Erik (Autor:in) / Ewing, Robert (Autor:in) / Li, Jia (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.07.2021


    Format / Umfang :

    2169548 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Feature Level Sensor Fusion for Passive RF and EO Information Integration

    Vakil, Asad / Liu, Jenny / Zulch, Peter et al. | IEEE | 2020


    Driver drowsiness detection using multimodal sensor fusion

    Andreeva, Elena O. / Aarabi, Parham / Philiastides, Marios G. et al. | SPIE | 2004


    Multimodal information fusion for urban scene understanding

    Xu, P. | British Library Online Contents | 2016


    Distributed Passive Sensor Trajectory Association and Fusion

    Chang, Ruowang / Wang, Bolan / Xu, Shengli et al. | Springer Verlag | 2022


    Distributed Passive Sensor Trajectory Association and Fusion

    Chang, Ruowang / Wang, Bolan / Xu, Shengli et al. | British Library Conference Proceedings | 2022