Many different sensing modalities across the spectrum exist for collecting and processing data for the purposes of target detection, tracking and differentiation. However, each of these individual modalities from the electromagnetic spectrum contain benefits, limitations, and sources of uncertainty. While research has been conducted to integrate complementary data collected by electro-optical (EO) and radio frequency (RF) modalities, the processing of RF data usually applies traditional methods, such as Doppler. This paper explores the viability of using histogram of I/Q (in-phase and quadrature) data for the purposes of augmenting the detection accuracy that EO input alone is incapable of achieving. Processing the histogram of I/Q data via deep learning, enhances feature resolution for neural network fusion. Using the simulated data from the Digital Imaging and Remote Sensing Image Generation (DIRSIG) dataset, the resulting fusion of EO/RF neural network (FERNN) can achieve 95% accuracy in vehicle detection and scenario categorization, which is a 23% improvement over the accuracy achieved by a standalone EO sensor.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Feature Level Sensor Fusion for Passive RF and EO Information Integration


    Contributors:
    Vakil, Asad (author) / Liu, Jenny (author) / Zulch, Peter (author) / Blasch, Erik (author) / Ewing, Robert (author) / Li, Jia (author)


    Publication date :

    2020-03-01


    Size :

    1767005 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Feature-level sensor fusion

    Peli, T. Young, M. Knox, R. Ellis, K. K. | British Library Conference Proceedings | 1999


    A Survey of Multimodal Sensor Fusion for Passive RF and EO Information Integration

    Vakil, Asad / Liu, Jenny / Zulch, Peter et al. | IEEE | 2021


    Insights into Heterogenous Sensor Fusion and Passive RF Feature Extraction for xAI

    Vakil, Asad / Ewing, Robert / Blasch, Erik et al. | IEEE | 2024


    FEATURE FUSION OF SENSOR DATA

    MOODIE DANIEL | European Patent Office | 2025

    Free access