This paper presents a joint manifold learning based distributed sensor fusion approach for image and radio frequency (RF) data. A typical scenario includes several objects (with RF emitters), which are observed by a network of platforms with Medium Wavelength Infrared (MWIR) cameras and/or RF Doppler sensors. Based on a joint manifold learning (JML) sensor fusion approach, we propose to design and implement a distributed heterogeneous data fusion approach for improved Detection, Classification, and Identification (DCI) of targets and entities in dynamic environments with constrained communications. We design and implement distributed JML using diffusion and consensus approaches. In our distributed mechanism, we first partition the JML matrices into submatrices for each platform. For every platform, these submatrices represent the mapping from the sensor data to its contribution in the final fused result. Each node processes the local measurements using submatrices and shares the results with a limited number of neighbors. A prototype is constructed from drones, onboard processing capabilities (Intel Next Unit of Computing, NUC), cameras, and radars to demonstrate the proposed distributed data fusion approach. Supportive results are achieved from field tests and compared with centralized JML framework.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Joint Manifold Learning Based Distributed Sensor Fusion of Image and Radio-Frequency Data


    Contributors:
    Shen, Dan (author) / Lu, Jingyang (author) / Zulch, Peter (author) / Disasio, Marcello (author) / Chen, Genshe (author) / Wang, Zhonghai (author) / Niu, Ruixin (author)


    Publication date :

    2019-03-01


    Size :

    2122752 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Manifold learning algorithms for sensor fusion of image and radio-frequency data

    Shen, Dan / Zulch, Peter / Disasio, Marcello et al. | IEEE | 2018


    Joint Sparsity Aided Joint Manifold Learning for Sensor Fusion

    Shen, Dan / Lu, Jingyang / Zulch, Peter et al. | IEEE | 2020



    MANIFOLD JOINT SEAL

    SCHARPF ROBERT N / EVATT S CLAY | European Patent Office | 2017

    Free access

    Manifold joint seal

    SCHARPF ROBERT N / EVATT S CLAY | European Patent Office | 2015

    Free access