Continuous health monitoring in private spaces such as the car is not yet fully exploited to detect diseases in an early stage. Therefore, we develop a redundant health monitoring sensor system and signal fusion approaches to determine the respiratory rate during driving. To recognise the breathing movements, we use a piezoelectric sensor, two accelerometers attached to the seat and the seat belt, and a camera behind the windscreen. We record data from 15 subjects during three driving scenarios (15 min each) city, highway, and countryside. An additional chest belt provides the ground truth. We compare the four convolutional neural network (CNN)-based fusion approaches: early, sensor-based late, signal-based late, and hybrid fusion. We evaluate the performance of fusing for all four signals to determine the portion of driving time and the signal combination. The hybrid algorithm fusing all four signals is most effective in detecting respiratory rates in the city ([Formula: see text]), highway ([Formula: see text]), and countryside ([Formula: see text]). In summary, 60% of the total driving time can be used to measure the respiratory rate. The number of signals used in the multi-signal fusion improves reliability and enables continuous health monitoring in a driving vehicle.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Robust in-vehicle respiratory rate detection using multimodal signal fusion


    Beteiligte:

    Erscheinungsdatum :

    2023-11-22


    Anmerkungen:

    Scientific Reports 13, 20435 (2023). https://doi.org/10.1038/s41598-023-47504-y -- Sci Rep -- http://www.bibliothek.uni-regensburg.de/ezeit/?2615211 -- https://www.nature.com/srep/ -- 2045-2322 -- 2045-2322



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :



    Robust in-vehicle heartbeat detection using multimodal signal fusion

    Warnecke, Joana M. / Lasenby, Joan / Deserno, Thomas M. | BASE | 2023

    Freier Zugriff

    Robust In-Vehicle Heartbeat Detection Using Multimodal Signal Fusion

    Warnecke, Joana M. / Lasenby, Joan / Deserno, Thomas M. | BASE | 2023

    Freier Zugriff

    Multimodal multi-technique signal fusion system for autonomous vehicle

    CREUSOT CLEMENT / SAHU SARTHAK / WISNIOWSKI MATTHIAS | Europäisches Patentamt | 2024

    Freier Zugriff

    Vehicle Tracking Using Surveillance With Multimodal Data Fusion

    Zhang, Yue / Song, Bin / Du, Xiaojiang et al. | IEEE | 2018


    A Multimodal Fusion Fatigue Driving Detection Method Based on Heart Rate and PERCLOS

    Du, Guanglong / Zhang, Linlin / Su, Kang et al. | IEEE | 2022