This study proposes a human-in-the-loop robot-augmented intelligent system for emergency reconnaissance. The system improves situational awareness of first responders by providing robot-collected information through an intelligent and interactive interface. Unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs) equipped with RGB-D camera, thermal camera, GPR, and LiDAR are deployed to acquire information on disaster sites. The collected sensor data are further processed to present actionable information to first responders, such as victim location, buried void shape, and accessible hole through an augmented reality interface. A virtual reality platform is used to validate and evaluate the proposed system. Participants are invited to complete a search and rescue mission with robot-augmented intelligent system to find survival victims under rubbles in the virtual environment. The experiments demonstrated that the proposed system reduces the searching time and false alarms, and increases the accuracy of detecting victims, which will change the search and rescue paradigm from an experience-based practice to an information-based one.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Human-in-the-Loop Robot-Augmented Intelligent System for Emergency Reconnaissance


    Contributors:
    Hu, Da (author) / Li, Shuai (author) / Du, Jing (author) / Cai, Jiannan (author)

    Conference:

    ASCE International Conference on Computing in Civil Engineering 2021 ; 2022 ; Orlando, Florida


    Published in:

    Publication date :

    2022-05-24




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Composite reconnaissance system of flight reconnaissance robot and multi-spherical mobile reconnaissance robot

    ZHU AIBIN / MAO HAN / WANG JINGDI et al. | European Patent Office | 2020

    Free access

    Reconnaissance robot

    WANG YIYUAN / ZHOU ZONGHE / ZHANG WU et al. | European Patent Office | 2024

    Free access

    Reconnaissance robot

    HU JIANMIN | European Patent Office | 2023

    Free access

    Reconnaissance robot

    LI SHIMING / XUE LI'AN / CHEN LI | European Patent Office | 2021

    Free access

    Throwable reconnaissance robot

    LI YITUO / WANG YUKAI / HE CHENGFENG et al. | European Patent Office | 2015

    Free access