Infrared (IR) thermal imaging can detect the warm temperature of the human body regardless of the light conditions, thus small drones equipped with the IR thermal camera can be utilized to recognize human activity for smart surveillance, road safety, and search and rescue missions. However, the unpredictable motion of the drone poses more challenges than a fixed camera. This paper addresses the detection and tracking of people through IR thermal video captured by a multirotor. For object detection, each frame is first registered with a reference frame to compensate for its coordinates. Then, the objects in each frame are segmented through k-means clustering and morphological operations. Falsely detected objects are removed considering the actual size and the shape of the object. The centroid of the segmented area is considered the measured position for target tracking. The track is initialized with two-point differencing initialization, and the target states are continuously estimated by the interacting multiple model (IMM) filter. The nearest neighbor association rule assigns the measurement to the track. Tracks that move slower than the minimum speed are terminated at the proposed criteria. In the experiments, three videos were captured with a long-wave IR band thermal imaging camera mounted on a multirotor. In the first and second videos, eight pedestrians on a pavement and three hikers on a mountain on winter nights were captured, respectively. In the third video, two walking people with complex backgrounds were captured on a windy summer day. The image characteristics vary between videos depending on the climate and surrounding objects, but the proposed scheme shows the robust performance in all cases; the average root mean squared errors in position and velocity are obtained as 0.08 m and 0.53 m/s, respectively for the first video, 0.06 m and 0.58 m/s, respectively for the second video, and 0.18 m and 1.84 m/s, respectively for the third video. The proposed method reduces false tracks from 10 to 1 in the third video.


    Access

    Download


    Export, share and cite



    Title :

    Moving People Tracking and False Track Removing with Infrared Thermal Imaging by a Multirotor


    Contributors:


    Publication date :

    2021




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Multirotor

    HE CHUNWANG | European Patent Office | 2015

    Free access

    ASYMMETRIC MULTIROTOR

    REGEV AMIT | European Patent Office | 2022

    Free access

    Multirotor

    HADDER RICHARD NATHAN | European Patent Office | 2016

    Free access

    Implementation of Face Tracking System with a Multirotor UAV

    Xiong, Jingfeng / Hu, Shiqiang / Zhu, Rentai | IEEE | 2018


    MULTIROTOR MACHINE

    HIGUCHI TAKEHIRO / TORATANI DAICHI / YAMAMOTO TAKAHIRO | European Patent Office | 2017

    Free access