Drones have been used in a variety of scenarios, such as atmospheric monitoring, fire rescue, agricultural irrigation, etc., in which accurate environmental perception is of crucial importance for both decision making and control. Among drone sensors, the RGB camera is indispensable for capturing rich visual information for vehicle navigation but encounters a grand challenge in high-dynamic-range scenes, which frequently occur in real applications. Specifically, the recorded frames suffer from underexposure and overexposure simultaneously and degenerate the successive vision tasks. To solve the problem, we take object tracking as an example and leverage the superior response of event cameras over a large intensity range to propose an event-assisted object tracking algorithm that can achieve reliable tracking under large intensity variations. Specifically, we propose to pursue feature matching from dense event signals and, based on this, to (i) design a U-Net-based image enhancement algorithm to balance RGB intensity with the help of neighboring frames in the time domain and then (ii) construct a dual-input tracking model to track the moving objects from intensity-balanced RGB video and event sequences. The proposed approach is comprehensively validated in both simulation and real experiments.


    Access

    Download


    Export, share and cite



    Title :

    Event-Assisted Object Tracking on High-Speed Drones in Harsh Illumination Environment


    Contributors:
    Yuqi Han (author) / Xiaohang Yu (author) / Heng Luan (author) / Jinli Suo (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    LED DRONES WITH LED ILLUMINATION LAMP

    CHO BYUNG GIL | European Patent Office | 2017

    Free access

    Tracking Drones with Drones Using Millimeter Wave Radar

    Baptista, Sedat Dogru Rui / Marques, Lino | TIBKAT | 2020


    A Harsh Environment?

    Online Contents | 1997


    OBJECT TRACKING ILLUMINATION SYSTEM

    POZZI ALEXANDER / GARING FRANCIS XAVIER L | European Patent Office | 2024

    Free access