Drones have been used in a variety of scenarios, such as atmospheric monitoring, fire rescue, agricultural irrigation, etc., in which accurate environmental perception is of crucial importance for both decision making and control. Among drone sensors, the RGB camera is indispensable for capturing rich visual information for vehicle navigation but encounters a grand challenge in high-dynamic-range scenes, which frequently occur in real applications. Specifically, the recorded frames suffer from underexposure and overexposure simultaneously and degenerate the successive vision tasks. To solve the problem, we take object tracking as an example and leverage the superior response of event cameras over a large intensity range to propose an event-assisted object tracking algorithm that can achieve reliable tracking under large intensity variations. Specifically, we propose to pursue feature matching from dense event signals and, based on this, to (i) design a U-Net-based image enhancement algorithm to balance RGB intensity with the help of neighboring frames in the time domain and then (ii) construct a dual-input tracking model to track the moving objects from intensity-balanced RGB video and event sequences. The proposed approach is comprehensively validated in both simulation and real experiments.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Event-Assisted Object Tracking on High-Speed Drones in Harsh Illumination Environment


    Beteiligte:
    Yuqi Han (Autor:in) / Xiaohang Yu (Autor:in) / Heng Luan (Autor:in) / Jinli Suo (Autor:in)


    Erscheinungsdatum :

    2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    LED DRONES WITH LED ILLUMINATION LAMP

    CHO BYUNG GIL | Europäisches Patentamt | 2017

    Freier Zugriff

    Tracking Drones with Drones Using Millimeter Wave Radar

    Baptista, Sedat Dogru Rui / Marques, Lino | TIBKAT | 2020


    A Harsh Environment?

    Online Contents | 1997


    Object tracking illumination system

    POZZI ALEXANDER / GARING FRANCIS XAVIER L | Europäisches Patentamt | 2019

    Freier Zugriff