This thesis presents study, analysis and implementation of algorithms to perform object detection and recognition using an event-based cam era. This sensor represents a novel paradigm which opens a wide range of possibilities for future developments of computer vision. In partic ular it allows to produce a fast, compressed, illumination invariant output, which can be exploited for robotic tasks, where fast dynamics and significant illumination changes are frequent. The experiments are carried out on the neuromorphic version of the iCub humanoid platform. The robot is equipped with a novel dual camera setup mounted directly in the robot’s eyes, used to generate data with a moving camera. The motion causes the presence of background clut ter in the event stream. In such scenario the detection problem has been addressed with an at tention mechanism, specifically designed to respond to the presence of objects, while discarding clutter. The proposed implementation takes advantage of the nature of the data to simplify the original proto object saliency model which inspired this work. Successively, the recognition task was first tackled with a feasibility study to demonstrate that the event stream carries sufficient informa tion to classify objects and then with the implementation of a spiking neural network. The feasibility study provides the proof-of-concept that events are informative enough in the context of object classifi cation, whereas the spiking implementation improves the results by employing an architecture specifically designed to process event data. The spiking network was trained with a three-factor local learning rule which overcomes weight transport, update locking and non-locality problem. The presented results prove that both detection and classification can be carried-out in the target application using the event data.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Object detection and recognition with event driven cameras



    Erscheinungsdatum :

    2020-04-29


    Anmerkungen:

    doi:10.15167/iacono-massimiliano_phd2020-04-29



    Medientyp :

    Hochschulschrift


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Independent motion detection with event-driven cameras

    Vasco, Valentina / Glover, A. / Müggler, Elias et al. | BASE | 2017

    Freier Zugriff

    Object Detection with Multiple Cameras

    Muller, B. / de Oliveira Anido, R. | British Library Conference Proceedings | 2002


    Object detection with multiple cameras

    Junior, B.M. / de Oliveira Anido, R. | IEEE | 2002


    Situation analysis and atypical event detection with multiple cameras and multi-object tracking

    Reulke, Ralf / Meysel, Frederik / Bauer, Sascha | Tema Archiv | 2008


    CUSTOM EVENT DETECTION FOR SURVEILLANCE CAMERAS

    JAHROMI MOHAMMAD RAFIEE | Europäisches Patentamt | 2022

    Freier Zugriff