This thesis presents study, analysis and implementation of algorithms to perform object detection and recognition using an event-based cam era. This sensor represents a novel paradigm which opens a wide range of possibilities for future developments of computer vision. In partic ular it allows to produce a fast, compressed, illumination invariant output, which can be exploited for robotic tasks, where fast dynamics and significant illumination changes are frequent. The experiments are carried out on the neuromorphic version of the iCub humanoid platform. The robot is equipped with a novel dual camera setup mounted directly in the robot’s eyes, used to generate data with a moving camera. The motion causes the presence of background clut ter in the event stream. In such scenario the detection problem has been addressed with an at tention mechanism, specifically designed to respond to the presence of objects, while discarding clutter. The proposed implementation takes advantage of the nature of the data to simplify the original proto object saliency model which inspired this work. Successively, the recognition task was first tackled with a feasibility study to demonstrate that the event stream carries sufficient informa tion to classify objects and then with the implementation of a spiking neural network. The feasibility study provides the proof-of-concept that events are informative enough in the context of object classifi cation, whereas the spiking implementation improves the results by employing an architecture specifically designed to process event data. The spiking network was trained with a three-factor local learning rule which overcomes weight transport, update locking and non-locality problem. The presented results prove that both detection and classification can be carried-out in the target application using the event data.


    Access

    Download


    Export, share and cite



    Title :

    Object detection and recognition with event driven cameras



    Publication date :

    2020-04-29


    Remarks:

    doi:10.15167/iacono-massimiliano_phd2020-04-29



    Type of media :

    Theses


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Independent motion detection with event-driven cameras

    Vasco, Valentina / Glover, A. / Müggler, Elias et al. | BASE | 2017

    Free access

    Object Detection with Multiple Cameras

    Muller, B. / de Oliveira Anido, R. | British Library Conference Proceedings | 2002


    Object detection with multiple cameras

    Junior, B.M. / de Oliveira Anido, R. | IEEE | 2002


    Situation analysis and atypical event detection with multiple cameras and multi-object tracking

    Reulke, Ralf / Meysel, Frederik / Bauer, Sascha | Tema Archive | 2008


    CUSTOM EVENT DETECTION FOR SURVEILLANCE CAMERAS

    JAHROMI MOHAMMAD RAFIEE | European Patent Office | 2022

    Free access