Event-based vision sensors achieve up to three orders of magnitude better speed vs. power consumption trade off in high-speed control of UAVs compared to conventional image sensors. Event-based cameras produce a sparse stream of events that can be processed more efficiently and with a lower latency than images, enabling ultra-fast vision-driven control. Here, we explore how an event-based vision algorithm can be implemented as a spiking neuronal network on a neuromorphic chip and used in a drone controller. We show how seamless integration of event-based perception on chip leads to even faster control rates and lower latency. In addition, we demonstrate how online adaptation of the SNN controller can be realised using on-chip learning. Our spiking neuronal network on chip is the first example of a neuromorphic vision-based controller on chip solving a high-speed UAV control task. The excellent scalability of processing in neuromorphic hardware opens the possibility to solve more challenging visual tasks in the future and integrate visual perception in fast control loops.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Event-driven Vision and Control for UAVs on a Neuromorphic Chip


    Beteiligte:

    Erscheinungsdatum :

    2021-07-05


    Anmerkungen:

    Vitale, Antonio; Renner, Alpha; Nauer, Celine; Scaramuzza, Davide; Sandamirskaya, Yulia (2021). Event-driven Vision and Control for UAVs on a Neuromorphic Chip. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi'an, China, 30 June 2021 - 5 July 2021. IEEE, 103-109.



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Neuromorphic vision processing system

    Lin / Chen / Chiueh | IET Digital Library Archive | 1997


    An Adaptive Neuromorphic Chip for Combustion Control

    Gallagher, John / Wolff, Mitch | AIAA | 2007


    Vision-based Positioning for UAVs

    Hu, Xiao | BASE | 2021

    Freier Zugriff

    Vision-Based Collision Detection for UAVs

    Carnie, R. J. | British Library Conference Proceedings | 2005


    Feedback control of dynamical systems using neuromorphic vision sensors

    Mueller, Erich, Ph. D. Massachusetts Institute of Technology | DSpace@MIT | 2016

    Freier Zugriff