A computer implemented method for controlling a system moving through an environment includes receiving a stream of event data from an event camera, the stream of event data representing a pixel location, a time stamp, and a polarity for each event detected by the event camera. A compressed representation of the stream of data is generated. The compressed representation is provided to a neural network model trained on prior compressed representations using reinforcement learning to learn actions for controlling the system. A control action is generated via the neural network model to control the movement of the system.
Event camera based navigation control
2023-10-17
Patent
Electronic Resource
English
IPC: | G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen |