This paper describes a novel stereo vision sensor based on deep neural networks, that can be used to produce a feedback signal for visual servoing in unmanned aerial vehicles such as drones. Two deep convolutional neural networks attached to the stereo camera in the drone are trained to detect wind turbines in images and stereo triangulation is used to calculate the distance from a wind turbine to the drone. Our experimental results show that the sensor produces data accurate enough to be used for servoing, even in the presence of noise generated when the drone is not being completely stable. Our results also show that appropriate filtering of the signals is needed and that to produce correct results, it is very important to keep the wind turbine within the field of vision of both cameras, so that both deep neural networks could detect it.
A Deep Neural Network Sensor for Visual Servoing in 3D Spaces
2020-03-01
Durdevic , P & Ortiz Arroyo , D 2020 , ' A Deep Neural Network Sensor for Visual Servoing in 3D Spaces ' , Sensors , vol. 20 , no. 5 , 1437 . https://doi.org/10.3390/s20051437
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
DDC: | 629 |
A bayesian deep neural network for safe visual servoing in human–robot interaction
BASE | 2021
|Springer Verlag | 2020
|Visual servoing - Nonlinear observer approach
British Library Online Contents | 1995
|TUDOR initial visual servoing experiments
TIB AV-Portal | 2011
|Visual Servoing of Legged Robots
British Library Online Contents | 2012
|