With the remarkable achievements of stereo matching algorithms based on Convolutional neural Networks (CNNs), more and more stereo matching algorithms based on CNNs are applied to intelligent driving research. Whereas, the existing convolution operators cannot fully mine and utilize the structure information, which is indispensable for stereo matching, especially in the regions with discontinuous disparity. In this work, to ameliorate these issues, an adaptive neighbor embedding paradigm (ANE paradigm) is proposed for deep stereo networks. In our ANE paradigm, the discriminative ability of features is improved by mining the neighbor correlation knowledge and performing adaptive neighbor aggregation. Specifically, we design a new convolution operator, termed adaptive neighbor embedding convolution (ANE conv) and its simplified version, termed adaptive neighbor embedding filter (ANE filter). Both ANE conv and ANE filter can be used as plug-and-play operators for all existing stereo matching models and can be easily trained end-to-end by standard back-propagation. Extensive experiments emphasize the performance of our approaches, especially in high accuracy metric.
Adaptive Neighbor Embedding for Efficient Stereo Matching
IEEE Transactions on Intelligent Vehicles ; 9 , 1 ; 2449-2458
2024-01-01
4178284 byte
Article (Journal)
Electronic Resource
English
Fast recursive adaptive weight stereo matching
British Library Online Contents | 2013
|Super-resolution through neighbor embedding
IEEE | 2004
|Super-Resolution through Neighbor Embedding
British Library Conference Proceedings | 2004
|Fast stereo matching using adaptive guided filtering
British Library Online Contents | 2014
|