Automatic prediction of visibility from surveillance images can provide timely warnings for transportation management departments and drivers, which is of great significance for improving the driving safety of highways in foggy weather. The currently mainstream prediction models are based on deep networks, which mainly learn visual features as clues to predict visibility levels. However, the geometric features of highways, such as the lane lines that can be observed from surveillance images are also important clues to reflect the visibility. Therefore, we propose a dual-branch fusion network driven by both geometric and visual features to achieve robust and effective visibility prediction. Specifically, we first exploit dual branches to learn geometric features of highway and deep visual features from the foggy surveillance images, respectively. We then design a fused classification module to fuse the dual-branch features to predict the visibility level. In order to simultaneously purify features during the fusion process, it utilizes a road attention block to highlight the deep visual features corresponding to the highway road area, and a lane length estimation block to extract the feature of the length of observable lane lines. Therefore, the dual-branch features can be adaptively fused to boost prediction performance. Meanwhile, we construct a real-scene foggy image dataset, which are all gathered from the surveillance video of real highways in China. We validate the effectiveness of the proposed network on this real-scene dataset and the synthetic dataset FRIDA. The experimental results show that our method can predict visibility levels more accurately than multiple existing methods.
Highway Visibility Level Prediction Using Geometric and Visual Features Driven Dual-Branch Fusion Network
IEEE Transactions on Intelligent Transportation Systems ; 25 , 8 ; 9992-10004
01.08.2024
18378236 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Engineering Index Backfile | 1931
Engineering Index Backfile | 1957
|Visibility and highway navigation
TIBKAT | 1986
|Visibility and Highway Navigation
NTIS | 1986
|MARVL Highway Visibility Monitor: Real Time Highway Safety
British Library Conference Proceedings | 1995
|