This paper presents an end-to-end approach, named FrictionSegNet, for jointly estimating tyre-road friction coefficient and identifying road surfaces in real time from on board camera data. FrictionSegNet combines semantic segmentation and friction estimation by learning a shared latent space that encompasses both semantic segmentation and friction coefficient information. An objective function is designed for this task and minimised using *geco to train the model, providing the ability to control the balance between improved predictions and uncertainty measurement. To the best of our knowledge, this study is the first attempt to jointly estimate tyre-road friction and surface type by learning the joint latent space of semantic segmentation and friction coefficient information. The results suggest that it is possible to identify low-friction surfaces, e.g. snow or ice, and estimate upcoming road friction in real time from a camera only. As it is of interest to develop techniques that require less training data, numerical experiments were performed using transfer learning from a dataset consisting of images of various road surfaces. This led to better performance and faster convergence during training. FrictionSegNet achieved per-pixel accuracies of 97% and 95% when identifying snow and ice respectively, and RMS errors of 0.04–0.09 when estimating $\mu $ values achievable by a truck *abs on gravel, dry and wet asphalt, snow, and ice surfaces.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    FrictionSegNet: Simultaneous Semantic Segmentation and Friction Estimation Using Hierarchical Latent Variable Models


    Contributors:

    Published in:

    Publication date :

    2024-12-01


    Size :

    1810129 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    HSPFormer: Hierarchical Spatial Perception Transformer for Semantic Segmentation

    Chen, Siyu / Han, Ting / Zhang, Changshe et al. | IEEE | 2025


    Classification of Streetsigns Using Gaussian Process Latent Variable Models

    Wober, Wilfried / Aburaia, Mohamed / Olaverri-Monreal, Cristina | IEEE | 2019


    Unsupervised learning in radiology using novel latent variable models

    Carrivick, L. / Prabhu, S. / Goddard, P. et al. | IEEE | 2005


    Latent-Segmentation, Hazard-Based Models of Travel Time

    Moylan, Emily K. M. / Rashidi, Taha Hossein | IEEE | 2017


    Latent-Segmentation, Hazard-Based Models of Travel Time

    Moylan, Emily K. M | Online Contents | 2017