Abstract Rapid advances in sensor, wireless communication, cloud computing and data science have brought unprecedented amount of data to assist transportation engineers and researchers in making better decisions. However, traffic data in reality often has corrupted or incomplete values due to detector and communication malfunctions. Data imputation is thus required to ensure the effectiveness of downstream data-driven applications. To this end, numerous tensor-based methods treating the imputation problem as the low-rank tensor completion (LRTC) have been attempted in previous works. To tackle rank minimization, which is at the core of the LRTC, most of aforementioned methods utilize the tensor nuclear norm (NN) as a convex surrogate for the minimization. However, the over-relaxation issue in NN refrains it from desirable performance in practice. In this paper, we define an innovative nonconvex truncated Schatten p -norm for tensors (TSpN) to approximate tensor rank and impute missing spatiotemporal traffic data under the LRTC framework. We model traffic data into a third-order tensor structure of time intervals × locations (sensors) × days and introduce four complicated missing patterns, including random missing and three fiber-like missing cases according to the tensor mode- n fibers. Despite nonconvexity of the objective function in our model, we derive the global optimal solutions by integrating the alternating direction method of multipliers (ADMM) with generalized soft-thresholding (GST). In addition, we design a truncation rate decay strategy to deal with varying missing rate scenarios. Comprehensive experiments are finally conducted using four different types of real-world spatiotemporal traffic datasets, which demonstrate that the proposed LRTC-TSpN method performs well under various missing cases even with high rates of data loss, meanwhile outperforming other state-of-the-art tensor-based imputation models in almost all scenarios. In general, the performance of the proposed method achieves up to a 52% improvement in mean absolute error (MAE) compared to baseline methods even when the missing ratio is as high as 90%. Moreover, both theoretical and empirical evidences indicate that our method has robust and efficient convergence performances.

    Highlights A novel truncated tensor Schatten p-norm (TSpN) method is proposed for data imputation. An efficient solving algorithm is derived with global optimum guarantees. The TSpN can effectively handle complicated missing patterns even under high missing rates. The TSpN outperforms other state-of-the-art methods on four real-world traffic data sets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Truncated tensor Schatten p -norm based approach for spatiotemporal traffic data imputation with complicated missing patterns


    Contributors:
    Nie, Tong (author) / Qin, Guoyang (author) / Sun, Jian (author)


    Publication date :

    2022-05-18




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Spatiotemporal traffic data imputation via tensorial weighted Schatten‐p norm minimization

    Wang, Shaofan / Zhao, Yongbo / Zhang, Yong et al. | Wiley | 2022

    Free access

    Spatiotemporal traffic data imputation via tensorial weighted Schatten‐p norm minimization

    Shaofan Wang / Yongbo Zhao / Yong Zhang et al. | DOAJ | 2022

    Free access

    Spatiotemporal Tensor Completion for Improved Urban Traffic Imputation

    Ben Said, Ahmed / Erradi, Abdelkarim | IEEE | 2022


    Scalable low-rank tensor learning for spatiotemporal traffic data imputation

    Chen, Xinyu / Chen, Yixian / Saunier, Nicolas et al. | Elsevier | 2021