A vast amount of text data is recorded in the forms of repair verbatim in railway maintenance sectors. Efficient text mining of such maintenance data plays an important role in detecting anomalies and improving fault diagnosis efficiency. However, unstructured verbatim, high-dimensional data, and imbalanced fault class distribution pose challenges for feature selections and fault diagnosis. We propose a bilevel feature extraction-based text mining that integrates features extracted at both syntax and semantic levels with the aim to improve the fault classification performance. We first perform an improved $\chi^{2}$ statistics-based feature selection at the syntax level to overcome the learning difficulty caused by an imbalanced data set. Then, we perform a prior latent Dirichlet allocation-based feature selection at the semantic level to reduce the data set into a low-dimensional topic space. Finally, we fuse fault features derived from both syntax and semantic levels via serial fusion. The proposed method uses fault features at different levels and enhances the precision of fault diagnosis for all fault classes, particularly minority ones. Its performance has been validated by using a railway maintenance data set collected from 2008 to 2014 by a railway corporation. It outperforms traditional approaches.
Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems
IEEE Transactions on Intelligent Transportation Systems ; 18 , 1 ; 49-58
2017-01-01
2223632 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems
Online Contents | 2017
|Bilevel Optimization of Intercity Railway Alignment
Transportation Research Record | 2021
|Portable railway fault diagnosis device and diagnosis method thereof
Europäisches Patentamt | 2021
|Feature extraction based on Morlet wavelet and its application for mechanical fault diagnosis
Online Contents | 2000
|Fault Diagnosis of Railway Turnout Based on Random Forests
Springer Verlag | 2020
|