A vast amount of text data is recorded in the forms of repair verbatim in railway maintenance sectors. Efficient text mining of such maintenance data plays an important role in detecting anomalies and improving fault diagnosis efficiency. However, unstructured verbatim, high-dimensional data, and imbalanced fault class distribution pose challenges for feature selections and fault diagnosis. We propose a bilevel feature extraction-based text mining that integrates features extracted at both syntax and semantic levels with the aim to improve the fault classification performance. We first perform an improved $\chi^{2}$ statistics-based feature selection at the syntax level to overcome the learning difficulty caused by an imbalanced data set. Then, we perform a prior latent Dirichlet allocation-based feature selection at the semantic level to reduce the data set into a low-dimensional topic space. Finally, we fuse fault features derived from both syntax and semantic levels via serial fusion. The proposed method uses fault features at different levels and enhances the precision of fault diagnosis for all fault classes, particularly minority ones. Its performance has been validated by using a railway maintenance data set collected from 2008 to 2014 by a railway corporation. It outperforms traditional approaches.
Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems
IEEE Transactions on Intelligent Transportation Systems ; 18 , 1 ; 49-58
2017-01-01
2223632 byte
Article (Journal)
Electronic Resource
English
Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems
Online Contents | 2017
|Bilevel Optimization of Intercity Railway Alignment
Transportation Research Record | 2021
|A Bilevel Model for Railway Train Set Organizing Optimization
British Library Conference Proceedings | 2007
|Portable railway fault diagnosis device and diagnosis method thereof
European Patent Office | 2021
|