Classifier performance evaluation is an important step in designing diagnostic systems. The purposes of performing classifier performance evaluation include: 1) to select the best classifiers from the several candidate classifiers, 2) to verify that the classifier designed meets the design requirement, and 3) to identify the need for improvements in the classifier components. In order to effectively evaluate classifier performance, a classifier performance measure needs to be defined that can be used to measure the quality of the classifiers considered. This paper first argues that in fault diagnostic system design, commonly used performance measures, such as accuracy and ROC analysis are not always appropriate for performance evaluation. The paper then proposes using misclassification cost as a general performance measure that is suitable for binary as well as multi-class classifiers, and - most importantly - for classifiers with unequal cost consequence of the classes. The paper also provides strategies for estimating the cost matrix by taking advantage of fault criticality information obtained from FMECA.. Three individual classifiers are considered. They are 1) multiple-layer feed-forward neural network (NN), 2) binary decision tree (CART), and 3) fuzzy neural network (FNN). By evaluating the performance of different classifiers considered during the design process of an engine fault diagnostic system, this paper demonstrates that misclassification cost is an effective performance measure for evaluating the performance of multi-class classifiers with unequal cost consequence for different classes.


    Access

    Access via TIB

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Classifier performance measures in multi-fault diagnosis for aircraft engines


    Contributors:
    Yan, Weizhong (author) / Goebel, K.F. (author) / Li, J.C. (author)


    Publication date :

    2002


    Size :

    10 Seiten, 9 Quellen




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Multi-Classifier Fusion for Assessing the Health of Aircraft Engines

    Eklund, N. / Qiu, H. / Yan, W. et al. | British Library Conference Proceedings | 2010


    Multi-Classifier Fusion for Assessing the Health of Aircraft Engines

    Eklund, Neil / Qiu, Hai / Yan, Weizhong et al. | AIAA | 2010


    Vibration Monitoring and Fault Diagnosis of Inflight Aircraft Engines

    Yi, J. | British Library Online Contents | 1992



    ICAS-92-6.1.2 Vibration Monitoring and Fault Diagnosis of Inflight Aircraft Engines

    Yi, J. / International Council of Aeronautical Sciences | British Library Conference Proceedings | 1992