Prognostics has taken center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of a system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Four prognostic algorithms, Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR), are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in a different manner; depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, this paper offers ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Evaluating algorithm performance metrics tailored for prognostics


    Contributors:


    Publication date :

    2009-03-01


    Size :

    514681 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Prognostics

    Roemer, Michael J. / Byington, Carl S. / Kacprzynski, Gregory J. et al. | Wiley | 2011


    METRICS FOR EVALUATING AUTONOMOUS VEHICLE PERFORMANCE

    HAYNES GALEN CLARK / TRAFT NEIL / SHRIDHAR SKANDA et al. | European Patent Office | 2022

    Free access

    Metrics for Evaluating Autonomous Vehicle Performance

    SHRIDHAR SKANDA / MA YUHANG / STENTZ TARA LYNN et al. | European Patent Office | 2022

    Free access

    Vehicle Prognostics

    Sraj,J.A. / US Army Tank-Automot.Command,US | Automotive engineering | 1981


    Toward IVHM Prognostics

    Walsh, Kevin / Venti, Mike | NTRS | 2007