Two different metrics quantifying model and simulator predictive capability are formulated and evaluated; both metrics exploit results from conducted validation experiments where simulation results are compared to the corresponding measured quantities. The first metric is inspired by the modified nearest neighbor coverage metric and the second by the Kullback–Liebler divergence. The two different metrics are implemented in Python and in a here-developed general metamodel designed to be applicable for most physics-based simulation models. These two implementations together facilitate both offline and online metric evaluation. Additionally, a connection between the two, here separated, concepts of predictive capability and credibility is established and realized in the metamodel. The two implementations are, finally, evaluated in an aeronautical domain context.


    Access

    Download


    Export, share and cite



    Title :

    Toward Objective Assessment of Simulation Predictive Capability


    Contributors:

    Published in:

    Publication date :

    2023-03-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Model Predictive Capability Assessment Under Uncertainty

    Ramesh Rebba / Sankaran Mahadevan | AIAA | 2006


    Model Predictive Capability Assessment under Uncertainty

    Mahadevan, Sankaran / Rebba, Ramesh | AIAA | 2005



    Assessment of predictive capability of aeromechanics methods

    Bousman, William G. / Norman, Thomas | Tema Archive | 2010


    Assessment of Predictive Capability of Aeromechanics Methods

    Bousman, W.G. / Norman, T. / AHS international | British Library Conference Proceedings | 2008