Synthetic data can support the design assurance of machine learning enabled components in aviation at a relatively low cost compared to in-field data collection campaigns and flight tests. In this paper, we study the methods for generating synthetic datasets using operational design domain descriptions and scenarios - informal or formal descriptions of the environment and the actions of objects over time. We propose a workflow where high-level scenario descriptions are parameterized with the operational envelope data of the machine learning system, and then concrete scenarios can be sampled from this parameter space. Concrete scenarios can be used to set up physics-based models to obtain synthetic data elements, such as images, via simulation. This data can then be used as part of either training or test dataset to support, respectively, training and testing of the model. We implement the scenario-based data generation workflow using state-of-the-art optimization and simulation tools, and demonstrate the results on a realistic case study for maritime search and rescue with unmanned aerial vehicles.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Scenario-Based Methods for Machine Learning Assurance


    Contributors:


    Publication date :

    2023-10-01


    Size :

    1264921 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Scenarios and Scenario Databases for AV Safety Assurance

    Glasmacher, Christoph / Schuldes, Michael / Klas, Christoph et al. | Springer Verlag | 2024



    Deobfuscating Machine Learning Assurance and Approval

    Wasson, Kimberly S. / Voros, Robert | IEEE | 2024


    Reliability and Quality Assurance of Space Missions - Indian Scenario

    Nanjundaswamy, T.S. / Rajangam, R.K. / European Space Agency | British Library Conference Proceedings | 2008


    Vehicle scenario mining for machine learning models

    KABZAN JURAJ / GOMES JULIA | European Patent Office | 2023

    Free access