Systems and methods are provided for implementing soft model assertions (SMA) system and techniques designed to monitor and improve Machine Learning (ML) model quality by to detecting errors within the one or more ML models. SMA techniques and systems are distinctly designed to leverage: 1) a user's ability to specify features over data; and 2) large, existing datasets of organizations, in a manner that can improve the accuracy and quality of predicting potential errors in Machine Learning (ML) models. A SMA system can include a controller device receiving predictions generated based on the ML models and output from the SMA system. The controller performs autonomous operations of the system in response to determining that the one or more detected errors within the one or more ML models yield a high certainty of errors in the predictions. The SMA system also includes a domain specific language and a severity score module.
SYSTEMS AND METHODS FOR SOFT MODEL ASSERTIONS
2022-11-10
Patent
Elektronische Ressource
Englisch
IPC: | G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung |
Executable assertions and flight software
AIAA | 1984
|Comparative product assertions - requirements and critical review
Kraftfahrwesen | 1997
|Comparative Product Assertions - Requirements and Critical Reviews
British Library Conference Proceedings | 1997
|Comparative Product Assertions - Requirements and Critical Reviews
SAE Technical Papers | 1997
|Using assertions to satisfy DO-254 Elemental Analysis
IEEE | 2011
|