A major focus of the commercial aviation community is discovery of unknown safety events in flight operations data. Data-driven unsupervised anomaly detection methods are better at capturing unknown safety events compared to rule-based methods which only look for known violations. However, not all statistical anomalies that are discovered by these unsupervised anomaly detection methods are operationally significant (e.g., represent a safety concern). Subject Matter Experts (SMEs) have to spend significant time reviewing these statistical anomalies individually to identify a few operationally significant ones. In this paper we propose an active learning algorithm that incorporates SME feedback in the form of rationales to build a classifier that can distinguish between uninteresting and operationally significant anomalies. Experimental evaluation on real aviation data shows that our approach improves detection of operationally significant events by as much as 75% compared to the state-of-the-art. The learnt classifier also generalizes well to additional validation data sets.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    Active Learning with Rationales for Identifying Operationally Significant Anomalies in Aviation


    Contributors:

    Conference:

    European Conference on Machine Learning and Principles and Practice of Knowledge (ECML-PKDD 2016) ; 2016 ; Riva del Garda, Italy


    Publication date :

    2016-09-19


    Type of media :

    Conference paper


    Type of material :

    No indication


    Language :

    English





    Operationally significant patterns of association

    Hardy, W.C. / La Valley, R.W. | IEEE | 2006




    IMPLEMENTING ADDS OPERATIONALLY AT THE NWS AVIATION WEATHER CENTER

    Sherretz, L. / Pratt, G. / Thompson, G. et al. | British Library Conference Proceedings | 2002