An effective test program for the evaluation of the performance of the Short Term Conflict Alert (STCA) function must consider the definition of the test scenario, assessment metrics, and alert classification rules. This paper discusses test issues encountered using a realistic scenario based on live data. The paper describes a method to obtain systematic and automated measurements of nuisance rate, missed rate, and alert response time for a realistic traffic scenario. Based on experience using live data, the concept of a valid alert is introduced to deal with an alert that is not associated with an actual conflict nor considered to be a nuisance alert (e.g., an alert issued prior to an aircraft maneuver that avoids loss of separation). To classify alerts as nuisance or valid, and to check timeliness of alerts associated with a conflict, the approach relies on the comparison of the alerts declared by the system with those that would be expected from “truth data” projected forward in time (linear predictor) — truth data defined as the actual aircraft paths. Detailed alert classification rules addressing issues encountered in performance testing with realistic scenario data are described. Approaches to obtaining a representation of “truth data” are referenced. The method of using a Test Predictor operating on truth data in association with alert classification rules was used in performance evaluation of, and problem identification related to, the tactical alert function in the En Route Automation Modernization (ERAM) system and for studies of the Common Automated Radar Terminal System (Common ARTS). Aspects of the performance measurement approach described herein may be applicable to the development of accuracy requirements of future systems.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Assessing tactical alert function accuracy performance


    Contributors:


    Publication date :

    2009-10-01


    Size :

    492757 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Analysis of False-Alert Rates for a Tactical Conflict Detection System

    Paielli, Russell / Erzberger, Heinz | AIAA | 2005


    TAKEOFF PERFORMANCE ALERT

    EREK S BARHOUM / PAUL E POTEET / ROSS GODWIN et al. | European Patent Office | 2023

    Free access

    Roadside user alert techniques based on location accuracy

    VASSILOVSKI DAN / MARSH GENE WESLEY / BALASUBRAMANIAN ANANTHARAMAN et al. | European Patent Office | 2024

    Free access

    TAKEOFF PERFORMANCE ALERT

    BARHOUM EREK S / POTEET PAUL E / GODWIN ROSS et al. | European Patent Office | 2023

    Free access

    Takeoff performance alert

    BARHOUM EREK S / POTEET PAUL E / GODWIN ROSS et al. | European Patent Office | 2023

    Free access