The air traffic transformation underway in the US with the FAA NextGen and in Europe with SESAR relies on information sharing and system interoperability to increase efficiencies, safety and capacity. The proliferation and dissemination of flight, weather, aeronautical, and environmental data by all air traffic participants represents a treasure trove of air traffic optimization opportunities awaiting to be exploited. Traditional data exploitation methods and tools tend to rely on structured data stores and analytical capability architected to answer defined and current questions. SGT, in collaboration with the US DOT Volpe National Transportation Systems Center, developed a prototype air transportation cloud based Data Lake to harness big data from a variety of sources and build the current and next generation of analytics capability. The Data Lake prototype ingests data from multiple sources including FAA sources like SFDPS, TFMData, TBFM, STDDS, ITWS, and AEDT data sources, and stores it in raw, processed, and refined format. The prototype offers an illustration for how users can realize powerful air traffic related data analysis using structured, unstructured and semi-structured data using open source tools to execute queries, searches, processing streams and to visualize data. Using a combination of traditional SQL and NOSQL, Open-Source and COTS products - PostgreSQL, Elastic-Logstash-Kibana, Apache Kafka, Apache Spark and visualization tools like Tableau, D3 and others, the project shows how analysts can quickly and easily build powerful data pipelines and statistical models.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Data Lake Architecture for Air Traffic Management


    Contributors:


    Publication date :

    2018-09-01


    Size :

    398051 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    DGT Architecture for Traffic Data Management Systems

    Puigpelat, A. M. / Lopez, J. L. / ASCE; Urban Transportation Division; Committee of Advanced Technology | British Library Conference Proceedings | 1996


    Space traffic management system architecture

    KOPARDEKAR PARIMAL HEMCHANDRA / NAG SREEJA / MURAKAMI DAVID DAISUKE | European Patent Office | 2023

    Free access

    Hierarchical computing architecture for traffic management

    HOH BAIK / KESHAVAMURTHY SHALINI / YANG HAO et al. | European Patent Office | 2022

    Free access

    Hierarchical Computing Architecture for Traffic Management

    HOH BAIK / KESHAVAMURTHY SHALINI / YANG HAO et al. | European Patent Office | 2022

    Free access

    Hierarchical Computing Architecture for Traffic Management

    HOH BAIK / KESHAVAMURTHY SHALINI / YANG HAO et al. | European Patent Office | 2020

    Free access