Rockwell Science Center is investigating novel human-computer interface techniques for enhancing the situational awareness in future flight decks. One aspect is to provide intuitive displays which provide the vital information and the spatial awareness by augmenting the real world with an overlay of relevant information registered to the real world. Such Augmented Reality (AR) techniques can be employed during bad weather scenarios to permit flying in Visual Flight Rules (VFR) in conditions which would normally require Instrumental Flight Rules (IFR). These systems could easily be implemented on heads-up displays (HUD). The advantage of AR systems vs. purely synthetic vision (SV) systems is that the pilot can relate the information overlay to real objects in the world, whereas SV systems provide a constant virtual view, where inconsistencies can hardly be detected. The development of components for such a system led to a demonstrator implemented on a PC. A camera grabs video images which are overlaid with registered information, Orientation of the camera is obtained from an inclinometer and a magnetometer, position is acquired from GPS. In a possible implementation in an airplane, the on-board attitude information can be used for obtaining correct registration. If visibility is sufficient, computer vision modules can be used to fine-tune the registration by matching visual clues with database features. Such technology would be especially useful for landing approaches. The current demonstrator provides a frame-rate of 15 fps, using a live video feed as background and an overlay of avionics symbology in the foreground. In addition, terrain rendering from a 1 arc sec. digital elevation model database can be overlaid to provide synthetic vision in case of limited visibility. For true outdoor testing (on ground level), the system has been implemented on a wearable computer.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    System for synthetic vision and augmented reality in future flight decks



    Conference:

    Enhanced and Synthetic Vision 2000 ; 2000 ; Orlando,FL,USA


    Published in:

    Publication date :

    2000-06-23





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Enhanced/Synthetic Vision Systems for Advanced Flight Decks

    Kaiser, Mary K. / Jenkins, James / Statler, Irving C. | NTRS | 1994


    Future Flight Decks

    Arbuckle, P. Douglas / Abbott, Kathy H. / Abbott, Terence S. et al. | NTRS | 1998


    Future Flight Decks

    P. D. Arbuckle / K. H. Abbott / T. S. Abbott et al. | NTIS | 1998


    Commercial Flight Crew Selection for Automated Flight Decks

    Clark, R. / Herlehy, W. F. | British Library Conference Proceedings | 1994


    Standardization of Flight Decks - Operational Aspects

    Lande, K. / Flight Safety Foundation | British Library Conference Proceedings | 1998