Eye gaze estimation and cognitive load estimation of the pilot garnered great attention in the aviation domain due to the numerous possible applications. Earlier works proposed to use eye gaze tracking to interact with multi-function displays (MFDs) and head-up display (HUD) in place of traditional interaction devices. Further, researchers also investigated the accuracy of commercially available gaze trackers during in-flight conditions by conducting studies under various actual flying scenarios like varying g-conditions and different maneuvers. In this paper, we first studied the functioning of a wearable eye gaze tracker using two one-hour long flights. Pilots undertook various challenging maneuvers during the flight. We analyzed the gaze tracking data recorded using the gaze tracker and observed that the ∼42% and ∼31% of flight duration resulted in loss of gaze data in flight1 and flight 2 respectively. Further, we analyzed unsynchronized raw data and observed that both flights recorded error-prone gaze samples for ∼51% of the flight duration. We hypothesized and verified that this loss of data is caused due to the higher levels of illumination on eyes and limited field of view provided by the gaze tracker in the vertical direction. The data from both flights supported our hypothesis and it was evident that the current field of view offered by the eye tracking glasses is not sufficient for the military aviation. We addressed the first limitation by using Machine learning approach. We built an end-to-end gaze estimation system which takes IR-eye images recorded using wearable eye tracking glasses to predict the gaze point. We sampled 10K images with proper ground truth gaze points. Our dataset contained wide variation in illumination and pupil dilation. We observed that the proposed approach using a convolutional neural network resulted in low gaze estimation errors and consistent gaze predictions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Learning-based Eye Gaze Estimation for Military Aviation


    Contributors:


    Publication date :

    2022-03-05


    Size :

    4073305 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Evaluating Accuracy of Eye Gaze Controlled Interface in Military Aviation Environment

    Murthy, LRD / Mukhopadhyay, Abhishek / Yellheti, Varshit et al. | IEEE | 2020


    Military Aviation

    J. Novotny | NTIS | 1969


    Military aviation

    Cervantes, F. | Engineering Index Backfile | 1912


    Military Aviation - Military Aircraft Upgrades

    Grant, Peter | Online Contents | 1998


    Point-of-Gaze Measurement in Aviation Research

    Mooij, H. A. / Advisory Group for Aerospace Research and Development / Aerospace Medical Panel | British Library Conference Proceedings | 1996