A driver’s gaze is critical for determining theirattention, state, situational awareness, and readiness to take over control from partially automated vehicles. Estimating the gaze direction is the most obvious way to gauge a driver’s state under ideal conditions when limited to using non-intrusive imaging sensors. Unfortunately, the vehicular environment introduces a variety of challenges that are usually unaccounted for - harsh illumination, nighttime conditions, and reflective eyeglasses. Relying on head pose alone under such conditions can prove to be unreliable and erroneous. In this study, we offer solutions to address these problems encountered in the real world. To solve issues with lighting, we demonstrate that using an infrared camera with suitable equalization and normalization suffices. To handle eyeglasses and their corresponding artifacts, we adopt image-to-image translation using generative adversarial networks to pre-process images prior to gaze estimation. Our proposed Gaze Preserving CycleGAN (GPCycleGAN) is trained to preserve the driver’s gaze while removing potential eyeglasses from face images. GPCycleGAN is based on the well-known CycleGAN approach - with the addition of a gaze classifier and a gaze consistency loss for additional supervision. Our approach exhibits improved performance, interpretability, robustness and superior qualitative results on challenging real-world datasets.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Gaze Preserving CycleGANs for Eyeglass Removal and Persistent Gaze Estimation


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    01.06.2022


    Format / Umfang :

    4908597 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    DRIVER GAZE ESTIMATION IN THE REAL WORLD: OVERCOMING THE EYEGLASS CHALLENGE

    Rangesh, Akshay / Zhang, Bowen / Trivedi, Mohan M. | British Library Conference Proceedings | 2020


    Driver Gaze Estimation in the Real World: Overcoming the Eyeglass Challenge

    Rangesh, Akshay / Zhang, Bowen / Trivedi, Mohan M. | IEEE | 2020


    Auto-Calibrated Gaze Estimation Using Human Gaze Patterns

    Alnajar, F. / Gevers, T. / Valenti, R. et al. | British Library Online Contents | 2017


    Learning gaze biases with head motion for head pose-free gaze estimation

    Lu, F. / Okabe, T. / Sugano, Y. et al. | British Library Online Contents | 2014


    GSA-Gaze: Generative Self-adversarial Learning for Domain Generalized Driver Gaze Estimation

    Han, Hongcheng / Tian, Zhiqiang / Liu, Yuying et al. | IEEE | 2023