A driver's gaze is critical for determining the driver's attention level, state, situational awareness, and readiness to take over control from partially and fully automated vehicles. Tracking both the head and eyes (pupils) can provide a reliable estimation of a driver's gaze using face images under ideal conditions. However, the vehicular environment introduces a variety of challenges that are usually unaccounted for - harsh illumination, nighttime conditions, and reflective/dark eyeglasses. Unfortunately, relying on head pose alone under such conditions can prove to be unreliable owing to significant eye movements. In this study, we offer solutions to address these problems encountered in the real world. To solve issues with lighting, we demonstrate that using an infrared camera with suitable equalization and normalization usually suffices. To handle eyeglasses and their corresponding artifacts, we adopt the idea of image-to-image translation using generative adversarial networks (GANs) to pre-process images prior to gaze estimation. To this end, we propose the Gaze Preserving CycleGAN (GPCycleGAN). This network preserves the driver's gaze while removing potential eyeglasses from infrared face images. Our approach exhibits improved performance and robustness on challenging real-world data spanning 13 subjects and a variety of driving conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Driver Gaze Estimation in the Real World: Overcoming the Eyeglass Challenge


    Contributors:


    Publication date :

    2020-10-19


    Size :

    492791 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    DRIVER GAZE ESTIMATION IN THE REAL WORLD: OVERCOMING THE EYEGLASS CHALLENGE

    Rangesh, Akshay / Zhang, Bowen / Trivedi, Mohan M. | British Library Conference Proceedings | 2020


    Gaze Preserving CycleGANs for Eyeglass Removal and Persistent Gaze Estimation

    Rangesh, Akshay / Zhang, Bowen / Trivedi, Mohan Manubhai | IEEE | 2022


    DRIVER DISTRACTION FROM UNCERTAIN GAZE ESTIMATION

    ALMÁSI PÉTER / OLLESSON NIKLAS / SANTIAGO ANJIN GABRIEL ALEXANDER et al. | European Patent Office | 2024

    Free access

    Young Driver Gaze (YDGaze): Dataset for driver gaze analysis

    Ceven, Suleyman / Albayrak, Ahmet / Bayir, Raif | IEEE | 2022


    GSA-Gaze: Generative Self-adversarial Learning for Domain Generalized Driver Gaze Estimation

    Han, Hongcheng / Tian, Zhiqiang / Liu, Yuying et al. | IEEE | 2023