A driver's gaze is critical for determining the driver's attention level, state, situational awareness, and readiness to take over control from partially and fully automated vehicles. Tracking both the head and eyes (pupils) can provide a reliable estimation of a driver's gaze using face images under ideal conditions. However, the vehicular environment introduces a variety of challenges that are usually unaccounted for - harsh illumination, nighttime conditions, and reflective/dark eyeglasses. Unfortunately, relying on head pose alone under such conditions can prove to be unreliable owing to significant eye movements. In this study, we offer solutions to address these problems encountered in the real world. To solve issues with lighting, we demonstrate that using an infrared camera with suitable equalization and normalization usually suffices. To handle eyeglasses and their corresponding artifacts, we adopt the idea of image-to-image translation using generative adversarial networks (GANs) to pre-process images prior to gaze estimation. To this end, we propose the Gaze Preserving CycleGAN (GPCycleGAN). This network preserves the driver's gaze while removing potential eyeglasses from infrared face images. Our approach exhibits improved performance and robustness on challenging real-world data spanning 13 subjects and a variety of driving conditions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Driver Gaze Estimation in the Real World: Overcoming the Eyeglass Challenge


    Beteiligte:
    Rangesh, Akshay (Autor:in) / Zhang, Bowen (Autor:in) / Trivedi, Mohan M. (Autor:in)


    Erscheinungsdatum :

    2020-10-19


    Format / Umfang :

    492791 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Gaze Preserving CycleGANs for Eyeglass Removal and Persistent Gaze Estimation

    Rangesh, Akshay / Zhang, Bowen / Trivedi, Mohan Manubhai | IEEE | 2022


    Young Driver Gaze (YDGaze): Dataset for driver gaze analysis

    Ceven, Suleyman / Albayrak, Ahmet / Bayir, Raif | IEEE | 2022


    GSA-Gaze: Generative Self-adversarial Learning for Domain Generalized Driver Gaze Estimation

    Han, Hongcheng / Tian, Zhiqiang / Liu, Yuying et al. | IEEE | 2023


    Comparison of Video-based Driver Gaze Region Estimation Techniques

    Bieg, Hans-Joachim / Strobel, Simon / Fischer, Matthias S. et al. | IEEE | 2022


    Personalized Driver Workload Estimation in Real-World Driving

    Murphey, Yi / Xie, Yongquan / Kochhar, Dev S. | British Library Conference Proceedings | 2018