Estimating driver gaze accurately is critical for the human-machine cooperative driving, but the significant facial appearance diversions caused by background, illumination, personal characteristics, etc. pose a challenge to the generalizability of gaze estimation models. In this paper, we propose the generative self-adversarial learning mechanism for generalized gaze estimation that aims to learn general gaze features while eliminating sample-specific features and preventing cross-domain feature over-fitting. Firstly, to reduce information redundancy, the feature encoder is designed based on pyramid-grouped convolution to extract a sparse feature representation from the facial appearance. Secondly, the gaze regression module supervises the model to learn as many gaze-relevant features as possible. Thirdly, the adversarial image reconstruction task prompts the model to eliminate the domain-specific features. The adversarial learning of the gaze regression and the image reconstruction tasks guides the model to learn only general gaze features across domains, preventing cross-domain feature over-fitting, enhancing the domain generalization capability. The results of cross-domain testing of four active gaze datasets prove the effectiveness of the proposed method. The code is available at https://github.com/HongchengHan/GSA-Gaze


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    GSA-Gaze: Generative Self-adversarial Learning for Domain Generalized Driver Gaze Estimation


    Contributors:
    Han, Hongcheng (author) / Tian, Zhiqiang (author) / Liu, Yuying (author) / Li, Shengpeng (author) / Zhang, Dong (author) / Du, Shaoyi (author)


    Publication date :

    2023-09-24


    Size :

    578310 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Young Driver Gaze (YDGaze): Dataset for driver gaze analysis

    Ceven, Suleyman / Albayrak, Ahmet / Bayir, Raif | IEEE | 2022


    Learning gaze biases with head motion for head pose-free gaze estimation

    Lu, F. / Okabe, T. / Sugano, Y. et al. | British Library Online Contents | 2014


    Auto-Calibrated Gaze Estimation Using Human Gaze Patterns

    Alnajar, F. / Gevers, T. / Valenti, R. et al. | British Library Online Contents | 2017


    Driver Gaze Behavior in Critical Cornering

    Nozaki, Hiromichi | SAE Technical Papers | 2006


    Comparison of Video-based Driver Gaze Region Estimation Techniques

    Bieg, Hans-Joachim / Strobel, Simon / Fischer, Matthias S. et al. | IEEE | 2022