For an in-depth, AOI-based analysis of mobile eye tracking data, a preceding gaze assignment step is inevitable. Current solutions such as manual gaze mapping or marker-based approaches are tedious and not suitable for applications manipulating tangible objects. This makes mobile eye tracking studies with several hours of recording difficult to analyse quantitatively. We introduce a new machine learning-based algorithm, the computational Gaze-Object Mapping (cGOM), that automatically maps gaze data onto respective AOIs. cGOM extends state-of-the-art object detection and segmentation by mask R-CNN with a gaze mapping feature. The new algorithm’s performance is validated against a manual fixation-by-fixation mapping, which is considered as ground truth, in terms of true positive rate (TPR), true negative rate (TNR) and efficiency. Using only 72 training images with 264 labelled object representations, cGOM is able to reach a TPR of approx. 80% and a TNR of 85% compared to the manual mapping. The break-even point is reached at 2 hours of eye tracking recording for the total procedure, respectively 1 hour considering human working time only. Together with a real-time capability of the mapping process after completed training, even hours of eye tracking recording can be evaluated efficiently. (Code and video examples have been made available at: https://gitlab.ethz.ch/pdz/cgom.git)


    Access

    Download


    Export, share and cite



    Title :

    Automating areas of interest analysis in mobile eye tracking experiments based on machine learning


    Contributors:

    Publication date :

    2018-12-10


    Remarks:

    doi:10.16910/jemr.11.6.6
    Journal of Eye Movement Research; Bd. 11 Nr. 6 (2018) ; Journal of Eye Movement Research; Vol. 11 No. 6 (2018) ; 1995-8692



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    A Machine Learning Approach for Automating Software Code Review

    Taggarsi, Bhavana Mohan / Kameshwari Prasad Dev, M / Hossain, Shadab | SAE Technical Papers | 2022


    FLEET TRACKING AND BEHAVIOR MODIFICATION IN GEOGRAPHIC AREAS OF INTEREST

    CLEWLOW REGINA RUBY LEE / FOTI FLETCHER SCOTT | European Patent Office | 2024

    Free access

    Fleet tracking and behavior modification in geographic areas of interest

    CLEWLOW REGINA RUBY LEE / FOTI FLETCHER SCOTT | European Patent Office | 2023

    Free access

    FLEET TRACKING AND BEHAVIOR MODIFICATION IN GEOGRAPHIC AREAS OF INTEREST

    CLEWLOW REGINA / FOTI FLETCHER | European Patent Office | 2023

    Free access

    FLEET TRACKING AND BEHAVIOR MODIFICATION IN GEOGRAPHIC AREAS OF INTEREST

    CLEWLOW REGINA RUBY LEE / FOTI FLETCHER SCOTT | European Patent Office | 2024

    Free access