This paper investigates the potential of PaliGemma, a recently released open-source Visual-Language Model (VLM), for detecting phone-based driver distraction. We evaluate PaliGemma’s performance on the State Farm Distracted Driver Detection (SFDDD) dataset. The proposed method involves three steps: (1) generating a textual description of the input image using PaliGemma, (2) create prompts related to phone distraction based on the text description (e.g., “Is the driver distracted by talking or using the phone?”), and (3) identifying the driver’s phone use status (talking or texting) based on PaliGemma’s response. We compare the accuracy of three PaliGemma models for classifying four driver actions: texting/talking on the phone with left/right hand. All models achieved high accuracy (>95%) for most categories, with PaliGemma-3b-pt-896 achieving impressive 100% accuracy. Our findings suggest that PaliGemma VLMs offer promising potential for detecting phone distraction while driving.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Detection of Phone Distraction While Driving Using Open Visual-Language Models


    Additional title:

    Proceedings in Automotive Engineering



    Conference:

    International Congress of Automotive and Transport Engineering ; 2024 ; Brasov, Romania November 06, 2024 - November 08, 2024



    Publication date :

    2024-11-20


    Size :

    6 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Wearables distraction reduction while driving

    RAJENDRAN SHANTHA KUMARI / KANAGARAJ PADHU | European Patent Office | 2018

    Free access

    WEARABLES DISTRACTION REDUCTION WHILE DRIVING

    RAJENDRAN SHANTHA KUMARI / KANAGARAJ PADHU | European Patent Office | 2017

    Free access

    Analysis of visual distraction related to smartphone use while driving

    Fancello, Gianfranco / Serra, Patrizia / Adamu, Marta | Elsevier | 2025

    Free access

    Predicting visual distraction using driving performance data

    Kircher, Katja / Ahlstrom, Christer | Tema Archive | 2010


    Predicting Visual Distraction Using Driving Performance Data

    Kircher, K. / Ahlstrom, C. / Association for the Advancement of Automotive Medicine | British Library Conference Proceedings | 2008