Classification of driving events is a crucial stage in driving behavior monitoring using smartphone sensory data. It has not been previously explored that to what extent classification performance depends on the classifier type and input data characteristics. To fill this gap, a real-world experiment is designed for supervised data collection. Then the effects of different machine learning (ML) classifiers, data sampling rates, and sensor combinations on the final classification accuracy are demonstrated. A considerable number of labeled events (4114) containing 11 types of driving maneuvers are collected using base sensors (accelerometer and gyroscope) and composite sensors (linear accelerometer and rotation vector) available in smartphones. Several models using 23 ML algorithms are trained. The sensitivity of these models is analyzed by changing the characteristics of the input data concerning the type of ML classifier, data sampling rate, and the bundle of mobile sensors. It is demonstrated that: (1) F1 scores vary from 70 to 96% for different ML classifiers, (2) F1 scores drop 30–40% depending on the classifier type when reducing the data sampling rate, and (3) using all four sensors as a bundle for classifying driving events is not reasonable since an approximate equal F1 score is achievable by a three-sensor bundle which includes an accelerometer and a linear accelerometer.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Sensitivity analysis of driving event classification using smartphone motion data: case of classifier type, sensor bundling, and data acquisition rate



    Published in:

    Publication date :

    2024-07-03


    Size :

    18 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Temporal analysis of driving efficiency using smartphone data

    Tselentis, Dimitrios I. / Vlahogianni, Eleni I. / Yannis, George | Elsevier | 2021


    Driving safety efficiency benchmarking using smartphone data

    Tselentis, Dimitrios I. / Vlahogianni, Eleni I. / Yannis, George | Elsevier | 2019


    Driving event data analysis

    BRINKMANN MARGARET A / KRAFT DANIEL / BRYER NATHAN M et al. | European Patent Office | 2019

    Free access

    Driving event data analysis

    BRINKMANN MARGARET A / KRAFT DANIEL / BRYER NATHAN M et al. | European Patent Office | 2018

    Free access

    Driving event data analysis

    BRINKMANN MARGARET A / KRAFT DANIEL / BRYER NATHAN M et al. | European Patent Office | 2020

    Free access