Assessing the driver's attention and detecting various hazardous and non-hazardous events during a drive are critical for driver's safety. Attention monitoring in driving scenarios has mostly been carried out using vision (camera-based) modality by tracking the driver's gaze and facial expressions. It is only recently that bio-sensing modalities such as Electroencephalogram (EEG) are being explored. But, there is another open problem which has not been explored sufficiently yet in this paradigm. This is the detection of specific events, hazardous and non-hazardous, during driving that affects the driver's mental and physiological states. The other challenge in evaluating multi-modal sensory applications is the absence of very large scale EEG data because of the various limitations of using EEG in the real world. In this paper, we use both of the above sensor modalities and compare them against the two tasks of assessing the driver's attention and detecting hazardous vs. non-hazardous driving events. We collect user data on twelve subjects and show how in the absence of very large-scale datasets, we can still use pre-trained deep learning convolution networks to extract meaningful features from both of the above modalities. We used the publicly available KITTI dataset for evaluating our platform and to compare it with previous studies. Finally, we show that the results presented in this paper surpass the previous benchmark set up in the above driver awareness-related applications.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Attention Monitoring and Hazard Assessment with Bio-Sensing and Vision: Empirical Analysis Utilizing CNNs on the KITTI Dataset


    Contributors:


    Publication date :

    2019-06-01


    Size :

    2905828 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English





    COLOR-BASED ROAD DETECTION AND ITS EVALUATION ON THE KITTI ROAD BENCHMARK

    Wang, B. / Fremont, V. / Rodriguez, S. et al. | British Library Conference Proceedings | 2014


    Investigation of Three-Arc Contour Prediction Algorithm on KITTI LiDAR Raw Data Set

    Sequeira, Gerald Joy / Harlapur, Bhuvan / Lugner, Robert et al. | IEEE | 2021


    COMPREHENSIVE PERFORMANCE ANALYSIS OF ROAD DETECTION ALGORITHMS USING THE COMMON URBAN KITTI-ROAD BENCHMARK

    Vitor, G. / Victorino, A. / Ferreira, J. et al. | British Library Conference Proceedings | 2014