This report describes the formulation and application of a performance metric designed to assist the design and development of automotive active safety systems. The impetus for developing the metric was to calibrate the relative performance of the pedestrian detection algorithms used by infrared (IR) night-vision systems. The two types of system, far- and near- infrared (FIR and NIR), have complementary strengths and weaknesses that produce different sets of misses and false alarms and reveal limitations in traditional methods for comparing their performance. To overcome these limitations, our metric quantifies the similarity between system output and it ground truth - the actual locations of pedestrians in the IR image. The metric reaches its maximum value of 1.0 when the system highlights all and only the elements in the ground truth. The evaluation of the metric compared a benchmark FIR system and a prototype system that fuses inputs from the FIR system and an NIR system. The prototype was found to outperform the benchmark by 10 to 26%. This finding supports the contentions that the metric provides an effective means for assessing systems with complementary strengths. It can be used in the development of image-based driver assistance systems to assess changes in system performance due to system modifications and to evaluate large databases by highlighting situations or events worthy of developers' scrutiny.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Development and evaluation of a performance metric for image-based driver assistance systems


    Contributors:
    Smith, K. (author) / Schweiger, R. (author) / Ritter, W. (author) / Kallhammer, J. (author)


    Publication date :

    2011-06-01


    Size :

    961528 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Development and Evaluation of a Performance Metric for Image-Based Driver Assistance Systems

    Smith, K. / Schweiger, R. / Ritter, W. et al. | British Library Conference Proceedings | 2011


    Attribute-based development of driver assistance systems

    Höfer, Manuel / Fuhr, Florian / Schick, Bernhard et al. | Springer Verlag | 2019


    DRIVER PERFORMANCE METRIC

    MOLLICONE DANIEL JOSEPH / KAN KEVIN GAR WAH / BIONDO DAMIAN MARCUS et al. | European Patent Office | 2016

    Free access

    Advanced driver assistance systems: objective and subjective performance evaluation

    Auckland,R.A. / Manning,W.J. / Carsten,O.M. et al. | Automotive engineering | 2008


    Advanced driver assistance systems: Objective and subjective performance evaluation

    Auckland, R.A. / Manning, W.J. / Carsten, O.M.J. et al. | Tema Archive | 2008