Standard-sized autonomous vehicles have rapidly improved thanks to the breakthroughs of deep learning. However, scaling autonomous driving to mini-vehicles poses several challenges due to their limited on-board storage and computing capabilities. Moreover, autonomous systems lack robustness when deployed in dynamic environments where the underlying distribution is different from the distribution learned during training. To address these challenges, we propose a closed-loop learning flow for autonomous driving mini-vehicles that includes the target deployment environment in-the-loop. We leverage a family of compact and high-throughput tinyCNNs to control the mini-vehicle that learn by imitating a computer vision algorithm, i.e., the expert, in the target environment. Thus, the tinyCNNs, having only access to an on-board fast-rate linear camera, gain robustness to lighting conditions and improve over time. Moreover, we introduce an online predictor that can choose between different tinyCNN models at runtime—trading accuracy and latency— which minimises the inference’s energy consumption by up to 3.2×. Finally, we leverage GAP8, a parallel ultra-low-power RISC-V-based micro-controller unit (MCU), to meet the real-time inference requirements. When running the family of tinyCNNs, our solution running on GAP8 outperforms any other implementation on the STM32L4 and NXP k64f (traditional single-core MCUs), reducing the latency by over 13× and the energy consumption by 92%.


    Access

    Download


    Export, share and cite



    Title :

    Robustifying the deployment of tinyml models for autonomous mini-vehicles



    Publication date :

    2021-01-01



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Robustifying the deployment of tinyML models for autonomous mini-vehicles

    de Prado M. / Rusci M. / Donze R. et al. | BASE | 2021

    Free access

    Robustifying Car-Following Models with Explicit Reaction Times

    Kreutz, Karsten / Eggert, Julian | IEEE | 2022


    Adaptive Traffic Control With TinyML

    Roshan, A. Navaas / Gokulapriyan, B. / Siddarth, C. et al. | IEEE | 2021


    DEPLOYMENT OF AUTONOMOUS VEHICLES

    GEISSLER FLORIAN / ROSALES RAFAEL / CIHANGIR NESLIHAN KOSE et al. | European Patent Office | 2021

    Free access

    Adaptive traffic control method based on TinyML

    SONG CHEN / GE JUNZHENG / LI RUI | European Patent Office | 2022

    Free access