The problem of action-conditioned image prediction in robotics is to predict the expected next frame given the current camera frame the robot observes and the action it selects. We provide the first comparison of two recent popular models, Convolutional Dynamic Neural Advection (CDNA) (6) and a feedforward model (15), especially for image prediction on cars. Our major finding is that action tiling encoding is the most important factor leading to the remarkable performance of the CDNA model. We present a light-weight model by action tiling encoding which has a single-decoder feedforward architecture same as (15). On a real driving dataset, the CDNA model achieves $0.3986 \times 10^{-3}$ MSE and 0.9836 Structure SIMilarity (SSIM) with a network size of about 12.6 million parameters. With a small network of fewer than 1 million parameters, our new model achieves a comparable performance to CDNA at $0.3613\times 10^{-3}$ MSE and 0.9633 SSIM. Our model requires less memory, is more computationally efficient and more advantageous to be used inside self-driving vehicles.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Practical Issues of Action-Conditioned Next Image Prediction


    Contributors:


    Publication date :

    2018-11-01


    Size :

    1896840 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Action-conditioned vehicle control

    WAGENMAKER ANDREW / PUSKORIUS GINTARAS VINCENT | European Patent Office | 2020

    Free access

    Practical considerations about noise measurements in railway vehicles using conditioned intensity

    Recuero, M. / Sobreira, M. / Gil, C. et al. | British Library Conference Proceedings | 1994


    The National Dredging Team's Action Agenda: Issues and Actions for the Next Decade

    Vogt, Craig / Holliday, Barry / Beiring, Elizabeth et al. | ASCE | 2003


    Conditioned creativity

    Cumberford, R. | British Library Online Contents | 1997


    CONDITIONED STEERING WHEEL

    ONICA MADALINA | European Patent Office | 2015

    Free access