We present a hierarchical VAE that, for the first time, outperforms the PixelCNN in log-likelihood on all natural image benchmarks. We begin by observing that VAEs can actually implement autoregressive models, and other, more efficient generative models, if made sufficiently deep. Despite this, autoregressive models have traditionally outperformed VAEs. We test if insufficient depth explains the performance gap by by scaling a VAE to greater stochastic depth than previously explored and evaluating it on CIFAR-10, ImageNet, and FFHQ. We find that, in comparison to the PixelCNN, these very deep VAEs achieve higher likelihoods, use fewer parameters, generate samples thousands of times faster, and are more easily applied to high-resolution images. We visualize the generative process and show the VAEs learn efficient hierarchical visual representations. We release our source code and models at https://github.com/openai/vdvae.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images


    Beteiligte:
    Child, Rewon (Autor:in)

    Erscheinungsdatum :

    2020


    Anmerkungen:

    17 pages, 14 figures


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Freier Zugriff

    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    Relaxed-Responsibility Hierarchical Discrete VAEs

    Willetts, Matthew / Miscouridou, Xenia / Roberts, Stephen et al. | ArXiv | 2020

    Freier Zugriff

    On Incorporating Inductive Biases into VAEs

    Miao, Ning / Mathieu, Emile / Siddharth, N. et al. | ArXiv | 2021

    Freier Zugriff

    Prior Learning in Introspective VAEs

    Athanasiadis, Ioannis / Lindsten, Fredrik / Felsberg, Michael | ArXiv | 2024

    Freier Zugriff