Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only global structure and discards information about detailed texture. In this paper, we present a simple but principled method to learn such global representations by combining Variational Autoencoder (VAE) with neural autoregressive models such as RNN, MADE and PixelRNN/CNN. Our proposed VAE model allows us to have control over what the global latent code can learn and , by designing the architecture accordingly, we can force the global latent code to discard irrelevant information such as texture in 2D images, and hence the VAE only "autoencodes" data in a lossy fashion. In addition, by leveraging autoregressive models as both prior distribution $p(z)$ and decoding distribution $p(x|z)$, we can greatly improve generative modeling performance of VAEs, achieving new state-of-the-art results on MNIST, OMNIGLOT and Caltech-101 Silhouettes density estimation tasks.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Variational Lossy Autoencoder


    Beteiligte:
    Chen, Xi (Autor:in) / Kingma, Diederik P. (Autor:in) / Salimans, Tim (Autor:in) / Duan, Yan (Autor:in) / Dhariwal, Prafulla (Autor:in) / Schulman, John (Autor:in) / Sutskever, Ilya (Autor:in) / Abbeel, Pieter (Autor:in)

    Erscheinungsdatum :

    2016


    Anmerkungen:

    Added CIFAR10 experiments; ICLR 2017


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Variational Autoencoder

    Okadome, Takeshi | Springer Verlag | 2025


    Variational Autoencoder

    Pinheiro Cinelli, Lucas / Araújo Marins, Matheus / Barros da Silva, Eduardo Antúnio et al. | Springer Verlag | 2021


    Autoencoding Variational Autoencoder

    Cemgil, A. Taylan / Ghaisas, Sumedh / Dvijotham, Krishnamurthy et al. | ArXiv | 2020

    Freier Zugriff

    Branched Variational Autoencoder Classifiers

    Salah, Ahmed / Yevick, David | ArXiv | 2024

    Freier Zugriff

    ControlVAE: Controllable Variational Autoencoder

    Shao, Huajie / Yao, Shuochao / Sun, Dachun et al. | ArXiv | 2020

    Freier Zugriff