Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This approximation is clearly limited as demonstrated by observing a residual image from a VAE reconstruction, which often possess a high level of structure. This paper demonstrates a novel scheme to incorporate a structured Gaussian likelihood prediction network within the VAE that allows the residual correlations to be modeled. Our novel architecture, with minimal increase in complexity, incorporates the covariance matrix prediction within the VAE. We also propose a new mechanism for allowing structured uncertainty on color images. Furthermore, we provide a scheme for effectively training this model, and include some suggestions for improving performance in terms of efficiency or modeling longer range correlations.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Training VAEs Under Structured Residuals


    Beteiligte:
    Dorta, Garoe (Autor:in) / Vicente, Sara (Autor:in) / Agapito, Lourdes (Autor:in) / Campbell, Neill D. F. (Autor:in) / Simpson, Ivor (Autor:in)

    Erscheinungsdatum :

    2018


    Anmerkungen:

    Simplified training methodology, added more results


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Freier Zugriff

    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    Relaxed-Responsibility Hierarchical Discrete VAEs

    Willetts, Matthew / Miscouridou, Xenia / Roberts, Stephen et al. | ArXiv | 2020

    Freier Zugriff

    Prior Learning in Introspective VAEs

    Athanasiadis, Ioannis / Lindsten, Fredrik / Felsberg, Michael | ArXiv | 2024

    Freier Zugriff

    On Incorporating Inductive Biases into VAEs

    Miao, Ning / Mathieu, Emile / Siddharth, N. et al. | ArXiv | 2021

    Freier Zugriff