While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned representations that over-emphasize compressing imperceptible details of the image. To address this, we introduce a KL-reweighting strategy to control the amount of infor mation in each latent group, and employ a Gaussian output layer to reduce sharpness in the learning objective. To trade off image diversity for fidelity, we additionally introduce a classifier-free guidance strategy for hierarchical VAEs. We demonstrate the effectiveness of these techniques in our experiments. Code is available at https://github.com/tcl9876/visual-vae.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Optimizing Hierarchical Image VAEs for Sample Quality


    Beteiligte:
    Luhman, Eric (Autor:in) / Luhman, Troy (Autor:in)

    Erscheinungsdatum :

    2022


    Anmerkungen:

    21 pages, 12 figures


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    Relaxed-Responsibility Hierarchical Discrete VAEs

    Willetts, Matthew / Miscouridou, Xenia / Roberts, Stephen et al. | ArXiv | 2020

    Freier Zugriff

    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Freier Zugriff

    HIERARCHICAL VAES KNOW WHAT THEY DON'T KNOW

    HAVTORN, JAKOB D. / FRELLSEN, JES / HAUBERG, SØREN et al. | TIBKAT | 2022


    dpVAEs: Fixing Sample Generation for Regularized VAEs

    Bhalodia, Riddhish / Lee, Iain / Elhabian, Shireen | ArXiv | 2019

    Freier Zugriff