While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned representations that over-emphasize compressing imperceptible details of the image. To address this, we introduce a KL-reweighting strategy to control the amount of infor mation in each latent group, and employ a Gaussian output layer to reduce sharpness in the learning objective. To trade off image diversity for fidelity, we additionally introduce a classifier-free guidance strategy for hierarchical VAEs. We demonstrate the effectiveness of these techniques in our experiments. Code is available at https://github.com/tcl9876/visual-vae.


    Access

    Download


    Export, share and cite



    Title :

    Optimizing Hierarchical Image VAEs for Sample Quality


    Contributors:
    Luhman, Eric (author) / Luhman, Troy (author)

    Publication date :

    2022


    Remarks:

    21 pages, 12 figures


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    Relaxed-Responsibility Hierarchical Discrete VAEs

    Willetts, Matthew / Miscouridou, Xenia / Roberts, Stephen et al. | ArXiv | 2020

    Free access

    HIERARCHICAL VAES KNOW WHAT THEY DON'T KNOW

    HAVTORN, JAKOB D. / FRELLSEN, JES / HAUBERG, SØREN et al. | TIBKAT | 2022


    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Free access

    dpVAEs: Fixing Sample Generation for Regularized VAEs

    Bhalodia, Riddhish / Lee, Iain / Elhabian, Shireen | ArXiv | 2019

    Free access