While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned representations that over-emphasize compressing imperceptible details of the image. To address this, we introduce a KL-reweighting strategy to control the amount of infor mation in each latent group, and employ a Gaussian output layer to reduce sharpness in the learning objective. To trade off image diversity for fidelity, we additionally introduce a classifier-free guidance strategy for hierarchical VAEs. We demonstrate the effectiveness of these techniques in our experiments. Code is available at https://github.com/tcl9876/visual-vae.
Optimizing Hierarchical Image VAEs for Sample Quality
2022
21 pages, 12 figures
Preprint
Elektronische Ressource
Englisch
LEARNING HIERARCHICAL PRIORS IN VAES
TIBKAT | 2020
|HIERARCHICAL VAES KNOW WHAT THEY DON'T KNOW
TIBKAT | 2022
|