Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Leveraging insights from classical methods of inference we introduce $\textit{Relaxed-Responsibility Vector-Quantisation}$, a novel way to parameterise discrete latent variables, a refinement of relaxed Vector-Quantisation. This enables a novel approach to hierarchical discrete variational autoencoder with numerous layers of latent variables that we train end-to-end. Unlike discrete VAEs with a single layer of latent variables, we can produce realistic-looking samples by ancestral sampling: it is not essential to train a second generative model over the learnt latent representations to then sample from and then decode. Further, we observe different layers of our model become associated with different aspects of the data.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Relaxed-Responsibility Hierarchical Discrete VAEs


    Beteiligte:

    Erscheinungsdatum :

    2020


    Anmerkungen:

    10 Pages


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    LEARNING HIERARCHICAL PRIORS IN VAES

    Klushyn, Alexej / Chen, Nutan / Kurle, Richard et al. | TIBKAT | 2020


    HIERARCHICAL VAES KNOW WHAT THEY DON'T KNOW

    HAVTORN, JAKOB D. / FRELLSEN, JES / HAUBERG, SØREN et al. | TIBKAT | 2022


    f-VAEs: Improve VAEs with Conditional Flows

    Su, Jianlin / Wu, Guang | ArXiv | 2018

    Freier Zugriff

    Optimizing Hierarchical Image VAEs for Sample Quality

    Luhman, Eric / Luhman, Troy | ArXiv | 2022

    Freier Zugriff

    On Incorporating Inductive Biases into VAEs

    Miao, Ning / Mathieu, Emile / Siddharth, N. et al. | ArXiv | 2021

    Freier Zugriff